Yeah, I realized that I wasn't being very clear. I was trying to say we can rule out these types of cases:
I actually like your algorithm. It'll be slower than Richard's method (I think), but it'd be easier to code up. For the number of points that I'll be working with, it probably won't be too bad. And I like your milling analogy. Very appropriate!