The exception that proves the rule

One of my pet peeves is the use of the expression "the exception that proves the rule," primarily because I've never heard it used in a manner that makes any sense.  I mean, whenever people use it, they are actually citing exceptions that disprove the rule! In fairness, this actually has more to do with the statement itself, rather than its usage.  In fact, I think the only time one could accurately use the expression "the exception that proves the rule" is if the rule itself stated, "this rule is in true in all cases, but one exception."