Rewrite URL and HttpHandler problems on IIS with certain characters

Trying to rewrite URL's or custom handle URL's on IIS 6/7 can lead to HTTP errors on the IIS level. The problem is that some characters like a question mark (?) are considered illegal by IIS when they are a part of a URL...