Zooming In Is Slow

I get that the zooming in gets slower as you get closer so that you can have more control over your zooming, but I doesn't work very well a lot of the times and when I try and zoom into a model (not even that much) the zooming gets slower and slower even though I have a long way to zoom in still to get to the point I want.