3D Gizmo Should be Ignored when Making a Selection

When you're making precise selection, a click to select an object behind the 3D Gizmo should ignore it's presence.

If you try to make a selection when it's on top of the mesh it simply blocks it from being selected, even though it's not moved.

The 3D Gizmo should only recognise and be considered active when actively interacted with, by dragging. Thoughts?