widgets during plot interaction

Can anybody think of a good way to disable a widget (specifically
SpanSelector) during plot interaction from the toolbar? It seems
wrong when you are panning and the SpanSelector is triggering over and
over. Is there a trivial way to detect the state of the toolbar?