interacting with graph objects

Could these kinds of things be done in/with matplotlib? Or

    > more importantly, does a framework in matplotlib exist that
    > this kind of thing could be developed? I am interested in
    > talking to anyone who has thoughts about this.

Basically, you will want to read up on matplotlib event handling.

  * user's guide section "event handling" in the pylab chapter

  * class documentation for Events at

  * wiki entry at

  * Example escripts