asterisk users - May 2006 - Chanspy Specifying Agent not Working

I use chanspy to listen to agents for QA.  It works great for listening 
to random conversations.  * works to switch between calls.

I cannot however specify the agent I want to listen to.  I dial the 
agent's extension and press # but get connected to some random 
conversation, not the one I dialed. 

Anyone know what I am doing wrong?

Thanks,
Steve