You no longer have to cancel your ssh request because you forgot to load your keys.
Because SSHKeychain acts as a gateway between you and the agent, it can automatically add keys when you need them. SSH will just pause for a few seconds, and you'll be on your way.