This is a little late of a reply.

You always want to wait until you feel the weight of a fish to really set the hook, because as you mentioned above you can easily pull a fly away from a fish...