You definitely explained yourself too much there.
I would have responded with 'stranger danger?' And seen her response to that. Some women will definitely try to guilt and shame you, but as long as you hold firm and don't come across like you're pushing, you can turn it around.