What to say

"It's just a casual drink. No expectations"

I would ask why. Potentially call her. I think you got to find out the reason

It might be

• doesn't want people to find out
• doesn't want to risk having to change jobs/ being uncomfortable if she rejects you
• doesn't want you to be intimate with her at work

Assure her no one will ever find out, yours and her little secret.