Never let your door / gate opener fob out of your control.
Here's why... Anyone (service person, neighbor, guest, valet, etc.) only needs to have access to your fob for a few seconds to make one for themselves.
Fob duplicators are cheap, available and easy to use... (more detailed version here)