Stupid but concerned

We have no sex but he fingers me and I give him handjobs I shouldn’t be worried of sperm getting in my vagina if he doenst ejaculate right?