Pool & toddlers

Hi my babies 👶 father wants to open the pool (we’ve just moved into this new house) we have a 3yr old and a 1.5yr old they cannot swim!!!! I’m terrified and we’re fighting over this I don’t want the pool which is 6ft deep as an option AT ALL!! Only this wknd we’re at a birthday party my oldest slipped in the pool I was next to her but still had to jump in fully clothed phone in my pocket to pull her out she freaked out. Can you please tell me if I’m overreacting? The pediatrician is also against this as long as the babies can’t swim. Ty