Husband gone off sex while trying to get pregnant

Was having sex tonight and my husband just stopped as he has lost his erection (something that’s only started happening recently)and said he’s not feeling it and doesn’t really feel like having sex lately it’s been like this ever since we said we were gonna start trying,I’ve asked if trying for a baby is what he wants and he says of course he does,I don’t know what to do tbh I don’t want to force him to sleep with me if he doesn’t want to but hate that we will miss my most fertile days,it’s also really ruined my confidence as I don’t feel wanted now at all and he’s making comments like all other men’s wife wear sexy underwear and what does he get? I’m not the prettiest or the skinniest so I don’t feel comfortable wearing that stuff 😭 just feel like maybe we shouldn’t be trying for a baby anymore