Need Advice!

My husband and I recently got married. Both virgins and I’ve never used any toys before. We’ve tried having sex a few times now and every time we aren’t able to get his penis in. He’s a decent size (I’d say more on the bigger side) and was hard enough. I was wet enough but for some reason it just wouldn’t go in. We even tried every different position. At this point we’re not even having sex anymore because we just end up frustrated and disappointed. I plan to ask my doctor about it soon, but any advice on how to fix this?