this happened to anyone else?

So my husband and I are having our first child ... and he now doesn't want to sleep with me he's scared he's going to hurt the baby .. I have told him that that wouldn't happen and there's nothing to worry about but he really doesn't like the idea .... I don't know if I'm being selfish or not but I have got to put up with sickness and aches and pains and all sorts for nine months and now this too? Has anyone else had this with their other half Is there anything someone has said that would reassure them? Or do I need to stop whining and suck it up till the baby is here and i have healed up lol