Just a little scared

Hello I have had 3 miscarriages and 2 live births I know this is a little personal but is anybody else afraid to have sex with thier partner my husband is very understanding but I'm sure he is getting frustrated since nothing as went on since I found out i was pregnant 3 weeks ago.