Baby is his. Period.

Butterfly
I have been with my husband since I was 14 since age 19 we have tried for a baby. We are now 27 and have recently given birth to our first baby boy 9 weeks ago. Well I recently heard a rumor spewing around my husbands family stating that I cheated and my baby is not his. I am Puerto Rican and my husband is Black. My baby is my skin color nothing lighter or darker but bkuz my husband is dark they said this is not his baby bkuz his skin is too bright. 
 y husband told me not to worry bkuz he knows my baby is his 💯% I feel it's just blatantly disrespectful and he should say something. What to do??