is this being selfish

so don't say rude things... i just want an opinion,  will it be nasty if i don't let the grandmas of my child not see my kid when she's born? first off i dot get along with my mother in law, she hated me from the start and called me an ugly ass man . so we don't speak only my husband goes over to say hi and bye.... MY MOM , i haven't seen her for like 3 years... we have problems, i never contact her for anything just my dad. so i always though of just raising my babies without no help and no grandmas because of my situation it sucks i know but that's i guess life for me and i can't do anything about it ..