Am I wrong?!?!?

Me and my fiancé have been together for 11 years we have a 1 1/2 year old daughter she live separate right now he lives with his mother I live with my parents. I got to his house when he has off from work, when I go there he is in the basement so me him and our daughter stay down there then go up for food etc. his mother doesn’t come down to see my daughter or hangout with her. I don’t let her be alone with my child bcus she calls her autistic!!! So when I was upstairs feeding my daughter we went down to get ready for her to go to bed I over herd her said nice visit with an attitude about not hanging out with my daughter. Am I wrong having my opinion that me and my daughter and fiancé don’t bring my child to people so they can be with her I feel if you want to hangout with her you can come to us I don’t feel I should beg you to hangout with your grandchild…. Plus every-time she is with my child my daughter falls and hits her head…and this past week she cut her head open bcus she refuses to let me child proof her room and put a gate pen so it doesn’t happen again!