Am i over reacting?

Sometimes I feel like I am but then other times I really don't. My fiance my daughter and I live with family (my grandpa and brother). We are only staying here until we get some things fixed in our home. And my grandpa don't shower. He doesnt clip his nails.. he doesn't shave or trim or anything to keep up. He hasn't had a shower since my daughters birthday party. Which was in September.. before that it was a year or more between showers.. he only did that cause I asked him to. He wants to see my daughter. I used to let him but just told him not to touch her unless he showers and trims his nails cause she was a new baby no vaccines really so you know... Anyways. We stay in one bedroom and he sleeps on the couch cause he just loves it there (he's been an alcoholic since he was in early 20s) like can't go more than 8 hours without a drink. I know by my description it sounds like I hate him right? Well I love him so much and I care about his well-being. But my daughter comes first.. and always will. He gets mad cause when he's at work we go out to the living room and stuff and if it's nice we go outside. But once he's home we are in the bedroom and he doesn't get to see her because I get anxiety so bad I get the shits over him. Well tonight he tried coming in and I wouldn't let him. My fiance explained I don't want him back here.. and I've asked him many times to start showering cause my kid isn't going to be touched by him. He literally emits a smell that smells like piss cause he gets wasted and passes out and pisses on himself and his spot on the couch.. like am i wrong?? I feel so crazy sometimes..