Stepson troubles

My fiancé has a 4 year old son, his mom is in prison so she isn’t around. Everyone expects me to be his mom now but I think that’s a little ridiculous? You can’t just be someone’s mom if you’re not, I understand I can be an important figure in his life but I’m so sick of people telling me I have to be his mom. He doesn’t listen to a single word I say and noone backs me up on discipline they say I’m too strict so I honestly have no desire to take on the mother role to him right now. I have a 4 month old of my own to take care of. Am I being crazy?? Any advice?? ... also is it wrong if I want to do things specifically with my son (pictures, little trips, visit family etc)?