He has me feeling sick to my stomach and I need advice

So this might be kind of long I want to get as much back story as I can. I have 2 children. My 3 1/2 yr old I had with a man who is now in prison for crimes everyone on here would be disgusted with. My 5 month old is with the man that my post will be about. I met him through work a couple years ago and we seemed to click he seemed so nice and very patient which is a great value to me since I can be a lot to handle.

Well fast forward a bit we get our own place together and get pregnant very quickly. Before I got pregnant we would do stuff together like go out on the weekends to Dave and Buster's or go see a movie or just anything we decided to do that sounded fun.

One of his many problems is that he doesn't show his feelings much sometimes and it makes me feel unappreciated and unloved.

Well when I went on my maternity leave he had been going on for months about how he would have no problem paying the bills himself and be the only one working. Yeah that didn't work at all he started only working like 2 days a week and my family had to pay our rent 3 months in a row so we didn't lose our apartment.

I was very frustrated because he would just sit at home all day doing nothing and would barely even help with the baby. We fought a lot and the stress was making him want to get drunk pretty often. So since I told him he can't do that he decided to get his medical marijuana card (we are in AZ so it's not legal here for everyone) and decided that instead of just being sober and facing issues with a clear mind he had to smoke all the time. I mean all the time morning to night. He would have his friends over and they'd spend hours outside smoking or playing video games every day.

Obviously I got mad and would say something and he'd get mad that I was embarrassing him in front of his friends. I had to go back to work since he couldn't handle bills and I would be tired too but he would insist he was more tired because his job was more tiring since he worked construction. So he still wouldnt help with the baby like at all unless I practically begged.

The other night I just got so sick of it I kicked him out and he moved into his sister's which is right across the way from me I mean literally like 15 ft away it's ridiculous. This hasn't seemed to be a problem but it's only been 3 days and he already had another female over last night and I'm not trying to be petty but I just cannot get over this and that's what I need help with.

My whole family thinks he's a total loser and don't understand why that would even bother me but it's like we just spent 2 years together and have a baby together and he'd already trying to see someone?? I guess what I really want to know is does the feeling of being hurt about this go away? Will I ever be able to look at him with someone else and not have my heart drop to my stomach?? Because right now I am losing my mind trying to figure out how he could do this. And yes I understand if we aren't together it's not my business I haven't said anything to him but that doesn't mean it doesn't hurt me very very much.