Advice on relationship

I’ve been with my boyfriend for 3 years. We had broken up for a short period of time and durning that time he was doing meth. While I was pregnant I felt like he was doing it and confronted him which turned into a huge argument so I kinda let it go and things got better. We recently had our little boy who is 3 weeks and I feel like he’s doing it again but don’t want to confront him on it if it really isn’t happening. He stays up all night even when he works 4:30am to 7pm, and can be aggressive, I truly love him and I want our family to be whole but I’m not stupid. I just don’t know what to do anymore or how to go about it.