Am I putting too much thought into this?

Lately I've been feeling kind of mad and putting too much thought into everything. My husband works long hours and comes home pretty late. My attitude has drastically increased. When my husband gets home, I don't want to talk to him. Im just so mad when I look at him. He constantly asks what's wrong and I say nothing. But inside I'm mad that he gets home late. I'm mad when I start to think that he might be cheating on me. But here's the thing about this, he doenst really give me a reason but at the same time he does. About two weeks ago he lied to me about being at a job but in fact he stopped at a bar real quick for chicken wings and beer with his buddy who works for him. ( this was after they finished the job) I let it go because deep inside I knew he didn't want to tell me because I would get mad. He knows that. His friend confirmed that they had just stopped real quick to drink two beers. ( talked to the friend before my husband knew I was about to tell him about the bar) ever since then I can't trust him. I feel like he's somewhere else instead of
Working. I'm very suspicious about his phone and feel like he's scared that I'll come across something BUT he leaves his phone anywhere. Then I make myself believe that he's sneaky and can easily hide anything on his phone. When I'm being an asshole, he constantly says "what's wrong honey" 
" are you ok baby?" 
"Why are you being mean honey?" 
It's like he continues to be nice and tries to kiss me even though I'm being a dick. Then I start to think that he's being nice because he's hiding something so it gets me even more mad. The other day he brought me flowers and said that although I've been a dick, he loves me. I told him I felt like he was being shady and suspicious and he said he would never do that to me. He swore on his kids and father (which are his life) but that doesn't mean it could be true. I don't know why he doenst go off on me because honestly he's that type of person. When someone is being mean to him, he will go off. But I also think that he feels bad for me because I've told him that I'm not really adjusting to being a stay at home mom and that it makes me feel irritated. He always apologizes to me because he says he knows how it feels to be home all day and not go out. Especially when all you do is clean and raise a baby. Today he came home pretty late, I was furious. I called him when I realized it was almost 8pm. He answers (like always) and says he's about to be on his way and I could hear him talking to his workers. He gets home 20 minutes later. He came home, he could tell I was mad. So he tried explaining to me why today it was such a long day and what he had done. He still tries to explain to me why he's late although he's not directly telling me "hey I was late today because...." sometimes my husband says means things to me like how I'm a shitty mom if I'm not paying attention to my duaghter because I just want to be on my phone for about 5 minutes. Then the next day, he'll say how much of a great mother I am. And blah blah blah. My birthday is coming up, mind you I am only 21. So my husband has already gave me a few surprises. He bought me a watch and a kitten already. He says he has more surprises for me. Maybe my husbands age doesn't matter but he's 34. Sometimes I feel like he's taking advantage of me. Sometimes I feel like I might bore him with my attitude. Am I wrong or is he? 
EDIT: he convinced to quit my job because baby would not stop crying when I was gone. Baby is attached to breastfeeding. He constantly would call me a shitty mom for working instead of quit. I finally got tired and quit my job. Now I'm jobless and at home. We only have one car which he uses so I have no other option then to be at home with our duaghter. Family and friends are always busy.