Newborn + stress? (Help!!/rant) FTM

Kyleigh • It's a boy!🌱🍼🐻 Born: 2•17•16
I need help, I'm in tears and need other moms help, I'm a FTM.
((I'm sorry this turned out way longer than expected... Too tired/frazzled to fix it though, thanks for any help)) 
My baby is 17 days old. The first week was a breeze. He was so calm and happy. And I had the opposite effect of PP Blues (I was so happy at all times with infinite patience and content!) The second week he was a bit more lively and would get fussy but still never really cry more than a millisecond if we were just really not catching onto what he needed, which was rare. Then just before the two week mark and ever since, has just been SO upset and hard to manage. More frequent feedings, but not sufficient no matter how disciplined I get with it (actively massaging breast and keeping him awake and holding off a bit between feedings to ensure he's hungry enough). He cries all the time and we can't fathom his needs. He's restless. We try to work with his temp, and his gassy-ness but to no avail since those end up not being the problem. 
I finally talked to my mom about it and she said stress can affect him tremendously. She said it can affect even the taste of my milk, and that he can pick up discomfort and stress in my voice. (True?)
So I'm trying to figure what's been going on but it's nothing significant. Lots of little things that, I suppose as an adult just doesn't phase me as significantly as it could an infant. Am I off the deep end here or is this at least semi accurate?
So what's the stress? idk. We have only had two days since the birth where it was just us as a family (husband, baby, and myself) because I've been on bedrest until now following the birth and needed help. So our moms have tag teamed being here (they're both from out of town so they've stayed for days in a row). Any stress stuff has been petty (such as, my dad-in-law came to pick up my mom-in-law and was in a bad mood both days he was here and it made me feel so bad and try to people-please him and made me feel worried and stressed the whole time, he was just this dark cloud, but nothing I couldn't tuck away on the exterior) but now looking at it, has been accumulating and yesterday was the last day  of having company. Now it's just us. Much needed. But I lost my shit so bad last night and scared the shit out of my poor baby by screaming "stop!" when he was ceuing over nothing, and I have been crying ever since because I can't believe that not only has my son been clearly discomforted lately for some unknown reason but I (his mom, his comfort!) just made him feel so unsafe in his environment and I can't get that look of absolute fear he gave me out of my head.💔 It turned into a bad night as my depression came back full force and I suddenly wanted to die to be sure my son wouldn't be around this hostility. The police showed up thanks to a "noise complaint", omg. It just amped up the stress, now it's 3am and I've been sobbing and praying. 
**sorry this is longer and more rant-like than expected, so sleep deprived and delusional here**
Can you help, have advice/wisdom?:
Is this stress thing accurate? How do you get it back to the relaxed, safe-sensation for Baby? What do I do? What triggers a baby? How can I protect my environment? If it's not this stress factor, why is my son so frustrated suddenly?! I just want him to feel safe and happy!! 💔💔😭😭😭😭😭😭😭😭😖