having real trouble sleeping 2nd trimester - anyone else?

So I've totally found out that I'm having trouble sleeping. First trip I used to get up 3ish times in the night to go to the bathroom. Now I wake up like once but it's like torture to get back to sleep. Sometimes it takes me a couple hours. And I start to get like real annoyed. I can't sleep if my partner isn't next to me but now I can't seem to sleep with him. All I hear is his breathing or I can't get comfortable or I just listen to the house move. The longer I'm awake the more annoyed I get and can't sleep but I'm soooo freaking tired so I don't know why I can't sleep.