On the verge of crying

So right after work I didn't get to go relax and rest my boyfriend and I had stuff to do and then he wanted to go fishing ... we have been fishing for two hours and last night we went fishing for four hours. So I'm pretty tired. He told me we could go home at 6 tonight then seven comes around and we were still fishing I was getting frusterated cause I'm tired hungry want to eat and relax plus I have to take my anti depressants at 8 pm . So he started giving me an attitude cause I wanted to go home and I was trying to talk to him and he was ignoring me because he's mad so I kinda gave an attitude and was like can you fucking answer me and so he told me I'm a fucking psycho and need to go to a mental hospital.. kinda down right hurt my feelings and I'm not sure what to do.. No I'm not leaving him because of this but I don't know how to go about talking to him about how it makes me feel when he says things like this and if I should even say anything right now or let things cool down .. the last thing I said to him was he needs anger management 😞 I just want to get along but I feel like I'm not good enough