He gets annoyed

I feel like after I spend a day with my bf, he starts to get kinda annoyed by me. I asked him if im annoying and he said sometimes but that he loves me and thinks it’s cute. but I could tell he kinda loses his patience with me a lot and gets frustrated, especially cuz I like being playful sometimes, he just gets silent and in a mood. and sometimes it’s not even when im trying to be playful, like yesterday we were going to starbucks and I gave him directions to one we haven’t been to before and it wasn’t a drive through, he got frustrated with me cuz he didn’t wanna go inside. he told me that he does that with a lot of people but tries to calm down and think before reacting when he’s with me and he does try!! but it just makes me feel sad when I could feel he’s frustrated from me or tired from me. like how are we gonna live together one day if he gets frustrated from one day? kinda concerned. I know he loves me and it’s not me, im just scared.

I mean sometimes I get annoyed and shit over stupid stuff but I think it’s more situation based and not when im tired or after spending a day with him. I guess an important note to add is that we usually don’t go to bed until 5AM when we have sleepovers… so maybe he’s just really tired.