need advice

I feel so confused. I love my boyfriend with everything inside of me don't get me wrong, but I'm scared he only loves me when he's with me. I'm probably being ridiculous but I can't help but overthink. right now I'm sitting here freaking out cause he read my message of me telling him how much I love him 4 hours ago and hasn't answered. he is at work and he's a cook at a busy restaurant so I understand it being busy. his phone could've even died. I just get nervous when he does that because one time he ignored me ALL day because he was mad at me and didn't tell me why or talk to me until the next day. that was a while ago and he hasn't done that since but I still can't help but be worried.