opinions please!!!!

So my boyfriend and I recently had an miscarriage and it was devastating. We are still trying though. But recently we had an argument because he found out I masterbated. He found my toy, which he bought me, in the living room closet. I only did it because it was 2 am and I was in the mood. He gets up at 3 am for work and I didn't want to bother him. He feels like I am hiding it from him? I don't do it often and he was really hurt by it. We have a great sex life so I just don't understand how to make him feel better or what I did wrong :/ any advice ladies?