Kinky stuff, a little awkward 😅

Okay so this is gonna sound weird. Kinky stuff 😅

So my bf is bisexual. He likes watching bi porn and uses a dildo from time to time. He says he's attracted to men but only physically and not all the time. He's way more into women. He'd rather be with a woman sexually and in a relationship over a man any day and he would never be in a relationship with a man, that it's too gay for him. He doesn't want to be with another man unless we have a threesome, which I told him I wouldn't be comfortable with (atleast not anytime soon) and he 100% respects that and doesn't push it. No one knows except like 3 people and myself. We've talked about using toys during sex but we've never actually done it. He has on his own and he'll text me or call me when he does do it (which is once a week if that, sometimes once every 2 weeks). He's asked me before if I wanted to try it and I always back down cause i didn't feel ready because it's something I've never done. Yesterday, he asked again if I wanted to try it. I said yes and we did. At first, I could tell he was shy about it and I asked if he was sure and he said yes. We used a toy first on him and then had sex. After it was over, he said it was weird and he felt embarrassed and he felt violated and doesn't want to talk about it. He said I didnt do anything wrong but that he doesn't think we'll do that again. I 100% respect that and I was only ok with doing it because it was something he wanted to try. I'd rather satisfy his needs then have him look for it somewhere else (not that I'm worried about it cause I trust him). Besides that, that's not something that I NEED to do. But I'm kinda weirded out a bit because we've talked about it so much. Today he called me twice already and things seem to be normal. Has anyone experience something similar? Although he told me I did nothing wrong, I feel kind of bad because he said he felt "violated."