My boyfriend gets defensive about his ex?

Literally he’ll bring her up in conversation (it’s never nice things) as he has a son with her, so of course I want to know how he’s doing etc and as soon as he brings her up I start asking ‘why’ etc and he gets very defensive over it? Should I be worried.