Baby playing on the breast

Ok so my son is 3 months old now and I EBF. I rarely ever pump because I just feel having him on the breast is better for him and I. I do pump when he doesn't want to eat much. But lately he's been eating for say 3-5 minutes on each breast and then he just wants to lay there and coo at me and smile. I mean it's cute!!! But I'm worried he isn't eating enough. Does anyone else's baby do this??