Dairy intolerance

I cut out dairy when my baby was a month old, five months later the dr said I can try to reintroduce it and she's doing good with it, but I'm not. Is this normal? Has anyone had this and does it stop? I love dairy and don't want to become lactose intolerant 😭