Arguing with my boyfriend

I am a new mother of a beautiful baby girl. breastfeeding bonded mother of a blessing. Am I wrong for feeling so protective of her that I wouldn’t allow her father to take her somewhere by himself? I know he’ll protect her with his life but by her being only 3 weeks old, am I wrong for feeling this way? This is his first child as well and he still learning. I’m not new to newborns and I’ve learned at a very young how to take care of infants. I just would like to wait until she’s a little older am I wrong for that? He thinks it’s a double standard that he can’t feel how I feel and I’m not saying he can’t but I believe a man will never have the same connection to his child as a mother would and I’m not saying his isn’t strong but I think it’s a mothers instinct to be so protective over her baby. Especially her first. Can someone please help me to understand if I am wrong? Am I controlling?