My husband doesn't want me breastfeeding

In public. I asked him awhile ago if he ok with breastfeeding in public. He said yea of course. Well recently my nipples were slightly showing threw my shirt and his brother now lives with us, so he was like go put another shirt on. I told him eventually il be breastfeeding in front of him im sure and in public as well.  He said noooo your not, no ones gonna look at your boobs! 
I guess before he meant he's ok with women BF in public only covered?? He said his main reasoning is because there's a lot of perverts out there. Any one else have a husband like this ? What should I say? Need advice 
* update:
He said if I do I don't have any self respect ? He said baby comes first and feed him just cover yourself 
Like it sucks in my position because he word means a lot. But is he wrong ?