Boyfriend guilt tripping me

My boyfriend is 22 and lives at home which is fine. Literally everyone I know pretty much lives at home. The thing is that he doesn’t have car insurance so he can’t drive. I live an hour away from him and my work so I’m always commuting and am already on my second car. So I’m usually the one driving everywhere, picking him up from work and everything. His mom pinched a nerve in her back a month ago. I can tell she’s played it up A LOT and when I’m over at his house late at night I literally hear her running throughout the house at night. Today my bf asked if I could take him and his brother to work. I finally spoke up and said no, your mom can but I can pick you up. He kept telling me I’m a bad gf and he would do the same for me and was all mad. I could tell he was trying to guilt trip me over and over again but I kept saying no. I honestly don’t feel bad for standing up for myself bc I know his mom is more than capable of driving them 10 mins away and I can’t be doing this all the time. Am I in the wrong??