I need advice ladies

Okay so my daughter is 2 and a half and we both have lived with my boyfriend for the last 18 months. He's a great guy, loves my daughter and me and takes great care of us. Him and my daughters father get along pretty well almost to the point where outsiders are like how do you guys make that work? Her dad and I have an agreement we made without the courts involved, he takes her every other weekend and pays me $300 a month. However, he has no vehicle so when he comes to get the baby I give him my SUV so if god forbid anything happens he has a means of transportation for my daughter. My boyfriend thinks this is ridiculous because that leaves me with no car, I agree but i also do it for my daughter so her dad can take her out to do stuff and not be stuck inside all weekend. It's annoying but I deal with it. However, for the last couple months that are his weekends he's been working overtime on saturdays so then he doesn't take her until Saturday after around 3 or 4 until Monday morning instead of Friday night to Monday morning. My boyfriend and I just had a talk because it's happening again this weekend. My boyfriend works 5 days a week so on the weekends we don't have mydaughter he likes for us to spend time together just the 2 of us. He just said to me "I think it's unfair that we've only been getting 1 night to spend together for the last month and a half because he wants to work overtime, why can't he do that on the other days he doesn't have his daughter?" He also said "I don't want you to think it's just about us having "a break" from Aaliyah, but her father should want her on his days and not be constantly saying he can't take her on this day and that day every time he has her." This has been going on for a while now but because her father and I get along pretty well I don't really want to take him to court. My good friend said if he wants to work on his days then he needs to find a sitter but I don't want my baby being watched by someone if he's not going to be with her I'd rather just keep her. Her father has no family at all he really only has his daughter, me and my family. Anyone in a similar situation or have any advice for me? I'm trying to do the best I can but I also want to be fair to my boyfriend. I said to him when we have a child of our own we won't get a break every other weekend you know and he said "yes I understand that but if we didn't work out I would make more of an effort to see my child than Aaliyah's father makes to see her."