Please tell me im not wrong!

My bf and I have been dating for 4 years now. Im getting so frustrated because I only see him once a week. He goes to school and work at night and the day he has off he sees me for like 4-5 hours. He is off Saturday and Sunday from school. Sundays he used to spend time with his daughters but now it's whenever during the week. Its really frustrating me because I want to see him more. The only time I get to spend more time with him his if he takes off from work when we go on Vacation which I spend every penny from hotel to flight to you name it. Even when he takes off a day for us to go to a place thats 2 hours away from where we live.. we take my car and I pay for the meal to hotel. Even the one day we spend with eachother I go pick him up at his.place and I pay every single dinner and all ive ever asked was for him to give me more time. He gets angry and ends up ignoring me everytime I bring this up. Im so frustrated to the point where I just want to walk away. He has been in Ged school since I met him and I just cant do this one day thing anymore. But he doesnt see anything wrong with it and ends up ignoring me for days when I bring it up. I just want to be done but I don't know how.