Is it irresponsible?? I really want it but need to know

Please tell me if this is irresponsible. I am quitting my job soon to work independently in real estate. I will be at my job for one year in August so I am trying to at least make it to the year. They are so negative, my co workers are so mean to me, and I work crappy hours. They make fun of me, say being my skinny is ugly, no guys find me attractive, that I’m stupid, one told me I was a spoiled brat because IT fixed something for me first. I’m so over it (my boss does it too).

My boyfriend is supportive. He is going to take over all bills expect my car. We talked about saving up 6 months worth of bills so that I can just focus on working. So I have 6 months saved of my car payment, insurance, and approximately what I’ll use for gas if I’m conservative.

But I also want to get back into horseback riding. I miss it so much and it’s starting to become all I think about. My aunt said she would let me free lease one of her horses if I just pay for food. But my boyfriend tells me that that’s dumb and that’s not priority. My aunt said that she will come get him after even 3 weeks if it doesn’t work out or if it does I can keep him. But everyone tells me I can quit sooner if I don’t save up money for him and that horses aren’t a priority. But that is my stress relief, my exercise, my passion. Is it irresponsible to want that when I am not going to be getting consistent income?