don't know how to feel?? 😧

So my SO and I have been trying for 5 months, we were going to get a house then try for a baby we'll I need about 6 months to build my credit for a house. Which is fine. But I've been taking prenatals pushing hella water trying eat healthier and this fertility mix I got from gnc and my bf thought we weren't trying anymore?? He saw me take my prenatal and was what's that? I said my prenatal he said oh I didn't know u were still taking those..I said yea cause it's a process and it won't be overnight that I'll get prego. He said that's fine go ahead and take it then. I jus feel confused and sad. Like how much longer did u want to wait? He thought we were guna wait until we bought our own home. So now I'm second guessing myself..should I keep taking all my stuff? 😔  I already have a 9 yr old.