Touchy subject?

My bf and I have been together since October of 2018. When we first got together, I made it known that I really wanted a baby. I’m nearing 30, and he’s already 30. He has 4 kids. I have none. He was completely on board, but obviously we weren’t going to start ttc right off the bat. Fast forward about 6/7 months later, we agree we’re ready and want to start ttc. Basically we’ve ttc since around April of 2019.

Around the first of this year, he said let’s just stop “trying”. It was hurting our relationship. All the trying and failing was really depressing me. It doesn’t get to him, which irritates me even more. As previously stated, he has kids so it doesn’t bother him so much. It’s like I want him to want us to have a growing family, but it’s confusing. When we pass by babies in the store, if I say “look how cute” etc, he’ll just shrug me off. He says even though I agreed to us giving ttc a break; all I talk about or think about is having a baby.

With all that being said; does anyone else feel this way? How supportive is your s/o about this?