Avoiding pregnancy, don't want to use bc pills....I need advice

Maria • Going for the second baby after 4 years of bliss with our first
I need advice....I had a hard time conceiving (was on the pill since I was 17, gave birth when I was 28) now we're both scared to have sex cuz we don't want another baby, and yes we use condoms but it's not as "fun" but I don't want to get back on the pill or do any hormone changing shit...how fertile were anyone who's had a hard time conceiving after birth?