Paranoid?

So, I'm 9 months postpartum, and weve had intercourse 3 times in probably 10 or 11 months now. I DO NOT want to have another, as both my pregnancies were extremely rough. Were waiting on my thyroid/hormones to get assessed and then moving forward with a permanent option to not have children anymore. I told my hubby that I was sorry (hes always wanting to have sex, regardless. This was during one of those times) I told him I was sorry, and that in 2 months we get to start the process of that and I know he always wants it and I'm actually worried he would look else where for sex if hes not getting it at home. And while we talked a teeny bit, he never actually told me anything reassuring. I'm pretty positive he wouldn't, but there's that voice in the back of my head saying "no one things it would be their spouse, but then, it's always SOMEONES spouse".

Am I just hormonal and taking this above and beyond, or would anyone else be paranoid too? My hubby is a very, very sexual person...