Better off without me

Does anyone ever feel like your husband would just be better off without you? I just can't shake that feeling sometimes. He's such a happy,  sweet, fun person and all I am is just a nag and a wet blanket. I feel like all I do is make him miserable. He says this isn't true but I just know one day he's going to realize this and leave. I don't know what to do.