husband troubles

anyone else's husband complaining that you are not making time for them anymore? i feel like im so over joyed and caught up in being a mom to my baby that i dont have much time for anything else. also since im exclusively breastfeeding i feel like my sex drive is non existant. i still love him so much if not more for giving me my son but i just dont get the neediness. i feel like he should realize that baby needs me a lot more than he does right now. am i wrong?