Sex post baby

I'm 6 weeks postpartum today, and my husband really really wants to have sex. We bed share with our daughter because we live with my parents and the room is too small for a crib, and she will NOT sleep in the bassinet that was gifted to us (I've tried everything. She'll just wake up the second she's put down). She's also exclusively breastfed.
Ever since my husband realized that 6 weeks was approaching he has been pushing me to try to use the bassinet. I do try but I'm not going to every time she falls asleep. It always turns into an argument.
He bought condoms last night, but I was just too tired to fool around besides the fact that i don't wanna have sex with the baby on the bed. I kept waking up to him looking at the baby and then sighing and sucking his teeth as if he hates her or something. 
This whole thing is stressing me out and I don't know what to do. Anyone have any advice?