i feel guilty..

so, my boyfriend has a 3 month old with another woman.. we got him overnight for the last two nights.. we've been ttc for the last 6 months, but after getting his son I don't think I'm truly "ready" for a baby.. don't get me wrong, I really want one... REALLY REALLY want one. but, man... I love my sleep. I feel guilty man! like, selfish kind of. I dunno how to feel about it. my boyfriend says I'm over thinking it and I shouldn't feel bad, buuuut... idk.