Baby Fever

Alex
So I have had endo for a couple of years. I have a blood condition (thalassemia minor) and also suffer from severe clinical depression. My hubs has low testosterone levels so he is on a gel supplement. We decided due to the risk of ppdepression and my health that we wouldn't have children. I don't want a baby, we're not in a financial position to care for one, I'm too selfish in so many ways (wanting to travel etc) 
but lately I have been having this urge and yearning to hold a child of our own in my arms, to have a baby bump and grow in my tummy, all the romanticized beautiful parts of motherhood. But I don't think I would be able to be a good mother. 
Any baby I see or pregnant lady makes me so emotional.. Happy and sad at the same time. I want a baby but when I think about the reality of it I know we shouldn't. But that infatuation of baby fever is really hard. 
Due to everything I don't think a child is a good idea. But I am wondering if anyone is in a similar position to me, maybe unable to conceive etc and how they cope, do you eventually become comfortable with being the "cool auntie" etc. My husband wanted kids but agrees it's not safe or wise to TTC. 
Sorry for the long post, just looking for anyone with insight or a similar situation. :) baby dust to those hoping!