He could care less

Sarah
Our daughter is two and we have been trying for about 9 months for #2 with no luck.  It took about a year to conceive the first time.  When I tell my husband I am upset, he tells me I should be happy we were blessed with one beautiful child.  Am I being selfish to be so upset?