Is it wrong for me to feel hurt?

Ok me and my husband have been married for 6 months. Three months ago we decided to start trying to get pregnant. At first I was scared because before him I never wanted children but with him I actually want to be a mom now. I was so excited about trying for a baby. We have been trying with no luck sadly. Than a few days ago he calls me and said we are now takeing custody of his little brother with out even asking me. His little brother is 8 Years old and I do love him so I’m not to upset about that part. The part I’m upset about is my husband no longer wants to try for our own baby. He said his little brother needs our love and attention right now because he has a lot of behavior problems and has had a bad past. I do understand he needs us but I still want our own baby. I feel like a bad person for still wanting a baby. I’m 20 years old and I have pcos and I know it’s going to be hard to get pregnant but I still want to try.