I could be prego n my bf is mad

Everytime I discuss me proably being pregnant, he gets upset. And it hurts me he feels that way, Im not the happiest either but it doesnt put me in a bad mood. Idk what to do, he does have another daughter from his ex is he worried how she might see him or is it ME being pregnant that puts him in a bad mood ?