Loss of a child via baby momma drama versus new pregnancy

This might get long and I'm sorry in advance..my bf and I are expecting our first little one ..I have 3 from my ex husband and he has 1 from his ex however his daughter is not biologically his. She is now 4 and he's been daddy since utero but now the ex is denying him rights basically because he has started a family with me( I know..so much drama)..I love his daughter like my own and was prepared to be step mommy..we haven't seen her in 4 weeks and I know he's in pain ..we are all in pain..but I feel the distance growing between him and our little bean..I'm 12 weeks and my bump is quite prominent..there is no touching or caressing of the bump..imlost..I am trying to be considerate of this loss but am feeling neglected...how do i deal? Please be kind