First thanksgiving as a family and he's absent

So I'm a ftm and this is our DD first holiday so I figured we'd spend at least a couple of hours together but no he comes gets dressed and leaves asking me what I was doing today. I said I thought we were going to my moms and he says no. I'm so hurt right now especially because Thanksgiving is a really tough day for me cause my family dinners have dwindled down to just me and my parents since people have passed or just not be able to get together. Also this is my first holiday off from work in over 5 years and will probably be one of the few for many years to come. The worse part is I really don't know where he is and I know he's not with his family. I just want to cry, i don't know how much longer I can do this