Scared to tell my father

I'm 26 TTC since April 2014, I've been with my husband for 11 years, good jobs, own home etc, However the closer I know the possibility of getting pregnant is, the more I am scared to tell my father. He does know I will be starting a family but more so in the next couple of years rather than now. When I casually dropped it in conversation about having a family in the next couple of years, he just kind of looked at me, and I didn't take it any further. Any ideas of how to drop in that I'm off birth control? How to announce pregnancy? How to reassure him he won't lose me as his little gir? (I think that's his problem, or he's either selfish, or worried about me, or doesn't want me to be happy) Thank you xxx
Baby dust to you all xxx