Guilt about grief following miscarriage

I was pregnant with my 2nd and we were very excited. Unfortunately, at about 7.5 weeks I had a miscarriage. I was devastated but I’m also going through a wide range of other emotions. Part of me fears moving on too quickly for fear that I will forget about my losing my angel baby. I’m busy with work and with chasing my 23 month old son and when I catch myself engrossed in the busy day to day I feel the most terrible guilt. Then I think about how I just lost a baby and the heartache hits me again. It hasn’t even been two weeks since I had the miscarriage. I don’t ever want to forget this baby. It’s terrible to never have been able to hold or kiss him or her and I think that’s a big reason why I am having a hard time accepting my own emotions. Anyone have similar experiences? Any words of wisdom or encouragement would be appreciated. Thank you.