Small hole on wall of heart

I just had my 20 week ultrasound and the doctor said that she was concerned about there possible being a small hole being in the heart. I am going back in 2 weeks for a follow up exam with a specialist. Is this a common thing? How concerned should I be?