Possible hole on wall of heart

I just had my 20 week ultrasound and the doctor said that she was concerned about there possibly being a small hole on the wall of the heart. I am going back in 2 weeks for a follow up exam with a specialist. How concerned should I be?