Sex help

How do you ladies become more confident with your partner about sex ? My boyfriend and I have had sex a few times and we both agree it's just not good because I'm too self conscious about the way I look and things like that. We've talked about new things to try and I'm just scared to do it. Any tips ??