finish inside me while starting the pill

When can you officially have sex without protection and have him cum inside you when you're just starting the pill?