Experimenting W/O a Condom

My boyfriend and I have had sex only with a condom. I'm not on birth control and I feel like this is the only way to stay safe. People keep telling me to at least try it once without a condom and it changes everything. Advice?