Labor question

So my husband heard that sex can start labor & I’m only 35 weeks so he doesn’t want to do anything because he’s scared I’ll go into labor..

Is it the seman that can cause labor or just the act of sex itself? Should we be worried?