Too little sex.

Due to work commitments hubby and I are only have sex about 5 or 6 times a month. Could this be why we are not conceiving ?