Sexual frustrations

My boyfriend get soft in the middle of us having sex is it my fault ? Is he not sexually attracted to me ? It makes me feel bad and makes my self esteem go down