Bottle feeding

My little one was born in April and is about five and a half months old. He is a breastfed baby. Does anyone else have trouble giving their breastfed babies a bottle? I have tried five different types of bottles different types of nipples, sippy cups you name it and he still cries when someone tries to give him a bottle. With his dad he'll suck nine ounces out of a bottle but his dad works offshore. We introduced him to solid food and that's no problem. He just won't suck any milk while I'm at work. There were also a few days that he refused to suck off of me. He's still gaining weight. He's 23 pounds. I was just wondering if I should be worried or if anyone else had this problem.