Breast feeding question.

Does breast/nipple size matter if you wanting to breast feed? I was told with my daughter I wouldn't be able to breast feed because my breast are smaller, this was for the hospital lactation lady. I tryed to breast feed her but it was to stressful I ended up formula feeding. But I want to breast feed this one and work hard at it. Anyone successfully breast feed your baby with small breasts and have lots of milk? 
Thank you.!