Milk production

Hi ladies, I'm a FTM and just a little concerned.  During the earlier part of my pregnancy my boobs grew and got much more firm & I assumed they were getting ready for milk production.  However, I'm 32 weeks pregnant & over the last week or 2, my boobs have seemed to shrink back down some more & aren't nearly as firm.  Have any of you ladies had this happen to you? I'm sorry if this is stupid, I'm just nervous about getting my milk in bc I really want to breastfeed my baby.  Thanks!