Selfish or what.?

Hi. My first time posting so bare with me.

My partner and I have a beautiful 2 Month old baby girl. We have been together for what’s going on to 3 years.

I myself am the eldest of 7 and we grew up in a not so rich environment and pretty much only had what we needed. Had a rough turn about 3 years ago when my father tried to murder my mother (mum survived 7 deep stab wounds) which then had to be my partner and I had to care for my younger siblings. The youngest is now 10 years of age.

My partner comes from a complete wealthy family. Everyone worked hard. Everyone pretty much wore brands and had everything they needed and wanted. This was all new to me.

Now that we have daughter of our own and live in our own house, I still try and be there for my siblings (especially the younger 3. Aged 13, 12 & 10). I created accounts for my 3 younger siblings (my daughter has a savings account too) but I set up one for my siblings because now that my mother has remarried and is always with her new husband, my siblings are left at home with my other 3 siblings (aged 21, 19 & 17 year old boys) so because I’ve never had much I decided to da like a savings account for the younger 3 to give them a head start in life unlike myself & my other 3 siblings. I told my partner about it and he just does not look happy about it. He said to me that we have a daughter. That our daughter should be my only priority. I said to him, that she is my priority and that she has everything she needs and already has a savings account. He then has not spoken to me since. I don’t know what seems to be the problem. Although I have a family of my own, am I not able to still care for my siblings in areas needed.? Can someone please tell me if I’m being selfish or something. Cause I don’t understand why he has not spoken to me.