TTC but now worried

My husband and I have been TTC going on three years. I’ve always baby Sar for family and friends but lately I’ve been baby sitting a month old baby who has colic.

She spent the night for the first time and was awake all night. I noticed towards the morning I was kinda frustrated and wanted to give up because nothing I was doing was getting her to sleep longer than 20 minutes.

Now I’m starting to rethink having a baby. I don’t think I will have the patience for it. I’m about to be 25 and I have always wanted a baby but now I’m scared.

Should I give up being TTC and accept never having a baby??