1st time disciplining our baby?

We were having dinner, everyone at the table and baby in his high chair. He still doesn’t do much other than play with his food. Anyway, he started getting antsy so as I was getting ready to take him out and clean up, he started hitting his head on the table (on the back support of the table) Both my husband and I sternly, and with a very loud tone, said no. He looked at us, quivered his lip and tears just fell out. After my husband and I kind of felt bad, but it seemed like the right thing to do at the time.