Feeling too ashamed to go to church

I am a single mom two young boys. I left their dad because he was abusive and cheating . We coparent now . I went to a church a few times and one of the times I went with one of my friends and she wanted to chat with the pastor on subject the pastor asked if I was also married and I said no. He asked if I was engaged or dating and I said no. He said that “God will send me Someone don’t go looking “. And I was like haha okay. But now that my church is open again I want to go to the services and join the groups at my church but I feel ashamed . I feel like I would be judged outwardly. And I don’t know if I can handle that type of judgement right now. Did what the pastor said seem judgemental ?