Covid Dating Advice

Just need some advice on this guy I've been seeing.

So I met this guy almost a month ago on a dating site, we've seen each other 3 times now over 4 weeks. First date we went bowling, art gallery and cafe. Second date we went cinema and then got food. They were before lockdown. Lockdown then happened so the third date was a big park and then played some games together on his Nintendo Switch.

Had a great time on all 3 dates. Seems like a lovely guy, not too forward or forceful however he has asked me to come to his flat for fourth date. Because of lockdown and weather (it's really cold here) it's not nice meeting up outside. So I was thinking I could go over to his flat but wondering what you girls think about this before I definitely agree.. I wouldn't normally even consider it with anyone else but because of the circumstances and because I really like him and feel comfortable around him I'm tempted to go.

I did say to him no sex and he's saying he wouldn't try anything. What do you all think?

Edit: It's just that he has asked me before to go to his house and he's asked a few times so i don't know what he's thinking because everytime he's mentioned it he's said he wont try anything. And I said to him last week that I wasn't ready to go to his house and today he messaged me saying that he doesn't know why I'm scared to go to his.