Should I confront cheating SO?

I just found my boyfriends work van parked outside of someone's house.. I think he's cheating. Should I walk up to the door? I'm literally parked right out front next to his van.

Also I have my 19 month old in he car with me.

What should I do?!

Update:

So I walked up to the door and could here him in there talking. So I rang the doorbell. Went silent and I waited a few minutes and rang again. Kept waiting and then I knocked. So girl came to the door screaming saying to leave and she was calling the cops saying "fuck you"... I didn't say anything at all. Stoop there for a while, knocked and rang again. Nothing. He texted me saying she called he cops and he's going to bed. It's been almost a half hour. I told him I'm not leaving without him. He said he's been drinking