Stay or Leave My Boyfriend?

my bf & I have been dating for 6 months now , he has a baby momma and a son which I don't mind. EXCEPT that he stays at his bm house still and claims he does not fw her. he wants to move out and be with me but he just says it and hasnt done a move. should I wait or just leave. I mean I really love him which makes it hard , cause in such a little amount of time he has showed me that he cares BUT could those actions just represent his guilt he has for being with his bm or what yall think ? help.