He has no where to go ? Well isn't that just to bad. Let him live in his car.
Get Mad !

He's playing with you.
I say change the locks next time he goes out, and get a lawyer. Tell him you want a trail seperation, and child support, if he wants back then he's going to have to go to counseling. If you don't play hardball he's going to keep breaking your heart, and your childrens.
If he doesn't want back at least you'll know now. You and your children deserve much more.
Hugs and prayers to you and your children.