My brother is doing it now very successfully with a 1 year old and a 4 year old. Kids love spending time with their parents - take them to the park, take them to the beach, walking, playing, being outside. None of those things cost any money.
It is simply about being careful how you spend money, because the more you spend, the more you'll have to go to work.