So your husband has gone but you should not be too much worried, your husband will come back to Krsna consciousness, if not now then later. Anyone who has tasted the bliss of Krsna consciousness he cannot stay away for a very long time. So you should not be too much concerned. Do not be too much worried—forget the past, do not be attached to it for we are only thinking of how we may now please the Supreme Personality of Godhead and the devotees are always optimistic for the advancement of their spiritual progress. So in the meantime there is no question of any more marriage by you so you will become freed from the entangling grip of maya which means sex life. Just see, so many people are suffering so much just for a little sex life. I am so much disturbed by problems caused by sex life that I am not going to sanction any more marriages. Our devotees must do it at their own risk from now on and they must provide their own income for living together outside the temple or if they live in the temple they must live separately.
So far as the other two children are concerned, they are not begotten by you but still it is important to save them for Krsna but if it appears impossible to get them back from the authorities never mind, that is Krsna's plan.
So now you have one son and you should see very carefully that he is raised and educated nicely in Krsna consciousness. If you are eligible for financial help from the government you may take it as it is not desirous to keep baby children in the temple.