Since you are off grid,  electric heaters are off the list.  Solar power gets challenging.  Yes it is possible, but costly.
Give this idea a try.
Source a few stone boulders, Picture below shows approximate size to look for.
Keep a few near a source of heat inside home.  Drop a boulder into bowl of water at intervals you see fit. (change out,,,swap with fresh warm ones)
Stone holds a considerable amount of heat for as long as it can. 
If you cant find any boulders,,,  then make your own from concrete cement.  Cement needs to be well cured before using. (at least one  week)
Place less than ideally cured cement stones into phasic bags, and into water to transfer warmth. 
Once cement is well cured,,, no need for plastic bag. 
WISHING YOU BEST,,,,,,,,,,,,,,,,,,,,and 
