Yeah, they do stay warm when discharging.. and when charging. But don't start out with an extremely cold battery..
I had raced RC cars quite a bit and we also messed around in the winter months. initially I was not doing anything to keep the cells warm before use and the first couple of packs...