Maybe instead of a sweater, you could just warm your head with a wool cap? The head's a great radiator of heat, and might be all you need to help regulate your personal thermostat in the still indoor environment.