Without seeing your gloves and knowing how cold it is...it's hard to say>>
I
I work outside-ish all year long. I install garage doors and door openers on mostly new houses, so 90% of the time, I get my heat in the summer and AC in the winter. No breeze blowing into the garage when it's hot, always a cold draft / wind blowing in the garage when it is cold.
So I deal with steel doors. You spell that C-O-L-D !

BIggest mistake I ever made was with gloves and sock:
Over kill IS NOT A GOOD THING! Sure, your hands might feel nice and toasty warm at first, but then they get a little bit too hot and start to sweat. YOu probably don't even know it because it happenes gradually. Soon, they are wet and wet means they get cold. Insulation packs down and isn't much better than non insulated gloves.
I really made this mistake with thick wool boot socks. Socke rated for walking in snow are too much for when it is only 39 to 40 degrees. Same thing: Feel great at first, but my feet SLOWLY got warmer and warmer. The sweat ( that I didn't notice) caused the wool to pack down thin. AS thing as regular sock...except they were also wet.