A fair few times when the temperature has dropped whilst I've been at work. I just stuck on a pair of those Latex "saftey" gloves that you may/may not wear when working on your bike/car/whatever to stop your hands getting dirty. They're good at keeping the wind chill off, but can make your hands sweat, depending which ones you use. Obviously not a permanent solution though.