On a serious note, when using nitrile ( I wouldn't recommend latex for prolonged use) gloves under jersey gloves, if you start to do real work your hands will sweat and it will pool inside the glove. Not so good in real cold weather. It works well if you are doing mild outside mechanic work or need to use pencils and such. With jersey knit gloves being $1 or less, I just toss them when too greasy or ripped.
For general use, I found $10 leather driving gloves good as long as it was not too cold out.
Sometimes wearing a leather glove on the writing hand inside a insulated glove or mitten works too.