Hi, I don't know if it's just me, but I try to do it the less I can. I find that when pairing against the grain, sometime a big "string" of wood fiber comes off and can often go deeper than you wished.
Seems that the less I pare against, and the more I pare with the grain, the better and easier to cut are my joint.
Alexis