I think the main reason the White pines aren't growing better is that there was no competition control done at the time of planting or anytime after. They are not dense enough to shade out the grass so they are still competing for the water and soil. Also we've had a few years of extremely dry summers.
About a 1/3 of the white pines also have weevil damage and some quite severe, we've got a few WP shrubs...

Almost every mature WP on our land has had weevil damage at some point and multiple times for some so I guess we are going to live with it.
The few mature red pines we have don't seem to have any weevil damage so I'm hoping the seedlings we plant will avoid that as well.
As for deer, we do have a lot that pass through and bed down but I've been watching for excessive browsing but they don't seem to eat to much on our property.
Thanks for the help,
Ian