Two factors come into play. Site and genetics. Genetics get continually lowered through high grading where poor quality trees are left for seed stock.
But, site dictates how well a tree will grow. You can't put a tree that grows well on a wet site, and expect it to do well on a dry site. Too much stress is put on the tree. They wil be slow growing and susceptible to both insects and disease.
Sometimes you are just too far north or too far south in a particular tree's range. Again, stress plays into how well the tree will survive.
There are a lot of sites in the NE that should be converted over to pine. But, hardwood prices always comes into play. People figure that they can grow veneer on some of these sites and make out better. It doesn't happen..Then you have a stand of slow growing, low grade hardwoods.
To help out your management decisions, you should get a soils map from your county agent.