The only way to make it fair is give every player a score out of 10.
That way the Panfer players (or any team winning) are not stealing points of each other..
Cleary / Yeo/Edwards Probably should have won it the last 4 years...
This would be the most sensible way to do it, however, I suspect your lower talent/higher work rate players would score well each week as people would naturally score them based on effort.
For example, a Josh Jackson type player, who runs his blood to water, would rarely challenge for points in a 3,2,1 system, but would likely score 8/10 most weeks as an individual score as he grafted his nuts off and made the best of his abilities - I think any judge would find it difficult not to have a natural bias in his scoring based on commitment/effort rather than game changing ability.