I think everyone could agree that there's something personal they'd like to fix if they were referee's boss....
But what is really played down in the media is how many we've been through since the NRL has reformed. Haven't we been through 7(?), and none have exited on their own terms. The height of the idiocy has come from News Corp. calling for Harrigan to come back, when they were on the sack Harrigan bandwagon when he was last in charge.
It's time the fans and especially the media take leadership and acknowledge it's an inherently difficult and thankless task to referee. I think apart from a rare comment from Sterlo and Vossy, no one praises the referees for a difficult yet correct decision, but we love to highlight an incorrect call. Fox and Nine commentators can argue about scrapping the bunker/two refs and naively say how we'd "all accept the on field decision and move on", but then show all 17 different angles that "prove" (often subjectively) a referee's decision is incorrect.
Reality is, there's no consensus in how to "fix" refereeing (even if it needs fixing), so they're going to just continually cop abuse unless more people in high places look to change the culture of ref bashing.