To be passionate about any team, that team needs to show some degree of success.
The Object of the game is to get Collingwood, Essendon, North Melbourne, St.Kilda, Melbourne, Hawthorne, etc etc fans to jump ship and start having an interest in Rugby League.
It's a bit impossible to start having an interest unless the team is doing well.
Moreover, how passionate can you be about a team of transplanted New South Welshmen, Queenslanders, Kiwis and Pacific Islanders if you're a Victorian?
That's why I believe it's important to have a junior development program for Rugby Leage in Victoria before you start an NRL team.
I myself am half-hearted about AFL, yet if there were Swans and GWS players that were actually born and bred in Sydney, I might take a greater interest.