The issue with the cars is that you might be smuggling stuff (explosives, even) onto the airport. Stupid, I know, but yeah. Even at a small airport, because once something is airside it doesn't get screened until it goes back landside. So you could stash something on your bugsmasher, then fly to sydney and asplode it.
That's part of it, at least, also they can charge you for an airside vehicle permit. Moneymoneymoney.
I have an ASIC, but I got it through work. I've only been asked for it once, and that was by a subcontracted security guard (she said that the WAC 'safety officers' had palmed that duty off to them because they were too busy). Never been asked by a safety officer (haha), or federal cop.
Even with the pass, I can't just wander around wherever I want. There's a clause about 'due cause' or 'legitimate reasons' or something like that. I haven't been to an airport outside of work duties since high school so I don't know how handy it would be for an RAA pilot. Last time I went to Jandakot was in 1998 or so. :P