Yeah, this is BS, I've never seen climbers doing anything except walking quitely past the lodge keeping a low profile and this ban is quite unecessary.
I won't be changing the way I access the crag any time soon.
This is similar to the situation that existed in England 50 years ago when wealthy land owners restricted access to mountains and moorland and climbers would risk being shot at attempting to reach crags. Australia needs something similar to the CROW act and a body similar to the BMC to stand up for our interests. Sadly nothing remotely similar exists.