I would say max 15mins from Flat Rock car park to Kindergarten... The Clicke Wall sector of Andersens is at most 200m from Kindergarten.. Just a bit of a scramble over rocks and through trees - mostly annoying due to having a pad on your back!
Andersons from Hollow Mountain Car Park again about 15mins max, and is the best way to approach if the track is open. Higher concentration of problems and more shade..
Hit up the Geelong Rock Climbers group on Facebook - we are pretty active up there with bouldering trips and have a lot of people who climb V1-8ish...
Camp at Stayplton if you want ANY chance of meeting anyone else - weekends are usually busier with weekend warriors like us coming up for our fix and no fees (there are signs up for $12.50 a night but I have only seen a ranger 3 times in 10 years.. No one I know pays $12.50 a night for a drop toilet!)
PM me or leave a message on GRC page if you need any more info - I can point you in the direction of some sweet problems in your range that you could manage without a pad