At the park entrance the guards give you a map which shows one access road that you can walk along which is about half way to the lighthouse on the left hand side. As far as I know this is the only public access road to that side of the cliffs. There are fences most of the way on the left hand sign with signs every 20m.
As many know there has been ongoing access issues to the Point in the past. I don't think it would be smart to think that we can all now start climbing again at some of these off limits areas because a guard said it was fine. If you really have to go there use park your car at the one access road and walk from there.
The Point is my favourite and my local crag and if it got closed because of climbers going off limits I would be seriously pissed off. It is a shame some parts are off limits to climbing but what we have is still bloody amazing.