Just south of the golf course is the Torrey Pines Glider Port. You can look out over La Jolla Shores from these cliffs. Here's an ~180 panorama of the spot on the cliffs to give you an idea of how what the glider port looks like.
I was there today with my son and was lucky enough to see...