The waters around the caves are beautiful, and it's one of the best spots for snorkeling as well. If you drive all the way to the north lighthouse, you can either take a bottom trip to the caves, or you can use the stairway near the water and then swim around from there.