You can visit the Blue caves with a boat from Alikes, but the best way to do it is to drive all the way north to the lighthouse and to take a glass bottom boat run by the Potamitis brothers. They were very accommodating and allowed us to swim in and around the caves for a long time. The best part is that from their mooring spot, the blue caves are just a few minutes away.