Climb the weathered ramparts of a 16th-century Portuguese fort where cannons once guarded the coast and ocean breezes now sweep through crumbling colonial halls. History here comes with a side of palm trees and turquoise views.