Ride a boat to a crumbling island fortress on the Hudson River, then wander through Bannerman's arsenal ruins with a guide before settling in for live music or a performance under the open sky.