Are there any good hiking/kayaking/climbing locations near NYC?

I would have loved to move to Denver or california for more outdoor activities, but it looks like my I'm destined for work in NYC. Are there any amazing outdoor locations in the area nearby?