Surprise surprise, the winner isn’t in Albany. It’s the obvious choice of Grafton Lake State Park. The main beach area is always packed, but walk down the trails a bit and you can find a nice somewhat private area to hang out in. There’s a little rock island you can get to from the trails which is a favorite of mine.
And here is the full directory form the City of Albany.