Will add links as suggested, probably add more data and more of the scenery vs the ruins. My biggest issue with the summit is lack of views except on the SW peak.
The scrambling reference is not for the tower trail but for trails up from Emerald Lake State Park (to the South East) and Route 7 (East side). I've never taken either so I don't have details but I've read about one that traverses under the natural bridge. There is also quite a few caves (not sure if they're natural or not) that the caving forums discuss which require at least hand lines and in some cases wet suits to explore.
Overall it's an interesting little mountain and the swimming hole in the quarry on Rt. 30 is a great place to cool down afterwards.
"So I was sitting in my cubicle today, and I realized, ever since I started working, every single day of my life has been worse than the day before it. So that means that every single day that you see me, that's on the worst day of my life."
--Peter Gibbons (Office Space)