A call to the The Monument Visitor Center verified that Santa Rosa Mtn. Road reopened 11-8-07. It had been closed due to extreme wildfire danger and lack of available firefighters.
Three camgrounds, Pinyon Flat (@ 4,000'), Ribbonwood Equestrian (@ 4,000') and Santa Rosa Springs (@ 7,200') are designated on the agency's map and further listed on the San Bernardino National Forest website:
http://www.fs.fed.us/r5/sanbernardino/recreation/camping/index.shtml
The Hundred Peaks Section,Angeles Chapter of the Sierra Club Driving & Climbing Guides:
Toro Peak:
http://angeles.sierraclub.org/hps/guides/30e.htm
Area peaks:Asbestos is right across Hwy 74. Santa Rosa Mtn. is on the way up to Toro.
http://angeles.sierraclub.org/hps/hpslist.htm#30
"In my opinion, the access is kind of cloudy, so you'll have to follow your nose here to play it safe."
It's pretty clear from the HPS writeup (link provided by MtnAire) that the peak is off-limits to peakbaggers, not cloudy at all. The HPS has even designated nearby Pt. 8,316ft as a replacement. Still, the odds of being caught are very low. You're the only one I've heard of being confronted up there.
I read the HPS route info a few weeks ago and noted the new edits about avoiding Toro Peak proper and going to the consolation peak 8316. Prior to that, the HPS page simply suggested to park at the Y and walk to the top. The Santa Rosa band may be cracking down on visitation. In any case, the work crew surrounding me and telling me to get lost was an unpleasant experience. I went back, did it properly and now I never need to go back, ever! But yes, your point is well-taken. The peak is "off limits" but it is unclear just how carefully it will be patrolled.