Found camping at Charlotte Lake to be fine for an east approach. Only took 2 hours to reach the main route approach from Charlotte Lake. Could be done much faster I am sure (we went slow).
The trail turns scrappy right after Charlotte Lake and keeps descending. I look at as more stuff to drag back out of there, because its another 3 or 4 more miles. This is just my opinion. The camping is nice at the Charlotte Dome though if you lug everything back there.