The trail only goes near Highrock, so I have never really check out access to it.
Sweetwater is fishable in several places. There is also camping available. However it is a place also well known to the locals. The day I was there on my thru, it was redneck nekkid swimming day... for the whole family!

(I really wanted to warn them of the cotton mouth I had just seen but didnt feel it was all that necessary.)
Sweetwater is also prone to flooding. I was there this past October (or was it November?) after all the rains we got... I have photos of the trail blazes that are normally head high on me (5' 7") IN the water!! Much bushwhacking had to be done.
Coleman Lake, the trail is on the west side of the Lake but doesnt really get close to it until its in the draw of the feeder streams. There is a hike/bike path that circles the lake from the campground that is on the east side of the lake. Should be accessible fishing spots around the lake.
Lets us know what successes you get!