I was there a couple months ago and took one of those bus things around town (not that one tho, mine was a lot more expensive). We hit every neighborhood in the city and the guide was spitting facts the whole time. Totally worth it.
The most fascinating part about San Francisco imo was China town. There's the part where all the white people go, but then there's the part when I forgot what country i was in. Was there during the Chinese new year. It was a trip.
Fishermans Wharf is mostly a tourist trap so i wouldnt hang down there too long. There are some good restaurants tho.
Really cant go wrong tho with whatever you do