Not really the best place to eat or drink, but September might be one of the few times of the year that it's actually nice outside and worth checking out the swan boats.
On one of my first trips to Boston, I was given the "Make Way for Duckings" book and taken to the Public Gardens. The bronze duck statues in homage to the book are very cool. Also, the Swan Boats have some real classic charm.