Make sure to walk over to the Ile-St. Louis which is connected to the island where Notre Dame is by a footbridge. Less tourists, better place to grab a bite or ice cream (see Berthillon) and a cool neighborhood.
Serious geography issues here dude! This place is a long way from London ..... If you want to go punting then come to Oxford and play for us while you're here ... pleeeease