Two of my favorite cities are Charleston and Savannah. Stay a day or two in each city. Lots of history. TIP: Whenever we go to a new city, we always spend $10-$30 on a one or two hour city tour by a local that's lived there 20 years or more. They know stuff that's not in the books.
Saint Augustine is the oldest settlement in the US, and is on the beach. It has a nice shopping and dining area. Castillo De San Marcos National Monument is a 17th-century Spanish stone fortress with views of the St. Augustine Inlet.