Don't miss the area around Charlottesville/Staunton, VA. Monticello has already been mentioned, but there's Ash Lawn (Monroe's home) less than three miles away. Montpelier, James Madison's home, is only about 45 minutes north of there and is definitely worth a trip.
The Frontier Culture Museum in Staunton is amazing, too, with lots of interesting hands-on activities.