We cycled through SOTW for grades 1-4.
For 5th grade (and a ds in 2nd) we did MOH vol. 1.
We are Catholic and I did not like how MOH vol. 2 was written with an anti-Catholic bias. My dd did History Odyssey level 2 Middle Ages for 6th grade. (In place of "The Story of Mankind," I had her read similar lessons from "The Old World's Gifts to the New" to give more of a Catholic perspective.) My ds (grade 3) listened to the audio of SOTW 2 and also did lessons from "The Old World's Gifts to the New".
Since I felt that our first go-round in history did not cover enough American history, we are focusing on that next year (dd 12, ds 9, ds 5)-- from the discovery of the Americas up to (but not including) the Civil War. We will be using From Sea to Shining Sea:the Story of America, plus the audio version of A Little History of the World to add some details of what was going on in the rest of the world.