Lisa, we have not been in the same position, but several years ago we changed from doing direct work to contracting wherever the money is good. For a year and a half we both worked that way (going to the same place) and since dd has been born it has just been dh. We travel with him to where the work is. It has made a world of difference for us. Our financial situation has improved greatly, dh is able to take significant time off between jobs, we have been to some beautiful areas of the US and we have made lots of friends in the different areas. It has its downsides too. We are in our home for only a couple of months a year, we end living pretty far away from family, we have spent a lot of time living in hotels. I don't know how much longer we will live this way, there is no work for dh where our home is and for now we will just keep doing it.
I guess what I am saying is that there are pros and cons to everything, and sometimes taking a risk can really work out. It took me a long time to be willing to take the kind of risks we did and I don't regret it a bit. I hope that you and your dh will come to a reasonable decision and be able to be happy with it.