You've got a lot on your plate. I can't speak to whether you should press forward with the homeschooling or choose to take advantage of public school; to a great extent that will depend on what your reasons are for homeschooling in the first place, and what your goals are for your children's education. If you are committed to homeschool, it might be time to reexamine your plans and priorities. Maybe there is something you can do differently that would make school run more smoothly in your home. I agree with those who caution against anticipating too much based on how the first day went, it always takes us a few days to get into a groove when there is any significant change in schedule. Partly because of this, and partly to limit the amount of work we need to fit into a day I prefer to school year round. I also aim to have my children working independently as much as possible. It is possible that a change in schedule or expectations or materials used could make your school's day flow more easily.
regarding guilt, I think we can choose to make the best decisions we are able for our families while acknowledging that perfection is impossible. We might have regrets over roads not taken but I believe we can choose to move forward with confidence that we are doing our best under the circumstances.