I suggest taking a break.
If you feel the need/desire to find/go to church consider trying one that someone you knows goes to.
Lastly, don't feel guilt to go to church. I did for years, it ate me up inside, I would hate for anyone to ever go through that.
At the end of the day, you/your husband need to decide what is RIGHT for your family.
We've had seasons where we were really active and involved in a church and at other times in our lives we didn't go for years. Do what is best for your family at this season in your life.