I would say to go ahead and start taking 1-2 prereq courses and see how that goes. You can get through anything for one semester. If it goes well, great, keep going! If not, you'll have that credit and can come back to your plan in a few years if you want to try again.
I tried doing an in-person masters and found that for my family it was too much--mom being gone for classes part time combined with needing to study at home left too little of me for my family. I finally chose an online degree and made it through. Good luck with your decision!
