Okay, just read through some more, and see that you are concerned about other people's opinions.
If you want, you can do a search of some of my very first posts on this forum many years ago, when I was the one excitedly researching homeschooling, and my husband was the one with all the doubts you're having. Four years later, he can't find a bad thing to say about homeschooling, and neither can most other people who know my children. They are bright, articulate, polite young men, who are no more weird than the next 9 & 11 year olds.
You will always have people asking questions about homeschooling. My husband now chats it up with other parents about how awesome it has been for us. You will always have people questioning the socialization, the friends, the ability to get into college, yada, yada, yada . . . Guess what? Those people are not in charge of your kids. You and your wife are. You need to work together to do what is best for your entire family. The other people can rear their own children and keep their noses out of your business. You don't have to answer to them.