All mine kids are beyond the babywearing stage, but when I did, I'd usually use the bouncy chair first in the day, until the baby had enough of that. After that though, the baby usually was in the wrap most of the day. Reasons including that I just needed to get stuff done, didn't have a place I felt was truely safe to put him/her down, that's where s/he was happiest. After nursing, I'd usually try somthing else (floor, bouncy chair), but if that wasn't going to work, I didn't waste time trying.
If what you're doing now works for you, then that's great. If you want to wear the baby more, just pick a time, like after lunch, and wear for a while. I love seeing other mom's wearing outside the home. It seems so rare in my area.
Wearing really save my mind. I don't know how I would have gotten anything done without it.