Imo, it means I believe what I'm saying, and you are included, but I'm not big enough to call you on it for what ever reason. My experience has been that people usually say what they mean, but will try to spare your feelings to avoid the conflict. ymmv
It's a subtle way to poke you to death with a dull stick...