I see it more as, hey I have this shirt in my closet that I refuse to wear on moral grounds, so I'll go give it to someone who will take any shirt they can get-- someone who won't care about morality-- surely they'll be thankful to me. It's almost like donating expired food. Donate your clothes, please do to those who need them, but to only do it to make a political statement rubs me the wrong way.
eta: I'm sure the idea comes from a good place, but it sends a bad message, imho. He's saying that homeless people wearing abercrombie will be the biggest insult to the brand. Saying that homeless people are an insult is wrong to me.