World Vision Super Bowl Shirts: the Final Chapter

Remember back in February when World Vision’s proud announcement that they were sending abroad 100,000 Super Bowl champion T-shirts emblazoned with the name of the losing team, as they have for the last 15 years, provoked aid blogger ire? We’ve been following the controversy—and occasionally piling on joining in—and here’s the latest. In an email to Aid Watch, World Vision disclosed that total transport and administrative cost per T-shirt was 58 cents, which is uncomfortably high relative to low market values (a quick spot check  produces estimates ranging from 20 cents to $1.20 for a T-shirt) in Africa's saturated second-hand clothing markets.

World Vision also sent us documents from two districts in central in Uganda* that received donated clothing, although NOT specifically the loser Super Bowl T-shirts that started this whole controversy. We learned that the donated clothing was used as part of World Vision’s health programs which aim to “improve access to better health services, safe water and sanitation.” Specifically, World Vision said:

Provision of clothing was done for women and children in extremely poor conditions to protect them from weather and to raise their self-esteem. Providing clothing also served to increase trust among the beneficiaries and encourage them to participate in other health services, including voluntary counseling and testing for HIV.

This led us to focus on the health and HIV/AIDS sections as we sifted through the documents for answers to two questions which arose in the debate.

First question we asked: Can World Vision show that they rigorously assess the need for gifts-in-kind in the communities where they work?

World Vision answered: Needs assessments are carried out by national offices, and the rigor of these assessments varies from office to office.

What the documents showed: World Vision sent us one program design document from the final phase of a 12-year, multi-sector program that ended in 2010, and one needs assessment from a neighboring region (WV couldn’t find the needs assessment for the 12-year project).

The needs assessment identified the most important problems faced by the community, and made recommendations how WV should deal with them. It did not discuss at any point the clothing needs of villagers, or how clothing donations might alleviate any of the problems mentioned in the 67-page report.

The program design documents, intended to “point out gaps that still exist in the community as expressed by the people,” made only one mention of gifts-in-kind. “Gifts in kind will be planned for on annual basis and this is meant to supplement the project fund in achieving project planned activities.”

The main report did not mention a need for clothing. However, I did learn that the region described is among those most heartbreakingly affected by HIV/AIDS, with high numbers of orphans and child-headed households, and after some digging I found an HIV/AIDS sub-report embedded within the main report that did mention clothing:

Most of these [orphaned children] lack care and support in terms of emotional coping, physical requirements like food, shelter, clothing, and limited access to basic social services like education and health.

Another embedded sub-report (actually a proposal for outside funding to support HIV/AIDS orphans in the area) was more specific:

Special needs will be identified for each of the selected families and the project will organize to procure and provide the essential needs for the children and guardians. These will include beddings, bicycles, clothing, cooking pans, washing basins and water tanks.

Our conclusion on the first question: No.

Second question we asked: Can WV point to any evidence that the 15-year distribution of Super Bowl T-shirts, or, more broadly, any distribution of clothing, has "facilitate[d] good, sustainable development"?

World Vision answered: No, “because the Superbowl clothing isn’t a program. It’s a donation. We evaluate the results of our programs…many of the programs where we use GIK have been enormously successful in facilitating good, sustainable development. Our evidence for that would be individual program evaluations from a variety of national offices.”

What the documents showed: WV sent us one annual report and program evaluations for each phase of the same 12-year project discussed above. After hours of reading, a picture emerged of a community decimated by the HIV/AIDS epidemic and valiantly struggling to provide support for the large populations of vulnerable children made orphans or adopted into already over-stretched extended families.

An annual report from 2006 gave the only specific accounting of the type of gifts-in-kind distributed:

GIK was received and distributed to children and these included 115 pairs of canvas shoes, 50 pairs of baby shoes, 900 T- shirts, 225 Gin trousers, 500 pairs of socks, 125 dolls and 200 blankets. This benefited 1615 children in the community.

In a report from the first phase of the project, evaluators noted that some villagers were able to sell eggs from a poultry project to buy clothes (this shows that clothing is available for purchase in the community, and probably not at prohibitive prices for most people). Clothing was also mentioned as an obstacle to achieving the program’s “Christian Witness” objective: the poor don’t attend church because “they lack good cloth to put on and feel not worth attending.”

Regarding World Vision’s ability to show success in facilitating sustainable development through their programming in general, the 2006 evaluation said “tracking changes…attributable to World Vision support” is “quite difficult” because over the course of the 12-year project priorities and goals shifted, and because early baseline measurements don’t match up with later evaluations.

Nonetheless, the final report attributed many positive health outcomes to project activities. For example, reduced malaria incidence; improved sanitation practices; and reduced prevalence of HIV/AIDS.

We don’t see any basis for attribution of these outcomes to World Vision, since the program was not designed in such a way to make such attribution possible. The resources provided by World Vision—clinics built, medicines supplied, HIV awareness courses given—are characterized as improving health outcomes, but also as very thinly spread over a large area with acute health needs.

As to sustaining project gains as WV funding ends, WV reported that local organizations have been trained in skills like proposal writing, resource mobilization and networking so that they can take over WV services. Villagers in the final survey said they learned “vocational, business management, leaderships, improved farming, HIV/AIDS care, positive parenting, and sanitation management skills,” all of which would provide a “pillar to further development in this area.”

Our conclusion on the second question: While we appreciate WV’s transparency in sharing these documents with Aid Watch, we have to conclude that the answer is no. There is no real evidence in these hundreds of pages of reports that the clothing donations are more than a minor afterthought to World’s Vision’s health programming (although gifts-in-kind are a major source of World Vision’s revenue). Given the aforementioned costs required to ship donations from the US abroad there is no development-related reason to continue this outdated, dependency-creating practice.

*World Vision asked us not to publish the names of the regions, or any other identifying information about the projects.

--

Related posts:

In Zambia, Pittsburgh won the Super Bowl: Why is World Vision perpetuating discredited T-shirt aid?

World Vision responds to blogger questions

 

Read More & Discuss

World Vision responds to blogger questions

Editor's Note 10:45 am 2/18/2011: Thanks to all the commentators, you really wrote a new post for us today. We have emailed World Vision follow up questions, especially taking them up on their offer to provide examples below. They said they will respond by middle of next week as they get their national offices to respond. In an email to the communications  department at World Vision, we collected and forwarded a few of the questions posed by aid bloggers in their posts (now up to 50, and counting) about the controversy over the 100,000 misprinted NFL T-shirts World Vision distributes as gifts-in-kind aid every year. On Wednesday evening we received World Vision's response, which we are publishing here in full:

1. Can WV show that they rigorously assess the needs of the communities they work in for gifts-in-kind (GIK)?

 

World Vision’s assessments of the need for supplies and of the impact a supply donation may have on the local economy are done by individual national offices as part of a strategic programmatic response.  As a result, when we set our strategy for GIK procurement each year, we ask each national office send us requests for resources they need and to do so after assessing the need for supplies and their ability to procure supplies locally.

The rigor of those assessments varies based on the national office providing the information.  Each World Vision office is an independent entity, with its own board and charter.  World Vision has deliberately worked within its international partnership to increasingly empower national offices regarding the assessment, design and implementation of its programs.

If it’s helpful, I can try to get you copies of some example assessments from some national offices so that you can get a sense of what those assessments look like.

2. Why does WV use a much larger share of GIK than other similarly sized nonprofits?

Depending on how you calculate the “size” of a non-profit (annual revenue, number of countries of operation, staff size, etc), World Vision doesn’t use a much larger share of GIK than other non-profits.

In fact, there are really no other organizations with a comparable size to World Vision, U.S. with the same operational mandate.

3. How did WV calculate the ‘fair market value’ for these shirts?

World Vision hasn’t valued this year’s donation of NFL-related clothing because we have not received the products yet. Unfortunately, the numbers listed in the blog post and a press release shouldn’t have been released – they were rough estimates that weren’t related to each other and don’t reflect how World Vision will value the clothing.

In general, World Vision calculates “fair market value” for any of its donated supplies based on standards set by the Financial Accounting Standards Board (FASB).  As a side note, the FASB recently established a new definition for valuing supply donations and as a result, there is a great deal more clarity in the way that all non-profits value supply donations.  While not all NGOs have yet implemented the new FASB standards, World Vision has.

This process is based on current standards required to value all forms of GIK donations.  While there may be a discussion about what the value of a particular item should be, the objective standards we follow are essential to guide our valuation approach.  It may worth discussing whether the current standards need to be improved; but for now, those are the standards with which we need to comply.

4. Has WV tried to evaluate the results of this program? Can WV point to any evidence that the 15-year distribution of Super Bowl T-shirts has "facilitate[d] good, sustainable development"?

The short answer is “no” because the Super Bowl clothing isn’t a program. It’s a donation. We evaluate the results of our programs.  Some programs are successful. Others less so.  But their success is based on the quality of the program’s assessment, design and implementation, not solely on the use of one tool or another.

Many of the programs where we use GIK have been enormously successful in facilitating good, sustainable development.  Our evidence for that would be individual program evaluations from a variety of national offices, but we can provide some examples if those are helpful.

In Summary: For World Vision, GIK is a resource in a robust tool kit.  We endeavor to use it in situations where it’s appropriate and in ways that are skilled, but like any tool, it’s not inherently helpful or hurtful.  A hammer can do a great deal of damage if you use it poorly, but it can also be a necessary piece of equipment when you’re trying to build something.

Our perspective on this greater debate is that the resource (GIK) can be used in ways that are very helpful.  It can also be used in ways that are destructive.  The answer isn’t to toss the tool.  The answer is to make the tool work better and to become more skilled at when and how to use it. World Vision continually seeks ways to make our work more effective in all areas, including how GIK is integrated into a full development strategy and the constructive elements of this ongoing conversation are a part of that continual effort to improve.

Read More & Discuss

In Zambia, Pittsburgh won the Super Bowl: Why is World Vision perpetuating discredited T-shirt aid?

Editor's Note 4: 10:45am 2/15: @saundra_s reports there are now 36 bloggers that have posted on this (excluding WV itself or its staffers), of which 35 are against. One more against here from faith perspective. Now have a Twitter hashtag #100kshirts.

Editor's Note 3: 8:45am 2/15: heard from @WorldVisionUSA finally! got this direct message on Twitter: "Thanks for following WV! For even more opportunities to get involved, check us out on Facebook."

Editor's Note 2 3:30pm: still silence from the @WorldVisionUSA palace as more bloggers post and more protesters gather outside in Aid Twitter Square.

Editor's Note 10:16am: Sorry World Vision, Aid Watch committed a major factual error due to the incompetence of one of our alleged experts. This supposed NFL and zoological expert with the initials W.E. initially got the team wrong in the picture, it is the losing 2007 team Chicago Bears.

As it has for 15 years, World Vision took credit last week for accepting the donation of 100,000 unwanted Super Bowl T-shirts from NFL merchandisers to ship to poor people across the world.

The T-shirts are the result of NFL merchandisers printing championship shirts for both teams in the Super Bowl so they’re prepared to immediately sell to fans of the winning team, whichever one that turns out to be. The merchandisers get a tax deduction for donating the losing team’s shirts (saying that the losers actually won) to World Vision, and World Vision (according to their website) ships the shirts abroad, this year to Armenia, Romania, Zambia and Nicaragua.

(Saundra S has a great post explaining the financial incentives that keep this arrangement in place. Among other things, World Vision uses the shirts to fictionally lower its overhead cost ratios, great for bragging about its efficiency.)

To quickly reiterate some of the arguments against SWEDOW (Stuff We DOn’t Want) aid:

  1. It’s not needed. Seriously, neither the developing world as a whole nor the specific recipient countries named by World Vision suffer an undersupply of T-shirts.
  2. It’s not cost effective. The cost of collecting, sorting, shipping and distributing bulky, low-value items like a bunch of T-shirts does not justify the (very questionable) benefit. And don’t forget to include the opportunity cost, the lost chance to allocate those same, considerable resources to provide something better, like clean water or medicine. (A World Vision PR rep told the New York times in 2007: “Where these items go, the people don’t have electricity or running water.")
  3. It can perpetuate local community’s dependence on free handouts and stifle home-grown economic initiatives, not to mention putting out of business local shirt sellers.

In comparison to the storm of protest that greeted aid neophyte Jason Sadler (aka the 1 Million Shirts Guy, aka Mr. Haterade) when he launched his idea to send a million T-shirts to Africa last year, the unexemplary behavior by aid behemoth and standard-setter World Vision has provoked far fewer critical posts.

Self-preservation-minded aid bloggers who work with World Vision might be  rationally self-censoring, and we've also heard reports that some bloggers received email requests not to blog about this topic.  This episode may reveal the current limits of the burgeoning power of by-the-people aid criticism.

Then again, this week has been an auspicious one for people-power protesting policies that should have been chucked in the bin of history long ago.  As the controversy spreads, World Vision can't avoid debating these policies with their supporters and critics. Will next January see World Vision bragging about its 16th year of sending loser shirts to poor people, or will people-power finally halt this disgrace?

Read More & Discuss