All Categories Blogs

Mid-year update on GiveWell’s progress

7 years 4 months ago

This post will provide a brief overview of GiveWell’s progress in a number of areas so far this year. In summary,

  1. Research: We are making progress on reaching charities that might be a good fit for a GiveWell recommendation and asking them to apply. We are also moving forward with GiveWell’s intervention prioritization goals.
  2. Operations: The separation of GiveWell and the Open Philanthropy Project was a major organizational priority in the first half of the year and was finalized on June 1. We’ve also increased the specialization on the operations team and outsourced some of GiveWell’s operations work.
  3. Outreach: Outreach is now a major organizational priority. We hope to develop a strategy for significantly increasing money moved to our recommended charities by September.

We hope you will let us know if you have any questions about our work this year in the comments.

Research

Our work on research now falls into two primary categories: Traditional top charities work, consisting of research into promising programs and evaluations of charities implementing them as potential GiveWell top charities, and GiveWell Incubation Grants, our work to grow the pipeline of potential top charities and improve our understanding of our current recommended charities.

Top charities

  • Encouraging charities to apply for a GiveWell recommendation.

    In recent years, we were surprised by how few charities reached out to GiveWell to apply for a recommendation. We guessed that some part of this may be driven by (a) a lack of understanding of GiveWell’s research priorities and which organizations we might be interested in recommending, and (b) a lack of understanding or misconceptions about GiveWell’s charity review process or the value added of a GiveWell recommendation in increasing a charity’s funding.

    We took two steps to address this problem in 2017. First, GiveWell Research Analyst Chelsea Tabart is now serving as GiveWell’s “charity liaison.” In this role, Chelsea connects with groups that may be a good fit for a GiveWell recommendation to learn more about their work and to encourage them to apply if a fit seems promising, and to explain GiveWell’s review process and value added. Second, we published a blog post on why we think more charities should consider applying for a GiveWell recommendation. We are now considering a number of charities as potential top-charity contenders and attribute this in part to taking the steps described above.

  • Intervention prioritization.

    A major goal this year is to assess a large number of interventions as potential GiveWell priority programs. This “intervention prioritization” work involves surveying the literature for a variety of interventions to identify the most cost-effective and evidence-backed programs.

    We have made good progress on intervention research in 2017. (We plan to write about our progress in more detail in a future post.) We completed 50 quick evidence assessments in the first half of the year and published interim intervention reports on:

    We also published an intervention report on surgery to repair obstetric fistula.

GiveWell Incubation Grants

We continue to expand our work on GiveWell’s Incubation Grants program:

Recruiting

We hired Caitlin McGugan as a Senior Fellow and James Snowden started working with us as a research consultant. We hope they will increase GiveWell’s output of intervention reports. We also have one summer research analyst, Scott Weathers, working with us.

Operations

The separation of GiveWell and the Open Philanthropy Project was a major priority for GiveWell’s operations team in the first half of 2017. The separation was finalized on June 1.

The operations team continues to increase in specialization (historically, GiveWell operations work has been done by generalists on staff). We hired Maryana Pinchuk to serve as a Donations Manager and Erin Wolff as a Donations Relations Assistant; a search for a Controller to manage our finance and accounting is underway. We have also started to work with new vendors to outsource some operations work, which we hope will increase our available staff capacity and improve the quality of our operations.

Outreach

Outreach is now a major organizational priority for GiveWell. In the past, we focused very little on efforts to reach new potential donors with GiveWell’s work. Now, we think outreach is more of a limiting factor than research—the high-value funding gaps we’ve identified exceed the amount of donations we expect to direct to those gaps.

We have developed a list of ideas for how to significantly increase the money GiveWell directs to our recommended charities, and are planning to work on the most promising ideas over the next few months. For example, we think there may be relatively low-intensity steps to take in areas like podcast advertising; in February, we advertised on a small number of podcasts and plan to do so again based on the cost of running advertisements and the additional donations to top charities we tracked as a direct result of those ads.

We are also trying to hire another Research Analyst, Outreach Focus to expand our capacity to communicate with donors and other individuals who rely on GiveWell’s research.

The post Mid-year update on GiveWell’s progress appeared first on The GiveWell Blog.

Catherine

Deciding whether to recommend fistula management charities

7 years 4 months ago

We’ve long been interested in fistula surgery as a potential GiveWell priority program. However, as with other surgery charities, we have struggled to identify an organization that meets GiveWell’s criteria. Now, we’re working with a group called IDinsight and are excited that we may be able to consider a fistula surgery organization as a potential GiveWell top charity.

Our longstanding interest in interventions to treat fistula can be attributed in part to the popular narrative presented about fistula. The condition, which is often associated with social ostracization, appears to cause a significant amount of suffering, and seems to be treatable. We’re not sure how representative the popular narrative is, but as donors, it has contributed to our continued interest in better understanding this intervention, along with the feeling that surgery charities in general may offer low-cost, life-changing impacts.

Summary

This post will discuss:

  • Fistula management, including surgery, as an intervention.
  • Our open questions and uncertainty around fistula management programs, particularly their costs.
  • Our plans to partner with IDinsight to help answer some of our questions about fistula management.

Surgery charities and GiveWell

We recently published a blog post describing our work to better understand charities that implement cataract surgery programs and to assess whether they might be a fit for a GiveWell top-charity recommendation. As we discussed in that post, surgical interventions in general seem to intuitively appeal to donors due to their potential to offer inexpensive, large impacts on quality of life. However, our uncertainty about surgery charities’ room for more funding and monitoring information has generally led GiveWell to deprioritize research on charities implementing these programs in the past.

Now, as part of GiveWell’s Incubation Grants program to grow the pipeline of potential future top charities and improve our understanding of our current top charities, we’re researching organizations that work on cataract surgery and fistula surgery as potential future top charities.

This post focuses on the latter. Although both interventions are surgical, fistula surgery is distinct in a number of ways from cataract surgery and other interventions GiveWell recommends. Fistula surgery may be a major, invasive procedure. In addition, the largest negative effects of fistula may be psychological, economic, and social, rather than physical.

Fistula management as an intervention

An obstetric fistula, or gynecologic fistula, is an abnormal opening between the vagina and the bladder or rectum. Obstetric fistula is often caused by prolonged obstructed labor, where pressure from the fetus on the mother’s pelvic bone cuts off blood flow to soft tissues, which then die, leading to a hole through which urine or feces may leak through the vagina. Fistula can have physical, economic, and psychological consequences, including social isolation.

Fistula may be treated with surgery to close or partially close the opening. (In some cases, small fistulas may not require surgical treatment; in other cases, the damage may be too extensive for surgical repair.) Job counseling and life skills training aimed at social reintegration may also be part of fistula treatment. “Fistula management” describes all of these interventions, including surgery.

Our very rough cost-effectiveness estimate for fistula surgery is $1,400 per successful surgery performed. The severity of suffering, combined with the cost per surgery, may mean that fistula surgery is in the same range of cost-effectiveness as GiveWell’s current priority programs.

Our open questions

We recently published an intervention report on the evidence for surgery to repair obstetric fistula. We have a number of remaining questions that we’d like to answer before making a recommendation of an organization implementing a fistula management program. Key aspects of this intervention that we’d like to better understand include:

Outreach and cost-effectiveness

It may be challenging to identify and diagnose potential fistula cases. Fistula most often occurs in women who are located in very geographically remote areas or who are too poor to access health systems for delivery care in the event of prolonged obstructed labor. Women located in very remote areas may be hard to reach in general; women with obstetric fistula may be very hard to reach in particular, because they may be more likely to be socially disconnected or unreachable through regular community health systems.

In addition, fistula may not be well known, post-birth complications may be stigmatized, or the symptoms may not be recognized. It may be shameful for women to discuss fistula symptoms; for that reason, we’re unsure whether information about incontinence would be provided to a researcher or surveyor. Even in cases where symptoms are shared, they can be caused by other urological issues, complicating diagnosis of fistula.

We’d like to better understand what the most cost-effective methods of outreach to women with fistula are. We understand that outreach activities have included media outreach; training health workers, nurses, midwives, and doctors in fistula identification to strengthen referrals to treatment; and having women who have had treatment for fistula help identify and encourage women with fistula in their communities to seek medical care. We’re not sure what approach to outreach is most cost-effective.

How cost-effective are fistula management programs?

We’re unsure how the above outreach contributes to the overall cost per patient of fistula treatment. In addition to outreach activities, our impression is that fistula surgery programs often involve training surgeons and the purchase of equipment. We remain very unsure about the costs and benefits of these activities.

Fistula management programs may also involve a number of non-surgical interventions for patients. Some fistula centers offer rehabilitation activities for patients, such as counseling or job training. We’re not sure how common these types of rehabilitation are or what other types of support might entail, or how effective they are at improving social or economic outcomes; this could have a large impact on our overall estimate of fistula management charities’ cost-effectiveness.

What is a ‘successful’ surgery, and what proportion of surgeries are successful?

Obstetric fistulas vary in their size and suitability for surgical repair. For women who do receive surgical treatment, a “successful surgery” may not lead to continence. We’re unsure what proportion of operations successfully close fistulas due to a lack of available data in this space.

Among women whose surgeries do result in continence, we’re unsure of the extent to which that leads to positive social, economic, and psychological outcomes in turn. A major open question is whether operations that succeed in closing a fistula will address any possible social impacts of fistula.

In addition, the prolonged obstructed labor that caused the fistula could also lead to other health complications, such as infertility, scarring, and neurological damage. Repair of the fistula would generally not address these other issues, which could also have social and economic as well as physical consequences.

We are thus very interested in monitoring a) the success of surgery in repairing fistulas and b) the social and economic outcomes for women who receive fistula surgery with or without non-surgical interventions such as counseling. We have not looked closely at the studies that have been done on post-surgical outcomes, although our impression is that most studies in this space have been small. As the economic and social consequences of fistula may be among the greatest burdens of those who have fistula, we are particularly interested in understanding the impact surgery has on those outcomes.

Our plans with IDinsight

GiveWell partnered with IDinsight, an international NGO that focuses on providing clients with information to increase their social impact, as part of our work on GiveWell Incubation Grants. The “GiveWell embedded team” at IDinsight is working with us on a project to better understand the potential of fistula management organizations to become GiveWell top charities.

IDinsight plans to begin this work by focusing on the cost-effectiveness of fistula management, including surgery, as an intervention. It plans to work closely with Fistula Foundation, an organization that funds fistula treatment in Asia and Africa, to understand its costs per surgery for one country to help inform GiveWell’s assessment of the cost-effectiveness of fistula management programs in general. (Even though information from a single country will have limitations in its applicability elsewhere, we think starting at this scale is the right first step.)

If this intervention appears cost-effective—competitive with our current priority programs—following this initial phase of work, then IDinsight will likely work with GiveWell to identify one or more fistula management charities with which to develop and implement a high-quality monitoring system. With additional, high-quality monitoring information, we may better be able to understand whether a fistula management charity should be included in GiveWell’s list of top charities.

We expect this work to take several years, due to the amount of time required to set up and gather data from a new monitoring system, and do not expect this to impact GiveWell’s charity recommendations in 2017.

The post Deciding whether to recommend fistula management charities appeared first on The GiveWell Blog.

Catherine

Are GiveWell’s top charities the best option for every donor?

7 years 4 months ago

We’re sometimes asked whether we think GiveWell’s top charities are the “best,” in some absolute sense of the word, or whether we’d ever advise that a donor give to an opportunity outside of our recommendations. This post aims to clarify how GiveWell thinks about different giving options and their suitability for different types of donors.

We believe that GiveWell’s top charities offer donors an outstanding opportunity to do a lot of good and are the best option for most donors. However, some donors—those with a very high degree of trust in a particular individual or organization to make this decision, donors with lots of time (in excess of 50 hours per year, and likely more) to consider their giving decision, or donors whose values point strongly toward a particular cause outside of the ones GiveWell covers—may find opportunities to have a greater impact per dollar than GiveWell’s top charities. Note that we think these characteristics are likely to be necessary, but not sufficient, for finding these types of opportunities; we still expect good giving to be hard, and spending, for example, 50 hours per year on research isn’t necessarily going to yield better opportunities.

In this post, we describe relevant considerations for donors in greater detail.

Giving to GiveWell’s top charities

GiveWell was founded to serve donors with limited amounts of time to make giving decisions. GiveWell’s co-founders, Elie Hassenfeld and Holden Karnofsky, were in this situation when they started GiveWell as a side project in 2006. They found that determining where to give effectively was a full-time project and quit their jobs to start GiveWell in 2007.

GiveWell’s top charity recommendations serve all donors. We rely on evidence and detail our rationale for making a recommendation publicly, so donors can vet our work; a strength of our recommendations is their falsifiability. We believe our top charity recommendations serve donors who want to give as effectively as possible and have only limited time to determine where to donate, and (prior to GiveWell) no trusted person or entity to outsource their thinking to, particularly well. Our criteria and recommendations were designed with this type of donor in mind:

  • Our top charities are largely uncontroversial and relatively straightforward ways to do a lot of good—for example, by providing direct aid such as insecticide-treated nets to prevent malaria and cash transfers to very poor households. There is room for debate on the evidence behind these interventions and their cost-effectiveness, but the basic case for them—and the fact that they are likely to do more good than harm—is subject to little debate, so a donor can feel fairly confident in these basics without needing to do their own research.
  • GiveWell publishes the full details of our charity analyses so that donors can review and vet our work, and so that donors with very limited time can trust that any major problems would likely be caught by others (with more time).
  • Because we lay out the entire case for the charities online, donors can spot-check any particular part of it to get a sense of whether we’re thinking reasonably about the issues that seem most salient to them.
  • Our top charities have room for more funding. In other words, we believe additional marginal donations to these organizations enable them to do more good.

Our guess is that most donors that use GiveWell fit this profile (want to give as effectively as possible and have only limited time to determine where to donate, and no other trusted person or entity to outsource their thinking to).

Below, we discuss alternative donor profiles:

(1) Donors with limited time and a high amount of trust in a person or organization to inform their giving decisions

This group of donors has limited time to spend on making a giving decision and has an organization or person (other than GiveWell or GiveWell staff) they personally trust to make or inform this decision. In this case, they may defer to that person or organization’s recommendations.

(2) Donors with lots of time

Donors with a lot of time to spend on giving decisions (50+ hours per year) may be able to find opportunities that GiveWell hasn’t. For example, a donor might know someone who is starting a charity and feel, based on their research, that supporting their project at an early stage might be a particularly leveraged way to do good. A donor with lots of time may also be very familiar with a particular cause and feel highly confident in a particular organization and its need for funding. These donors may want to compare alternative opportunities to GiveWell’s top charities. They may also want to actively vet GiveWell’s recommendations as part of their research process.

Donors with lots of time may also wish to apply a different strategy to their giving. GiveWell largely recommends charities where sufficient evidence exists to make a fairly robust estimate of the expected value of a donation. Donors with much more time to spend (maybe even significantly more than 50 hours per year) thinking about where to give may want to take a “hits-based giving” approach—having a high tolerance for philanthropic risk, so long as the overall expected value is sufficiently high. This is the approach the Open Philanthropy Project, which was incubated at GiveWell, has taken, and we believe doing this well requires a lot of work, as the Open Philanthropy Project discussed in a blog post last year (emphasis original):

Aim for deep understanding of the key issues, literatures, organizations, and people around a cause, either by putting in a great deal of work or by forming a high-trust relationship with someone else who can. If we [the Open Philanthropy Project] support projects that seem exciting and high-impact based on superficial understanding, we’re at high risk of being redundant with other funders. If we support projects that seem superficially exciting and high-impact, but aren’t being supported by others, then we risk being systematically biased toward projects that others have chosen not to support for good reasons. By contrast, we generally aim to support projects based on the excitement of trusted people who are at a world-class level of being well-informed, well-connected, and thoughtful in relevant ways.

Achieving this is challenging. It means finding people who are (or can be) maximally well-informed about issues we’ll never have the time to engage with fully, and finding ways to form high-trust relationships with them. As with many other philanthropists, our basic framework for doing this is to choose focus areas and hire staff around those focus areas. In some cases, rather than hiring someone to specialize in a particular cause, we try to ensure that we have a generalist who puts a great deal of time and thought into an area. Either way, our staff aim to become well-networked and form their own high-trust relationships with the best-informed people in the field.

I [Open Philanthropy Project Executive Director Holden Karnofsky] believe that the payoff of all of this work is the ability to identify ideas that are exciting for reasons that require unusual amounts of thought and knowledge to truly appreciate.

(3) Donors with values that differ from GiveWell staff

Donors who hold different values than the majority of GiveWell staff, or who place more weight on a particular cause outside of the causes covered by GiveWell, may find other giving opportunities to be more attractive for reasons beyond the time/trust framework articulated earlier in this post. For example, individuals who place a very high value on farm animal welfare may wish to give a large proportion of their donation, if not all of their donation, to organizations working in that cause.

We’re happy to speak with you about giving decisions.

If you’re not sure which considerations apply to you, please reach out. We’re always happy to talk through giving decisions.

The post Are GiveWell’s top charities the best option for every donor? appeared first on The GiveWell Blog.

Catherine

June 2017 open thread

7 years 5 months ago

Our goal with hosting quarterly open threads is to give blog readers an opportunity to publicly raise comments or questions about GiveWell or related topics (in the comments section below). As always, you’re also welcome to email us at info@givewell.org or to request a call with GiveWell staff if you have feedback or questions you’d prefer to discuss privately. We’ll try to respond promptly to questions or comments.

You can view our March 2017 open thread here.

The post June 2017 open thread appeared first on The GiveWell Blog.

Catherine
Checked
17 minutes 26 seconds ago
Exploring how to get real change for your dollar.