Please note: this content is not actively maintained. Vocational Foundation applied for a grant GiveWell offered in 2007, but did not receive the grant. The information below explains why.

_____________________________

The Details

Whom do they serve?

VFI serves “disconnected youth”: 17-21 year olds who are neither employed nor in school. VFI's entrance requirements are less strict (in terms of the level of education required) than those of Year Up or the skills training programs for Highbridge and St. Nick's, although we believe that VFI's population served faces fewer barriers than those of organizations like CCCS, Covenant House, and HOPE.

Selection. VFI gets its clients through referrals from the New York City Housing Authority, DOE, and other organizations (Attachment A-2 Pg 2). The program requires at least a 6th-grade level proficiency in reading (Attachment A-2 Pg 2), and the numbers on Attachment A-2 Pg 2 imply that applicants must be between 17-21, and classified as "low-income" (we aren't sure exactly what this means). VFI conducts a several-stage screening process, and about 2/3 of those who originally express interest end up self-selecting out, although VFI accepts all or nearly all of those that meet its fairly basic requirements (the source for this information is a response to our initial draft of the review, which we do not have clearance to make public).

Attachment B-4 Pg 10 makes it sound as though VFI's screening process is unusually involved, and thus ends up causing more people to self-select out, than is typical. We don't know whether this is the case, though (it could easily be true that HOPE and Covenant House conduct similar screening and experience similar self-selection).

Characteristics. VFI states that its clients have the following characteristics (Attachment A-2 Pg 2):

• Ethnicity: predominantly African-American and Latin-American.
• Income: Low. 25% are on government assistance, which implies being below the federal poverty line (we see a "self-supporting" income as being roughly twice the federal poverty line).
• GED/HS degree: 23%
• In public housing: 75%
• Past conviction: 15%

What do they do?

VFI offers a fifteen-week, 7.5 hours/day program, including:

• Vocation-specific training (medical administrative assistant, office support specialist, computer technology, security guard and bank teller – see Attachment A-2 Pg 1).
• General job training (writing a resume, what to wear to work, etc. – see Attachment A-2 Pg 3).
• Pre-GED literacy and GED training (Attachment A-2 Pg 3).
• Job placement services.
• A relationship with a counselor who continues working with graduates for two years after program completion (Attachment A-2 Pg 3).

What are the results?

Below data is from Attachment A-4 Pgs 1-4.

Placements

VFI places about 60% of its enrollees in sustainable employment (lasting at least 12 months).

Graduate to enrollee ratios have improved dramatically as time has gone on; going forward, we'd expect 80% of enrollees to graduate (as they have recently). Placement-to-graduate rates have held pretty constant in the 85% range. 12m retention, as a percentage of placements, has generally been around 90%. 80% * 85% * 90% =~ 60% of all enrollees placed sustainably (12m+).

We have very little data on 24-month retention, but what we have shows further attrition (note that VFI defines retention as having no periods of unemployment lasting 3 months or more - see Attachment A-4 Pg 4). We ignore this for purposes of discussing "sustainable job placements," because (a) it is a small sample; (b) we don't have 24-month retention data for our other applicants, and are using as consistent as possible a definition of "sustainable job placements."

25% or fewer of those who are sustainably placed also obtain their GED through VFI, which presumably improves their future earning potential (see immediately below). ("Or fewer" is meant to account for the fact that the GED figures may include those who were not placed in jobs.)

Incomes and career paths

Clients initially earn an average of around $10/hr; career paths vary by occupation but appear generally limited.
Attachment A-4 Pg 8-10 indicates that VFI trains people as bank tellers, security guards, and administrative assistants (general and medical). According to the US Department of Labor data that VFI included with its application, bank teller appears to be the role with the best career path, starting at $9-12/hr and getting up to $30,000-50,000 (pg 8); no salary data is given on administrative assistants, and security guards are stated to be in the $8.50-$13/hr range (pg 9).
Attachment A-4 pg 5 tells a slightly different story, with more variation in occupations, but similar wage data, in the $8-10/hr range to start. It also reveals that bank teller is less common than the other placements, with only 9 of the 150 being trained for this in Fall '06, (7 were placed, according to the percentages), and apparently none in Spring '06. The bank teller track is also the one with the strictest requirements (see above).

The range for Spring 2005 is cited as $5.15/hr to $13.50/hr (Attachment A-4 pg 6).

Does it work?

We would bet that VFI's clients are substantially better off than they would be without its help, though there is substantial room for improvement in our confidence level. We would be more confident if we had more information about the likely outcomes for people who fit the profile of its clients, but do not go through its program.

We lack strong "comparison group" data that would help us identify just how much VFI is helping clients, beyond what they could likely accomplish on their own. Instead, we consider the following perspectives:

• Logical: what does VFI provide that clients could not obtain otherwise? VFI may provide connections to employers, training in specific skills (data entry, medical coding, and a state license for being a security guard), and "soft skills" training that helps applicants make a better impression in interviews. It also provides GED training, though as we note above, this seems relevant for 25% or fewer of those sustainably placed. Overall, the value-added of this program is not as clear to us as it is for programs like Year Up, St. Nick's, and Highbridge (which prepare people for higher-skill jobs) - intuitively, it appears to us that the main qualification for these lower-skill jobs is motivation. However, we know relatively little about the job markets, and can also see how what VFI provides can be beneficial.
• Comparison to census data. Our census analysis estimates that about 18% of those with similar profiles to VFI enrollees make $20k+/year. As stated above, about 60% of VFI enrollees are placed in jobs paying $20k/yr on average. This difference appears smaller when you consider that census analysis leaves out the motivation needed to enter a job training program (as stated above, in VFI's case this may filter out up to 2/3 of the relevant population); on the other hand, those coming to VFI have not only motivation but need (low incomes - see "Whom do they serve?" above).
• Difficult-to-interpret data from another funder. VFI attached data from a large funder that shows its placement and retention rates' slightly outperforming those of what the funder terms "peer" organizations. We aren't sure how the "peer" group is constructed, and we don't have information on just how similar peer organizations' populations served are to VFI's. Unfortunately, the funder wishes not only that this information remain confidential but that the funder remain anonymous, so we can't share the details.

All of these approaches to determining the "VFI effect" are problematic, but looking at all three, we would bet with low confidence that the effect exists.

Costs and scalability

It looks like 300 people per year is where VFI has put its own "optimal people served" (just based on the fact that that's been the constant number over the last three years – some scalability issues are discussed in Attachment A-4 Pg 2). VFI has told us that their building has space on another floor, which they hope to use in the next three years as they expand to 500 people served annually.

From VFI's audit (hard copy only, but Form 990s are available on GuideStar), we see that total expenses were $3.2M in 2006 and $2.9M for 2005. Assuming $3M of expenses and 300 enrollees per year, that implies about $10,000 per enrollee, and $17,000 per sustainable job placement. Note that this calculation is not attempting to measure what VFI literally spends on each sustainably placed person; rather, it's looking at what you get for your dollar, across the whole organization - including costs of overhead and of enrolling students who don't end up placed in jobs.

Conclusion

VFI is a standout in terms of providing clear, thorough documentation and evaluation of itself; we find it second only to HOPE in this respect. It also places a large proportion (~60%) of people in jobs, sustainably, despite serving a highly undereducated population.

We lack strong comparison group data for any of our organizations, which would help us more clearly identify how much they help clients beyond what the clients could likely accomplish themselves. We rank VFI behind HOPE, because we find HOPE's results more impressive for the population it is working with (this is partly because we have more semblance of comparison group data for HOPE, and partly simply because of our intuitions about the difficulty of serving HOPE's population).

We'd like to know more about:

• Comparison group data. We still lack the information necessary to look at a moderately relevant "comparison group" for VFI, in order to gauge the extent of its impact beyond what clients would likely accomplish without its help. Above we describe a couple of attempts to get a very rough sense of this.

Attachments

A. Application and response

• Attachment A-1: Application - Round 1
• Attachment A-2: Response - Round 1
• Attachment A-3: Application - Round 2
• Attachment A-4: Response - Round 2

B. Program related attachments

• Attachment B-1: Newsletter Spring 2007
• Attachment B-2: Newsletter Summer 06
• Attachment B-3: NY Times 5-27-07
• Attachment B-4: PPV Moving Up Report
• Attachment B-5: Year End Report 2006-2007

C. Organization related attachments

See Attachment A-4 for general organization information.

D. Financials

The audit we were sent is available in hard copy only. Form 990s are available from GuideStar.