SAN FRANCISCO VOCATIONAL SERVICES

ANNUAL PROGRAM EVALUATION

FY00: 7/1/00 TO 6/30/01

The total number of clients served grew slightly from the prior year (359 in FY00, up from 340 in FY99. There were no significant changes in the age distribution of consumers: the incidence of disability increases with age, as reflected in the fact that 72% of consumers are 36 years of age or older. Men and women were served in nearly equal numbers. There were no changes in referral patterns: the bulk of referrals (58%) continue to come from the State Department of Rehabilitation.

There were minimal changes in patterns of persons served by type of disability. The percentage of persons served with orthopedic impairments grew slightly from 25% to 32%, while the percentage of persons with learning disabilities dropped from 10% to 6%. The largest categories of disability among consumers continue to be Orthopedic, Emotional, and Chronic Disease (especially HIV+). SFVS serves very few consumers with developmental disabilities, reflecting our specialization in computer and clerical skills training and placement for business office occupations.

The volume of initial referrals to both the COMPUTERS PLUS! program and the Transitional Employment Program (TEP) fell significantly, while there was a significant increase in initial referrals for Vocational Evaluation. These patterns reflect the fewer total number of unemployed persons with disabilities seeking vocational services in a strong economy, and those who do seek help may need more vocational assessment prior to training or placement.

Patterns of educational level are similar to the prior year. The majority of consumers (52%) claim some amount of postsecondary education. Only ten percent acknowledge less than a high school education. Consumer ethnic patterns are very similar to the prior year, with Caucasians at 44%, and significant numbers of blacks (20%), Asians (18%) and Hispanics (13%) served. Despite the high school or better education claimed by 90% of consumers, the average overall tested grade level for academic achievement is only 9.3, virtually unchanged from the prior year. The relatively low academic achievement of consumers is addressed by remedial coursework in English and math in COMPUTERS PLUS!

Expressed satisfaction with vocational evaluation services by referring counselors was generally positive but still fell below goal. While approximately three quarters of counselors expressed satisfaction, the goal was 90%. A modified procedure was used to collect feedback this year. Very few mailed questionnaires were returned, so referring counselors were surveyed by telephone. This method seems to have elicited a greater amount of critical responses than were received in the past. Much of this feedback was useful, but some of the negative criticism was unwarranted. One criticism indicated a perceived bias (conflict of interest) toward recommending clerical training; staff have been counseled to be aware of the concern. One criticism noted insufficient information about specific potential vocational goals. The service could be improved in this area. In some instances the feedback revealed that the counselors did not state their referral questions clearly enough: our staff need to probe more deeply to find out exactly what information the referring counselor is seeking. Consumers were very satisfied with vocational evaluation services, with 90% expressing satisfaction (goal was 70%.) Average daily attendance dropped from the prior year, from 1.6 to 1.33, below the budgeted ADA goal of 1.83. Lack of DR referrals accounted for all of the deficit. DR had substantial turnover in counselors this year, leading to fewer persons served and referred to programs like ours.

The actual graduation rate of 62% exceeded the goal (60%.) The percent of graduates who started employment was exactly on goal (70%), and represented a significant improvement from the prior year (54%.) Average hourly wage rate was above goal ($10.50 vs. $9.50), but represented a drop from the prior year ($11.15.) 90 day job retention was below goal (79% vs. 85%.) Consumer satisfaction was much improved from the prior year with 91% of students rating their experience "above satisfactory" (goal was 70%.) Average daily attendance dropped slightly from 12.21 in the prior year to 11.57. The budgeted ADA goal of 18 is not realistic: the DR contract called for a total monthly attendance of 20 unduplicated individuals, and this goal was exceeded.

Many of the Special Programs outcomes exceeded goals and are very similar to the DR program outcomes, including graduation rate (64%), percent of graduates who start employment (74%..), and consumer satisfaction (95%.) However, Special Programs graduates earned a significantly higher wage ($12.16 per hour.) (Special Programs students, who include injured workers, tend to have more work experience than do Department of Rehabilitation students.) 90 day job retention was far below goal (65% vs. 85%), reflecting the fragile health status of many Special Programs students who are HIV+, and/or who have histories of substance abuse and who subsequently fail to maintain sobriety. ADA at 8.22 was almost exactly the same as in the prior year, again falling well below the budgeted ADA of 15. (The department was commensurately staffed with fewer FTE’s than was budgeted.)

TEP serves clients with the most significant barriers to employment, often including no work history or a negative work history and poor work habits. Nonetheless, most outcomes were very good. The graduation rate from TEP exceeded goal (82% vs. 80%), representing a great improvement over the prior year (65%.). The percentage of graduates who obtain employment was well above goal (74% vs. 55%), yet significantly lower than in the prior year (90%). Similarly, 70% of persons placed retained employment long term, well below the goal of 80% and below the level of the prior year (95%). Hourly wage rates were well above goal ($10.14 vs. $8.50), a significant improvement over the prior year ($8.37.). Consumer satisfaction rose significantly from the prior year (58%) and met the goal (71% vs. 70%), reflecting improved interpersonal skills of new TEP staff. Average Daily Attendance improved slightly over the prior year (10.31 vs. 10.16), but continued to fall well below goal (15.) The primary problem in achieving a higher ADA is the low wage paid in TEP ($7.64 per hour), which makes recruitment difficult. Employment in TEP is intended to provide transitional work experience, and is not an end goal.

The number and percentage of consumers obtaining employment fell off from the prior year. Fewer total consumers were served in Placement (167 vs. 213), reflecting a low unemployment rate in the general economy (and reduced need for the program), as well as the effects of chronic staff vacancies. 116 consumers (69%) obtained employment as compared with 160 individuals (75%) in the prior year. Persons who were served in Placement were persons who had remained long term unemployed in this year’s strong economy, and who tended to have more severe work-related deficits. On the positive side there was a substantial increase in average hourly wage over the prior year ($12.49 vs. $11.48.) The 90 day job retention rate continued to fall below goal (72% vs. 90%), but this goal may be set unrealistically high. Consumer satisfaction fell significantly from the prior year (59% vs. 84%), and was below goal (70%.) To some extent this is caused by ongoing staff shortages, which result in less availability of intensive, individualized service. Also well below goal was the percent of placed consumers who were quick to obtain employment (49% vs. 70%), again a significant drop from the prior year (74%.). The Placement department urgently needs to fill vacancies with competent staff.

1. Objectives 2, 3, and 4 based on clients who received placement services. Objectives 1, 5 and 6 based on all clients. 

1. Objectives 2, 3, and 4 based on clients who received placement services. Objectives 1, 5 and 6 based on all clients. 

RETURN TO PROGRAM EVALUATION CHOICES