SAN FRANCISCO VOCATIONAL SERVICES
ALL CLIENTS
CLIENT DESCRIPTORS REPORT OF
7/1/02 THROUGH 6/30/03SAN FRANCISCO VOCATIONAL SERVICES
ANNUAL PROGRAM EVALUATION
FY00: 7/1/02 to 6/30/03
SAN FRANCISCO VOCATIONAL SERVICES
ANNUAL PROGRAM EVALUATION
Fiscal Year 2003: 7/1/02 TO 6/30/03
Executive Summary
Descriptors for All Clients Served
As compared with the prior year, the total number of clients remained the same (317 vs 316. There was no significant increase or decrease in the percentages served by age group. Slightly more men than women were served.
Referral Sources
The percentage of referrals come from the State Department of Rehabilitation increased dramatically from 66% to 76%, reflecting increasing dependence on this source, but also increasing success in working with the counselors and their clients. A concern is that all of DR’s clients are severely disabled, and the many barriers to employment presented by these clients negatively impact outcomes. Private insurance referrals decreased slightly. Self-referrals dropped by one-half.
Referral for Specific Services
Initial referrals for direct placement grew from 29% to 33%, while referrals to COMPUTERS PLUS! Pre-training assessment decreased by 8%. The percentage referred for Vocational Evaluation increased by 5%, and referrals to the Transitional Employment Program (TEP) remained the same. San Francisco Department of Human Services referred its first non-disabled client for COMPUTERS PLUS! training through the Calworks/PAES program.
Disabilities Served
There were some changes in patterns of persons served by type of disability. The percentage of persons served with orthopedic impairments increased slightly from 25% to 26%. Visually impaired individuals grew to 13% of those served (from 10%), while those with neurological impairments also grew to 13% (from 8%). Our significant categories of disability among consumers are now: Orthopedic, followed by Emotional, Chronic Disease (most commonly HIV+), Neurological and Visually Impaired. Other trends include an increase in hearing impaired and a decrease in drug/alcohol referrals. A new category last year was non-disabled PAES referrals for services.
Education Levels
Patterns of educational level show an increasing majority of consumers (65% vs. 62%) who claim some amount of postsecondary education. Only 6% percent acknowledge less than a high school education (down from 10%).
The overall average tested grade level for academic achievement decreased to 8.2 vs. 9.3. The relatively low academic achievement of consumers is addressed by remedial coursework in English and math in COMPUTERS PLUS! However, this does create challenges for achieving proficiency in computer skills as well as job placement.
Wide Representation of Diversity
Consumer ethnic patterns are very similar to the prior year, continuing a trend toward a predominantly non-white population, with Caucasians remaining at 38%, and significant numbers of blacks (23%), Asians (13%) and Hispanics (13%) served.
Vocational Evaluation…
99 clients had vocational evaluations this year under the DR case service contract (100 was goal). Questionnaires were sent to referring counselors to ascertain their satisfaction with vocational evaluation services. Fifteen responded, with 75% of counselors expressing "’satisfaction’ with response to referral questions" (last year was 100%); the goal was 90%. Prompt scheduling of clients also decreased from the prior year (61% vs. 80%) and was well below goal of 90%. Satisfaction with assisting referring counselors in setting vocational goals for client decreased from 93% to 75%. The written reports were judged clear and easy to read by 89%, a drop from 100% last year.
Forty-five consumers completed the post-service questionnaire, with 78% rating their overall evaluation experience as "above satisfactory" (goal was 70%), as compared to 25 people last year who all expressed satisfaction with vocational evaluation services. Average daily attendance increased from the prior year, from .83 to 1.09 (goal was 1.68.)
Vocational Evaluation services were negatively impacted by personnel health issues, requiring extended medical leaves and recruitment of substitute and replacement staff.
COMPUTERS PLUS! Department of Rehabilitation
We ended the year with 88 clients served (70 was goal), 26 served/mo (18 was goal) and 31 completions of training (25 was goal). 33 people received "Pre-Training Assessment" only (25 was goal); many of these individuals entered the Transitional Employment Program. The actual graduation rate of 54% (25/46) fell below the goal (60%.). The percent of graduates who started employment (57%) fell below goal (70%). Only 12 out of 21 were placed (3 individuals chose not to utilize employment services for various reasons). This low placement rate is partly a reflection of a very weak economy as well as the competition with displaced workers who have work experience and higher skills than needed for the jobs.
Average hourly wage rate decreased dramatically from the prior year ($10.24 vs $13.55/hour), but still above goal of $9.50/hour. Five of the 12 placed achieved successful 90-day job retention, a rate of only 42% (vs 71% last year). This was significantly below the goal of 85%. If the 2 additional clients who are pending 90-day retention are successful, the rate will increase to 58%. Consumer satisfaction remained well above goal with 82% of students rating their training experience "above satisfactory" (goal was 70%.) Average daily attendance grew from the prior year from 12.39 to 13.93, as compared with the goal of 14.4. (The monthly contract enrollment goals is 18, multiplied by a projected 80% attendance rate = 14.4 average daily attendance goal.)
COMPUTERS PLUS! Special Programs
Special Programs served/trained 19 individuals this year, with a graduation rate of 9, or 45%, below the goal of 60%. These individuals have multiple barriers to employment, either several disabilities or a disability combined with low skills, poor language understanding or abilities, and other socio-economic issues and may be referred to us without prior screening. They do not have the support system of the Department of Rehabilitation to minimize or assist with any of their issues. However, the percent of graduates who start employment was better than last year at 38% (vs 28%), although still well short of the goal of 60%. (Two dropped out due to receiving Workers’ Comp settlements.) Three graduates are still active in job search and if successful the placement rate would be increased to 75%. Consumer satisfaction remains well above goal (89% vs. 70%.) Special Programs graduates earned an average wage of $12.42, well above the goal of $9.50 per hour (but down from an average of $16.70/hr last year). 90-day job retention improved over the prior year to 100% (vs. 75%), above goal of 85%. However, 2 of the 3 individuals are employed at TEP (in other words, only one Special Programs graduate was placed in a job outside TEP.) ADA fell below the prior year (6.52 vs.5.36) and below the budgeted ADA of 7.11.
Transitional Employment Program
TEP serves clients with the most significant barriers to employment, often including no work history or a negative work history and poor work habits. Outcomes fell significantly from the prior year: there were many very challenging clients who failed to meet program standards. The graduation rate from TEP fell further below goal to 52% over the prior year (67%.). The percentage of graduates who obtain employment was 73% or 8 out of 11 (with 2 additional persons still seeking employment), exceeding goal of 55%. Five of the 8 persons placed, retained their employment (and 2 are pending 90-days). Hourly wage rates grew from $8.32 to $9.73, above goal of $8.50. Consumer satisfaction grew by 10 % to 83% (above the goal of 70%.) Average Daily Attendance declined slightly, (11.37 to 10.20).
Placement
131 consumers were served by Placement staff (PWI and VI programs) this year, which is an increase of 2, in FY 2001. The percentage of these individuals who have severe or multiple disabilities (often including a mix of physical and psychiatric disabilities) was 95% (125 individuals) and the percent who were unemployed more than 6 months prior to project entry is 69% (This is artificially low due to the 17 people who enter placement after doing a TEP internship, who then count as having recent employment). The SFVS Visually Impaired placement program placed 6 individuals (goal was 12). 57 PWI clients achieved successful placement. PWI goals were greatly exceeded for percent of long term unemployed served, and percent of persons with severe disabilities served and placed. Both of these barriers negatively impact the likelihood of placement success.
The number of jobs obtained this period increased. 87 consumers obtained employment (began jobs) this fiscal year, including 22 who began jobs at State Fund (19 as TEP participants and 3 as State Fund employees) as opposed to 61 last year (Note: TEP participants were not included in the placements counted last year). Many factors contribute to program underperformance. A weak economy has had a major negative impact: our job seekers faced strong competition for fewer job openings. In addition the length of time and number of applications needed to obtain a job has increased significantly in our area. Furthermore, it has been a challenge this year to maintain staffing, which has made it difficult to serve and place the number of clients targeted. In comparison to last year, the same number of qualified, job-ready individuals graduated from SFVS’ training programs including COMPUTERS PLUS! (both DR and Special Programs together graduated the same number: 34) as well as from TEP, but the number of direct placement referrals increased.
As other placement organizations and job search groups are also reporting, there was a decrease in average hourly wage over the prior year ($11.00 vs. $10.79). The 90-day job retention rate of 74% was significantly below goal of 90%, as well as below last year’s rate of 75%. Consumer satisfaction, with 20 survey responses, decreased significantly from the prior year (55% vs. 71%). Significant improvement was obtained in the percent of placed consumers who were quick to obtain employment (78% vs. 63%), approaching program goal of 70%. However, it must be realized that 19 people were hired at TEP, again demonstrating how important this source of employment and work experience is to SFVS.
|
|
|
SAN FRANCISCO VOCATIONAL SERVICES ALL CLIENTS CLIENT DESCRIPTORS REPORT OF 7/1/02 THROUGH 6/30/03 |
|
7/1/01 to 6/30/02 |
7/1/02 to 6/30/03 |
|||
|
Number |
Percent |
Number |
Percent |
|
|
1) Clients served |
317 |
100% |
316 |
100% |
|
2) Age: 18-25
|
24 49 109 95 40 |
8% 15% 34% 30% 13% |
24 52 100 91 49 |
8% 16% 33% 30% 13% |
|
3) Sex: Male Female |
168 149 |
53% 47% |
171 145 |
54% 46% |
|
4) Referral source: 1-Department of Rehabilitation 2-Private Insurance 3-Department of Human Services 4-Self 5-Other |
208 43 0
26 |
66% 14% 0%
7% |
239 39 2
14 |
76% 12% 1%
4% |
|
5) Primary Disability: 1-Visually impaired 2-Hearing impaired 3-Orthopedic 4-Emotional 5-Drug/alcohol 6-Developmentally Disabled 7-Chronic disease 8-Learning disabled 9-Neurological 10-Other 11-Non-Disabled PAES |
33 6 79 62 21 9 55 12 31 9 N/A |
10% 2% 25% 20% 7% 3% 17% 4% 8% 4% N/A |
43 10 80 56 12 10 45 11 40 8 1 |
13% 3% 26% 18% 3% 3% 14% 4% 13% 3% N/A |
|
6) Reason for referral: 1-Computers PLUS! Assessment 2-TEP Assessment 3-HEC Assessment 4-Direct placement 5-Vocational Evaluation 6-Training, No Assessment 7-WIA Assessments |
104
5 93 63 20 N/A |
33%
2% 29% 20% 6% N/A |
82
N/A 105 68 26 4 |
25%
N/A 33% 23% 8% 1% |
|
7) Educational Level 1-8th Grade or lower 2-Some high school 3-High school/equivalency 4-Some college 5-College graduate 6-Some graduate studies 7-Graduate school 8-Other |
4 27 88 129 51 6 9 3 |
1% 9% 28% 40% 16% 2% 3% 1% |
11 11 87 119 59 8 22 4 |
3% 3% 28% 38% 19% 2% 6% 1% |
|
8) Ethnicity: 1-Caucasian 2-Black (non-Hispanic) 3-Asian 4-Hispanic 5-Native American 6-Other 7-Multi-Ethnic |
119 69 44 42 5 26 12 |
38% 22% 14% 13% 2% 8% 3% |
120 72 42 41 3 27 11 |
38% 23% 13% 13% 1% 9% 3% |
|
9) TABE Grade level scores: Language Mechanics Language Expression Reading Comprehension Vocabulary Math Computation Math Concepts Spelling Overall |
8.4 8.9 10.4 10.0 8.8 8.9 8.5 9.3 |
8.1 9.0 9.7 10.2 7.9 8.9 8.4 8.2 |
|
SAN FRANCISCO VOCATIONAL SERVICES |
|||||
|
ANNUAL PROGRAM EVALUATION 7/1/02 to 6/30/03 |
|||||
|
|
|||||
|
PRIMARY OBJECTIVES |
MEASURE |
FOR YEAR |
FOR YEAR |
||
| ACTUAL | GOAL | ACTUAL | GOAL | ||
|
1) Develop clerical skills to meet job objectives |
Percentage of terminees achieving full competencies – ("graduation rate") |
56% |
60% |
53% |
60% |
|
2) Maximize employability1 |
Percentage of graduates placed in employment |
47% (3 of the 18 completors did not go on to placement: |
70% |
57% (4 of the 26 completors did not go on to placement: (1) refused contact post-graduation; |
70% |
|
3) Maximize income and independence1 |
Average hourly wage |
$13.55 |
$9.50 |
$10.24 |
$9.50 |
|
4) Maximize job retention1 |
90-day job retention rate
|
71% (2) more are pending 90-days. |
85% |
58% (1) was non-responsive to follow-up at 90-days. |
85% |
|
5) Consumer satisfaction |
Percentage of consumers rating overall training experience "Above Satisfactory" |
87% |
70% |
82% |
70% |
|
6) Program efficiency |
Average daily attendance |
12.39 |
18 |
13.93 |
18 |
1. Objectives 2, 3, and 4 based on clients who received placement services. Objectives 1, 5 and 6 based on all clients.
|
SAN FRANCISCO VOCATIONAL SERVICES |
|||||
|
ANNUAL PROGRAM EVALUATION 7/1/02 TO 6/30/03 |
|||||
|
Serving PAES, Workers Comp, CalWORKS, and WIA Clients |
|||||
|
PRIMARY OBJECTIVES |
MEASURE |
FOR YEAR |
FOR YEAR |
||
| ACTUAL | GOAL | ACTUAL | GOAL | ||
|
1) Develop clerical skills to meet job objectives |
Percentage of terminees achieving full competencies - ("graduation rate")
|
62% |
60% |
45% |
60% |
|
2) Maximize employability1 |
Percentage of graduates placed in employment |
28% (2 were not contracted for placement services); |
70% |
38% (1 of 9 completors was not provided placement services
due to relapse of disability) |
60% |
|
3) Maximize income and independence1 |
Average hourly wage |
$16.70 |
$9.50 |
$12.42 |
$9.50 |
|
4) Maximize job retention1 |
90-day job retention rate
|
75% (1 more is pending 90-days) |
85% |
100% |
85% |
|
5) Consumer satisfaction |
Percentage of consumers rating overall training experience "Above Satisfactory" |
86% |
70% |
89% |
70% |
|
6) Program efficiency |
Average daily attendance |
6.52 |
7.11 |
5.36 |
7.11 |
1. Objectives 2, 3, and 4 based on clients who received placement services. Objectives 1, 5 and 6 based on all clients.
|
SAN FRANCISCO VOCATIONAL SERVICES |
|||||
|
ANNUAL PROGRAM EVALUATION 7/1/02 TO 6/30/03 |
|||||
|
|
|||||
|
PRIMARY OBJECTIVES |
MEASURE |
FOR YEAR |
FOR YEAR |
||
| ACTUAL | GOAL | ACTUAL | GOAL | ||
|
1) Obtain valuable work skills |
Graduation rate: percentage of terminees who attain full competencies |
67% |
80% |
52% |
80% |
|
2) Obtain competitive employment |
Percentage of graduates who obtain employment |
56% (2 are active in job search; |
55% |
73% (1 ) was not transferred to placement) |
55% |
|
3) Obtain a competitive wage |
Average hourly wage |
$8.32 |
$8.50 |
$9.73 |
$8.50 |
|
4) Ensure adequate job adjustment and retention |
Percent obtaining 90-day job retention |
89% |
80% |
88% |
80% |
|
5) Consumer satisfaction |
Percentage of consumers rating overall training experience "Above Satisfactory" |
73% |
70% |
83% |
70% |
|
6) Program efficiency |
Average Daily Attendance |
11.37 |
12* |
10.20 |
12* |
*NOTE: TEP III was closed 12/31/01.
G:\PROGEVAL\2003\TEP12-03.doc
|
SAN FRANCISCO VOCATIONAL SERVICES |
||||||
|
ANNUAL PROGRAM EVALUATION 7/1/02 TO 6/30/03 |
||||||
|
|
||||||
|
PRIMARY OBJECTIVES |
MEASURE |
FOR YEAR |
FOR YEAR |
|||
| ACTUAL | GOAL | ACTUAL | GOAL | |||
|
1) Obtain competitive employment |
Percentage of persons obtaining 1st day of employment |
47% |
70% |
55% |
70% |
|
|
2) Obtain a competitive wage |
Average hourly wage |
$12.64 |
$8.75 |
$11.00 |
$8.75 |
|
|
3) Retain stable employment |
Percentage of placements retained 90 days |
75% (Includes 9 placements pending 90-day retention.) |
90% |
77% |
90% |
|
|
4) Place persons with significant disabilities |
Percent of persons placed who have significant disabilities |
79% |
85% |
100% |
85% |
|
|
5) Consumer satisfaction |
Percentage of consumers rating overall placement experience "Above Satisfactory" |
71% |
70% |
55% |
70% |
|
|
6) Program efficiency |
Percent who were quick to obtain appropriate employment (<120 days) |
63%* |
70% |
73%* |
70% |
|
* DATA REPRESENTS CONSUMERS WHO OBTAINED EMPLOYMENT 5/1/02 THROUGH 4/30/03
|
SAN FRANCISCO VOCATIONAL SERVICES |
|||||
|
ANNUAL PROGRAM EVALUATION 7/1/02 TO 6/30/03 |
|||||
|
|
|||||
|
PRIMARY OBJECTIVES |
MEASURE |
FOR YEAR |
FOR YEAR |
||
| ACTUAL | GOAL | ACTUAL | GOAL | ||
|
1) Appropriate response to referral questions |
Counselor questionnaire |
100% |
90% |
75% |
90% |
|
2) Prompt scheduling of referred client |
Counselor questionnaire |
80% |
90% |
61% |
90% |
|
3) Assist referring counselor in setting vocational goals for client |
Counselor questionnaire |
93% |
90% |
75% |
90% |
|
4) Written report clear and easy to read |
Counselor questionnaire |
100% |
90% |
89% |
90% |
|
5) Consumer satisfaction |
Percentage of consumers rating overall evaluation experience "Above Satisfactory" |
100% |
70% |
78% |
70% |
|
6) Program efficiency |
Average daily attendance |
.83 |
1.68 |
1.09 |
1.68 |
RETURN TO PROGRAM EVALUATION CHOICES
PROGRAM:
COMPUTERS PLUS! OFFICE SKILLS
TRAINING PROGRAM: