spacer State Government Victoria Australia Department of Health header
Victorian Government Health Information header
Victorian Government Website (Victoria the place to be)
spacer
spacer Health Home
Main A to Z Index | Site Map | About Health | Links  
Victoria's Mental Health Services
Because Mental Health Matters - Victorian Mental Health Reform Strategy 2009-2019

5. Workforce development

Expectations

Routine outcome measurement (consumer outcomes) was introduced in Australian clinical mental health services in 2003 as a key strategy of the national agenda to strengthen evidence based culture and practice. As collection of outcome measures is mandatory in all public (and private hospital) mental health services (with nationally agreed exceptions), ongoing training for clinical staff in accurately completing and using the measures is essential. Implementation of routine consumer outcomes is also reliant on effective leadership at all levels and building the capacity of information technology systems to produce meaningful reports. Increasing the knowledge and confidence in consumer outcomes among consumer and carer consultants will enhance collaborative practice and service improvement initiatives.

Action to consolidate systems for workforce development, consumer and carer involvement, improved reporting capability, and providing effective leadership have been developing in or across states and territories through Quality Through Outcomes funded activities and initiatives.

Consequently a range of resources have been developed to support consumer outcomes.

Establishment of sustainable and enduring systems for training will be a vital step for consolidation of a workforce capable of collecting and meaningfully using consumer outcomes in the future.

As an example, the Victorian Department of Health, Draft Victorian Outcome

Measurement Training Framework has been incorporated into the following sections detailing the competencies, minimum requirements and timeframe for the five types of training:

  • orientation
  • managers/leaders
  • clinicians
  • consumer and carer consultants (or their equivalents)
  • trainers.

Linking to key policies and strategies

  • The routine measurement of clinical outcomes is an initiative under the National Mental Health Strategy that was introduced across all clinical public mental health services in Australia in 2003-2004 and is now part of the third National Mental Health Plan 2003-2008.
  • Key Performance Indicators for Australian Public Mental Health Services (2005) report proposes a set of key performance indicators for use in Australia’s public sector mental health services that is based on the National Health Performance Framework and linked to the strategic directions of the National Mental Health Plan 2003-2008.
  • The measurement of consumer outcomes in mental health is compatible with the emphasis placed on high quality health services, consumer and carer participation and improving outcomes articulated in jurisdictional plans.

Roles and responsibilities

The roles and responsibilities related to training and workforce development should be articulated for each of the following key stakeholders:

  • Australian Mental Health Outcomes and Casemix Network (AMHOCN)
  • jurisdictional departments
  • funded consumer outcome positions/programs
  • mental health services
  • funded training, education and workforce development programs
  • trainers – funded and portfolio holders
  • consumer and carer consultants (or their equivalents)
  • participants of consumer outcomes training.

In addition to formalised training sessions the full potential for consumer outcomes in clinical practice and in ensuring data integrity will require a commitment by mental health clinicians and services to the development of ‘learning environments’ where consumer outcomes are routinely used and applications are further developed. Examples of these would include clinical review meetings, clinical/operational supervision, peer mentoring etc. There is also a role for other development activities such as annual Australasian Mental Health Outcomes Conference, statewide forums and research activities. For more information visit: http://amhoc2008.com.au

Top of page

Training delivery

Initial materials were developed in 2002. The Australian Mental Health Outcomes and Casemix Classification Network (AMHOCN) developed and distributed basic training materials in 2005 and clinical utility materials in 2006.

In the absence of a nationally articulated outcome measurement framework, the following competency areas, minimum requirements and recommendation duration were taken from a Draft Victorian Outcome Measurement Training Framework.

The Australian Mental Health Outcomes and Casemix Classification Network (AMHOCN) have carriage for NOCC training accreditation. A national training framework, including NOCC rater certification and trainer accreditation and e-learning for NOCC, will in part be developed through AMHOC 2008 pre-conference workshop November 2008. Following this workshop a discussion paper will be developed and contribution sought from the mental health sector.

Each state and territory has developed and implemented different training models. Despite this difference there is a shared recognition that training is required at different levels dependent on target audience. Generally there are three tiers of training requirements from orientation, basic or rater training and utility. Experience suggests that inclusion of clinical utility training with the rater training is beneficial. In addition to the types or tiers of training required it has also been identified that training needs differ dependent on the target audience with three key groups identified, managers/leaders, mental health clinicians as well as consumer and carer consultants.

Bearing in mind the specific training requirements and models utilised in each state and territory the following proposed training components are included in an attempt to differentiate between the training requirements as a guide only.

Example orientation components

Competency areas

 

Minimum

requirements

Recommended

duration

Initial orientation to consumer outcomes

  • Introductory knowledge of the NOCC measures
  • Knowledge of the collection protocol for specific
  • work setting
  • Introductory knowledge of rating rules for NOCC
  • measures used in that setting
  • Knowledge of local data system including entry/extraction processes

Within first week of employment
(Could be done one-on-one)

 

30 – 60 minutes

 

Formal orientation to consumer outcomes

  • Knowledge of the context and history of NOCC implementation
  • Understanding of the purpose of NOCC collection
  • Knowledge of the collection protocol for all settings
  • Beginner understanding of all of the NOCC outcome measures

Within 2 months of commencing employment
(Optional if core competency clinician training completed within that time period)

60 – 90 minutes

 

5.1 Managers

Example managers/leaders training components

This training is designed for staff employed in leadership/supervisory/management roles involved in the use but not the completion of the measures.

Competency areas

 

Minimum

requirements

Recommended

duration

Opportunity to workshop possibilities for mental health information

  • Develop mental health information literacy
  • Explore role and possibilities of supporting functions for developing and using mental health information
  • Developing a culture of enquiry and developing an understanding of how to sustain quality mental health information collection and utilisation
  • Skill development to analyse aggregate data to see if changes/improvements to system are happening
  • Explore strategies for motivating staff to value the collection and use mental health information

Within first month

 

2 hour blocks

or a half day

 

Overview of consumer outcomes – collection and utility

  • Knowledge of the context, history and purpose of NOCC
  • Knowledge of items that each of the measures cover
  • Awareness of the challenges and opportunities for the consumer self-assessment process
  • Detailed knowledge of the collection protocol
  • Understanding and interpreting individual consumer reports
  • Overview of how consumer outcomes can be utilised in clinical practice including clinical decision making (reviews/care plans), also with consumers and carers
  • Knowledge of available aggregate data

In addition to this session manager should attend a clinical review to observe use of consumer data in clinical decision making.

Within first month

(Not required if clinical core competency basic and advanced have been completed)

 

Consumer outcome data informing service quality

Skill development to enable interpretation and application of aggregated consumer outcome data presented at the:

  • Team or service level to better manage teams/services
  • Team or service level to inform service planning
  • Jurisdiction and national level to understand individual consumers (DST), trends and service profiles.
  • Awareness of how the team/unit/service “looks” according to what they have collected such as service/team profile, complexity of cases, clinical significance, outcomes demonstrated etc. (where these reports exist)

While primarily delivered to mangers and team leaders this session would be useful for all mental health staff involved in using consumer outcome aggregate data.

Workforce development

 

90 – 120 minutes

 

Top of page

5.2 Clinicians

Mental health clinicians have considerable skills, knowledge and expertise having undertaken discipline specific undergraduate degrees and for some postgraduate qualifications. Professional development opportunities and access to supervision varies considerably across mental health services.

Participation in the consumer outcomes initiative affects nearly all aspects of clinical service delivery and most clinicians will have areas where their skills and knowledge excel and also areas that require further skill development.

Child and adolescent mental health clinicians require specific training in CAMHS consumer outcomes while adult and older person measures can be trained either in combination or separately.

Consumer and carer involvement in consumer outcomes training for clinicians is a powerful way of promoting:

  • The value of collecting and using measurement tools.
  • That clinician rated and self-rated measures provide opportunities to elicit multiple perspectives.
  • Measurement tools can assist in prioritising and negotiating goals.
  • Utilisation of existing programs/training strategies would provide an avenue for sustainable consumer outcome training, such as:
  • Identification and integration of consumer outcome training into broader discipline based activities, for example graduate nurse programs and psychiatric registrar rotations, would ensure that consumer outcomes are understood and integrated as a mandatory clinical activity.
  • Mental health training providers.
  • Universities, particularly postgraduate degrees.

Generic skill requirements

Ongoing skill development in the following areas will enable active participation in consumer outcomes:

  • knowledge and understanding of consumer outcomes - rationale, how to rate the measures and use of consumer outcomes ratings
  • ability to interpret consumer ratings and engage in dialogue with consumer
  • ability to offer the self-assessment including a rationale, instilling value in the process and ensuring time to explore issues/fears
  • understanding clinical information systems
  • ability to provide support and possibly assistance to consumers in the completion of the self-assessment
  • ability to facilitate meaningful dialogue on consumer outcomes with consumers and carers
  • skills in clinical review preparation, presentation and documentation
  • skills in incorporating consumer outcomes into care planning.

Example

Rate an existing consumer as a group

This activity is perhaps more useful in teams where there are more than one clinician involved in the consumer care. Rating as a group is an opportunity to share perspectives, developing an understanding, and confidence of the measures and engaging collaborative information exchange, development of the use of a consistent terminology and language.

Subsequently this technique can improve inter-rater reliability.

All services hold regular staff meetings that discuss clinical issues, business information (service changes, new policies/procedures etc) and provide a space for staff development (external and internal presentations). Some services have embedded consumer outcomes into these meetings in the staff development component. For example one staff member leads the discussion by utilising one of the examples from this resource:

  • case-manager describing how they introduced and talked about consumer outcomes with a consumer.
  • Consultant psychiatrist presenting information about discrepancies between clinical perception (HoNOS and LSP-16 ratings) and consumer perception (for example, BASIS-32® ratings) for discussion by all staff.

Top of page

Example clinician training components

Competency areas

 

Minimum

requirements

Recommended

duration

Rater training

  • Knowledge of the context, history and purpose of NOCC
  • Detailed knowledge of the collection protocol
  • Knowledge of the rating rules for clinician rated consumer outcome measures
  • Skills in completing HoNOS suites through practice ratings of clinical vignettes
  • Knowledge of suite of NOCC measures
  • Awareness of the challenges and opportunities for the consumer self-assessment process
  • Skills in offering consumer self-assessments
  • Beginner understanding of consumer level reports
  • Awareness of possibility for consumer outcomes in clinical practice

Refresher training - rater

For clinicians who have already had previous training in NOCC measures and some experience in collection:

  • Enhanced skills in effective/accurate rating.
  • Improved inter-rater reliability.
  • Enhanced experience/skill in use of measures at clinical level.
  • Enhanced understanding of information use and need to collect quality information.

Other strategies to enhance inter-rater reliability include:

a)   Refresher training sessions – including rating new clinical vignettes, revision of rating rules.

b)   Discussion of ratings in clinical review meetings.

c)   Team rating a known consumer and comparing ratings.

d)   Rating training vignettes individually or as a team.

All mental health clinicians should complete this training within 2 months of commencement of employment within a mental health service (or when a change in age setting occurs).

a) & d) Annually

b) & c) Regularly

Half day

a) 120 minutes

b) 5-10 minutes

c) 15 -20 minutes

d) 10 minutes

Advanced clinical training:

  • Understanding and interpreting individual consumer reports.
  • Skills in discussing consumer outcomes with consumers and carers.
  • Knowledge of, and skills in, utilising consumer outcomes in clinical practice (e.g. care plans, clinical review, discharge planning).
  • Skills in accessing and interpreting clinical reference material (e.g. compare individual consumer scores with clinical reference material available nationally on DST).
  • Knowledge of, and skills in, utilising consumer outcomes in service planning and evaluation.
  • Awareness of how the team/unit/service “looks” according to what they have collected such as service/team profile, complexity of cases, clinical significance, outcomes demonstrated etc (where access to these types of reports is possible).

All mental health clinicians should complete this training within 2 months of commencement of employment in a mental health service (or when a change in age setting occurs).

 

Half day

Using consumer outcomes should be explored regularly in routine meetings.

 

5.3 Consumer and carer consultants (or equivalent)

Consumer and carer consultants as discussed here refer to roles employed by mental health services.

Consumer and carer consultant/advisor roles vary across states and territories but it is suffice to say that these roles are fundamentally designed to support and assist in improving outcomes for people receiving mental health services. While consumer and carers bring a wealth of personal experience and knowledge to these roles, they also require opportunities for professional development and training. Currently, skill building for consumer and carer consultants has not been prioritised.

Consumer and carer consultants or advisors have the potential to play a pivotal role in consumer outcomes providing that they are:

  • Not expected to be the primary engager of consumers and carers in consumer outcomes, this is a service wide responsibility with clinicians taking the primary role.
  • Provided with key materials and resources related to consumer outcomes.
  • Provided opportunities to develop skills to interpret consumer outcome information to use it for service quality.
  • Offered professional development opportunities to enhance general skills as well as focused sessions on consumer outcomes including creative ways for managing resistance.

Top of page

Example consumer and carer consultant training components

Competency areas

 

Minimum
requirements

Recommended
duration

Opportunity to workshop possibilities for mental health information:

  1. Introduction to mental health information development.
  2. Clarify role opportunities in developing and using mental health information.
  3. Identification of opportunities to utilise aggregate data, including what is available.
  4. Explore strategies for ensuring a focus on the consumer perspective remains on the consumer outcome agenda.
  5. Skill development to analyse aggregate data to see if changes/ improvements to system are happening.

 

Within 3 months

 

2hour blocks

 

Overview of consumer outcomes – collection and utility: or a half day

  1. Knowledge of the context, history and purpose of NOCC.
  2. Knowledge of items that each of the measures cover.
  3. Awareness of the challenges and opportunities for the consumer self-assessment process.
  4. An awareness of the collection protocol.
  5. Overview of how consumer outcomes can be utilised in clinical practice including clinical decision making (reviews/care plans), also with consumers and carers.
  6. An overview on how consumer outcomes can be used with consumers and carers.

Within 6 months

 

Co-facilitators/trainers (consumer and carer consultants):

  1. Knowledge and skills in training.
  2. Awareness of data collection and reporting systems.
  3. Knowledge of the challenges and opportunities for the consumer self-assessment process.
  4. Working knowledge and use of training materials and other resources (e.g. Decision Support Tool).
  5. Knowledge of common areas of misunderstanding/errors with consumer outcome collection and their resolution.
  6. Skills in responding to frequently asked questions.
  7. Confidence and support to challenge participants assumptions regarding the consumer self-assessment process.
  1. Has a recognised role in consumer outcomes training
  2. Completed all relevant consumer outcomes training
  3. Values:
  4. information development, collection and use

- consumer and carer perspectives, participation and consumer self-assessment process

 

Half day

 

5.4 Trainers

There is considerable variation across jurisdictions regarding the appointment, capacity (formalised training role), qualifications (Cert IV in workplace assessment and training etc) and requirements for trainers in consumer outcomes. Jurisdictions have also implemented quite different training programs including:

  • train-the-trainer model
  • small pool of appointed staff
  • accredited trainers.

The provision of training in a number of jurisdictions is undertaken by trainers as an add-on to their primary role. The sustainability for training and trainer requirements continues to be an area for development.

There have been a number of identified benefits from involving consumers and carer consultants in training clinicians in consumer outcomes:

  • positive response from clinicians
  • felt their involvement made a difference
  • more confident about being involved in training
  • raised profile within service.

Example trainers training components

Competency areas

Minimum requirements

Recommended

duration

Trainers (clinicians) providing clinical core competency – rater/advanced training:

  • Knowledge and skills in training.
  • Knowledge in data collection and reporting systems and capacity to translate knowledge to participants.
  • Awareness of the challenges and opportunities for the consumer self-assessment process.
  • Working knowledge and use of training materials and other resources (e.g. Decision Support Tool).
  • Knowledge of common areas of misunderstanding/errors with consumer outcome collection and their resolution.
  • Skills in responding to frequently asked questions.
  • Skills in challenging participants assumptions regarding the consumer self-assessment process.

 

  • Has a recognised role in consumer outcomes training.
  • Generic skills as a trainer.
  • Values information development, collection and use.
  • Values consumer and carer perspectives, participation and consumer self-assessment process.
  • Completed consumer outcome rater and advanced training.
  • Experience in using consumer outcomes in clinical practice.

 

Half day

 

Top of page

Last updated: 4 August, 2009
This Web site is managed by the Mental Health, Drugs & Regions Division of the State Government Department of Health, Victoria, Australia

Copyright | Disclaimer | Privacy Statement | State Government of Victoria Home | Download Help

For general enquiries to the Department of Health telephone 61 3 90960000