115759 Conduct moderation of outcomes-based assessments

SOUTH AFRICAN QUALIFICATIONS AUTHORITY

REGISTERED UNIT STANDARD:

 

Conduct moderation of outcomes-based assessments

SAQA US ID UNIT STANDARD TITLE

115759            Conduct moderation of outcomes-based assessments

ORIGINATOR          ORIGINATING PROVIDER

SGB Assessor Standards

QUALITY ASSURING BODY

ETDP SETA – Education, Training and Development Practices Sector Education and Training Authority

FIELD            SUBFIELD

Field 05 – Education, Training and Development      Higher Education and Training

ABET BAND UNIT STANDARD TYPE    PRE-2009 NQF LEVEL        NQF LEVEL  CREDITS

Undefined       Regular            Level 6            Level TBA: Pre-2009 was L6             10

REGISTRATION STATUS  REGISTRATION START DATE     REGISTRATION END DATE         SAQA DECISION NUMBER

Reregistered    2012-07-01      2015-06-30      SAQA 0695/12

LAST DATE FOR ENROLMENT   LAST DATE FOR ACHIEVEMENT

2016-06-30                   2019-06-30

 

In all of the tables in this document, both the pre-2009 NQF Level and the NQF Level is shown. In the text (purpose statements, qualification rules, etc), any references to NQF Levels are to the pre-2009 levels unless specifically stated otherwise.

 

This unit standard replaces:

US ID Unit Standard Title     Pre-2009 NQF Level  NQF Level      Credits            Replacement Status

9929    Moderate an assessment         Level 5            Level TBA: Pre-2009 was L5             12        Complete

7977    Moderate Assessment             Level 6            Level TBA: Pre-2009 was L6             10        Complete

 

PURPOSE OF THE UNIT STANDARD

This unit standard is for people who conduct internal or external moderation of outcomes-based assessments. The assessments could be in terms of outcomes defined in a number of documents, including but not limited to unit standards, exit level outcomes, assessment standards, curriculum statements and qualifications. This unit standard will contribute towards the achievement of a variety of qualifications particularly within the field of Education Training and Development Practices and Human Resource Development.

 

Those who have achieved this unit standard will be able to moderate assessments in terms of the relevant outcome statements and quality assurance requirements. The candidate-moderator will be able to use the prescribed Quality Assurance procedures in a fair, valid, reliable and practicable manner that is free of all bias and discrimination, paying particular attention to the three groups targeted for redress: race, gender and disability.

 

In particular, people credited with this unit standard are able to:

Demonstrate understanding of moderation within the context of an outcomes-based assessment system,

Plan and prepare for moderation,

Conduct moderation,

Advise and support assessors,

Report, record and administer moderation, and

Review moderation systems and processes.

 

LEARNING ASSUMED TO BE IN PLACE AND RECOGNITION OF PRIOR LEARNING

The credit calculation is based on the assumption that learners have previous assessment experience when starting to learn towards this unit standard, and in particular, recognition for the unit standard: NLRD 115753: “Conduct outcomes-based assessments”. It is recommended that candidates should achieve NLRD 115755: “Design and develop outcomes-based assessments” before attempting this unit standard:

 

It is further assumed that the person has evaluative expertise within the field in which they are moderating assessments.

 

UNIT STANDARD RANGE

1. This is a generic unit standard, and applies to internal and/or external moderation within all fields of learning. It is accepted that moderation happens in different ways and at different levels in different sectors, including different models for what constitutes internal versus external moderation. This standard is intended to cover any situation in which moderation occurs, whether this be internally, i.e. within the ambit of the provider-assessor, or externally through cooperating providers, or externally through professional bodies and quality assurance bodies.

 

2. Assessment of candidate-moderators will only be valid for award of this unit standard if the following requirements are met:

Moderation is carried out for assessments that include candidates with special needs, and RPL situations. Where real assessments are not available to cover these situations, the candidate is able to demonstrate how special needs and RPL situations would be addressed within their moderation plan and process.

Moderation covers assessment instruments, assessment design and methodology, assessment records; assessment decisions, reporting and feedback mechanisms.

Moderation is carried out for assessments involving a variety of assessment techniques, such as work samples, simulations, role-plays, written items, oral, portfolios and projects.

Moderation activities include pre-assessment interactions with assessors, interactions during assessments and post-assessment interactions.

Moderation involves at least two sets of real assessment materials for the same standards and at least six assessor decisions.

The assessments that are moderated are in relation to a significant, meaningful and coherent outcome statement that includes assessment criteria and allows for judgements of competence in line with SAQA’s definition of competence i.e. embraces foundational, practical and reflexive dimensions of competence. This means that moderation of simple, single-task assessments will not be valid for awarding this unit standard.

 

3. For the purposes of assessment against this unit standard, candidate-moderators should have access to organisational assessment and moderation policies, procedures and systems. It is assumed the organisational policies and procedures are of a quality sufficient for accreditation purposes. Where candidate-moderators are assessed in organisations that do not have a moderation system in place, assessors of moderators should provide a mock system for the purposes of the assessment.

 

4. This unit standard applies to all Moderators, regardless of whether a person carries out moderation internally, as part of an organisation’s quality assurance system, or externally, as part of an ETQA or other process to verify assessment results supplied by the provider or assessment agency.

 

Further range statements are provided in the body of the unit standard where they apply to particular specific outcomes or assessment criteria.

 

Specific Outcomes and Assessment Criteria:

 

SPECIFIC OUTCOME 1

Demonstrate understanding of moderation within the context of an outcomes-based assessment system.

 

ASSESSMENT CRITERIA

 

ASSESSMENT CRITERION 1

Moderation is explained in terms of its contribution to quality assured assessment and recognition systems within the context of principles and regulations concerning the NQF.

 

ASSESSMENT CRITERION 2

A variety of moderation methods are described and compared in terms of strengths, weaknesses and applications. The descriptions show how moderation is intended to uphold the need for manageable, credible and reliable assessments.

 

ASSESSMENT CRITERION 3

Key principles of assessment are described in terms of their importance and effect on the assessment and the application of the assessment results. Examples are provided to show how moderation may be effective in ensuring the principles of assessment are upheld.

ASSESSMENT CRITERION RANGE

See “Definition of Terms” for a definition of assessment principles.

 

 

ASSESSMENT CRITERION 4

Examples are provided to show how moderation activities could verify the fairness and appropriateness of assessment methods and activities used by assessors in different assessment situations.

ASSESSMENT CRITERION RANGE

Assessment situations for gathering evidence of abilities in problem solving, knowledge, understanding, practical and technical skills, personal and attitudinal skills and values.

 

 

SPECIFIC OUTCOME 2

Plan and prepare for moderation.

OUTCOME RANGE

The planning and preparation is to take place within the context of an existing moderation system, whether internal or external, as well as an existing assessment plan.

 

ASSESSMENT CRITERIA

 

ASSESSMENT CRITERION 1

Planning and preparation activities are aligned with moderation system requirements.

 

ASSESSMENT CRITERION 2

The scope of the moderation is confirmed with relevant parties.

ASSESSMENT CRITERION RANGE

Parties include the assessors and moderating bodies where these exist.

 

 

ASSESSMENT CRITERION 3

Planning of the extent of moderation and methods of moderation ensures manageability of the process. Planning makes provision for sufficient moderation evidence to enable a reliable judgement to be passed on the assessments under review.

 

ASSESSMENT CRITERION 4

The contexts of the assessments under review are clarified with the assessors or assessment agency, and special needs are taken into consideration in the moderation planning.

 

ASSESSMENT CRITERION 5

Moderation methods and processes are sufficient to deal with all common forms of evidence for the assessments to be moderated, including evidence gathered for recognition of prior learning.

 

ASSESSMENT CRITERION 6

The documentation is prepared in line with the moderation system requirements and in such a way as to ensure moderation decisions are clearly documented.

 

ASSESSMENT CRITERION 7

Required physical and human resources are ensured to be ready and available for use. Logistical arrangements are confirmed with relevant role-players prior to the moderation.

 

SPECIFIC OUTCOME 3

Conduct moderation.

OUTCOME RANGE

Moderation to address the design of the assessment, activities before, during and after assessment, and assessment documentation.

Moderation to include assessments of candidates with special needs and for RPL cases. Where assessments do not include special needs or RPL cases, evidence for this may be produced through scenarios.

Evidence must be gathered for on-site and off-site moderation.

Evidence must be show candidate-moderators are able to moderate in situations where:

– The moderation process confirms the assessment results, and where

– The moderation process finds it cannot uphold the assessment results.

 

ASSESSMENT CRITERIA

 

ASSESSMENT CRITERION 1

The moderation is conducted in accordance with the moderation plan. Unforeseen events are handled without compromising the validity of the moderation.

 

ASSESSMENT CRITERION 2

The assessment instruments and process are checked and judged in terms of the extent to which the principles of good assessment are upheld.

ASSESSMENT CRITERION RANGE

See “Definitions of Terms” for definitions of assessment principles.

 

 

ASSESSMENT CRITERION 3

Moderation confirms that special needs of candidates have been provided for but without compromising the requirements specified in the relevant outcome statements.

 

ASSESSMENT CRITERION 4

The proportion of assessments selected for checking meets the quality assurance body’s requirements for consistency and reliability. The use of time and resources is justified by the assessment history or record of the assessors and/or assessment agency under consideration.

 

ASSESSMENT CRITERION 5

Appeals against assessment decisions are handled in accordance with organisational appeal procedures.

 

ASSESSMENT CRITERION 6

The moderation decision is consistent with the quality assurance body’s requirements for fairness, validity and reliability of assessments to be achieved.

ASSESSMENT CRITERION RANGE

The “moderation decision” includes agreement or disagreement with the results of the assessments.

requirements include the interpretation of assessment criteria and correct application of assessment procedures.

 

 

SPECIFIC OUTCOME 4

Advise and support assessors.

 

ASSESSMENT CRITERIA

 

ASSESSMENT CRITERION 1

The nature and quality of advice facilitates a common understanding of the relevant outcomes and criteria, and issues related to their assessment by assessors.

 

ASSESSMENT CRITERION 2

The nature and quality of advice promotes assessment in accordance with good assessment principles and enhances the development and maintenance of quality management systems in line with ETQA requirements.

ASSESSMENT CRITERION RANGE

Advice on quality management systems includes planning, staffing, resourcing, training and recording systems.

 

 

ASSESSMENT CRITERION 3

Support contributes towards the further development of assessors as needed.

 

ASSESSMENT CRITERION 4

All communications are conducted in accordance with relevant confidentiality requirements.

 

SPECIFIC OUTCOME 5

Report, record and administer moderation.

 

ASSESSMENT CRITERIA

 

ASSESSMENT CRITERION 1

Moderation findings are reported to designated role-players within agreed time-frames and according to the quality assurance body’s requirements for format and content.

ASSESSMENT CRITERION RANGE

Role-players could include ETQA or Moderating Body personnel, internal or external moderators and assessors.

 

 

ASSESSMENT CRITERION 2

Records are maintained in accordance with organisational quality assurance and ETQA requirements.

 

ASSESSMENT CRITERION 3

Confidentiality of information relating to candidates and assessors is preserved in accordance with organisational quality assurance and ETQA requirements.

 

SPECIFIC OUTCOME 6

Review moderation systems and processes.

 

ASSESSMENT CRITERIA

 

ASSESSMENT CRITERION 1

Strengths and weaknesses of moderation systems and processes are identified in terms of their manageability and effectiveness in facilitating judgements on the quality and validity of assessment decisions.

 

ASSESSMENT CRITERION 2

Recommendations contribute towards the improvement of moderation systems and processes in line with ETQA requirements and overall manageability.

 

ASSESSMENT CRITERION 3

The review enhances the credibility and integrity of the recognition system.

 

 

UNIT STANDARD ACCREDITATION AND MODERATION OPTIONS

A candidate-moderator wishing to be assessed, against this unit standard may apply to an assessment agency, assessor or provider institution accredited by the relevant ETQA.

Anyone assessing a candidate-moderator against this unit standard must meet the assessor requirements of the relevant ETQA. In particular, such assessors of candidate-moderators must demonstrate that they assess in terms of the scope and context defined in all the range statements.

Any institution offering learning towards this unit standard must be accredited as a provider with the relevant ETQA.

External moderation of assessment will be conducted by the relevant ETQA at its discretion.

 

UNIT STANDARD ESSENTIAL EMBEDDED KNOWLEDGE

The following knowledge is embedded within the unit standard, and will be assessed directly or indirectly through assessment of the specific outcomes in terms of the assessment criteria:

Outcomes-based education, training and development

The role and function of moderation – directly assessed through assessment criterion ‘Moderation is explained in terms of its contribution to quality assured assessment and recognition systems within the context of principles and regulations concerning the NQF.’ and indirectly assessed throughout the unit standard.

Moderation methods – directly assessed through assessment criterion ‘A variety of moderation methods are described and compared in terms of strengths, weaknesses and applications. The descriptions show how moderation is intended to uphold the need for manageable, credible and reliable assessments.’ and ‘Moderation methods and processes are sufficient to deal with all common forms of evidence for the assessments to be moderated, including evidence gathered for recognition of prior learning.’, and indirectly assessed through application throughout the standard.

Principles of assessment – directly assessed through assessment criterion ‘Key principles of assessment are described in terms of their importance and effect on the assessment and the application of the assessment results. Examples are provided to show how moderation may be effective in ensuring the principles of assessment are upheld.’, and indirectly assessed via a requirement to judge whether the principles are applied by assessors.

Principles and practices of RPL – assessed in terms of the requirement for candidate moderators to moderate RPL-related assessments.

Methods of assessment – directly assessed through assessment criterion ‘Examples are provided to show how moderation activities could verify the fairness and appropriateness of assessment methods and activities used by assessors in different assessment situations’, and indirectly when checking the appropriateness and fairness of assessment methods used by assessors

Potential barriers to assessment – assessed when dealing with special needs.

The principles and mechanisms of the NQF – this knowledge underpins the standard

Assessment policies and ETQA requirements

Knowledge of quality assurance policy and procedures

Understanding of organisational or institutional contexts

Understanding the curriculum (where applicable).

 

UNIT STANDARD DEVELOPMENTAL OUTCOME

N/A

 

UNIT STANDARD LINKAGES

N/A

 

 

Critical Cross-field Outcomes (CCFO):

 

UNIT STANDARD CCFO IDENTIFYING

Identify and solve problems using critical and creative thinking: planning for contingencies, candidates with special needs, problems that arise during moderation, suggesting changes to moderation following review.

 

UNIT STANDARD CCFO WORKING

Work effectively in a team using critical and creative thinking: working with assessors and other relevant parties during moderation, as well as post-moderation.

 

UNIT STANDARD CCFO ORGANISING

Organize and manage oneself and ones activities: planning, preparing, conducting and recording the moderation.

 

UNIT STANDARD CCFO COLLECTING

Collect, analyse, organize and critically evaluate information: gather, evaluate and judge evidence and the assessment process.

 

UNIT STANDARD CCFO COMMUNICATING

Communicate effectively: communicate with assessors and other relevant parties during moderation, and provide feedback.

 

UNIT STANDARD CCFO DEMONSTRATING

Demonstrate the world as a set of related systems: understanding the impact of moderation assessment on individuals, organisations and the credibility of recognition through NQF systems.

 

UNIT STANDARD CCFO CONTRIBUTING

Be culturally and aesthetically sensitive across a range of social contexts: plan, conduct and give feedback on moderation in a culturally sensitive manner.

TRAINYOUCAN NETWORK ONLINE STATUS