Validity refers to the extent to which the assessment measures what it intends to measure, in other words, the competency and performance criteria of the applicable competency framework. An assessment judgement is valid if the assessed activities, according to the methods and tools used, integrate the required knowledge and skills and demonstrate the ability to apply these in a workplace task. A team made up of assessors and supervisors should review assessment tools to decide if they trust that validity will be met by the evidence they will gather. The tools can be modified over time, based on observed outcomes, to increase the validity of assessment methods.
Reliability refers to the level of consistency and accuracy of
the assessment outcomes (judgements on competence) for all individuals being assessed. Assessment outcomes should also be consistent at different times and places, and regardless of the specific assessor conducting the assessment. Given the variability in assessment tools and assessment situations (for example, simulation contexts, interpretations of questions, and variable day-to-day conditions of on-the-job observations), 100% reliability is impossible to achieve. But with good assessment design, practice and observation of results, one can gain trust that sufficient reliability is reached. Using multiple tools is likely to increase reliability by increasing the amount of evidence.
Flexibility refers to the opportunity for individuals to negotiate some aspects of their assessment, such as the time and place. All candidates should be fully informed of the purpose of competency assessment, the assessment criteria,
the methods and tools that will be used, and the context and timing of the
assessment. When the workforce is dispersed across a varied geographical area, some conditions of assessment might need to be customized to appropriately meet workplace conditions.
Fairness refers to assessment methods that do not advantage or disadvantage particular individuals or groups of individuals. Assessment
methods may need to be adjusted for particular candidates (such as people with
disabilities or from different cultural backgrounds) to ensure that the
methods used do not create adverse conditions that might prevent them from
demonstrating competence. For example, an assessment should not demand a
higher level of English language skills than that required to
perform the workplace standards described in the competencies and job description. It should also not demand skills of using tools and data products typically unavailable to the individual.