HVAC Excellence Exam Development Process

Content - HVAC Excellence exam content is developed through the input of technical experts within focus groups of subject matter experts (SME’s). In the development of the individual exams, a minimum of five and a maximum of nine technical experts from at least three states were selected. The focus groups used job and task analysis to pinpoint the common and critical issues to be included in each certification exam. The SME’s also identified other elements of the occupations, such as: tools, equipment, and work environment.
Structure - After the job and task analysis is completed, the focus group; developed the structure of the exam. The exam items were then generated from a table of test specifications.

Pilot Testing - All HVAC Excellence exams are pilot tested prior to release. Individuals were selected whose experience approximated the target level of the test.

Item Analysis - An item analysis is conducted, technically reviewing the structure, response, and fit of each item and the relationship of that item to the rest of the exam.

Final Formatting - The item analysis is designed to reveal items that are not effective. These items are either eliminated or modified.

Continuing Analysis - Test results are monitored on a regular basis. As score anomalies occur, whole tests or individual items are scrutinized for problems. All tests are reviewed on a three year basis. The exams are living documents and are reviewed and modified to adjust to changes within technology and our industry. We are always mindful of the need to provide quality service for the existing legacy equipment that will remain in use for years.