‍ Welcome to the RLTS Competency Profile Review Page

‍The National Coordination Center (NCC), in conjunction with the RLTS Steering Committee is responsible for implementing consistent training standards across federal and state levels. This centralized governance ensures that quality remains uniform even as the system expands to include academic, industry, and private providers.

‍These instructions provide a structured process to evaluate a training resource to determine the resource competency profile ensuring it accurately addresses the competency before it is listed in the national catalog.

‍Requesting Access to the RTLS Portal and locating courses to review

‍To access the learning resources that you have been assigned to review, you will first need to request access to the RLTS Portal. Please use this link to request access to the portal. Once you follow the prompts through the link, you will be sent an email with instructions for creating a username and password for your RLTS portal account.

‍Once you have your account set up and are logged in, you will see the homepage for the RLTS portal. This homepage is the view that all users will have access to. As an RLTS reviewer, you have access to the “RLTS Tasks” dashboard as well. To locate this dashboard, look at the blue panel on the left-hand side of your screen. Please click on the “RLTS Tasks” button.

Once you are in the RLTS Task Management dashboard, please click on the “Competency Reviewer Tasks” to view the learning resources you have been assigned.

‍Competency Review Instructions

‍Once you have identified a learning resource available for review, click on the learning resource to review all contents.

‍You will notice the name of learning resource at the top of the page in bold print.  Directly under the name you find 5 independent steps to follow:‍ ‍

• Learning Resource Information

• System Competency Selection

• Competency Selection Evaluation Report

• Confirm Competencies

• Complete Review

‍Within the Learning Resource Information section, you will find the following learning resource descriptors and materials for your review these have been included by the submitter.

• Learning Resource Name

• Delivery Modality

• Learning Resource Material‍

• Learning Resource Description‍

• Learning Objectives

Consider as Stage 1 (all AI ‍competencies selected shown here)

‍Within the System Competency Selection section, you will find the competency comparison of the Learning Resource materials that have been submitted for review and the NCS Framework competencies.

NOTE: Each box indicates the Enabling Learning Objective in bold print, while identifying the Framework, Level within the framework, Content Area within the framework.

‍Click your cursor anywhere within the box to identify the Competency Learning Pathways, including the percent competency match of each framework Learning Pathway., Topic Area, Terminal Competencies and Behavioral Anchors.

‍Within the Competency Selection Evaluation Report, you will find the Matched Competencies, indicating the percent confidence of selected competencies. This will assist you with determining if the competencies should be selected and included for approval of the Learning Resource that has been submitted.   Within the QA report review and consider the revised confidence and the QA outcome.‍ ‍

Competency Selection Evaluation Report Format and Explanation:

‍The following report shows each Competency selected, original confidence evaluation, a secondary quality assessment (QA) for the selected competencies, revised confidence evaluation to identify systematic issues (such as overmatching from topic similarity, confusing knowledge with performance, inferring skills not directly demonstrated, treating classroom simulation as field competency, partial anchor coverage treated as full alignment), challenges identified in competency selection , summary of QA findings, and a final system determination.

‍The Competency Selection Evaluation Report Format and Analysis Key:

• Matched Competency

• Preliminary Confidence %

• Preliminary Confidence Band:

• High (85–100): Strong direct alignment Multiple anchors supported Practice + assessment evidence

• Moderate (65–84): Partial anchor coverage OR guided practice only

• Low (<65): Topic overlap only OR weak instructional support

• QA Outcome:

• Confirmed: the match remains clearly defensible after challenge, Bloom’s verb and level remain aligned, competency orientation is correct, behavioral anchors are genuinely supported, instructional evidence is sufficient, and no major overclaim remains.

• Confirmed with Reduced Confidence: the match is still plausible and defensible, but Stage 2 overstated its certainty, or anchor support is partial, or instructional sufficiency is weaker than originally claimed, or evidence is more implied than explicit.

• Downgraded to Low Confidence: the match is possible, but there is substantial doubt, or the evidence is weak, or the Bloom’s/behavioral alignment is only partial, or the training appears to contribute to the competency without strongly supporting achievement.

• Rejected / No Defensible Match: the match is mostly topical, the competency demand exceeds the training evidence, the Bloom’s level is too low, the competency is performance-based but the training is informational only, the anchors are unsupported, or the rationale depends on speculation.

• Revised Confidence %

• Revised Confidence Band:

• High (85–100): Strong direct alignment Multiple anchors supported Practice + assessment evidence

• Moderate (65–84): Partial anchor coverage OR guided practice only

• Low (<65): Topic overlap only OR weak instructional support

• QA Findings: For each Objective ID, the QA Findings field must explain: what was challenged, whether the Stage 2 match survived the challenge, whether Bloom’s verb and level were truly aligned, whether the competency orientation was appropriate, whether the behavioral anchors were fully, partially, or not supported, whether the training evidence was sufficient, and why the confidence was maintained, reduced, downgraded, or rejected.

• Final Determination: Suggested Competency Acceptance

  • FINAL SUMMARY: A brief summary covering: the strongest competency themes supported by the training, whether the training is primarily knowledge-based, performance-based, or mixed, which competencies appear most strongly supported, notable gaps where the training discusses a topic but does not adequately support competency achievement, and any caution about inferred objectives or limited evidence.

Next you will Confirm Competencies and Complete your Competency Approval

‍In the confirm competency section you can search for a particular word to determine additional potential competencies within the resource material.  You can add or reject the additional competencies.  Once the suggestions have been identified, they will not appear again as they have already been identified. You may wish to review the learning resource material that has been submitted to confirm your decision to accept, add or delete a competency.

Reviewer instructions: After reviewing the Competency Selection Evaluation Report, edit the following list of Selected Competencies to only include those that should be included in the Learning Resource's Approved Competency Profile. All selected competencies will be listed, remove any competencies that should NOT be included by clicking the X in the top right corner of the Competency block.

Reviewer instructions: Once you are done with your review, click the "Review Complete" box below and select the "Review Complete" button.

‍Review Complete

BOX

‍Once you have clicked in the Review Complete Box, the review has been completed and you may Return to “My Dashboard”