A reproducible method before a ranking.

How well the system turns prior FE performance and new evidence into a targeted recovery plan.

1. Diagnostic report intakeAccepts structured or manual NCEES topic results without losing topic identity.
2. Scale normalizationSeparates NCEES diagnostic scale values from raw percent-correct assumptions.
3. Blueprint topic mappingMaps each imported signal to the current FE discipline specification.
4. Evidence confidenceShows uncertainty when evidence is sparse, old, or internally inconsistent.
5. Failure-mode classificationDistinguishes concept, handbook, unit, timing, reading, and formula-selection errors.
6. Remediation priorityCombines weakness, exam weight, fixability, and available study time.
7. Retake plan generationProduces an ordered, time-bounded plan tied to diagnosed gaps.
8. Retest loopSchedules targeted reassessment and changes the plan from observed recovery.
9. Diagnostic explainabilityExplains why a topic was prioritized and what evidence would change the decision.

Whether the coach is accurate, context-aware, exam-grounded, and useful across a study sequence.

1. Learner context continuityUses discipline, exam date, recent work, and known gaps without repeated prompting.
2. FE-specific groundingKeeps answers within the selected FE discipline and current public specification.
3. Reference Handbook guidancePoints learners toward the relevant handbook concept without implying NCEES affiliation.
4. Calculation accuracyProduces dimensionally consistent steps and a reproducibly correct result.
5. Error detectionIdentifies flawed assumptions, unit mistakes, and invalid intermediate steps.
6. Pedagogical controlCan switch among hint, Socratic, worked-example, and concise-review modes.
7. Response personalizationChanges depth and next actions based on demonstrated mastery and confidence.
8. Uncertainty handlingStates limitations, avoids invented authority, and requests missing information.
9. Failure recoveryRecovers from a wrong answer through correction, traceability, and follow-up practice.

How effectively practice changes from learner evidence instead of presenting a static question queue.

1. Cold-start targetingUses diagnostic evidence rather than random practice for a new learner.
2. Topic priorityBalances mastery gap with exam weight and study-time constraints.
3. Difficulty matchingSelects challenge level from recent accuracy and confidence.
4. Spaced reviewReturns concepts at evidence-based intervals rather than fixed repetition.
5. Wrong-answer recoveryRe-tests the underlying failure mode, not only the identical question.
6. Question noveltyControls duplication and avoids memorization masquerading as mastery.
7. Sequence coherenceBuilds prerequisites before dependent skills and explains major sequence changes.
8. Outcome feedback loopUpdates recommendations after every meaningful practice outcome.
9. Learner controlLets the learner inspect, override, or constrain recommendations.

How safely and transparently AI issues, corrections, and learner requests are resolved.

1. Structured issue intakeCaptures the answer, prompt, topic, and learner-reported problem.
2. Issue routingSeparates content errors, AI behavior, billing, privacy, and product support.
3. TraceabilityRetains model, content, and decision identifiers needed to reproduce an issue.
4. Human escalationProvides an appropriate route for technical or high-impact unresolved issues.
5. Resolution communicationTells the learner what changed and whether saved guidance was affected.
6. Privacy controlsMinimizes exposed learner data and respects deletion and access controls.
7. Quality learning loopUses verified reports to improve content or safeguards without silently rewriting history.

Whether the product represents mastery as evidence with uncertainty rather than a decorative progress number.

1. Skill granularityRepresents topics and subskills at a useful FE decision level.
2. Multi-source evidenceCombines diagnostic, practice, mock, and learning evidence without double counting.
3. Confidence estimateDistinguishes apparent mastery from well-supported mastery.
4. Recency decayReduces confidence when evidence becomes stale.
5. Coverage visibilityShows untested areas separately from weak areas.
6. Readiness calibrationAvoids presenting readiness as an official pass prediction and documents calibration limits.
7. ActionabilityConnects every major readiness signal to a specific next action.
8. Score explainabilityShows which evidence moved a score and why.

How well AI-generated or AI-assisted study content is controlled, validated, and maintained.

1. Specification mappingMaps content to the current public FE topic outline.
2. Originality controlUses original study material and avoids copying protected exam content.
3. Technical correctnessPasses answer, units, assumptions, and numerical verification.
4. Explanation qualityIncludes concept, method, calculation, and common failure mode where appropriate.
5. Distractor qualityWrong options reflect plausible engineering mistakes without ambiguity.
6. Duplication controlDetects near-duplicate stems, solutions, and answer patterns.
7. Revision lifecycleTracks source, reviewer state, issue history, and publication version.

Whether users can understand the system's ownership, limits, evidence, and operational safeguards.

1. Ownership disclosureDiscloses material ownership or commercial relationships near comparison claims.
2. Evidence provenanceLinks objective claims to dated sources or reproducible artifacts.
3. Model and content versioningIdentifies the model and content versions involved in scored behavior.
4. Scoring reproducibilityFreezes tasks, formulas, and evidence before publishing a ranking.
5. Learner privacyDocuments collection, use, retention, access, and deletion.
6. Fair comparisonUses the same tasks, availability rules, and evidence thresholds for every product.
7. Corrections processProvides a visible route for vendors and users to challenge factual errors.
8. Operational reliabilityRecords failed tasks, latency, outages, and fallback behavior instead of silently excluding them.