Task-specific benchmark
Each challenge defines capability, failure surface, cost, latency and reproducibility criteria. Candidates are ranked against it.
Ranger is deliberate about AI. Qualification is never decided by AI. Every qualifying outcome is governed by deterministic, independent verification and sealed with a signature. This page documents how AI is and is not used, which providers are under evaluation, and the human authority that governs every decision.
AI is a staff tool, governed by policy and kept away from every qualifying decision. Candidates receive no AI assistance in assessment.
No specific model is claimed operational until it is deployed and independently verified.
Ranger is evaluating open-weight model inference for internal engineering use only. It is provider-independent: Hugging Face is one prospective inference integration, not the sole technology underpinning any pathway. No model is in production for assessment. Each integration is tracked as proposed, validated, or operational.
Models and frameworks are selected by benchmark against the specific task, not by brand. No component is adopted to claim breadth. Anything used in assessment must produce reproducible evidence the signing plane can seal.
Each challenge defines capability, failure surface, cost, latency and reproducibility criteria. Candidates are ranked against it.
A component advances only when it produces evidence that recomputes from recorded inputs and maps to the evidence schema.
Outcomes are re-measured and signed, never self-reported, and verification remains deterministic and human-governed.
Submissions and candidate data are handled for assessment and verification only, and are never used to train models.
AI never qualifies a candidate. Authority rests with people, and the signed record makes every decision auditable.
Transparency is a differentiator, not a disclaimer. If you need detail for a security or procurement review, reach the team directly.