EVALUATION #IM-0042
ILLUSTRATIVE EXAMPLE — NOT LIVE DATA
- Evaluation
- #IM-0042
- Target
- Customer Support Agent
- Attack
- Tool Abuse
- Observation
- Unauthorized tool invocation
- Judge
- Verifier
- 7/8 reproductions
- Severity
- HIGH
- Evidence
- Captured
INTELLIGENCE IS NOT THE SAME AS RELIABILITY.
We build systems that challenge intelligent systems—making failure visible, testable, and easier to understand.
THE EVALUATION GAP
Instructions, retrieved content, tools, and multi-step interactions can all influence how an AI system behaves. A model-level check alone may not reveal how the complete application responds under pressure.
Evaluation has to reach the system around the model—the instructions it receives, the information it is given, the actions it can take, and the way those elements combine in real use.
PROJECTILE / IN PROTOTYPE
PROJECTILE challenges intelligent systems to expose potential weaknesses, examines candidate failures, and supports evidence-led evaluation. It is being built to evaluate AI systems against defined objectives, record observed behavior, and preserve the evidence needed to assess what occurred.
The objective is to distinguish a potential failure from a finding supported by evidence—and to preserve an inconclusive outcome when the available evidence is insufficient.
EXPLORE PROJECTILECORE CAPABILITIES
Find vulnerabilities
within an hour.
PROJECTILE is designed to help teams surface and investigate potential weaknesses quickly, with a target of finding vulnerabilities within an hour under suitable evaluation conditions. Evaluation time depends on the target system, scope, configuration, and test conditions.
PROJECTILE is currently in the prototype stage.
Public beta is planned for January 2027. The beta timeline is a plan, not a guaranteed release date.
CAPABILITY SET / 04
Evaluations draw on a substantial base of more than 30,000 strategies for challenging intelligent systems — a wide foundation that testing and self-learning build on.
PROJECTILE learns from attacks and their outcomes, using results to sharpen subsequent testing and strategy selection rather than repeating a fixed sequence.
Evaluations run across multi-turn interactions and adapt their direction in response to observed behaviour — because failures often emerge through accumulated context, changing instructions, and tool use rather than isolated prompts.
Designed to support continuous evaluation coverage rather than one-off manual testing, so a system can be examined as it changes — not only on the day someone checks.
EVIDENCE, NOT ASSERTION
Every candidate is judged, reproduced by the independent verifier, and only then trusted. This is an illustrative example of the record structure — not live data from a real evaluation.
EVALUATION #IM-0042
ILLUSTRATIVE EXAMPLE — NOT LIVE DATA
RESEARCH MODE
Research runs track everything needed to reproduce, compare, and defend a result.
APPROACH
Credible evaluation requires more than identifying an unusual response. A potential failure must be examined in context, supporting evidence must be preserved, and the outcome must reflect what the evaluation actually establishes.
EXPLORE THE APPROACHINTENDED PROCESS / FIVE STAGES
UNDER DEVELOPMENT — AVAILABILITY OF EACH STAGE SHOULD BE CONFIRMED BEFORE PLANNING AN EVALUATION.
EVALUATION CONTEXTS
Evaluation should reflect how a system is used, what information it receives, what actions it can take, and the constraints it is expected to follow. The relevant failure modes differ across applications.
FIELD GUIDES
Practical guides to the methods behind PROJECTILE: how LLM red teaming works, how prompt injection is tested, and how AI agents are assessed for security.
PRIVATE DEMONSTRATION
PROJECTILE is demonstrated privately, in controlled settings, for research and enterprise teams. Request a private demonstration or contact DYMORPIC to discuss the evaluation context, intended scope, and current product capabilities.
There is no public demo on this website, by design. The scope and format of any demonstration are agreed directly.