Automotive StoryQ and Test-Evidence Management
A vehicle program can contain thousands of requirements.
It can also contain thousands of tests.
But a large quantity of requirements and tests does not automatically create confidence.
The key questions are:
Which requirement does this test verify?
Under which configuration?
What exactly happened during execution?
Where is the resulting evidence?
Does that evidence still apply after the vehicle changes?
ZenOps therefore treats testing as a direct continuation of the engineering model.
StoryQ describes the expected behavior.
Testing executes that behavior against a real or simulated system.
Evidence records what happened.
Quality Thresholds decide whether the accumulated evidence is strong enough to move forward.
The chain becomes:
Need → Requirement → StoryQ → Test → Evidence → Status → QT
Inside OPUS Delivery, this can become one continuous verification network.
Start From the Requirement
Suppose the NDD contains:
Need:Vehicle shall support reliable fast charging.
That becomes a requirement:
REQ-CHARGE-041The vehicle shall maintain required charging functionalityunder the defined operating conditions.
The requirement is still only a claim.
Engineering believes the vehicle should behave this way.
StoryQ makes that claim executable.
StoryQ Converts Requirement Into Behavior
For example:
Scenario: Fast charging begins at low battery temperatureGiven the battery temperature is below the defined thresholdAnd the vehicle is connected to a compatible fast chargerWhen charging is initiatedThen battery preconditioning shall operate as requiredAnd charging shall remain within the approved thermal envelope
The requirement has become much more concrete.
StoryQ Is Not Just Test Syntax
The most important value is not the words:
GivenWhenThen
The value is that the scenario forces the team to make expected behavior explicit.
It asks:
What state are we starting from?
What event occurs?
What observable outcome should follow?
That improves both engineering and communication.
A StoryQ Scenario Should Be an Object
Inside OPUS Delivery:
STORYQ-CHARGE-018
can have relations such as:
STORYQ-CHARGE-018 verifiesREQ-CHARGE-041
The scenario is no longer just text inside a test document.
It becomes part of the program model.
One Requirement May Need Many Scenarios
A charging requirement may require:
Normal ChargingCold ChargingHot ChargingCommunication LossPower InterruptionFault Recovery
Therefore:
REQ-CHARGE-041├── StoryQ S1├── StoryQ S2├── StoryQ S3└── StoryQ S4
Coverage becomes explicit.
One Scenario May Support Multiple Requirements
For example, a charging fault scenario may simultaneously exercise:
Charging RequirementThermal RequirementDiagnostic RequirementSafety Requirement
The relationship is many-to-many.
This is another reason to model verification as a network rather than a simple checklist.
StoryQ Can Describe Physical Behavior
For example:
Scenario: Vehicle stops within required distanceGiven the vehicle is traveling at the defined speedAnd the road condition is within the specified test rangeWhen the driver commands full brakingThen the vehicle shall stop within the required distanceAnd directional stability shall remain within the accepted limits
The scenario is connected directly to physical vehicle behavior.
StoryQ Can Describe Software Behavior
Scenario: Controller enters degraded mode after sensor failureGiven normal control is activeWhen the critical sensor signal becomes unavailableThen the controller shall detect the faultAnd the defined degraded function shall remain available
Hardware and software can use the same verification language.
StoryQ Can Describe Manufacturing Behavior
For example:
Scenario: Incorrect battery variant reaches the workstationGiven Vehicle #000142 requires Battery Variant B2When Battery Variant B1 is presentedThen installation shall be blockedAnd the configuration mismatch shall be recorded
The factory process becomes testable too.
StoryQ Can Describe Service Behavior
Scenario: Replacement controller is installedGiven the approved replacement controller is fittedWhen configuration and calibration are completedThen communication shall be validAnd required diagnostic checks shall pass
The same method can span the lifecycle.
StoryQ Can Describe Supplier Behavior
For example:
Scenario: Supplier component loses required traceabilityGiven a safety-critical component requires individual identityWhen the component identity cannot be verifiedThen the component shall not be accepted for production use
Verification is not limited to vehicle functions.
StoryQ Becomes the Behavioral Layer of the Domain Model
The OR model says:
Controller commandsPump
StoryQ can say:
What should happen when that relation is exercised?
This gives structure and behavior two connected representations.
Select a Relation, Find Its StoryQ
For example:
Battery cooled byCooling System
The user should be able to inspect:
Associated RequirementsAssociated StoryQAssociated TestsAssociated Evidence
The verification context becomes navigable.
StoryQ Does Not Automatically Mean Automation
Some scenarios may be automated.
Others may require:
- physical prototype
- proving-ground test
- visual inspection
- destructive testing
- supplier audit
StoryQ defines the behavior.
The test method implements the verification.
Separate Scenario From Test Method
Suppose:
StoryQ:Vehicle maintains battery temperature during fast charging.
This could be verified through:
SimulationBench TestPrototype Vehicle TestClimate Chamber Test
The scenario remains stable even when methods change.
This Separation Improves Reuse
A future program may reuse the same StoryQ but use a different test method.
Behavioral knowledge survives implementation changes.
Test Objects Need Identity
For example:
TEST-THERM-118
with:
Method:Climate Chamber Vehicle TestExecutes:STORYQ-CHARGE-018
Now the test itself becomes traceable.
Test Definitions and Test Runs Are Different
This is crucial.
A test definition says:
How should the test be performed?
A test run says:
What happened on this specific execution?
Therefore:
TEST DEFINITION↓TEST RUN
should be separate objects.
Test Run Identity Matters
For example:
TEST-RUN-2026-0418
with:
Test:TEST-THERM-118Vehicle:Prototype P7Configuration:Battery B2 / SW 6.2Result:PASS
This gives the evidence provenance.
Configuration Must Be Captured
A PASS without configuration context is weak.
Suppose:
TEST-THERM-118:PASS
Was that with:
Battery B1
or:
Battery B2
?
The answer matters.
Evidence Is Configuration-Specific
ZenOps should treat:
Evidence valid forConfiguration C
as a fundamental relation.
If the configuration changes, applicability must be reviewed.
Test Conditions Matter Too
A useful run may record:
Ambient TemperatureVehicle MassBattery StateSoftwareRoad Condition
The evidence is only meaningful within its context.
The Result Is Not the Whole Evidence Object
An evidence object should not be only:
PASS
It should include:
ClaimMethodConfigurationConditionsObservationResultProvenance
That makes the evidence reusable and auditable.
Evidence Should Point Upstream
For example:
EVIDENCE-881 supportsREQ-CHARGE-041
and:
EVIDENCE-881 produced byTEST-RUN-2026-0418
The entire chain remains visible.
One Test Run Can Produce Multiple Evidence Objects
Suppose a climate-chamber run measures:
Battery TemperatureCharging PowerEnergy Consumption
Each measurement may support different claims.
The test run is the event.
Evidence objects are the interpreted results.
Evidence Should Preserve Raw and Interpreted Information
Conceptually:
Raw Measurement↓Analysis↓Evidence Statement
For example:
Raw:Maximum battery temperature = TInterpretation:Within accepted limitEvidence:REQ-THERM-041 supported
The reasoning should be transparent.
PASS, PARTIAL, FAIL, UNKNOWN
A requirement may have:
PASS
when evidence is sufficient.
Or:
PARTIAL
if only part of the required context has been verified.
Or:
FAIL
if evidence contradicts the requirement.
Or:
UNKNOWN
if there is insufficient evidence.
This status language is powerful.
UNKNOWN Is Not Failure
Suppose the cold-weather scenario has never been tested.
That is:
UNKNOWN
not necessarily:
FAIL
The distinction directs the next work correctly.
PARTIAL Matters for Configuration Coverage
Suppose the requirement has been verified for:
Battery B1
but not:
Battery B2
Then overall evidence may be:
PARTIAL
The gap is explicit.
Evidence Gaps Generate WBS
If:
REQ-CHARGE-041Cold Climate:UNKNOWN
then work becomes:
Define cold-climate testPrepare vehicleExecute testAnalyze evidence
Verification gaps pull project work.
This Is Better Than Planning Tests Blindly
Traditional programs may create huge test plans months in advance.
ZenOps can still plan ahead.
But it also lets current evidence status determine what testing is actually needed.
StoryQ Coverage Can Be Navigated
For a requirement:
REQ-BRAKE-001
show:
Normal: PASSWet Road: PASSCold: PASSSensor Failure: UNKNOWN
The remaining uncertainty becomes obvious.
Test Coverage Is Not Just Scenario Count
Having 500 scenarios does not imply strong verification.
The important question is:
Do the scenarios cover the relevant behavior and contexts?
Coverage should remain connected to the requirement model.
StoryQ Can Be Hierarchical
A high-level scenario may be:
Vehicle stops safely.
Lower-level scenarios may verify:
Brake commandPressure generationWheel controlFault degradation
Behavior can be decomposed.
Do Not Create Scenario Explosion Without Purpose
The goal is not the maximum number of Gherkin statements.
The goal is sufficient behavioral clarity and evidence.
StoryQ should stay proportional to risk and need.
Criticality Should Influence Evidence Depth
A decorative-light behavior may need limited evidence.
A braking requirement may require:
- simulation
- subsystem tests
- vehicle tests
Evidence depth should follow consequence.
FMEA Can Generate StoryQ
Suppose FMEA identifies:
Failure Mode:Temperature sensor unavailable
This should create a scenario:
Scenario: Temperature sensor becomes unavailableGiven thermal control is activeWhen the primary temperature sensor signal is lostThen the controller shall detect the conditionAnd enter the defined degraded thermal state
Risk becomes executable verification.
Field Failures Should Generate StoryQ
Suppose a real vehicle experienced:
Charging did not recover after temporary communication loss.
Then create a regression scenario.
The field defect becomes part of the permanent test system.
This Creates a Knowledge Ratchet
The sequence is:
Failure↓Root Cause↓StoryQ Regression↓Future Release Test
Once the organization learns a failure mode, future versions should not casually reintroduce it.
StoryQ Can Carry Origin
For example:
STORYQ-CHARGE-022Origin:Field Failure FP-118
Years later, engineers understand why the scenario exists.
Never Delete a Regression Scenario Casually
If someone says:
This test looks unnecessary.
OPUS Delivery should allow navigation to:
Field Failure↓Engineering Change↓StoryQ
The history protects organizational learning.
Test-Evidence Management Should Support Versioning
Suppose:
TEST-THERM-118 v1
changes to:
TEST-THERM-118 v2
because the method improved.
The old evidence should remain tied to the old test definition.
Never rewrite history.
Requirement Version Changes Need Evidence Review
Suppose requirement threshold changes.
Then prior evidence may become:
Still ValidNeeds ReviewNo Longer Sufficient
Evidence applicability is dynamic.
Engineering Change Should Trigger Test Impact Analysis
Suppose:
Cooling Pump
changes.
OPUS Delivery should find:
Affected RequirementsAffected StoryQAffected Test DefinitionsAffected Evidence
This creates a targeted revalidation plan.
Not Every Change Requires Full Regression
If a trim clip color changes, charging tests do not need to rerun.
Dependency analysis controls verification scope.
But Shared Software Changes May Need Broad Regression
A software module reused across many functions may affect:
ChargingThermalDiagnosticsEnergy Estimation
The StoryQ network makes this scope visible.
Test Selection Can Be Dependency-Driven
The chain becomes:
Changed Object↓Affected Relations↓Affected Requirements↓Affected StoryQ↓Required Tests
This is much more precise than a static regression list alone.
Test Evidence Can Be Reused Across Programs
If a Pattern is reused in an equivalent context:
Pattern P+Evidence E
may support a new program.
But only after applicability review.
Evidence Reuse Should Be Explicit
A requirement could show:
Evidence E1:NEWEvidence E2:REUSEDEvidence E3:REVALIDATED
Management can see where confidence comes from.
Simulation Evidence and Physical Evidence Can Coexist
For example:
REQ-THERM-041├── Simulation Evidence├── Bench Evidence└── Vehicle Evidence
Different methods can support the same claim.
Evidence Hierarchy Should Follow the Question
Simulation may be excellent for exploring design space.
Physical testing may be needed to confirm final behavior.
ZenOps does not prescribe one universal evidence hierarchy.
It asks:
What evidence is sufficient for this claim?
Prototype Evidence Has Context
A prototype may differ from production hardware.
Therefore:
Prototype Evidence
may support concept confidence without fully supporting production release.
Context should remain visible.
Production Evidence Adds Another Layer
At the factory, StoryQ can generate process verification.
For example:
Scenario: Critical bolt reaches required torqueGiven the correct bolt and joint configuration are presentWhen the approved fastening process is executedThen the measured torque shall satisfy the defined rangeAnd the evidence shall be linked to the vehicle instance
Now every manufactured car may create instance-level evidence.
Vehicle Instance Evidence Is Different From Design Evidence
Design evidence says:
This design is capable of satisfying the requirement.
Instance evidence says:
This specific physical vehicle was manufactured and tested acceptably.
Both are important.
EOL Testing Can Produce Vehicle Evidence Packages
For Vehicle #000142:
VEHICLE EVIDENCE PACKAGEConfiguration: PASSSoftware Identity: PASSBrake Test: PASSAlignment: PASSTraceability: PASS
The vehicle earns release.
QT Consumes Evidence
Quality Thresholds sit above the evidence network.
For example:
BATTERY PROTOTYPE QT
may require:
Thermal Requirement: PASSCharging Requirement: PASSSafety Requirement: PASSSupplier Evidence: PARTIAL
The gate evaluates the current knowledge state.
QT Is Not Just a Test Checklist
A QT can include:
- requirements
- risks
- supplier readiness
- manufacturing readiness
Evidence from many sources can feed one decision.
QT Prevents False Progress
Suppose:
All scheduled tests complete.
But one critical test failed.
A project schedule might appear complete.
QT says:
FAIL
The distinction protects reality.
Completion and Confidence Are Different
A test can be completed.
The evidence can still show failure.
ZenOps therefore separates:
Work Status
from:
Evidence Status
This is essential.
OPUS Delivery Can Show Both
For example:
Task:Cold Charge TestWork:COMPLETEEvidence:FAIL
The work happened.
The product did not yet earn confidence.
Failed Evidence Should Generate New Work
For example:
FAIL↓Root Cause↓Design Change↓Retest
The loop continues naturally.
Test Failure Is Useful Information
A failed test is not wasted work.
It has answered a question.
It may reveal:
- wrong design
- wrong assumption
- wrong requirement
- wrong test setup
Evidence should be preserved.
Do Not Hide Failed Runs
Suppose:
Run 1: FAILRun 2: PASS
Do not overwrite Run 1.
The sequence may explain later behavior.
The test history matters.
Test History Can Reveal Instability
If:
PASSFAILPASSFAIL
the system may be unstable.
A single final PASS should not erase that pattern.
Repeated Runs Can Build Statistical Evidence
Some requirements depend on variability.
For example:
100 test runs↓Distribution↓Capability Evidence
The evidence object may summarize repeated observations.
StoryQ Can Connect to Statistical Acceptance
The scenario still defines behavior.
The test method defines how many observations and which acceptance criteria are required.
This keeps business-readable behavior separate from statistical detail.
Diagnostic Test Evidence Belongs in the Same System
A service center may execute:
Diagnostic Test
and produce:
Root-Cause Evidence
This can later feed engineering StoryQ.
The test-evidence model spans development and field service.
Predictive Maintenance Produces Evidence Too
Prediction says:
Pump degradation likely.
Service later inspects the removed pump.
That physical observation becomes:
Model Validation Evidence
The evidence system can improve the predictive Pattern.
Field Evidence Should Be Linkable to Original StoryQ
Suppose a StoryQ scenario predicted:
Charging recovers after network interruption.
Field evidence shows a failure.
The system can connect:
Field Failure↓StoryQ Scenario↓Requirement
The behavioral model is challenged directly.
A Requirement Can Become CHALLENGED
Suppose it previously had:
PASS
from development evidence.
Field failure may change status to:
CHALLENGED
This does not erase the old evidence.
It adds stronger new context.
Evidence Is Cumulative, Not Static
The knowledge state evolves:
Simulation PASS↓Prototype PASS↓Vehicle PASS↓Field Challenge↓New Engineering
Confidence is a living state.
Test-Evidence Management Becomes Organizational Memory
Years later, an engineer can ask:
Why is this requirement tested under this exact condition?
The chain may show:
Field Failure FP-118↓StoryQ S22↓Test T41
The answer survives personnel changes.
The System Should Support “Show Me the Proof”
For any requirement:
Show Evidence
should produce the supporting chain.
For any PASS:
Show why this is PASS.
For any FAIL:
Show what failed.
For any UNKNOWN:
Show what is missing.
This creates transparent decision-making.
The System Should Also Support “Show Me the Gap”
For example:
Requirement:PARTIAL
Ask:
What is missing?
The answer may be:
No cold-climate vehicle evidence for Battery B2.
Now the next action is obvious.
This Makes Program Reviews Stronger
Instead of:
Testing is 82% complete.
leadership can see:
Safety Requirements:PASSCharging:PARTIALExtreme Cold:UNKNOWNSupplier Durability:FAIL
The real program state becomes visible.
Evidence Can Be Filtered by Configuration
A user may ask:
Show all evidence for:Battery B2Software v6.2
This is critical for variant management.
Evidence Can Be Filtered by Pattern
For example:
Show field evidence supporting Thermal Pattern v4.
The Pattern Network and evidence system become connected.
Evidence Can Be Filtered by Vehicle Instance
For example:
Show release evidence for Vehicle #000142.
The same infrastructure supports product-instance traceability.
A Single Evidence Model Can Span the Entire Lifecycle
Conceptually:
Research EvidenceSimulation EvidencePrototype EvidenceSupplier EvidenceFactory EvidenceVehicle EvidenceService EvidenceField Evidence
All are evidence objects with different context.
The Meaning Comes From the Relation
An evidence object becomes useful when we know:
What claim does it support?
Without that relation, the system becomes an archive.
Evidence Should Not Become a File Dump
Uploading:
test_report_final_v8.pdf
is not sufficient test-evidence management.
The file may still be attached.
But OPUS Delivery should know:
Which test?Which requirement?Which configuration?Which result?
The file supports the structured evidence object.
StoryQ Helps Keep Test Intent Human-Readable
Detailed test procedures can become technical.
StoryQ preserves a simple answer to:
What behavior are we trying to prove?
This makes verification understandable across disciplines.
The StoryQ Designer Can Be Integrated Into OPUS Delivery
Conceptually, the user could select:
REQ-CHARGE-041
and add:
ScenarioGivenWhenThen
The scenario automatically remains linked to the requirement.
The Test Designer Can Build From StoryQ
The next layer can add:
EquipmentConditionsMeasurementsAcceptance Criteria
Now the behavioral scenario becomes an executable test definition.
Execution Produces Evidence
The chain becomes:
StoryQ↓Test Definition↓Test Run↓Evidence
This is one of the most important flows inside OPUS Delivery.
Evidence Review Can Change Status
An engineer or authorized review process evaluates:
Evidence
and updates the claim:
PASSPARTIALFAILUNKNOWN
The status is based on evidence rather than activity.
QT Can Then Aggregate the Right Things
For example:
VEHICLE RELEASE QTBraking: PASSSteering: PASSSoftware: PASSTraceability: PASSOpen Safety Failure: 0
The next state is allowed.
The Complete Automotive StoryQ Loop
The full transformation becomes:
x ↓NDD ↓REQUIREMENT ↓OR OBJECT / RELATION ↓STORYQ SCENARIO ↓TEST DEFINITION ↓TEST RUN ↓RAW OBSERVATIONS ↓EVIDENCE ↓PASS / PARTIAL / FAIL / UNKNOWN ↓QT ↓RELEASE / MORE WORK ↓VEHICLE ↓FIELD EVIDENCE ↓STORYQ CHALLENGE / NEW SCENARIO ↓BETTER TEST SYSTEM
The verification model learns throughout the lifecycle.
StoryQ Is the Bridge Between Requirement and Reality
This is the deepest role of StoryQ.
A requirement says:
The vehicle should behave this way.
StoryQ asks:
Under what conditions, when what happens, what should we observe?
The test creates the conditions.
Reality responds.
Evidence records the answer.
And QT decides whether the answer is strong enough to trust.
That is Automotive StoryQ and Test-Evidence Management:
connect every important requirement to explicit behavioral scenarios, keep scenarios separate from test methods, give test definitions and test runs persistent identity, preserve configuration and conditions, treat evidence as a structured first-class object, never overwrite failed or historical evidence, let gaps and failures generate new work, and use Quality Thresholds to turn accumulated evidence into controlled vehicle-program decisions.
The requirement is the claim.
StoryQ is the question.
The test asks reality.
The evidence records the answer.
And OPUS Delivery keeps the entire chain connected.