Recorded demo calls: 58 real demo calls from the call archive, shown here directly (current, kept up to date on a schedule). A separate synthetic lab also exists on these tabs, built from a generator: the two are never counted together.
Show the synthetic lab instead. Timing covers the briefing service's own processing only: it leaves out the telephone connection, speech recognition and speech synthesis. A synthetic request is one ask of the service. It is never a call.
Improvement queue
Real evidence from the recorded demo calls: the archive's own Review & Learn findings, and what a small set of local checks flagged in the calls' text and fields. The synthetic lab's own queue (findings, hypotheses, a simulated decision log) is separate. Show it instead.
Every recorded call with a usable start time, as of Tue 29 Sep 2026 14:53 UTC (Tue 29 Sep 2026 09:53 CDT).
Review & Learn findings
Recorded demo callsRead-only mirror of the archive's own Review & Learn board. Nothing here can be accepted, fixed, verified or dismissed — that stays in the archive's own tool. "Implemented, verification not recorded" means implemented, not independently checked; a "Marked verified in archive" record is shown as the archive marks it, and its evidence is not included here — this page never claims to have checked it again. A reference or a history note may be shown truncated.
8 of 8 finding(s) shown.
Implemented, verification not recorded phrasing medium call 28 - What went wrong
- Mike: read field elevation and density altitude, not how high the density altitude is above field elevation.
- What was expected
- field elevation X feet, density altitude Y feet
- Must say
- field elevation · density altitude
- Must not say
- above field elevation
- Reference recorded with the status
- flight-service 9262aed
History (1)
- Sat 19 Sep 2026 03:24 UTC — Implemented, verification not recorded: Mike's request on the call
Implemented, verification not recorded platform high call 28 - What went wrong
- The caller's 'Yes' abandoned the weather lookup while it was running ('Tool execution was abandoned due to user input'); Albert had to call again.
- What was expected
- The lookup finishes even if the caller speaks.
- Reference recorded with the status
- voice platform tool setting interruption_mode = disable_during_tool (19 Sep)
History (1)
- Sat 19 Sep 2026 03:24 UTC — Implemented, verification not recorded: config change, no briefing-text test
Not a problem in the archive other low call 28 - What went wrong
- Automatic check failed on the freezing-level G-AIRMET ('No SIGMETs or airmets on route' followed by the freezing level).
- What was expected
- Reference recorded with the status
- evaluation criterion clarified 19 Sep
History (1)
- Sat 19 Sep 2026 03:24 UTC — Not a problem in the archive: dismissed: the check was wrong
Not a problem in the archive other low call 27 - What went wrong
- Automatic check failed on the freezing-level G-AIRMET ('No SIGMETs or airmets on route' followed by the freezing level).
- What was expected
- Reference recorded with the status
- evaluation criterion clarified 19 Sep
History (1)
- Sat 19 Sep 2026 03:24 UTC — Not a problem in the archive: dismissed: the check was wrong
Implemented, verification not recorded flow medium call 26 - What went wrong
- The greeting was cut off by 'Mm-hmm', and Albert repeated the advisory statement three times before taking the flight.
- What was expected
- Greeting plays once, uninterrupted; acknowledgements don't interrupt; advisory said once.
- Reference recorded with the status
- agent config 19 Sep: greeting not interruptible, acknowledgement ignore terms, …
History (1)
- Sat 19 Sep 2026 03:24 UTC — Implemented, verification not recorded: config change
Implemented, verification not recorded readback medium call 26 - What went wrong
- DD-175 blocks not taken: alternate, ETE to alternate, unit/home base; pilot rank handled as 'not part of a filed plan'.
- What was expected
- Take every DD-175 block and read it back in block order.
- Reference recorded with the status
- agent prompt 19 Sep: DD Form 175 section (blocks 1-16 + unit)
History (1)
- Sat 19 Sep 2026 03:24 UTC — Implemented, verification not recorded: verified on Mike's 01:18Z call
Implemented, verification not recorded wrong value high call 24 - What went wrong
- Arrival forecast wind was read from the TAF period that had already ended: 190 at 6, while the FM190000 group (150 at 3) governed the ETA of 0045Z. Ties in the +/-1 h window went to the first period scanned.
- What was expected
- Forecast for McAlester at the arrival time: wind one five zero at three.
- Must say
- one five zero at three
- Must not say
- one nine zero at six
- Reference recorded with the status
- flight-service 8b8e750 (TAF window tie-break)
History (1)
- Sat 19 Sep 2026 03:24 UTC — Implemented, verification not recorded: from the 18 Sep audit
Implemented, verification not recorded missing item medium call 24 - What went wrong
- Freezing level was not stated, and the automatic check flagged 'No SIGMETs or airmets' against the freezing-level G-AIRMET.
- What was expected
- State the freezing level after the adverse conditions.
- Must say
- Freezing level
- Reference recorded with the status
- flight-service 8b8e750; evaluation criterion clarified 19 Sep
History (1)
- Sat 19 Sep 2026 03:24 UTC — Implemented, verification not recorded: from the 18 Sep audit
From the recorded demo calls (measured)
Recorded demo callsFound by a small fixed set of local checks of what was recorded (text and fields). No recording was listened to and no model judged a call. A call a check cannot decide is "unknown", and is never counted as fine. Counted over 58 calls in All recorded — never over the synthetic examples in the separate synthetic lab, which are never combined with these. Review status: none is recorded here; the human review of real calls stays on the archive's own Review & Learn board above, and these checks never close or reopen anything.
M-AUTOMATIC_CHECKS Flagged on 5 calls in this range
An automatic check failed
5 of 34 calls the rule could decide (14.7%). First flagged 2026-09-18T20:06:11Z, latest 2026-09-19T01:18:14Z (in this range).
Examples: call · call · call · call · call
M-ADVISORY_NOTICE Flagged on 3 calls in this range
The agent spoke but did not give the notice
3 of 34 calls the rule could decide (8.8%). First flagged 2026-09-18T20:06:11Z, latest 2026-09-20T06:47:37Z (in this range).
Examples: call · call · call
M-FINDINGS_VERIFIED Flagged on 3 calls in this range
A review finding is open, or implemented and not yet verified
3 of 4 calls the rule could decide (a share is shown from 30 calls). First flagged 2026-09-18T22:37:31Z, latest 2026-09-19T01:18:14Z (in this range).
Examples: call · call · call
M-WEATHER_LOOKUP Flagged on 1 call in this range
The weather lookup returned an error
1 of 16 calls the rule could decide (a share is shown from 30 calls). First flagged 2026-09-19T01:18:14Z, latest 2026-09-19T01:18:14Z (in this range).
Examples: call