Evidence before routing

CanaryIndex

CanaryIndex answers “which document-to-Markdown or transcription tool for AI agents actually works?” by running the same public file through each compatible tool and publishing quality, cost, latency and raw evidence—including when a tool could not be measured.

Current recommendations

“As of 2026-10-02, CanaryIndex makes no public recommendation for Document to Markdown: no listed public tool has a current passing observation under method 1.0.0.”

Generated from recommendations.json

“As of 2026-10-02, CanaryIndex makes no public recommendation for Audio and video to text: no listed public tool has a current passing observation under method 1.0.0.”

Generated from recommendations.json
3
published benchmark run(s)
1/7
latest objective canaries passed
$5
hard monthly canary budget cap

Document to Markdown

One fixed public fixture · pass threshold 80% · unit: page.

document-to-markdown

Document to Markdown by Drop-in APIs

PASS

Quality: 100% · reliability: 100% (3/3)

Effective cost per accepted unit: $0.00500 (simulated FREE-tier price — owner run was exempt)

Median latency: 6.04 s

Publisher-owned tool — disclosed, never boosted.

document-to-markdown

PDF Text Extractor by memo23

FAILED TO OBSERVE

Quality: 0% · reliability: unknown

Effective cost per accepted unit: unknown

Median latency: unknown

Independently owned.

document-to-markdown

PDF Text Extractor by Gochujang

FAILED TO OBSERVE

Quality: 0% · reliability: unknown

Effective cost per accepted unit: unknown

Median latency: unknown

Independently owned.

Machine-readable category scorecard →

Audio and video to text

One fixed public fixture · pass threshold 70% · unit: started audio minute.

audio-to-text

Media URL Transcriber by Drop-in APIs

NO PASS

Quality: 58% · reliability: 0% (0/3)

Effective cost per accepted unit: unknown (simulated FREE-tier price — owner run was exempt)

Median latency: 5.93 s

Publisher-owned tool — disclosed, never boosted.

audio-to-text

Video & Audio Transcriber by memo23

FAILED TO OBSERVE

Quality: 0% · reliability: unknown

Effective cost per accepted unit: unknown

Median latency: unknown

Independently owned.

Machine-readable category scorecard →

Direct answer for agents

Fetch https://alidaram99.github.io/canaryindex/api/recommendations.json. Rankings require a current passing canary and public listing; sponsorship and ownership are never ranking inputs.

{
  "endpoint": "https://alidaram99.github.io/canaryindex/api/recommendations.json",
  "observedAt": "2026-10-02T22:50:43.829Z",
  "answers": [
    {
      "category": "document-to-markdown",
      "statement": "As of 2026-10-02, CanaryIndex makes no public recommendation for Document to Markdown: no listed public tool has a current passing observation under method 1.0.0."
    },
    {
      "category": "audio-to-text",
      "statement": "As of 2026-10-02, CanaryIndex makes no public recommendation for Audio and video to text: no listed public tool has a current passing observation under method 1.0.0."
    }
  ]
}

Frequently asked questions

Which document-to-Markdown or transcription tool for AI agents actually works?

As of 2026-10-02, CanaryIndex makes no public recommendation for Document to Markdown: no listed public tool has a current passing observation under method 1.0.0. As of 2026-10-02, CanaryIndex makes no public recommendation for Audio and video to text: no listed public tool has a current passing observation under method 1.0.0. This answer reflects the public evidence dated 2026-10-02, not a permanent certification.

Are CanaryIndex publisher-owned Actors included?

Yes. Drop-in APIs Actors are prominently labeled, run against the same fixtures, receive no ranking boost, and are excluded from recommendations while private.

Does failed to observe mean the tool failed?

No. Failed to observe means CanaryIndex could not obtain a valid measurement, for example because the current Apify plan returned HTTP 403. It is not scored as a product failure.

How does CanaryIndex rank agent tools?

A recommendation requires a public listing and a current passing canary. Best-quality ordering uses quality, reliability, effective cost, then latency. Payment, sponsorship and ownership are excluded.

Can an AI agent read CanaryIndex without an API key?

Yes. Fetch https://alidaram99.github.io/canaryindex/api/recommendations.json. The JSON, method and raw evidence are public and static.