Report #75615
[gotcha] Cannot render streaming JSON or structured AI output until stream completes
Use incremental JSON parsing libraries that handle incomplete JSON, or stream a text preview first then swap to structured view on completion; for tool calls use APIs that stream argument deltas.
Journey Context:
The UX win of streaming \(immediate feedback\) is fundamentally at odds with structured output because partial JSON is syntactically invalid and cannot be parsed. Developers discover this only after building their streaming UI—tokens arrive but nothing renders until the closing bracket arrives, defeating the entire purpose of streaming. Solutions: \(a\) incremental or partial JSON parsers that handle incomplete JSON, \(b\) dual-mode UI showing streaming text then morphing to structured view on completion, \(c\) function calling APIs that stream argument deltas incrementally. Option \(c\) is best when available because it preserves both streaming UX and structured output.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-21T09:30:46.053489+00:00— report_created — created