fix(genai): format=json loose mode (Ollama 0.11.8 schema segfaults) #39

Merged

goldstein merged 1 commit from fix/ollama-loose-json into main

2026-04-18 11:59:19 +00:00

goldstein commented

2026-04-18 11:59:17 +00:00

Owner

Prompt + Pydantic validation do the contract enforcement now.

goldstein added 1 commit 2026-04-18 11:59:17 +00:00

fix(genai): send format="json" (loose mode) to Ollama

tests / test (push) Successful in 1m13s

Details

tests / test (pull_request) Successful in 1m23s

Details

2efc4d1088

Ollama 0.11.8 segfaults on any Pydantic-shaped structured-output schema
with $ref, anyOf, or pattern — confirmed on the deploy host with the
simplest MVP case (BankStatementHeader alone). The earlier null-stripping
sanitiser wasn't enough.

Switch to format="json", which is "emit valid JSON" mode. We're already
describing the exact JSON shape in the system prompt (via GenAIStep +
the use case's citation instruction appendix) and validating the
response body through Pydantic on parse — which raises IX_002_001 on
schema mismatch, exactly as before.

Stronger guarantees can come back later via a newer Ollama, an API
fix, or a different GenAIClient impl. None of that is needed for the
MVP to work end to end.

Unit tests: the sanitiser left in place (harmless, still tested). The
"happy path" test now asserts format == "json".

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

goldstein merged commit 9c73895318 into main

2026-04-18 11:59:19 +00:00

goldstein referenced this pull request from a commit

2026-04-18 11:59:21 +00:00

fix(genai): ollama loose JSON (#39)

No reviewers

No labels

No milestone

No project

No assignees

1 participant

Notifications

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: goldstein/infoxtractor#39

No description provided.