LLM Module 10 MB limit exceeded when sending large/image-heavy PDFs → SSE stream 400

[fistofzen]

Checklist

• My issue is not an AI Core service issue, but an SDK issue.
• My issue is a JS/TS related issue, not a Java related issue.
• My issue is not already reported or documented.

Describe the Question

When a packaging label (PDF) is sent to the LLM, a single base64 document exceeds SAP AI Core Orchestration's per-document limit of 10 MB (10,485,760 bytes). The request is rejected with 400 and the stream dies as Error while iterating over SSE stream. The user receives no answer.

ErrorWithCause: Error while iterating over SSE stream.
at OrchestrationStream.iterator (.../@sap-ai-sdk/core/src/stream/sse-stream.ts:63:15)
at async _processOrchestrationStreamChunkResponse (.../orchestration-stream.ts:58:22)
at async OrchestrationClient._streamResponseChunks (.../langchain/src/orchestration/client.ts:378:22)
Caused by:
Error: Error received from the server.
{"request_id":"...","code":400,"message":"400 - LLM Module: Base64 document size (12300030 bytes) exceeds maximum allowed size (10485760 bytes)","location":"LLM Module", ...}

[davidkna-sap]

Hey @fistofzen,

The PDF could not be processed because its base64-encoded size exceeds SAP AI Core Orchestration’s maximum per-document limit of 10 MB. If you require higher limits please open an issue with the AI core Orchestration service.
The backend rejects the request with HTTP 400, which is why the stream terminates without an answer.

As a workaround, until this is fixed in the service, please reduce the PDF size, split it into smaller parts (e.g. split on page boundaries), or submit only the relevant pages.
You may also wish to try using other models such as gemini-3.5-flash which appear to work with pdf-files that exceed 10MB when encoded with base64.