-
-
Notifications
You must be signed in to change notification settings - Fork 439
Open
Description
Relates to #137, in particular this comment. AgentMemory does not serialize multimodal content (Image, PDF, Audio) so that Instructor can handle it. However we do not support it if the multimodal content is provided in a nested input schema as follows:
class Document(BaseIOSchema):
"""PDF document with owner."""
pdf: PDF = Field(..., description="The PDF data")
owner: str = Field(..., description="The PDF owner")
class InputSchema(BaseIOSchema):
"""A list of documents to analyze."""
documents: list[Document] = Field(..., description="List of documents")In the above, the pdf will be serialized using json.dumps, which might lead to issues as discussed in #131.
KennyVaneetvelde and anshulkr04
Metadata
Metadata
Assignees
Labels
No labels