Skip to content

feat: Add Semantic Text Splitter #9199

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 332 commits into
base: main
Choose a base branch
from
Open

feat: Add Semantic Text Splitter #9199

wants to merge 332 commits into from

Conversation

promentol
Copy link

Added semantic text splitter, similar to python version
I put the file in experimental folder, as in python version it is still in langchain_experimental package

solves this #7147

hntrl and others added 30 commits August 27, 2025 09:52
@hntrl
chore(core): standard updates
a22398f
@hntrl
feat(core): v0 message contentBlocks property
22b50c5
@hntrl
feat(anthropic): adopt contentBlocks
d4eae81
@hntrl
chore(core): move legacy data content logic
4a68d5a
@hntrl
chore(anthropic): fix some std parse issues
a5213fe
@hntrl
chore(core): add missing utils
9856db6
@hntrl
chore(core): multistep content blocks parsing
827eb03
@hntrl
chore(openai): reorganize input parsing
b4d0181
@hntrl
chore(openai): reorganize test
28be3e0
@hntrl
feat(core): add openai content blocks parser
70dd057
@hntrl
chroe(core): fix base message content blocks constructor
4a75cd0
@hntrl
chore(core): add openai tests
0622d5a
@hntrl
wip(openai): add v1 stubs
12576d2
@hntrl
chore(core): add anthropic jsdocs
a30a316
@hntrl
feat(core): output version for chat models
4f005d2
@hntrl
fix(anthropic): some anthropic fixes
d6d8f67
@hntrl
chore(core): fix openai annotations
6c6e054
@hntrl
chore(anthropic): fix standard annotation handling
d7ead5f
@hntrl
chore(core): iife relocation
b439a01
@hntrl
chore(core): interop content block for message content
85499cc
@hntrl
chore(core): fix odd merging behavior
3633fae
@hntrl
cr
5bc6048
@hntrl
chore(core): add tool calls to content blocks array
7e38979
@hntrl
chore(core): rm v1 messages (for now)
28e5e39
@hntrl
chore(core): remove occurrences of MessageContentComplex
aa31f50
@hntrl
cr
f44e200
@hntrl
chore(standard-tests): content block assertions
0c3ac7a
@hntrl
chore(core): add translator stubs
fa2f05b
@christian-bromann
chore(langchain) v1 clean up ./agents/* (langchain-ai#8739)
cf74ece
@hntrl
chore(core): fix duplicate yield bug
0953ad1
christian-bromann and others added 25 commits October 14, 2025 00:51
@christian-bromann
feat(langchain/createAgent): add before/after agent hooks (langchain-…
775a976 
…ai#9161)
@pokey
fix(anthropic): Add execution tool response block types (langchain-ai…
073e977 
…#9108)
@pokey
feat(anthropic): Add support for container reuse for code execution (l…
0ea1111 
…angchain-ai#9109)
@christian-bromann
fix(langchain/createAgent): fix naming wrapModelRequest -> wrapModelC…
d1eddaf 
…all (langchain-ai#9174)
@pokey
fix(anthropic): Add integration test for Anthropic multi-step code ex…
aac6abc 
…ecution (langchain-ai#9177)
@hntrl
fix(core/v1): create tool calls when standard content is initialized …
1fddf7d 
…in content (langchain-ai#9170)
@hntrl
fix(openai/v1): better responses multimodal handling (langchain-ai#9169)
be5dfc6
@hntrl
chore(core/v1): patch changes (langchain-ai#9172)
f212784
@hntrl
chore(langchain/v1): patch changes (langchain-ai#9171)
ce0a2d6
@hntrl
chore(community/v1): patch changes (langchain-ai#9181)
4f4d19e
@hntrl
fix(anthropic/v1): better multimodal handling (langchain-ai#9168)
436a656
@hntrl
chore(cerebras): patch changes (langchain-ai#9183)
aa938e0
@hntrl
chore: release packages (langchain-ai#9182)
47f6d20
@christian-bromann
fix(langchain): rename planning middleware to todolist (langchain-ai#…
9460e8c 
…9187)
@hntrl
chore(cohere/v1): patch changes (langchain-ai#9184)
8f7b824
@hntrl
chore(google-genai/v1): patch changes (langchain-ai#9185)
81daf47
@hntrl
chore(groq/v1): patch changes (langchain-ai#9186)
7b606e9
@hntrl @durran
chore(mongodb/v1): patch changes (langchain-ai#9188)
9da64a2 
Co-authored-by: Durran Jordan <[email protected]>
@hntrl @rliu6915 @christian-bromann
chore(ollama/v1): patch changes (langchain-ai#9189)
c98f246 
Co-authored-by: rliu6915 <[email protected]>
Co-authored-by: Christian Bromann <[email protected]>
@hntrl @dudanogueira
chore(weaviate/v1): patch changes (langchain-ai#9191)
5b8d02d 
Co-authored-by: Duda Nogueira <[email protected]>
@hntrl
chore(openai/v1): patch changes (langchain-ai#9193)
499ca4d
@hntrl @Dag7
chore(redis/v1): patch changes (langchain-ai#9190)
ce73741 
Co-authored-by: Dag7 <[email protected]>
@hntrl
chore: update project files (langchain-ai#9195)
8013da5
@hntrl
chore: release packages (langchain-ai#9196)
9709279
@promentol
Add Semantic Text Splitter
d7ba6f0
@changeset-bot
Copy link

changeset-bot bot commented Oct 15, 2025

⚠️ No Changeset found

Latest commit: d7ba6f0

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

@vercel
Copy link

vercel bot commented Oct 15, 2025

The latest updates on your projects. Learn more about Vercel for GitHub.

1 Skipped Deployment
Project Deployment Preview Updated (UTC)
langchainjs-docs Ignored Ignored Oct 15, 2025 1:58am

@promentol promentol mentioned this pull request Oct 15, 2025
Closed
@promentol promentol changed the title Add Semantic Text Splitter feat: Add Semantic Text Splitter Oct 15, 2025
@hntrl hntrl changed the base branch from v1 to main October 15, 2025 22:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.