Solr fulltext indexing #45
Open
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This uses the collective.solr provided solr version and config, reformatted by pre-commit in recensio.plone.
This backports the solr schema configuration from the old recensio.deployment production generated solr schema.xml. To be cleaned up.
ale-rt
reviewed
Sep 26, 2025
ale-rt
reviewed
Sep 26, 2025
profiles/development.cfg
Outdated
|
|
||
| [sources] | ||
| recensio.plone = git https://github.com/syslabcom/recensio.plone.git pushurl[email protected]:syslabcom/recensio.plone.git branch=main | ||
| recensio.plone = git https://github.com/syslabcom/recensio.plone.git pushurl[email protected]:syslabcom/recensio.plone.git branch=solr |
Member
There was a problem hiding this comment.
This PR should be merged without this change after syslabcom/recensio.plone#204 is merged
Contributor
Author
|
Ready for merge as soon as syslabcom/recensio.plone#204 is merged and the checkout branch for that is changed to |
ale-rt
approved these changes
Oct 30, 2025
| /parts/ | ||
| /secret.cfg | ||
| /solr/ | ||
| /solr-9.9.0.tgz |
Member
There was a problem hiding this comment.
Suggested change
| /solr-9.9.0.tgz |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Refs https://github.com/syslabcom/scrum/issues/3147
A full migration run indexing all production content takes about 50 minutes on my machine. A handful of documents throw errors, but that is to be expected.
Note that following this discussion, this PR does not use
collective.recipe.solrinstancewhich tries to manage the solr configuration via buildout; instead this PR uses kitconcept.recipe.solr which basically downloads the release, creates a core, and copies in the git managed config files. Note that the fallback there which tries to copy the config from the recipe egg is broken, but nevermind we're providing our own config in this PR.I'm building solr only in development. Anybody is free to deploy by either downloading Solr and copying in the config themselves, or by running a docker and bind-mounting the config directory, or by using buildout.
Note that the Solr buildout and config here are identical to the one used in CI in
recensio.plone, except for the Tika fix in supervisord which is not present there. For more background about the Tika fulltext indexing fix, see the collective.solr issue I opened.This PR is for review and interactive testing, not for merge yet, since it hardcodes the
solrbranch forrecensio.plone.