Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Extension of Solr documentation #460

Open
vkush opened this issue Aug 2, 2024 · 1 comment
Open

Extension of Solr documentation #460

vkush opened this issue Aug 2, 2024 · 1 comment
Labels
documentation README, wiki?, guides

Comments

@vkush
Copy link

vkush commented Aug 2, 2024

Proposal for some updates and extensions for Solr documentation:

  1. Reference Extended Solr guide already in the main README file, just for the case, when user wants to install Solr separately. The part where Solr config from webarchive-discovery is used to create Solr Cloud is very important.
  2. Since Solr-9 it is not possible to store index files outside of Solr home folder (e.g. for the case, when external file storage is used), some additional setting of solr.allowPaths is needed for that, see here. This note should be mentioned in Extended Solr guide.
  3. Usage of "--collection_id" in custom configuration of the indexer in the main README:
    THREADS=4 INDEXER_CUSTOM="--collection_id collection1 --collection corona2021" ./warc-indexer.sh warcs1/*

    Currently the spelling of "collection_id" was changed to "collection-id", see issue: "collection-id" vs "collection_id" in WARCIndexerCommandOptions.java ukwa/webarchive-discovery#315 . So, maybe with new release it will work again with "collection_id".
    Also for custom configuration the parameter "--institution institution1" also could be added as an example to the README file, to have all 3 possibilities. I think, we have only 3 options here: https://github.com/ukwa/webarchive-discovery/blob/13595bead029fd44f133ec6c18f689edde202e53/warc-indexer/src/main/java/uk/bl/wa/solr/SolrFields.java#L151-L154
@VictorHarbo VictorHarbo added the documentation README, wiki?, guides label Dec 18, 2024
@VictorHarbo
Copy link
Collaborator

Hi @vkush, thanks for your inputs! You are more than welcome to open documentation pull request for all three of your suggestions! For 1. and 2. I agree that these things should be mentioned exactly where you've described them. For 3. a note would indeed be helpful.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation README, wiki?, guides
Projects
None yet
Development

No branches or pull requests

2 participants