Skip to content

Commit

Permalink
Pre 2.10 release
Browse files Browse the repository at this point in the history
Signed-off-by: Julien Nioche <[email protected]>
  • Loading branch information
jnioche committed Oct 25, 2023
1 parent 5462006 commit 2bd817e
Show file tree
Hide file tree
Showing 4 changed files with 5 additions and 5 deletions.
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@ NOTE: These instructions assume that you have [Apache Maven](https://maven.apach

StormCrawler requires Java 11 or above.

The version of Storm to use must match the one defined in the pom.xml file of your topology. The major version of StormCrawler mirrors the one from Apache Storm, i.e whereas StormCrawler 1.x used Storm 1.2.3, the current version now requires Storm 2.5.0. Our [Ansible-Storm](https://github.com/DigitalPebble/ansible-storm) repository contains resources to install Apache Storm using Ansible. Alternatively, our [stormCrawler-docker](https://github.com/DigitalPebble/stormcrawler-docker) project should help you run Apache Storm on Docker.
The version of Apache Storm to install must match the one defined in the pom.xml file of your topology. The major version of StormCrawler mirrors the one from Apache Storm, i.e whereas StormCrawler 1.x used Storm 1.2.3, the current version now requires Storm 2.5.0. Our [Ansible-Storm](https://github.com/DigitalPebble/ansible-storm) repository contains resources to install Apache Storm using Ansible. Alternatively, our [stormCrawler-docker](https://github.com/DigitalPebble/stormcrawler-docker) project should help you run Apache Storm on Docker.

Once Storm is installed, the easiest way to get started is to generate a brand new StormCrawler project using \:

Expand Down
2 changes: 1 addition & 1 deletion external/elasticsearch/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@ Getting started

Use the archetype for Elasticsearch with:

`mvn archetype:generate -DarchetypeGroupId=com.digitalpebble.stormcrawler -DarchetypeArtifactId=storm-crawler-elasticsearch-archetype -DarchetypeVersion=2.9`
`mvn archetype:generate -DarchetypeGroupId=com.digitalpebble.stormcrawler -DarchetypeArtifactId=storm-crawler-elasticsearch-archetype -DarchetypeVersion=2.10`

You'll be asked to enter a groupId (e.g. com.mycompany.crawler), an artefactId (e.g. stormcrawler), a version and package name.

Expand Down
2 changes: 1 addition & 1 deletion external/opensearch/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@ Getting started

The easiest way is currently to use the archetype for OpenSearch with:

`mvn archetype:generate -DarchetypeGroupId=com.digitalpebble.stormcrawler -DarchetypeArtifactId=storm-crawler-opensearch-archetype -DarchetypeVersion=2.9`
`mvn archetype:generate -DarchetypeGroupId=com.digitalpebble.stormcrawler -DarchetypeArtifactId=storm-crawler-opensearch-archetype -DarchetypeVersion=2.10`

You'll be asked to enter a groupId (e.g. com.mycompany.crawler), an artefactId (e.g. stormcrawler), a version and package name.

Expand Down
4 changes: 2 additions & 2 deletions external/warc/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -30,7 +30,7 @@ To configure the WARCHdfsBolt, include the following snippet in your crawl topol
.withPath(warcFilePath);

Map<String,String> fields = new HashMap<>();
fields.put("software:", "StormCrawler 2.9 http://stormcrawler.net/");
fields.put("software:", "StormCrawler 2.10 http://stormcrawler.net/");
fields.put("format", "WARC File Format 1.0");
fields.put("conformsTo:",
"https://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.0/");
Expand Down Expand Up @@ -80,7 +80,7 @@ components:
- name: "put"
args:
- "software"
- "StormCrawler 2.9 http://stormcrawler.net/"
- "StormCrawler 2.10 http://stormcrawler.net/"
- name: "put"
args:
- "format"
Expand Down

0 comments on commit 2bd817e

Please sign in to comment.