Skip to content

Commit

Permalink
Upgrade to Storm 2.5.0, fix #1089
Browse files Browse the repository at this point in the history
Signed-off-by: Julien Nioche <[email protected]>
  • Loading branch information
jnioche committed Aug 9, 2023
1 parent c6e5aa8 commit 90e52e3
Show file tree
Hide file tree
Showing 7 changed files with 7 additions and 7 deletions.
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@ NOTE: These instructions assume that you have [Apache Maven](https://maven.apach

StormCrawler requires Java 11 or above.

The version of Storm to use must match the one defined in the pom.xml file of your topology. The major version of StormCrawler mirrors the one from Apache Storm, i.e whereas StormCrawler 1.x used Storm 1.2.3, the current version now requires Storm 2.4.0. Our [Ansible-Storm](https://github.com/DigitalPebble/ansible-storm) repository contains resources to install Apache Storm using Ansible. Alternatively, our [stormCrawler-docker](https://github.com/DigitalPebble/stormcrawler-docker) project should help you run Apache Storm on Docker.
The version of Storm to use must match the one defined in the pom.xml file of your topology. The major version of StormCrawler mirrors the one from Apache Storm, i.e whereas StormCrawler 1.x used Storm 1.2.3, the current version now requires Storm 2.5.0. Our [Ansible-Storm](https://github.com/DigitalPebble/ansible-storm) repository contains resources to install Apache Storm using Ansible. Alternatively, our [stormCrawler-docker](https://github.com/DigitalPebble/stormcrawler-docker) project should help you run Apache Storm on Docker.

Once Storm is installed, the easiest way to get started is to generate a brand new StormCrawler project using \:

Expand Down
2 changes: 1 addition & 1 deletion archetype/src/main/resources/archetype-resources/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@ Have a look at the code and resources and modify them to your heart's content.

# Prerequisites

You need to install Apache Storm. The instructions on [setting up a Storm cluster](https://storm.apache.org/releases/2.4.0/Setting-up-a-Storm-cluster.html) should help. Alternatively,
You need to install Apache Storm. The instructions on [setting up a Storm cluster](https://storm.apache.org/releases/2.5.0/Setting-up-a-Storm-cluster.html) should help. Alternatively,
the [stormcrawler-docker](https://github.com/DigitalPebble/stormcrawler-docker) project contains resources for running Apache Storm on Docker.

You also need to have an instance of URLFrontier running. See [the URLFrontier README](https://github.com/crawler-commons/url-frontier/tree/master/service); the easiest way is to use Docker, like so:
Expand Down
2 changes: 1 addition & 1 deletion archetype/src/main/resources/archetype-resources/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@
<properties>
<project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
<stormcrawler.version>${project.version}</stormcrawler.version>
<storm.version>2.4.0</storm.version>
<storm.version>2.5.0</storm.version>
</properties>

<build>
Expand Down
2 changes: 1 addition & 1 deletion core/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,7 @@
<icu4j.version>73.1</icu4j.version>
<xerces.version>2.12.2</xerces.version>
<httpclient.version>4.5.14</httpclient.version>
<snakeyaml.version>1.33</snakeyaml.version>
<snakeyaml.version>2.0</snakeyaml.version>
<commons.lang.version>2.6</commons.lang.version>
<wiremock.version>2.27.2</wiremock.version>
<rometools.version>2.1.0</rometools.version>
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@
<properties>
<project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
<stormcrawler.version>${StormCrawlerVersion}</stormcrawler.version>
<storm.version>2.4.0</storm.version>
<storm.version>2.5.0</storm.version>
</properties>

<build>
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@
<properties>
<project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
<stormcrawler.version>${StormCrawlerVersion}</stormcrawler.version>
<storm.version>2.4.0</storm.version>
<storm.version>2.5.0</storm.version>
</properties>

<build>
Expand Down
2 changes: 1 addition & 1 deletion pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -74,7 +74,7 @@
<additionalparam>-Xdoclint:none</additionalparam>
<!-- dependency versions -->
<junit.version>4.13.2</junit.version>
<storm-client.version>2.4.0</storm-client.version>
<storm-client.version>2.5.0</storm-client.version>
<jackson.version>2.15.0</jackson.version>
<tika.version>2.8.0</tika.version>
<mockito.version>5.3.1</mockito.version>
Expand Down

0 comments on commit 90e52e3

Please sign in to comment.