Opensearch version

[hari819]

Hello I am using opensearch version 1.3.2 , have not upgraded to 2.0.0.

I am trying to push logs in my cluster using fluentd-plugin-opensearch , i have taken a base image of fluentd-debian and trying to install plugin using , "gem install fluentd-plugin-opensearch" ,but this is installing version 2.0.0 and i am not able to run fluentd ,

aggregagator pod is crashing with no error except "shutting down fluentd worker worker=0" , i enabled trace log , but could not see any error , please could you help me with this ,

is this because of gems from version 2.0.0 installed in the docker file?

Step 3/5 : RUN gem install fluent-plugin-opensearch
---> Running in 88482c668e84
Successfully installed opensearch-transport-2.0.0
Successfully installed opensearch-api-2.0.0
Successfully installed opensearch-ruby-2.0.0

Parsing documentation for opensearch-api-2.0.0
Installing ri documentation for opensearch-api-2.0.0
Parsing documentation for opensearch-ruby-2.0.0
Installing ri documentation for opensearch-ruby-2.0.0

[hari819]

even if i try "gem install fluent-plugin-opensearch -v 1.0.0" , it still installs 2.0.0 gems

[hari819]

please help me installing the correct version of plugin/gems which will work with opensearch cluster 1.3.2

[hari819]

this is the trace log ,

2022-06-15 08:25:07 +0000 [trace]: #0 [out_os] enqueueing all chunks in buffer instance=2880
2022-06-15 08:25:08 +0000 [info]: Received graceful stop
2022-06-15 08:25:08 +0000 [trace]: #0 [out_os] enqueueing all chunks in buffer instance=2880
2022-06-15 08:25:08 +0000 [trace]: #0 [out_os] enqueueing all chunks in buffer instance=2880
2022-06-15 08:25:08 +0000 [info]: #0 fluentd worker is now stopping worker=0
2022-06-15 08:25:08 +0000 [info]: #0 shutting down fluentd worker worker=0
2022-06-15 08:25:08 +0000 [trace]: #0 [out_os] enqueueing all chunks in buffer instance=2880
2022-06-15 08:25:08 +0000 [trace]: #0 [out_os] enqueueing all chunks in buffer instance=2880
2022-06-15 08:25:08 +0000 [info]: #0 shutting down input plugin type=:forward plugin_id="object:b54"
2022-06-15 08:25:08 +0000 [info]: #0 shutting down output plugin type=:opensearch plugin_id="out_os"
2022-06-15 08:25:09 +0000 [debug]: #0 [out_os] closing buffer instance=2880
2022-06-15 08:25:09 +0000 [info]: Worker 0 finished with status 0

[cosmo0920]

aggregagator pod is crashing with no error except "shutting down fluentd worker worker=0" , i enabled trace log , but could not see any error , please could you help me with this ,

is this because of gems from version 2.0.0 installed in the docker file?

Yes, this should be caused by major version mismatch between OpenSearch and OpenSearch plugin.

Could you try to install the specific version of opensearch-ruby and opensearch-transport gems?
ref: https://rubygems.org/gems/opensearch-ruby/versions/1.0.0

To fix using plugin versions, you should use bundle command and --gemfiles option to specify desired plugin versions and their dependencies. gem install always pulls the latest gems.
ref: https://docs.fluentd.org/deployment/plugin-management#gemfile-option

[hari819]

sure I will try this , thankyou @cosmo0920