Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cannot get new connection from pool. #87

Open
2 tasks done
haobin-ihealth opened this issue Nov 23, 2022 · 1 comment
Open
2 tasks done

Cannot get new connection from pool. #87

haobin-ihealth opened this issue Nov 23, 2022 · 1 comment

Comments

@haobin-ihealth
Copy link

haobin-ihealth commented Nov 23, 2022

(check apply)

  • read the contribution guideline
  • (optional) already reported 3rd party upstream repository or mailing list if you use k8s addon or helm charts.

Steps to replicate

<match proapi.**>
    @type opensearch
    index_name proapi
    host xxxxxxxxx
    port 443
    user xxxxxxxxx
    password xxxxxxxxx
    scheme https
</match>

Expected Behavior or What you need to ask

When I use this plugin to connect to aws opensearch, after a few days, I get this error in the logs

failed to flush the buffer. retry_times=14 next_retry_time=2022-11-22 05:43:24 +0000 chunk="5edfeac22ba712f91bf039046796ec61" error_class=Fluent::Plugin::OpenSearchOutput::RecoverableRequestFailure error="could not push logs to OpenSearch cluster ({:host=>"XXXXXXXX", :port=>443, :scheme=>"https", :user=>"XXXXXXXX", :password=>"XXXXXXXX"}): Cannot get new connection from pool.

Using Fluentd and OpenSearch plugin versions

  • Ubuntu 11.2.0-19ubuntu1
  • Bare Metal or within Docker or Kubernetes or others?
  • td-agent 4.4.1 fluentd 1.15.2
  • fluent-plugin-opensearch (1.0.8)
  • OpenSearch 1.3
  • OpenSearch template(s) (optional)
@haobin-ihealth
Copy link
Author

I think it may be because the connection has suspended animation for a long time without writing, and a new connection will be applied for when writing again, causing the connection to be exhausted. Now as the frequency of the records I write becomes higher, there is no longer a situation where the link cannot be obtained.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant