Skip to content

Commit

Permalink
Add the Firehose troubleshooting section to the new AWS monitoring do…
Browse files Browse the repository at this point in the history
…cs (#3750)

* Add troubleshooting section to Firehose guide

* Update docs/en/observability/cloud-monitoring/aws/monitor-aws-firehose-troubleshooting.asciidoc

Co-authored-by: Mike Birnstiehl <[email protected]>

---------

Co-authored-by: Mike Birnstiehl <[email protected]>
(cherry picked from commit e0038b6)
  • Loading branch information
alaudazzi authored and mergify[bot] committed Apr 15, 2024
1 parent ce2e438 commit 3670717
Show file tree
Hide file tree
Showing 2 changed files with 27 additions and 0 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -36,4 +36,6 @@ include::monitor-aws-firehose.asciidoc[]

include::monitor-aws-vpc-flow-logs.asciidoc[leveloffset=+2]

include::monitor-aws-firehose-troubleshooting.asciidoc[leveloffset=+2]

include::monitor-aws-esf.asciidoc[]
Original file line number Diff line number Diff line change
@@ -0,0 +1,25 @@
[[monitor-aws-firehose-troubleshooting]]
= Troubleshooting

++++
<titleabbrev>Troubleshooting</titleabbrev>
++++

You can use the monitoring tab in the Firehose console to ensure there are incoming records and the delivery success rate is 100%. By default Firehose also logs to a Cloudwatch log group with the name `/aws/kinesisfirehose/<delivery stream name>`, which is automatically created when the delivery stream is created. Two log streams, `DestinationDelivery` and `BackupDelivery`, are created in this log group.

The backup settings in the delivery stream specify how failed delivery requests are handled. For more details on how to configure backups to S3, refer to <<firehose-step-three>>.

[discrete]
[[aws-firehose-troubleshooting-scaling]]
== Scaling

Firehose can https://docs.aws.amazon.com/firehose/latest/dev/limits.html[automatically scale] to handle very high throughput. If your Elastic deployment is not properly configured for the data volume coming from Firehose, it could cause a bottleneck, which may lead to increased ingest times or indexing failures.

There are several facets to optimizing the underlying Elasticsearch performance, but Elastic Cloud provides several ready-to-use hardware profiles which can provide a good starting point. Other factors which can impact performance are {ref}/size-your-shards.html[shard sizing], {ref}/tune-for-indexing-speed.html[indexing configuration], and {ref}/index-lifecycle-management.html[index lifecycle management (ILM)].


[discrete]
[[aws-firehose-troubleshooting-support]]
== Support

If you encounter further problems, please contact https://www.elastic.co/guide/en/starting-with-the-elasticsearch-platform-and-its-solutions/current/get-support-help.html[Elastic support].

0 comments on commit 3670717

Please sign in to comment.