-
Notifications
You must be signed in to change notification settings - Fork 171
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Add the Firehose troubleshooting section to the new AWS monitoring do…
…cs (#3750) * Add troubleshooting section to Firehose guide * Update docs/en/observability/cloud-monitoring/aws/monitor-aws-firehose-troubleshooting.asciidoc Co-authored-by: Mike Birnstiehl <[email protected]> --------- Co-authored-by: Mike Birnstiehl <[email protected]> (cherry picked from commit e0038b6)
- Loading branch information
1 parent
ce2e438
commit 3670717
Showing
2 changed files
with
27 additions
and
0 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
25 changes: 25 additions & 0 deletions
25
...bservability/cloud-monitoring/aws/monitor-aws-firehose-troubleshooting.asciidoc
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,25 @@ | ||
[[monitor-aws-firehose-troubleshooting]] | ||
= Troubleshooting | ||
|
||
++++ | ||
<titleabbrev>Troubleshooting</titleabbrev> | ||
++++ | ||
|
||
You can use the monitoring tab in the Firehose console to ensure there are incoming records and the delivery success rate is 100%. By default Firehose also logs to a Cloudwatch log group with the name `/aws/kinesisfirehose/<delivery stream name>`, which is automatically created when the delivery stream is created. Two log streams, `DestinationDelivery` and `BackupDelivery`, are created in this log group. | ||
|
||
The backup settings in the delivery stream specify how failed delivery requests are handled. For more details on how to configure backups to S3, refer to <<firehose-step-three>>. | ||
|
||
[discrete] | ||
[[aws-firehose-troubleshooting-scaling]] | ||
== Scaling | ||
|
||
Firehose can https://docs.aws.amazon.com/firehose/latest/dev/limits.html[automatically scale] to handle very high throughput. If your Elastic deployment is not properly configured for the data volume coming from Firehose, it could cause a bottleneck, which may lead to increased ingest times or indexing failures. | ||
|
||
There are several facets to optimizing the underlying Elasticsearch performance, but Elastic Cloud provides several ready-to-use hardware profiles which can provide a good starting point. Other factors which can impact performance are {ref}/size-your-shards.html[shard sizing], {ref}/tune-for-indexing-speed.html[indexing configuration], and {ref}/index-lifecycle-management.html[index lifecycle management (ILM)]. | ||
|
||
|
||
[discrete] | ||
[[aws-firehose-troubleshooting-support]] | ||
== Support | ||
|
||
If you encounter further problems, please contact https://www.elastic.co/guide/en/starting-with-the-elasticsearch-platform-and-its-solutions/current/get-support-help.html[Elastic support]. |