在 Amazon Kinesis Data Analytics 中使用 CloudWatch 警报 - Amazon Kinesis Data Analytics
Amazon Web Services 文档中描述的 Amazon Web Services 服务或功能可能因区域而异。要查看适用于中国区域的差异,请参阅 中国的 Amazon Web Services 服务入门 (PDF)

本文属于机器翻译版本。若本译文内容与英语原文存在差异,则一律以英文原文为准。

在 Amazon Kinesis Data Analytics 中使用 CloudWatch 警报

使用 Simple Storage Service(Amazon) CloudWatch CloudWatch 指标警报,可以观看指标在指定时间段内的变化。告警根据指标或表达式在多个时间段内相对于某阈值的值执行一项或多项操作。操作的一个示例是将通知发送到 Amazon Simple Notification Service (Amazon SNS) 主题。

有关 CloudWatch 警报的更多信息,请参阅使用亚马逊 CloudWatch 警报

本部分包含用于监控 Kinesis Data Analytics 应用程序的推荐警报。

该表描述了推荐的警报,包括以下几列:

  • 指标表达式:根据阈值进行测试的指标或指标表达式。

  • 统计数据:用于检查指标的统计数据,例如平均值

  • 阈值:使用此警报要求您确定定义预期应用程序性能限制的阈值。您需要通过在正常条件下监控应用程序来确定此阈值。

  • 描述:可能触发此警报的原因以及可能的解决方案。

指标表达式 统计数据 Threshold 描述
停机时间 > 0 Average 0 A downtime greater than zero indicates that the application has failed. If the value is larger than 0, the application is not processing any data. Recommended for all applications. The 停机时间 metric measures the duration of an outage. A downtime greater than zero indicates that the application has failed. For troubleshooting, see 应用程序正在重新启动.
速率(numberOfFailed检查点) > 0 Average 0 This metric counts the number of failed checkpoints since the application started. Depending on the application, it can be tolerable if checkpoints fail occasionally. But if checkpoints are regularly failing, the application is likely unhealthy and needs further attention. We recommend monitoring RATE(numberOfFailedCheckpoints) to alarm on the gradient and not on absolute values. Recommended for all applications. Use this metric to monitor application health and checkpointing progress. The application saves state data to checkpoints when it's healthy. Checkpointing can fail due to timeouts if the application isn't making progress in processing the input data. For troubleshooting, see 检查点已超时.
操作员。 numRecordsOutPerSecond < threshold Average The minimum number of records emitted from the application during normal conditions. Recommended for all applications. Falling below this threshold can indicate that the application isn't making expected progress on the input data. For troubleshooting, see 吞吐量太慢.
records_lag_max|millsBehindLatest > threshold Maximum The maximum expected latency during normal conditions. If the application is consuming from Kinesis or Kafka, these metrics indicate if the application is falling behind and needs to be scaled in order to keep up with the current load. This is a good generic metric that is easy to track for all kinds of applications. But it can only be used for reactive scaling, i.e., when the application has already fallen behind. Recommended for all applications. Use the 记录_延迟_max metric for a Kafka source, or the millisBehindLatest for a Kinesis stream source. Rising above this threshold can indicate that the application isn't making expected progress on the input data. For troubleshooting, see 吞吐量太慢.
lastCheckpointDuration > threshold Maximum The maximum expected checkpoint duration during normal conditions. Monitors how much data is stored in state and how long it takes to take a checkpoint. If checkpoints grow or take long, the application is continuously spending time on checkpointing and has less cycles for actual processing. At some points, checkpoints may grow so or take so long that they fail. In addition to monitoring absolute values, customers should also considering monitoring the change rate with 率 (lastCheckpointSize) and 率 (lastCheckpointDuration). If the lastCheckpointDuration continuously increases, rising above this threshold can indicate that the application isn't making expected progress on the input data, or that there are problems with application health such as backpressure. For troubleshooting, see 州无界增长.
lastCheckpointSize > threshold Maximum The maximum expected checkpoint size during normal conditions. onitors how much data is stored in state and how long it takes to take a checkpoint. If checkpoints grow or take long, the application is continuously spending time on checkpointing and has less cycles for actual processing. At some points, checkpoints may grow so or take so long that they fail. In addition to monitoring absolute values, customers should also considering monitoring the change rate with 率 (lastCheckpointSize) and 率 (lastCheckpointDuration). If the lastCheckpointSize continuously increases, rising above this threshold can indicate that the application is accumulating state data. If the state data becomes too large, the application can run out of memory when recovering from a checkpoint, or recovering from a checkpoint might take too long. For troubleshooting, see 州无界增长.
heapMemoryUtilization > threshold Maximum This gives a good indication of the overall resource utilization of the application and can be used for proactive scaling unless the application is I/O bound. The maximum expected heapMemoryUtilization size during normal conditions, with a recommended value of 90 percent. You can use this metric to monitor the maximum memory utilization of task managers across the application. If the application reaches this threshold, you need to provision more resources. You do this by enabling automatic scaling or increasing the application parallelism. For more information about increasing resources, see 扩缩 生产准备就绪.
cpuUtilization > threshold Maximum This gives a good indication of the overall resource utilization of the application and can be used for proactive scaling unless the application is I/O bound. The maximum expected cpuUtilization size during normal conditions, with a recommended value of 80 percent. You can use this metric to monitor the maximum CPU utilization of task managers across the application. If the application reaches this threshold, you need to provision more resources You do this by enabling automatic scaling or increasing the application parallelism. For more information about increasing resources, see 扩缩 生产准备就绪.
线程数 > threshold Maximum The maximum expected 线程数 size during normal conditions. You can use this metric to watch for thread leaks in task managers across the application. If this metric reaches this threshold, check your application code for threads being created without being closed.
(oldGarbageCollection时间 * 100)/60_000 在 1 分钟内') > threshold Maximum The maximum expected oldGarbageCollection时间 duration. We recommend setting a threshold such that typical garbage collection time is 60 percent of the specified threshold, but the correct threshold for your application will vary. If this metric is continually increasing, this can indicate that there is a memory leak in task managers across the application.
率(oldGarbageCollection计数) > threshold Maximum The maximum expected oldGarbageCollection计数 under normal conditions. The correct threshold for your application will vary. If this metric is continually increasing, this can indicate that there is a memory leak in task managers across the application.
操作员。 currentOutputWatermark -操作员。 currentInputWatermark > threshold Minimum The minimum expected watermark increment under normal conditions. The correct threshold for your application will vary. If this metric is continually increasing, this can indicate that either the application is processing increasingly older events, or that an upstream subtask has not sent a watermark in an increasingly long time.