Description
Without broker logs, investigating Kafka connectivity problems and broker errors during operation is harder. Logs can be sent to CloudWatch Logs, Firehose, or S3.
Potential impact
Without broker-level error records, finding the cause of message delays and failures can take longer.
Remediation
Configure the chosen destination in logging_info.broker_logs and set its enabled value to true. Verify that logs actually reach at least one destination.
Examples
The examples show only broker log-delivery settings. Other required settings, including the cluster name, Kafka version, and broker nodes, are omitted.
Before
hcl
resource "aws_msk_cluster" "example" {
logging_info {
broker_logs {
cloudwatch_logs {
enabled = false
log_group = aws_cloudwatch_log_group.test.name
}
firehose {
delivery_stream = aws_kinesis_firehose_delivery_stream.test_stream.name
}
}
}
}
After
hcl
resource "aws_msk_cluster" "example" {
logging_info {
broker_logs {
cloudwatch_logs {
enabled = true
log_group = aws_cloudwatch_log_group.test.name
}
}
}
}