Skip to content

Why are my AWS CloudWatch logs not ordered correctly by timestamp in SigNoz?  #2682

Description

@revmag

Answer

The AWS CloudWatch receiver uses the timestamp provided by CloudWatch as the event timestamp, which often has lower precision than the actual log entries in your CI/CD pipeline. This can cause logs from the same CloudWatch log stream to appear out of order, especially when multiple log lines share the same CloudWatch timestamp.

The receiver does not automatically parse or extract timestamps from within the log message content itself. For example, if your CodeBuild logs contain timestamps like [Container] 2026/01/05 17:52:19.313300, these more precise timestamps are not used for ordering.

To resolve this issue and preserve correct log ordering:

  1. Use Pipelines to parse and extract the timestamp from your log payload
  2. Configure the pipeline to set the extracted timestamp as the correct log timestamp
  3. This will allow SigNoz to use the more precise timestamp embedded in your log messages for proper ordering

This behavior is expected when using the AWS CloudWatch receiver, as it relies on CloudWatch's event timestamps rather than parsing log content. The limitation comes from how the OpenTelemetry AWS CloudWatch receiver processes the data from the CloudWatch API.

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions