Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add log insights querying information for Nuxt 5XX errors #4012

Merged
merged 1 commit into from
Apr 4, 2024
Merged
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
Expand Up @@ -5,6 +5,7 @@ Status: **Stable**

Alarm link:
- [Alarm details](https://us-east-1.console.aws.amazon.com/cloudwatch/home?region=us-east-1#alarmsV2:alarm/Nuxt+Production+HTTP+5XX+responses+count+over+threshold)
- [Nuxt Production log group][log_group]
- [ECS-Production-Dashboard](https://us-east-1.console.aws.amazon.com/cloudwatch/home?region=us-east-1#dashboards/dashboard/ECS-Production-Dashboard)
```

Expand All @@ -25,10 +26,36 @@ errors (this can be checked by observing paths in the Cloudflare logs).
investigation into the API side is warranted to determine the cause for the
5XX responses. Also refer to the
[API 5XX runbook](/meta/monitoring/runbooks/api_http_5xx_above_threshold.md).
- To gather more information check the [log group][log_group], use the "Logs
Insights" view to query for requests that failed using a CloudWatch query
similar to the following which can give more hints about where is the problem.

```
fields request, @timestamp, @message
| filter status >= 500
| sort @timestamp desc
| limit 20
```

- Occasionally, we'll observe a high number of 5XX responses on the `/api/event`
endpoint. These are often the result of outages or issues with Plausible and
are not actionable for us. The following Log Insights query can be helpful in
determining the source of the 500s based on the endpoints.

```
fields request, @timestamp, @message
| filter status >= 500
| sort @timestamp desc
| stats count(*) by request
```

[log_group]:
https://us-east-1.console.aws.amazon.com/cloudwatch/home?region=us-east-1#logsV2:log-groups/log-group/$252Fecs$252Fproduction$252Ffrontend

## Historical false positives

Nothing registered to date.
- _2024-04-02, 15:22 UTC_: High number of 500s to the `/api/event` endpoint,
nothing actionable on our end.

## Related incident reports

Expand Down
Loading