Skip to content

Commit

Permalink
Add docker cluster pod errors due to too many open files (#7183)
Browse files Browse the repository at this point in the history
Co-authored-by: Jiayi Wang <[email protected]>
  • Loading branch information
eks-distro-pr-bot and jiayiwang7 authored Dec 15, 2023
1 parent a47d610 commit 4c46913
Showing 1 changed file with 22 additions and 0 deletions.
22 changes: 22 additions & 0 deletions docs/content/en/docs/troubleshooting/troubleshooting.md
Original file line number Diff line number Diff line change
Expand Up @@ -101,6 +101,28 @@ Then verify you are using _cgroups v1_.
Cgroup Version: 1
```

### Pod errors due to `too many open files`

The bootstrap or EKS Anywhere Docker cluster pods show error: `too many open files`.

This may be caused by running out of [inotify](https://linux.die.net/man/7/inotify) resources. Resource limits are defined by `fs.inotify.max_user_watches` and `fs.inotify.max_user_instances` system variables. For example, in Ubuntu these default to 8192 and 128 respectively, which is not enough to create a cluster with many nodes.

To increase these limits temporarily run the following commands on the host:

```bash
sudo sysctl fs.inotify.max_user_watches=524288
sudo sysctl fs.inotify.max_user_instances=512
```

To make the changes persistent, edit the file `/etc/sysctl.conf` and add these lines:

```bash
fs.inotify.max_user_watches = 524288
fs.inotify.max_user_instances = 512
```

Reference: https://kind.sigs.k8s.io/docs/user/known-issues/#pod-errors-due-to-too-many-open-files

### ECR access denied

```
Expand Down

0 comments on commit 4c46913

Please sign in to comment.