-
Notifications
You must be signed in to change notification settings - Fork 80
Noobaa Support Cases Help Guide for ODF
Danny Zaken edited this page Mar 18, 2024
·
11 revisions
-
Noobaa performance tuning
In many cases, the default resource limits\requests allocated for noobaa pods in ODF are not sufficient for the actual use of noobaa. You can check noobaa CR to see if the defaults have changed (e.g., the default for the DB is 0.5 CPU) and recommend increasing it if not. many times, this is not the root cause of the issue, but it can help in further diagnostic of the system by eliminating other issues. -
How to rebuild Noobaa in ODF
This should be used carefully since it will result in a new empty system and cause loss of all existing data in Noobaa. It is useful when the customer is not using Noobaa, but it interferes with the ODF use (e.g.: upgrade issues, irrelevant alerts, etc.).
In some cases, this can be used as a last resort when there is no other way to restore the system. in that case, if there is a backup of noobaa it is possible to try and restore from backup (see backup and restore support case). - Backup and Restore
-
Postgres logs location in the DB pod -
/var/lib/pgsql/data/userdata/log
-
Debugging Postgres CPU issues
When the DB is maxing its CPU allocation, you can try using Postgrespg_stat_statements
extension to check which queries take the most time to run. By also enabling query logging, you can identify the exact code that produces this query -
Setting debug level
- Dynamically without pods restarts (recommended)
To get core and endpoints logs higher than
L0
, you can increase the debug level. It's important to reduce the level back to 0 after the logs were taken to avoid performance issues due to logging. Also, notice that the debug level is not persistent and is set back to 0 after a pod restart. In ODF 4.13 and up there is a CLI command:On versions 4.12 and older it can be done using an API commandnoobaa system set-debug-level 5
noobaa api redirector publish_to_cluster '{ "target": "" , "method_api": "debug_api", "method_name": "set_debug_level", "request_params": {"level": 5, "module": "core"} }'
- Statically using
noobaa-config
in the config mapnoobaa-config
, set"NOOBAA_LOG_LEVEL: all"
. This will cause all pods to restart with a high debug level. It will also be persistent until it is restored to"NOOBAA_LOG_LEVEL: default_level"
- Dynamically without pods restarts (recommended)
To get core and endpoints logs higher than
If you wish to check the connection from backingstores or namesapcestores to the cloud provider and use the same credentials, you can use the commands (using the noobaa CLI):
- For one backingstore:
noobaa diagnostics analyze backingstore <name>
. - For one namespacestore:
noobaa diagnostics analyze namespacestore <name>
. - For all backingstores and namespacestores:
noobaa diagnostics analyze resources
.