How to test DB migration

[iBobik]

Hello,
i did some changes to the schema and wants to try locally if migration will work well.

So I exported data from production:

contember data:export contember://${CONTEMBER_PROJECT}:${CONTEMBER_TOKEN}@api-${CONTEMBER_PROJECT}.eu.contember.cloud --include-system

And imported it on the localhost where I have app's new version with new schema and migrations. Then it run some time and failed:

> npm run contember data:import thebeast.jsonl.gz  

> contember
> docker-compose run --rm contember-cli data:import thebeast.jsonl.gz

[+] Building 0.0s (0/0)                                                                                                  
[+] Creating 2/0
 ✔ Container thebeast-postgres-1          Running                                                                   0.0s 
 ✔ Container thebeast-contember-engine-1  Running                                                                   0.0s 
[+] Running 1/1
 ✔ Container thebeast-postgres-1  Healthy                                                                           0.5s 
[+] Building 0.0s (0/0)                                                                                                  

Importing data into a following project

Project name: xxx
API URL: http://contember-engine:4000
Token: 000***000

This will completely wipe the target project.
(to skip this dialog, you can pass --yes option)

✔ Do you want to continue? … yes
transferred 405 MiB; inserted 47 size rows, 4397202 total; 101 secondsError: Invalid response: Bad Request
{"ok":false,"error":"Incompatible schema version (import version 2023-08-16-162735 does not match server version 2023-08-20-143911)"}
    at ClientRequest.<anonymous> (/opt/contember/run.js:116624:16)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)

Of course database has new version, but I expected it will erase it even with the schema and create old schema from the dump file.

How to test it correctly?

[iBobik]

It seems that this worked:

• Stop and remove psql container and volume
• Restart stack
• contember-cli migration:exec --until 2023-08-16-162735-added-product-size-relation - filename of migration from the "Incompatible schema version" message
• contember-cli data:import xxx.jsonl.gz
• contember-cli migration:exec
• Run own migration tasks and test

[honzasladek]

Yes, this is the best way at the moment.