Skip to content
hgy59 edited this page Sep 8, 2024 · 9 revisions

Breaking Changes in MinIO dataformat

MinIO Package Release 2022.10.24-16 is the latest that supports the FS (FileSystem) data mode. Any MinIO version starting at 2022-10-29T06-21-33Z does not support this format anymore.

If your initial minio package installation was with Version 2022.09.07-15 or later, you already have the new format.

To check if you're affected by this change use one of the two methods:

  • check your buckets manually by looking into each folder on your diskstation. If there is exactly a single file per S3 object you need to migrate your data.
  • check the format in the file format.json located in the .minio.sys folder. If the file has an entry "format": "fs" you need to migrate your data.

Otherwise you're already running a single-node single-drive deployment (format is xl or xl-single) and can upgrade to the new MinIO package in future without a migration.

An automated migration is not available.

Existing minio data structures in FS format must be manually migrated as documented in Migrate from Gateway or Filesystem Mode.

For a regular user it is suggested to run an instance of MinIO on a separate system and migrate your data to this new instance. This system could be a desktop, single board computer or a server. If possible you can mount the storage from your diskstation over the network and use it directly during the migration process. After a successful migration replace the data of your current MinIO installation on your diskstation. Please stop MinIO before replacing your data and restart it afterwards.

Standalone Data Migration

You can migrate the data on a single system, alas this is not recommended for huge bucket data, since two minio instances are running on the same system.

The following migration works only with minio package release 2022.10.24-16 and 2022.09.07-15. Those are the only versions released that work with the old FS data format and initialize a new data structure with the SNSD format.

Prerequisites

  • You have a running minio installation on your diskstation that was originally installed with minio version 2022.05.19-14 or older.

  • Assuming the existing minio share is named "minio_old" and you migrate to a share named "minio_new"

  • Create a new shared folder named "minio_new" in the Control Panel like this: grafik

    and configure Read/Write Access for the system internal user sc-minio grafik

  • you need ssh access to the diskstation

  • This guide works only with MinIO Package Version 2022.10.24-16 and 2022.09.07-15 (we recommend version 2022.10.24-16 that provides additional information in the upgrade wizard)

Step by Step Guide

  1. Update your MinIO installation with package Version 2022.10.24-16
  2. Use the existing minio share (minio_old) in the wizard page "MinIO configuration" and optionally alter the minio root user and password.
  3. On the next page "MinIO - Migration Notes" you will see the text: "This MinIO installation uses the FS data format. ..."
  4. Continue the update and you will get a running minio installation
  5. You can login into minio with http://{diskstation-ip}:9001 with the minio root credentialsand navigate to the buckes, the users etc.
  6. Create and run the script minio_new.sh with the following content:
    #!/bin/bash
    export MINIO_ROOT_USER="minio root user name"
    export MINIO_ROOT_PASSWORD="minio root user password"
    PATH=/var/packages/minio/target/bin:${PATH}
    HOME=/var/packages/minio/var
    /var/packages/minio/bin/minio server --address :9002 --console-address :9003 --anonymous /volume1/minio_new
    run this script in foreground and you will see the output of minio server.
    To continue, you need another shell
Clone this wiki locally