Size limitations

[academe-01]

Hello,
I'm facing

Skipped: File too large: 7306601181 > 4294967295

Is there any particular reason for size limit ?
I badly need to compress big files, including 1.5TB single file

I can of course patch sources, but want to be sure it's safe from APFS perspective.

[Dr-Emann]

See #70. The compression format itself can't support compressed files whose compressed size is larger than 4 gig, (it stores offsets into the compressed file as 32 bit unsigned integers), but much worse, macos will kernel panic reading compressed files whose uncompressed size is a little over 4 gig. So it is not safe to remove this limitation.

[academe-01]

See #70. The compression format itself can't support compressed files whose compressed size is larger than 4 gig, (it stores offsets into the compressed file as 32 bit unsigned integers), but much worse, macos will kernel panic reading compressed files whose uncompressed size is a little over 4 gig. So it is not safe to remove this limitation.

Thanks for fast reply.
My bad I didn't look through closed issues.
Ok, understood.
Do you know what behavior we can expect if compressed file size is 4GB but we made some appends/edits and new appends (of course they will be uncompressed) gonna exceed total length of 4GB ? panic as well ?
In this case it's strongly advised to compress only read only files ?

[Dr-Emann]

MacOS will automatically de-compress any modified files. After modifications, the files will no longer be compressed. There's no risk of panics, but compressing files which are modified is usually not what you want, as they'll only be compressed until they are next modified.