You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
In my 33M, dataset, this particular label hash is written 36k times, that means that we are writing (in this specific case) the following objects, (36.000 - 1) times unnecessarily.
As pointed out by @proddata in some private conversations, we could further reduce the storage usage by normalizing how we store the data in CrateDB.
Currently we store the same information,
label_set
many times, e.g:In my 33M, dataset, this particular label hash is written 36k times, that means that we are writing (in this specific case) the following objects, (36.000 - 1) times unnecessarily.
Also, in my test dataset, there are
939
unique label hashes, so potentially we could stop writing objects like that (33x10^6-939
) times.The text was updated successfully, but these errors were encountered: