Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Two different processes produce .clu.1 files #17

Open
nickponvert opened this issue Mar 25, 2019 · 0 comments
Open

Two different processes produce .clu.1 files #17

nickponvert opened this issue Mar 25, 2019 · 0 comments

Comments

@nickponvert
Copy link
Collaborator

There are currently two different ways for .clu.1 files to be produced, which could potentially cause confusion.

  1. These files are created by klustakwik when you cluster a session
  2. When we cluster multiple sessions, the resulting .clu.1 file that klustakwik makes corresponds to the entire set of spikes across all sessions. To make loading individual sessions easier, we use this multisession .clu.1 file (and the vector of which spikes came from which recording) to save individual .clu.1 files for each session.

Pros of this method: Data loading functions can just look for the .clu.1 file and load it, without having to care if the session was clustered on its own or as part of a multisession clustering run.

Cons of this method: You don't know which sessions were clustered to produce a .clu.1 file. More problematically, multiple different multisession clustering runs containing a session will overwrite the previously-existing .clu.1 file. This happens pretty frequently when you are doing some online clustering with a subset of sessions, and then doing offline clustering later with the full set of sessions.

We should consider whether we want to have each multisession clustering run produce a unique .clu file to avoid confusion about what process generated a specific .clu file.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant