Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Abstract spec refinement -- tracking issue #34

Open
4 tasks
bkmartinjr opened this issue Sep 28, 2022 · 2 comments
Open
4 tasks

Abstract spec refinement -- tracking issue #34

bkmartinjr opened this issue Sep 28, 2022 · 2 comments
Assignees

Comments

@bkmartinjr
Copy link
Member

bkmartinjr commented Sep 28, 2022

Tracking issue for tactical refinement of the abstract spec as we run up to an early pilot implementation.


  • Version number API: current view is: use semver and have separate version numbers for SOMA API and package implementation.
    The open question: how should the API present the semver -- as a string (get_version->'1.3.2-rc1-test+buildlabel') or as a numeric/label tuple/list (get_version -> [1, 3, 2, ['rc1', 'test'], ['build-label']])
  • dense nd array - should the read operator support incremental/chunked reads, or should we remove the batch_size parameter? (the end user can still do their own chunking, as they know the chunk/result size)
  • dense nd array - when the user asks for the read operator to return results in the dense format (aka Tensor), what is the shape of the tensor? (eg, TileDB returns a 1D flattened array, always)
  • shape and reshape - object shape is currently set at create-time. Some of the objects (eg, SOMA*NdArray) would benefit from a post-create reshape operation. Should we support this, and what are the implications on implementation?
@gspowley
Copy link
Member

dense nd array - should the read operator support incremental/chunked reads, or should we remove the batch_size parameter? (the end user can still do their own chunking, as they know the chunk/result size)

We can support batching for dense arrays in the SOMA C++ API. This would remove the burden of batching from the user and provide a more symmetric API for dense and sparse arrays.

@bkmartinjr
Copy link
Member Author

support batching for dense arrays in the SOMA C++ API.

Do you have a suggestion for what the interface would look like? I.e., a suggestion on how to return the coordinates of each chunk? I do think it would be useful

@johnkerl johnkerl changed the title abstract spec refinement - tracking issue Abstract spec refinement -- tracking issue Feb 3, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants