You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This is follow up for PR #294 where listing is saved (cached) inside .from_storage() method itself which means it's not lazy unlike all the other DataChain steps.
We should think how to postpone caching / saving listing when all chain steps are applied.
Ideas:
Make some generic step that accepts function (closure) in DatasetQuery
Create .terminate() on DataChain class
...
The text was updated successfully, but these errors were encountered:
This is follow up for PR #294 where listing is saved (cached) inside
.from_storage()
method itself which means it's not lazy unlike all the otherDataChain
steps.We should think how to postpone caching / saving listing when all chain steps are applied.
Ideas:
DatasetQuery
.terminate()
onDataChain
classThe text was updated successfully, but these errors were encountered: