Custom Datasets for audio/video files?

[andrewcstewart]

Hi folks. Is anyone aware of any custom datasets out there for audio and/or video files? I suspect I'll have to create my own classes for that, but thought I'd check to see if anyone is aware of existing work.

As for writing some new custom datasets, I'd be happy to hear any advice/suggestions from folks here. I am thinking that the closest examples to model off of would be kedro.extras.datasets.pillow.ImageDataSet.

[mzjp2]

Closest thing I could find is: https://stackoverflow.com/questions/65900415/how-do-i-add-a-directory-of-wav-files-to-the-kedro-data-catalogue

[datajoely]

Hi @andrewcstewart this doesn't exist today - but we'd love to accept a PR for this. You're completely right that the pillow.ImageDataSet is the best analogue for what you're trying to do.

Instead of Pillow I think the best candidates look like:

• MoviePy
• ImageIO
• SimpleCV
• OpenCV2

Depending on what you need to do - this section of the MoviePy docs may be helpful

[astrojuanlu]

These days there's actually a VideoDataset https://docs.kedro.org/projects/kedro-datasets/en/kedro-datasets-5.1.0/api/kedro_datasets.video.VideoDataset.html