Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add audbackend.backend.Minio #231

Open
wants to merge 43 commits into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
43 commits
Select commit Hold shift + click to select a range
e7bbfa0
Add audbackend.backend.MinIO
hagenw Sep 3, 2024
cf34071
Add dependency to minio
hagenw Sep 3, 2024
dd642d0
Rename MinIO to Minio
hagenw Sep 4, 2024
40a2654
Fix Minio.delete() to first remove objects
hagenw Sep 4, 2024
64941c5
Let Minio.exists() return True for "/"
hagenw Sep 4, 2024
fe4b88d
Fix Minio.ls() for non-existing paths
hagenw Sep 4, 2024
054174e
Add tests using a local MinIO server
hagenw Sep 4, 2024
d19d390
Expand tests to 100% code coverage
hagenw Sep 4, 2024
07b34df
Fix remaining issues
hagenw Sep 4, 2024
3ed2685
Update docstrings
hagenw Sep 4, 2024
77b3a14
Define constant hosts values at single position
hagenw Sep 4, 2024
3a8517d
Run tests on play.min.io
hagenw Sep 4, 2024
7073080
Be more conservative for other copy method
hagenw Sep 4, 2024
c5e6a27
Add Minio.get_config()
hagenw Sep 4, 2024
393cff7
Add docstring example
hagenw Sep 4, 2024
2284cfc
Correct get_config() docstring
hagenw Sep 4, 2024
9faf954
Add secure argument
hagenw Sep 4, 2024
1005c6b
Add possibility to provide **kwargs
hagenw Sep 25, 2024
92282f6
Set content-type during upload
hagenw Sep 30, 2024
c70ae7e
Add **kwargs to docstring
hagenw Oct 1, 2024
371cc8c
Add support for owner() (#234)
hagenw Oct 18, 2024
643c85d
Fix owner test under Windows
hagenw Oct 18, 2024
29b5990
Revert "Fix owner test under Windows"
hagenw Oct 18, 2024
74f5c8f
Try to fix Windows owner test
hagenw Oct 22, 2024
792fd5a
Replace _close() with close()
hagenw Oct 22, 2024
6901166
Limit copy size to 4.9 GB
hagenw Oct 22, 2024
520c129
Ensure errors are tested for MinIO
hagenw Oct 22, 2024
86aaf4c
Add docstring to test_get_config
hagenw Oct 22, 2024
2a92642
Add docstring to test_maven_file_structure
hagenw Oct 22, 2024
52a9597
Ground truth var for interfaces in _unversioned.py
hagenw Oct 22, 2024
fc86e53
Ground truth var for interfaces in _versioned.py
hagenw Oct 22, 2024
cb67cd3
Ground truth var for interfaces in _maven.py
hagenw Oct 22, 2024
3aabdf0
Fix typos
hagenw Oct 22, 2024
a044205
Update get_file test
hagenw Oct 22, 2024
4f65f5f
Fix typing of _size()
hagenw Oct 22, 2024
ccf7d63
Remove default None in dict.get()
hagenw Oct 22, 2024
e131cba
Improve code quality
hagenw Oct 22, 2024
6292bfc
Add comment for MinIO credentials
hagenw Oct 22, 2024
785305a
Improve code quality
hagenw Oct 22, 2024
3f0a4b0
Add exception in _get_file()
hagenw Oct 22, 2024
601a825
Fix coverage
hagenw Oct 22, 2024
60c9479
DEBUG: coverage
hagenw Oct 22, 2024
af109fc
Try to fix coverage
hagenw Oct 22, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions audbackend/backend/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -6,3 +6,7 @@
from audbackend.core.backend.artifactory import Artifactory
except ImportError: # pragma: no cover
pass
try:
from audbackend.core.backend.minio import Minio
except ImportError: # pragma: no cover
pass
8 changes: 8 additions & 0 deletions audbackend/core/api.py
Original file line number Diff line number Diff line change
Expand Up @@ -233,3 +233,11 @@ def register(
register("artifactory", Artifactory)
except ImportError: # pragma: no cover
pass

# Register optional backends
try:
from audbackend.core.backend.minio import Minio

register("minio", Minio)
except ImportError: # pragma: no cover
pass
Loading