Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add SAM-2.1 fine-tuning notebook #441

Open
wants to merge 4 commits into
base: main
Choose a base branch
from

Conversation

capjamesg
Copy link

This PR introduces a SAM-2.1 fine-tuning notebook. The notebook uses Roboflow to generate a dataset in the SAM-2.1 mask format for use in training models with image datasets.

The notebook is added to the notebooks directory, and written for use in Google Colab.

The notebook walks through an example of training on a car parts dataset. The dataset includes refined annotations that point to specific parts of a car, such as individual windows and doors. Out of the box, SAM-2.1 tends to label larger regions (i.e. the whole chassis, or the whole car), but with fine-tuning the model starts to improve at more precisely segmenting parts.

The notebook has been tested twice to ensure the code works as expected.

The Roboflow team has published an accompanying tutorial that walks through the notebook in more depth.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants