-
Notifications
You must be signed in to change notification settings - Fork 837
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
add sketch to image notebook (#1991)
- Loading branch information
Showing
3 changed files
with
1,044 additions
and
1 deletion.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,23 @@ | ||
# One Step Sketch to Image translation with pix2pix-turbo and OpenVINO | ||
|
||
Diffusion models achieve remarkable results in image generation. They are able synthesize high-quality images guided by user instructions. In the same time, majority of diffusion-based image generation approaches are time-consuming due to the iterative denoising process.Pix2Pix-turbo model was proposed in [One-Step Image Translation with Text-to-Image Models paper](https://arxiv.org/abs/2403.12036) for addressing slowness of diffusion process in image-to-image translation task. It is based on [SD-Turbo](https://huggingface.co/stabilityai/sd-turbo), a fast generative text-to-image model that can synthesize photorealistic images from a text prompt in a single network evaluation. Using only single inference, pix2pix-turbo achieves comparable by quality results with recent works such as ControlNet for Sketch2Photo and Edge2Image for 50 steps. | ||
|
||
![](https://github.com/GaParmar/img2img-turbo/raw/main/assets/gen_variations.jpg) | ||
|
||
In this tutorial you will learn how to turn sketches into images using [Pix2Pix-Turbo](https://github.com/GaParmar/img2img-turbo) and OpenVINO. | ||
|
||
## Notebook contents | ||
The tutorial consists from following steps: | ||
|
||
- Prerequisites | ||
- Load PyTorch Model | ||
- Convert the model to OpenVINO IR | ||
- Select Inference Device | ||
- Compile OpenVINO Model | ||
- Run Model Inference | ||
- Launch Interactive Demo | ||
|
||
## Installation instructions | ||
This is a self-contained example that relies solely on its own code.</br> | ||
We recommend running the notebook in a virtual environment. You only need a Jupyter server to start. | ||
For details, please refer to [Installation Guide](../../README.md). |
Oops, something went wrong.