Merge branch 'main' into table-questioning

openvinotoolkit · Oct 31, 2023 · 396b257 · 396b257
2 parents ebc4eb9 + b5b96fa
commit 396b257
Show file tree

Hide file tree

Showing 15 changed files with 1,416 additions and 200 deletions.
diff --git a/.ci/ignore_convert_execution.txt b/.ci/ignore_convert_execution.txt
@@ -48,4 +48,5 @@ notebooks/259-decidiffusion-image-generation/259-decidiffusion-image-generation.
 notebooks/260-pix2struct-docvqa/260-pix2struct-docvqa.ipynb
 notebooks/262-softvc-voice-conversion/262-softvc-voice-conversion.ipynb
 notebooks/263-latent-consistency-models-image-generation/263-latent-consistency-models-image-generation.ipynb
+notebooks/264-qrcode-monster/264-qrcode-monster.ipynb
 notebooks/404-style-transfer-webcam/404-style-transfer.ipynb
diff --git a/.ci/ignore_treon_docker.txt b/.ci/ignore_treon_docker.txt
@@ -30,6 +30,7 @@
 260-pix2struct-docvqa
 262-softvc-voice-conversion
 263-latent-consistency-models-image-generation
+264-qrcode-monster
 301-tensorflow-training-openvino
 305-tensorflow-quantization-aware-training
 404-style-transfer-webcam
diff --git a/.ci/ignore_treon_linux.txt b/.ci/ignore_treon_linux.txt
@@ -34,4 +34,5 @@
 260-pix2struct-docvqa
 262-softvc-voice-conversion
 263-latent-consistency-models-image-generation
+264-qrcode-monster
 404-style-transfer-webcam
diff --git a/.ci/ignore_treon_mac.txt b/.ci/ignore_treon_mac.txt
@@ -31,4 +31,5 @@
 260-pix2struct-docvqa
 262-softvc-voice-conversion
 263-latent-consistency-models-image-generation
+264-qrcode-monster
 404-style-transfer-webcam
diff --git a/.ci/ignore_treon_win.txt b/.ci/ignore_treon_win.txt
@@ -32,4 +32,5 @@
 259-decidiffusion-image-generation
 260-pix2struct-docvqa
 262-softvc-voice-conversion
-263-latent-consistency-models-image-generation
+263-latent-consistency-models-image-generation
+264-qrcode-monster
diff --git a/.ci/spellcheck/.pyspelling.wordlist.txt b/.ci/spellcheck/.pyspelling.wordlist.txt
@@ -440,6 +440,7 @@ PyTorch
 PyTorchVideo
 QFormer
 Qi
+qrcode
 quant
 quantized
 quantizer

diff --git a/README.md b/README.md
@@ -38,6 +38,7 @@ Check out the latest notebooks that show how to optimize and deploy popular mode
 | [Fast Segment Anything](notebooks/261-fast-segment-anything/)<br>[![Binder](https://mybinder.org/badge_logo.svg)](https://mybinder.org/v2/gh/openvinotoolkit/openvino_notebooks/HEAD?filepath=notebooks%2F261-fast-segment-anything%2F261-fast-segment-anything.ipynb)<br>[![Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/openvinotoolkit/openvino_notebooks/blob/main/notebooks/261-fast-segment-anything/261-fast-segment-anything.ipynb) | Object segmentations with FastSAM and OpenVINO™ | <img src="https://user-images.githubusercontent.com/26833433/248551984-d98f0f6d-7535-45d0-b380-2e1440b52ad7.jpg" width=225> |
 | [SoftVC VITS Singing Voice Conversion](notebooks/262-softvc-voice-conversion)<br> | SoftVC VITS Singing Voice Conversion and OpenVINO™ | |
 | [Latent Consistency Models: the next generation of Image Generation models ](notebooks/263-latent-consistency-models-image-generation)<br> | Image generation with Latent Consistency Models (LCM) and OpenVINO™ |  <img src=https://user-images.githubusercontent.com/29454499/277367065-13a8f622-8ea7-4d12-b3f8-241d4499305e.png width=300> |
+| [QR Code Monster](notebooks/264-qrcode-monster/)<br> | Generate creative QR codes with ControlNet QR Code Monster and OpenVINO™ | <img src="https://github.com/openvinotoolkit/openvino_notebooks/assets/76463150/1a5978c6-e7a0-4824-9318-a3d8f4912c47" width=225> |
 
 ## Table of Contents
 
@@ -201,7 +202,8 @@ Demos that demonstrate inference on a particular model.
 | [261-fast-segment-anything](notebooks/261-fast-segment-anything/)<br>[![Binder](https://mybinder.org/badge_logo.svg)](https://mybinder.org/v2/gh/openvinotoolkit/openvino_notebooks/HEAD?filepath=notebooks%2F261-fast-segment-anything%2F261-fast-segment-anything.ipynb)<br>[![Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/openvinotoolkit/openvino_notebooks/blob/main/notebooks/261-fast-segment-anything/261-fast-segment-anything.ipynb) | Object segmentations with FastSAM and OpenVINO™ | <img src="https://user-images.githubusercontent.com/26833433/248551984-d98f0f6d-7535-45d0-b380-2e1440b52ad7.jpg" width=225> |
 | [262-softvc-voice-conversion](notebooks/262-softvc-voice-conversion)<br> | SoftVC VITS Singing Voice Conversion and OpenVINO™ | |
 | [263-latent-consistency-models-image-generation](notebooks/263-latent-consistency-models-image-generation)<br> | Image generation with Latent Consistency Models (LCM) and OpenVINO™ |  <img src=https://user-images.githubusercontent.com/29454499/277367065-13a8f622-8ea7-4d12-b3f8-241d4499305e.png width=225> |
-| [266-table-question-answering](notebooks/266-table-question-answering)<br> | TAPAS base model fine-tuned on WikiTable Questions (WTQ) with OpenVINO™ ||
+| [264-qrcode-monster](notebooks/264-qrcode-monster/)<br> | Generate creative QR codes with ControlNet QR Code Monster and OpenVINO™ | <img src="https://github.com/openvinotoolkit/openvino_notebooks/assets/76463150/1a5978c6-e7a0-4824-9318-a3d8f4912c47" width=225> |
+| [266-table-question-answering](notebooks/266-table-question-answering)<br><br>[![Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/openvinotoolkit/openvino_notebooks/blob/main/notebooks/266-table-question-answering/266-table-question-answering.ipynb)<br> | TAPAS base model fine-tuned on WikiTable Questions (WTQ) with OpenVINO™ ||
 
 <div id='-model-training'></div>
 

diff --git a/notebooks/109-performance-tricks/109-latency-tricks.ipynb b/notebooks/109-performance-tricks/109-latency-tricks.ipynb
@@ -67,7 +67,7 @@
     }
    ],
    "source": [
-    "%pip install -q \"openvino>=2023.1.0\" seaborn \"ultralytics<=8.178.0\" onnx"
+    "%pip install -q \"openvino>=2023.1.0\" seaborn \"ultralytics<=8.0.178\" onnx"
    ]
   },
   {
@@ -872,7 +872,7 @@
    "name": "python",
    "nbconvert_exporter": "python",
    "pygments_lexer": "ipython3",
-   "version": "3.11.5"
+   "version": "3.8.10"
   },
   "widgets": {
    "application/vnd.jupyter.widget-state+json": {

diff --git a/notebooks/109-performance-tricks/109-throughput-tricks.ipynb b/notebooks/109-performance-tricks/109-throughput-tricks.ipynb
@@ -3,7 +3,6 @@
   {
    "cell_type": "markdown",
    "metadata": {
-    "collapsed": false,
     "jupyter": {
      "outputs_hidden": false
     }
@@ -61,7 +60,7 @@
    },
    "outputs": [],
    "source": [
-    "%pip install -q \"openvino>=2023.1.0\" seaborn ultralytics onnx"
+    "%pip install -q \"openvino>=2023.1.0\" \"ultralytics<=8.0.178\" seaborn ultralytics onnx"
    ]
   },
   {
@@ -95,7 +94,6 @@
   {
    "cell_type": "markdown",
    "metadata": {
-    "collapsed": false,
     "jupyter": {
      "outputs_hidden": false
     }
@@ -169,7 +167,6 @@
   {
    "cell_type": "markdown",
    "metadata": {
-    "collapsed": false,
     "jupyter": {
      "outputs_hidden": false
     }
@@ -227,7 +224,6 @@
   {
    "cell_type": "markdown",
    "metadata": {
-    "collapsed": false,
     "jupyter": {
      "outputs_hidden": false
     }
@@ -278,7 +274,6 @@
   {
    "cell_type": "markdown",
    "metadata": {
-    "collapsed": false,
     "jupyter": {
      "outputs_hidden": false
     }
@@ -343,7 +338,6 @@
   {
    "cell_type": "markdown",
    "metadata": {
-    "collapsed": false,
     "jupyter": {
      "outputs_hidden": false
     }
@@ -462,7 +456,6 @@
   {
    "cell_type": "markdown",
    "metadata": {
-    "collapsed": false,
     "jupyter": {
      "outputs_hidden": false
     }
@@ -522,7 +515,6 @@
   {
    "cell_type": "markdown",
    "metadata": {
-    "collapsed": false,
     "jupyter": {
      "outputs_hidden": false
     }
@@ -605,7 +597,6 @@
   {
    "cell_type": "markdown",
    "metadata": {
-    "collapsed": false,
     "jupyter": {
      "outputs_hidden": false
     }
@@ -691,7 +682,6 @@
   {
    "cell_type": "markdown",
    "metadata": {
-    "collapsed": false,
     "jupyter": {
      "outputs_hidden": false
     }
@@ -742,7 +732,6 @@
   {
    "cell_type": "markdown",
    "metadata": {
-    "collapsed": false,
     "jupyter": {
      "outputs_hidden": false
     }
@@ -797,7 +786,6 @@
   {
    "cell_type": "markdown",
    "metadata": {
-    "collapsed": false,
     "jupyter": {
      "outputs_hidden": false
     }
@@ -855,7 +843,6 @@
   {
    "cell_type": "markdown",
    "metadata": {
-    "collapsed": false,
     "jupyter": {
      "outputs_hidden": false
     }
@@ -910,7 +897,6 @@
   {
    "cell_type": "markdown",
    "metadata": {
-    "collapsed": false,
     "jupyter": {
      "outputs_hidden": false
     }
@@ -963,7 +949,6 @@
   {
    "cell_type": "markdown",
    "metadata": {
-    "collapsed": false,
     "jupyter": {
      "outputs_hidden": false
     }
@@ -1046,7 +1031,6 @@
   {
    "cell_type": "markdown",
    "metadata": {
-    "collapsed": false,
     "jupyter": {
      "outputs_hidden": false
     }
@@ -1074,7 +1058,14 @@
    "name": "python",
    "nbconvert_exporter": "python",
    "pygments_lexer": "ipython3",
-   "version": "3.11.5"
+   "version": "3.8.10"
+  },
+  "widgets": {
+   "application/vnd.jupyter.widget-state+json": {
+    "state": {},
+    "version_major": 2,
+    "version_minor": 0
+   }
   }
  },
  "nbformat": 4,

diff --git a/...rflow-object-detection-to-openvino/120-tensorflow-instance-segmentation-to-openvino.ipynb b/...rflow-object-detection-to-openvino/120-tensorflow-instance-segmentation-to-openvino.ipynb
-Original file line number
+Diff line change
@@ Expand Up / @@ -440,6 +440,7 @@ PyTorch @@
     PyTorchVideo
     QFormer
     Qi
+    qrcode
     quant
     quantized
     quantizer
@@ Expand Down @@