Skip to content

Commit 9ff81cd

Browse files
Update gemma3 to use openvino genai (#3075)
This PR updates the Gemma3 notebook to use OpenVINO GenAI instead of the transformers library. ## Changes Made - **Replaced transformers with OpenVINO GenAI** - **Updated model loading** to use OpenVINO GenAI pipeline - **Modified gradio helper** to work with OpenVINO GenAI streaming capabilities ## Files Changed - `notebooks/gemma3/gemma3.ipynb` - Main notebook updates - `notebooks/gemma3/gradio_helper.py` - Gradio helper updates - `notebooks/gemma3/README.md` - Documentation updates ## Testing - [x] Notebook runs successfully with OpenVINO GenAI - [x] Gradio interface works with streaming - [x] Image processing functions correctly - [x] All dependencies are properly handled --------- Co-authored-by: Aleksandr Mokrov <[email protected]>
1 parent 44554ee commit 9ff81cd

File tree

3 files changed

+385
-200
lines changed

3 files changed

+385
-200
lines changed

notebooks/gemma3/README.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,4 @@
1-
# Visual-language assistant with Gemma3 and OpenVINO
1+
# Visual-language assistant with Gemma3 and OpenVINO GenAI
22
![](https://github.com/user-attachments/assets/2540a58e-c242-4439-b151-0fd1e6938af1)
33

44
Gemma 3 is Google's new iteration of open weight LLMs. It comes in four sizes, 1 billion, 4 billion, 12 billion, and 27 billion parameters with base (pre-trained) and instruction-tuned versions. The 4, 12, and 27 billion parameter models can process both images and text, while the 1B variant is text only.
@@ -19,7 +19,7 @@ The tutorial consists from following steps:
1919

2020
- Install requirements
2121
- Convert and Optimize model
22-
- Run OpenVINO model inference
22+
- Run OpenVINO GenAI model inference
2323
- Launch Interactive demo
2424

2525
In this demonstration, you'll create interactive chatbot that can answer questions about provided image's content.

0 commit comments

Comments
 (0)