Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Added initial implementation of Microsoft.KernelMemory.AI.ONNX package #788

Merged

Conversation

JustinRidings
Copy link
Contributor

Motivation and Context (Why the change? What's the scenario?)

This change includes an entirely new extension that allows TextGeneration with ONNX Models. This scenario allows users to interact with local cloned ONNX Models

High level description (Approach, Design)

This is a scenario that abstracts the general implementation of the OnnxRuntimeGenAI library to work with text generation. More examples on using OnnxGenAI Libraries, please see https://github.com/microsoft/onnxruntime-genai

extensions/ONNX/README.md Outdated Show resolved Hide resolved
@dluc dluc added waiting for author Waiting for author to reply or address comments work in progress labels Sep 17, 2024
extensions/ONNX/Onnx/OnnxTextGenerator.cs Outdated Show resolved Hide resolved
extensions/ONNX/Onnx/OnnxTextGenerator.cs Outdated Show resolved Hide resolved
extensions/ONNX/Onnx/OnnxConfig.cs Show resolved Hide resolved
@dluc dluc force-pushed the user/JustinRidings/AddOnnxExtension branch from 5899510 to 8c5c87d Compare September 20, 2024 17:34
@dluc dluc force-pushed the user/JustinRidings/AddOnnxExtension branch from 502d724 to eadd5a0 Compare October 5, 2024 03:57
@dluc dluc merged commit 59e9f5d into microsoft:main Oct 5, 2024
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
waiting for author Waiting for author to reply or address comments work in progress
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants