Discussions

• 0 You must be logged in to vote

  💬

  Draft: Efficient RegexFSM Concatenation / Union, Enabling LALR(1), Multi-Terminal Tokens

  lapp0 started Feb 16, 2024 in General

  

  

  

  

  6
• 1 You must be logged in to vote

  🙏

  Now I use outlines+vllm and it takes 10 seconds to generate a JSON. This speed is not feasible in my current business. Is there any accelerated solution, such as a paper, plan or PR?

  lwdnxu asked Sep 18, 2024 in Q&A · Unanswered

  

  

  

  

  3
• 1 You must be logged in to vote

  💬

  Paper: Let Me Speak Freely? A Study on the Impact of Format Restrictions on Performance of Large Language Models

  ChristianWeyer started Aug 26, 2024 in General

  

  

  1
• 1 You must be logged in to vote

  💡

  Feature Request: Expand Collapse Block, Tab Block, Image Options

  jonnymccullagh started Aug 22, 2024 in Feature requests · Closed

  

  

  2
• 1 You must be logged in to vote

  💡

  Allow for Pydantic model field structured output without JSON schema validation

  ncoop57 started Aug 14, 2024 in Feature requests

  

  

  0
• 1 You must be logged in to vote

  🙏

  Supported models?

  jammiguelyfish asked Aug 1, 2024 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Generating grammars automatically following lark grammar

  AdrienCorenflos asked Aug 2, 2024 in Q&A · Unanswered

  

  

  1
• 2 You must be logged in to vote

  🙏

  How to use multimodal models with Outlines?

  cegutica asked Jul 18, 2024 in Q&A · Answered

  

  

  

  

  9
• 0 You must be logged in to vote

  💬

  How to bypass group reference in regex expression

  wanxingliu94 started Jul 14, 2024 in General

  

  

  1
• 1 You must be logged in to vote

  🙏

  How to use the openai api service deployed by VLLM to use outlines

  deku0818 asked Jul 13, 2024 in Q&A · Unanswered

  

  

  

  

  4
• 2 You must be logged in to vote

  🙏

  Working with Groq?

  ubervincent asked May 6, 2024 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Huggingface token in Official docker image

  Ofplarsen asked Jul 5, 2024 in Q&A · Unanswered

  

  

  3
• 1 You must be logged in to vote

  🙏

  How to use outlines with Replicate.com?

  stephane-klein asked Jul 7, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Huggingface Transformers/Tokenizers do not have required attributes for outlines.models.Transformers

  ahgraber asked Jun 12, 2024 in Q&A · Answered

  

  

  3
• 1 You must be logged in to vote

  💡

  Add support for CTranslate2 backend

  lewoudar started Jun 15, 2024 in Feature requests

  

  

  1
• 3 You must be logged in to vote

  🙏

  How to add the grammar of an entire programming language for better code generation?

  help wanted structured generation Linked to structured generation grammar

  MoritzLaurer asked May 12, 2024 in Q&A · Unanswered

  

  

  2
• 2 You must be logged in to vote

  💡

  Multimodal support for Llava

  kshetrajna12 started Jan 17, 2024 in Feature requests

  

  

  

  

  2
• 1 You must be logged in to vote

  🙏

  Can't find class named FSM in outlines.fsm.fsm

  axxx03 asked Jun 8, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  How to enforce a JSON without defining a schema?

  shixianc asked Jun 4, 2024 in Q&A · Unanswered

  

  

  0
• 2 You must be logged in to vote

  💬

  How to use guided decoding and regex in vLLM with outlines backend?

  debraj135 started May 27, 2024 in General

  

  

  0
• 5 You must be logged in to vote

  🙏

  Comparison between Outlines and other structured generation libs

  gabrielgrant asked May 24, 2024 in Q&A · Unanswered

  

  

  0
• 2 You must be logged in to vote

  🙏

  Huggingface TGI / external API Support?

  ibndias asked Apr 8, 2024 in Q&A · Unanswered

  

  

  

  

  2
• 1 You must be logged in to vote

  🤖

  JSON generation fails for Llama-2-7b-chat-hf

  vegaluisjose started Feb 20, 2024 in Weird model output

  

  

  

  

  6
• 1 You must be logged in to vote

  💬

  Allow Tokens to Span Multiple Terminals in CFG

  enhancement grammar

  lapp0 started Jan 23, 2024 in General

  

  

  

  

  2
• 1 You must be logged in to vote

  🤖

  Why do we select only the 1st char in the decoded string in get_next_state() ?

  ekagra-ranjan started May 3, 2024 in Weird model output

  

  

  

  

  4