You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
ReLLM Exact structure out of any LLM by constraining pre-generation logits with regex. ParserLLM is an extension to ReLLM that constrains LLMs to only generating a specific context-free grammar (e.g., JSON).
Typed LLM API Use TypeScript types to enforce a schema on LLM output
Model API Gateway Call over 20+ LLMs from a single API. For a WebGPU powered Llama-2 playground, see thiggle
Structured LLM Completion APIs Structured LLM completion APIs. Generate text with LLMs that conform to regex patterns, context-free grammars, or classification.
@react-llm/headless Easy-to-use headless React Hooks to run LLMs in the browser with WebGPU. All inference happens clientside in the browser. See chat.matt-rickard.com for a live example.
LLaMaTab A Chrome Extension that uses @react-llm/headless to run a LLM entirely in the browser. Load the model once and run on any site.
openlm a drop-in OpenAI-compatible Python library that can call LLMs from any other hosted inference API. OpenLM takes in the same parameters as the openai.Completion class and and outputs a similarly structured result.
llm.ts A TypeScript equivalent of OpenLM that works in any JS environment (browser, node, deno)
ScapeNetosrs-ocr Fine-tuned object recognition and OCR models for the MMORPG Old School RuneScape