Tokelon
Follow
Stars
This repo contains the source code for RULER: What’s the Real Context Size of Your Long-Context Language Models?
a structural diff that understands syntax 🟥🟩
A developer reference project for creating Retrieval Augmented Generation (RAG) chatbots on Windows using TensorRT-LLM
This reference can be used with any existing OpenAI integrated apps to run with TRT-LLM inference locally on GeForce GPU on Windows instead of cloud.
A blazing fast inference solution for text embeddings models
Generative AI extensions for onnxruntime
Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]
User-friendly WebUI for AI (Formerly Ollama WebUI)
Get up and running with Llama 3.2, Mistral, Gemma 2, and other large language models.
RAG architecture: index and query any data using LLM and natural language, track sources, show citations, asynchronous memory patterns.
The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, and more.
C# implementation of LangChain. We try to be as close to the original as possible in terms of abstractions, but are open to new entities.
the AI-native open-source embedding database
Qdrant - High-performance, massive-scale Vector Database for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/
A cloud-native vector database, storage for next generation AI applications
Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with structured filtering with the fault tolerance and scalability of …
A high-throughput and memory-efficient inference and serving engine for LLMs
The easiest way to serve AI apps and models - Build reliable Inference APIs, LLM apps, Multi-model chains, RAG service, and much more!
Online Inference API for NLP Transformer models - summarization, text classification, sentiment analysis and more
This project employs emotion detection in textual data, specifically trained on Twitter data comprising tweets labeled with corresponding emotions. It seamlessly takes text inputs and provides the …
A lightweight yet feature-rich file logger implementation for the Microsoft.Extensions.Logging framework.
Repository for the source that sits on https://twitchtokengenerator.com
C# Twitch Chat, Whisper, API and PubSub Library. Allows for chatting, whispering, stream event subscription and channel/account modification. Supports everything that supports .NETStandard 2.0
A .NET library for making bots using the Discord API.
Just a fork of RVC for easy audio file voice conversion locally
Easily train a good VC model with voice data <= 10 mins!