Libraries & frameworks
toon
toon-format/toon
A compact, token-efficient serialization of JSON for LLM prompts with TypeScript SDK, CLI, and lossless round-trips.
Topics
Related projects
gigatoken4.1kDelivers GB-per-second language model tokenization compatible with popular tokenizers, designed for high-throughput preprocessing and inference pipelines for researchers and engineers needing fast text encoding at scale.
yek2.5kYek is a fast Rust CLI that serializes text files in a repository into a single LLM-ready file, respecting git history and ignore rules.
protobuf72.1kGoogle's data interchange format with compilers and runtimes enabling efficient structured serialization across programming languages for backend and cross-service communication developers.
heretic40.4kA fully automatic command-line tool that removes safety alignment from transformers via optimized directional ablation with minimal quality loss.
pandas-ai23.9kA Python library for conversational data analysis, letting users chat with SQL, CSV, and dataframes to query and chart.
peft21.9kA Python library for parameter-efficient fine-tuning like LoRA, adapting large pretrained models by training only small adapters.