embedding-quantization

To make LLM faster we need faster retrieval system. Here comes Embedding Quantization. Embedding quantization is great technique to save cost on Vector DB, significantly faster retrieval while preserving retrieval performance.

⚡🧠 Vectro+ — High-Performance Embedding Engine in Rust 🦀💾 Compress, quantize, and accelerate vector search 🚀 Boost retrieval speed, cut memory, keep semantic precision 🎯🔥

Unofficial Implementation of Binary and Scalar Embedding Quantization for Significantly Faster & Cheaper Retrieval and Evaluation of RAG system using "SEMALEX" evaluation metric .