Guide & Resources
Tei features
What you can do with Tei, fully managed by Elestio.
What you can do with Tei, fully managed by Elestio.
Text Embeddings Inference: A blazing fast inference solution for text embeddings models. Benchmark for BAAI/bge-base-en-v1.5 on an Nvidia A10 with a sequence length of 512 tokens:
TEI incorporates token-based dynamic batching, thus optimizing resource utilization during inference.
TEI leverages Flash Attention, Candle, and cuBLASLt by using optimized transformers code for inference.
TEI loads Safetensors weights for faster boot times.
TEI supports distributed tracing through Open Telemetry and exports Prometheus metrics.
Explore Tei on Elestio
Tei runs on a dedicated instance, with backups, monitoring, SSL and updates handled by Elestio. Learn more about the software and everything included with the managed service.
Overview, screenshots and key benefits of Tei.
Everything Elestio manages for your Tei instance.
Deploy Tei on Elestio step by step.
Live prices for every cloud provider and region.
Join thousands of developers who trust Elestio for fully managed hosting. Up and running in minutes, on any cloud.