Skip to content

framework

Sentence-Transformers

Embedding model library named alongside OpenAI as a typical source of RAG embeddings suited to cosine distance.

Known aliases

  • SentenceTransformer

Relationships

No evidence-backed relationships are recorded.

Current stories

build1 publisher

213 seconds per agent step evicts hybrid RAG from the local CPU

The FAISS-plus-BM25 retrieval in this writeup does address vocabulary mismatch, but the agent loop around it ran at over 213 seconds a step on CPU, and that figure decided the deployment, not the retrieval design.

Publishers:dev.to

Reality

Evidence34
Adoption14
Hype gap+42
Incentives38
Confidence56
build1 publisher

A semantic cache hit saves five times what a prompt cache hit saves

The provider cache discounts a repeated prefix, and the worst case is bounded arithmetic. The semantic cache deletes the call outright, but a miss there means a wrong answer, not a rounding error, so the threshold sweep matters more than the hit rate.

Publishers:dev.to

Reality

Evidence46
Adoption
Insufficient
Hype gap+32
Incentives34
Confidence54