Skip to content

Benchmark

MTEB

Massive Text Embedding Benchmark, a standard suite for scoring text embedding models on retrieval, classification, clustering, reranking and other tasks.

Known aliases

  • Massive Text Embedding Benchmark
  • MTEB
  • MTEB Code

Current stories

buildOne report1 publisher

EmbeddingGemma 2 maps five modalities into one 768-dimension vector space

Google DeepMind released EmbeddingGemma 2, a 740M-parameter open model that runs on a phone and embeds text, code, images, video and audio in one space. Teams running a separate embedder per modality can consolidate on it if Google's reported benchmark numbers hold on their own data.

Publishers:dev.to

Reality

Evidence50
Adoption20
Hype gap+25
Incentives60
Confidence55
buildConfirmed15 publishers

Google's EmbeddingGemma 2 fits multimodal search into 567MB of phone RAM

Google released EmbeddingGemma 2, an Apache 2.0 model that maps text, code, images, video and audio into one embedding space with 740M parameters. Phone apps get offline cross-media search from one set of weights, within limits set by a shared 8K-token window and lossy vector truncation.

Perspective Coverage

17 publishers
Builder
Builder 59%
Operator
Operator 29%
Investor
Investor 12%

Reality

Evidence55
Adoption22
Hype gap+20
Incentives70
Confidence62