Text Similarity and Threshold Calibration

A cache hit is a quota refund: semantic caching with trigrams and no vector database

A dev.to tutorial builds a semantic cache in pure Python. The part worth your time is not the code, it is what hit rate does to your effective quota under a rate limit.