Portkey

Experiential Labs bets its open-source router's traces will train cheaper replacements for rented models

The router picks a cheaper model for work that resembles work it has already seen, and falls back to the strongest one when nothing matches. The same traces that enable that call are the proposed training set.