LLM selection and classification systems

The argmax layer was doing more work than anyone credited

A procurement team swapped a trained classifier for an LLM to pick one cost centre out of thousands. The talk transcript reads as a list of the boundaries you have to rebuild by hand.