Product1 publisher2 min readPublished
Red Hat's AutoRAG preview turns chunking and embedding choices into a scored search
The upcoming technical preview in Red Hat OpenShift AI 3.5 runs the combinations and compiles the winner into a deployable pipeline. The test data and the metric it scores against are still yours to supply.
The Product Desk · Product desk

What happened
- Red Hat says building a retrieval-augmented generation pipeline is no longer a hurdle for many enterprise AI teams, and that the real issue is optimizing the pipeline once it exists.
- AutoRAG, an upcoming advanced technical preview in OpenShift AI 3.5, automates evaluation and hyperparameter tuning across RAG frameworks using Kubeflow Pipelines and IBM's open source ai4rag engine.
- Picking a winner from AutoRAG's leaderboard generates production-ready artifacts for both the ingestion pipeline and the query endpoint, work that Red Hat says previously meant rebuilding the architecture by hand.
- The query half comes out as a Responses API configuration via Open GenAI Framework, formerly Llama Stack, with a pattern.json and copy-paste snippets in Python, cURL, Go and Node.js.
Compiled by The Product DeskSomething wrong?How this is made
Why it matters
- decision The eval set becomes the deciding artifact. The person who writes the test questions, not the platform team, effectively picks which chunking and embedding combination reaches production.
- cost Tuning cost moves from engineer time to cluster time, and Red Hat's own pruning stage is the admission that a full matrix over these settings is expensive enough to need trimming first.
- capability Re-tuning after a corpus change becomes a re-run of a compiled pipeline instead of a manual rebuild. That is a different operational job from the notebook-to-production handoff teams do now.
- constraint Teams whose internal documents are not in German, Spanish or Japanese have to wait for a later release before the language-aware pruning does anything for them.
Before AutoRAG, Red Hat says, testing an optimized RAG pattern in a live environment meant rebuilding the pipeline architecture by hand and pulling configurations out of notebooks [4]. The pattern being rebuilt had been chosen by feel in the first place. Between chunking strategy, embedding models and generation parameters, developers "are often left to guess which combination of factors yields the highest model faithfulness," Red Hat wrote [2].
A search needs inputs the platform does not ship with. One is the metric. The other is a test set, because the preselector benchmarks embedding models and LLMs against your test data and drops the poor performers before the full optimization matrix runs [10].
Then there is compute. Red Hat added the preselector to improve compute efficiency across large search spaces and to cut computation on incompatible model combinations [11]. The pattern AutoRAG eventually compiles carries document parsing, chunking strategy, embedding model configuration and vector database indexing parameters [5]. Three candidate values for each of those four settings, to take a round number, is 81 combinations to score [14]. Chunking and the embedding model both sit in the ingestion half, so most of those combinations mean ingesting and indexing the corpus again [15].
Red Hat's post does not include benchmark figures for AutoRAG-selected patterns, pricing, a general availability date, or a duration for the deployment cycle it says the feature compresses [13]. The post does say that the step from "pipeline ready" to first interactive test becomes a near-instant configuration load, using an inline chat window against the selected pattern [7]. Native multilingual ingestion removes the translation layer, and starts with German, Spanish and Japanese, with Latin, CJK and Cyrillic scripts named for later releases [8][9]. A team whose internal documents are in Hindi or Arabic is not covered by this preview [16].
Schedule a run if you have a test set drawn from your own documents that you would defend in a design review, and cluster capacity for the matrix. With both, re-tuning becomes a job you re-run when the corpus changes, since the winner compiles into a redeployable Kubeflow Pipeline [5]. A team with the test set and no spare capacity should run the preselector alone, which is the stage that prunes candidates before the full matrix [10]. A team with capacity and no test set has to write the test questions before any of the scoring means anything.
What to watch
- Whether the technical preview reaches general availability with published faithfulness numbers for AutoRAG-picked patterns against hand-tuned baselines.
- Which languages Red Hat names next, and whether scripts outside Latin, CJK and Cyrillic appear at all.
- Whether the search cost is metered by Red Hat or simply lands in the customer's own cluster budget.