Atlas: Optimizing Deployment of Compound AI Workflows on Heterogeneous Clusters
2026-09-07 12:00Science🔥 42.2 heat score
1sources
1days unfolding
42.2heat score
1mentions
SummaryAI generated
The researchers proposed the Atlas framework, aimed at solving the problem of optimizing the deployment of composite AI workflows constrained by service level objectives (SLOs) on heterogeneous clusters. The framework introduces a Marker Accuracy Predictor (MAP), which uses local conditional precision to transform discrete intermediate outputs and combines workflow topology to generate transition profiles, thereby estimating configuration accuracy without conducting full end-to-end configuration experiments. Atlas models execution plan selection as a mixed-integer linear programming problem, with the goal of maximizing prediction accuracy and satisfying SLO constraints. Experimental results show that in four composite AI workflows, the Spearman correlation of MAP reached 0.947, reducing the experimentation cost by up to 2.6 times compared to full experimentation; under MAP guidance, the execution plans selected by the Atlas optimizer had an error of less than 0.03 from the optimal solution, and reduced deployment costs by up to 42% through heterogeneous deployment.