ORBIT: An Optimal Routing and Budgeted Inference Toolbox

Published in Frontiers of Computer Science, 2026

Recommended citation: Guannan Lai, Haoran Hu, Hao-Xuan Ma, and Han-Jia Ye. (2026). ORBIT: An Optimal Routing and Budgeted Inference Toolbox. Frontiers of Computer Science. https://www.lamda.nju.edu.cn/laign/file/FCS-261310-final.pdf

Abstract

ORBIT is a modular and extensible toolbox for standardized LLM routing research. It provides unified interfaces for benchmark loading, query representation, router implementation, budget-aware evaluation, and method comparison.

Role: Second author.

Status: Accepted at Frontiers of Computer Science