[R] [P] 10 times faster LLM evaluation with bayesian optimization

Recently I've been working on making LLM evaluations fast by using bayesian optimization to select a sensible subset.




Bayesian optimization is used because it’s good for exploration / exploitation of expensive black box (paraphrase, LLM).




[Project link](https://github.com/rentruewang/bocoel)




I would love to hear your thoughts and suggestions on this!

bayesian black box box evaluation exploitation exploration faster good llm love machinelearning making optimization suggestions thoughts