10 times faster LLM evaluation with bayesian optimization

Recently I've been working on making large language model evaluations (so slow) fast by using selecting a sensible subset.


Bayesian optimization is used because it’s good for exploration / exploitation of expensive black box (paraphrase, LLM).


[Project here](https://github.com/rentruewang/bocoel)


Please give me your thoughts and suggestions!

bayesian black box box deeplearning evaluation exploitation exploration faster good language language model large language large language model llm making optimization suggestions thoughts