One Size Does Not Fit All: Customizing Open-Domain Procedures

arXiv:2311.09510v2 Announce Type: replace
Abstract: How-to procedures, such as how to plant a garden, are now used by millions of users, but sometimes need customizing to meet a user's specific needs, e.g., planting a garden without pesticides. Our goal is to measure and improve an LLM's ability to perform such customization. Our approach is to test several simple multi-LLM-agent architectures for customization, as well as an end-to-end LLM, using a new evaluation set, called CustomPlans, of over 200 WikiHow procedures …

abstract arxiv cs.cl customization domain how-to llm type