Iterate on an LLM, Serve on an SLM
The authors propose a method to develop desired behavior in a large language model (LLM) and then distill that behavior into a smaller language model (SLM) for efficient and economical inference. They demonstrate the effectiveness of this approach using a scheduling agent for home-care agencies.
Save an API key to vote.