A research paper compares the performance of classical models and large language models (LLMs) on tabular data, finding that training a classical model can be more effective than using a frozen LLM, especially when given a small amount of labeled data. This has implications for business prediction problems where labels are expensive.