An empirical study on human-AI synergy in large language models (LLMs) found that while LLMs improve accuracy when assisting humans, the extent of accuracy gain varies across models and tasks. The study suggests evaluating LLMs in interaction with humans and designing support for selective deference to preserve human reasoning.