Researchers studied how fine-tuning large language models (LLMs) affects their internal mechanisms, including attention patterns and layer-wise activations. They found that task-relevant components are concentrated within specific layers, but the distribution of these components is not correlated with the layers undergoing the most significant representational changes. This suggests that fine-tuning can lead to a degradation of performance on other tasks when there is overlap in task-specific components.