A new loss function, Centroid-Guided Contrastive Loss (CGCL), is proposed for structured fraudulent job posting detection. CGCL unifies classification and clustering to achieve high accuracy and meaningful structure in latent-space representations, capturing subtleties among fake posts. Experiments demonstrate state-of-the-art performance on the EMSCAD benchmark dataset.

Researchers proposed Attention-Aware Routing (AAR), a new approach for routing in Mixture-of-Experts (MoE) language models. AAR uses temporal and spectral features from attention weights to improve model performance and reduce long diverging generation. The method exposes a retrieval-reasoning tension across depth in MoE models, making it a controlled probe for routing-relevant information.

Researchers explore the impact of chunking and representation on retrieval-augmented generation in chemistry-aware question answering. They evaluate 41 embedding models on a new benchmark and find that retrieval-tuned E5, BGE, and Nomic models perform well. They also identify optimal chunking strategies and sizes for practical application.

HyQuant is a hybrid-precision quantization framework for large language model (LLM) attention, balancing accuracy and efficiency by retaining high-precision states in critical regions. This affects developers building or operating LLM-based AI agents, as it can improve model performance and reduce costs.

A research paper proposes a model-agnostic framework to repurpose deep limit order book forecasting models for scenario-conditioned market impact modeling. This allows for quantifying the effects of counterfactual order book messages without retraining the models. This advancement has implications for AI agents operating in financial markets, enabling them to better understand and respond to market scenarios.

A company, Wolt, has developed a new AI-powered ranking system called Universal Venue Ranker (UVR) that combines a transformer encoder with a Gradient Boosting Decision Tree (GBDT) ranker to improve personalized store ranking for on-demand delivery. The system was deployed in production and resulted in increased trial and reorder rates, and a simplified serving stack.