Skip to content

Measuring ESG Content in Financial Text with Frozen LLM Activations: Concept Vectors and Linear Probing

· 0 citations · 19 references

TL;DR

This thesis uses a cheap, off-the-shelf measure of Environmental, Social and Governance content in financial text by monitoring the internal activations of frozen, out-of-the-box LLMs and finds that these methods come close to fully fine-tuned models without any task-specific fine-tuning.

View source

Similar papers

Preprint Sep 2026

From Word Counts to Context: Topic Models for Asset Pricing

News may reveal systematic risk, but whether its context enhances the construction of systematic risk factors is still unclear. We seek to test whether utilizing a sentence transformer represents an improvement over techniques such as Latent Dirichlet Allocation (LDA) in the coherence of topic term lists generated from...

Kevin Foley, Jonathan Hartadi, S. Prakash et al. · 0 citations
Sep 2026

Master Modeler: Learning Institutional Portfolio Construction with Large Language Models

Investment institutions exert substantial influence on asset prices, liquidity, and market stability, making the ability to forecast their portfolio adjustments both academically and practically important. We study modeling investment institutions by fine-tuning large language models (LLMs) to predict next-quarter chan...

Yu-Xiang Cheng, Nan-Jiang Du, Qi-Da Mou et al. · 0 citations
Preprint Sep 2026

Benchmarking Embedding Models for ESG Data

The use of Environmental, Social, and Governance (ESG) data is fundamental for modern corporate accountability, sustainability reporting, and financial decision-making. Embedding models have emerged as a powerful approach for transforming unstructured ESG text into numerical representations suitable for downstream natu...

Motaz Saad, Veronica Cretì, Ivan Gentile et al. · 0 citations
Preprint Sep 2026

FinRegQA-EU: Corruption-Based Preference Data for Grounded EU Financial Regulatory Question Answering

Large Language Models (LLMs) struggle with region-specific factual knowledge, particularly in financial regulation. While benchmarks such as CFinBench, provide broad coverage of financial knowledge in other regions, no comparable resource exists for European financial regulation. We close this gap by proposing an end-t...

Aulia Kharis Rakhmasari, Fang-Rong Yu, A. Hoyle et al. · 0 citations
Review Open access Sep 2026

Online Reviews in SKU-level Demand Forecasting Using Global Cross-Learning LSTM

The findings support Proxy Theory by indicating that review volume and valence can provide leading information before sufficient transaction data accumulate and inform replenishment and safety-stock decisions by reducing underforecasting during demand activation.

I. M. Siregar, I. Fauzi · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.