Z. Ren

Measuring ESG Content in Financial Text with Frozen LLM Activations: Concept Vectors and Linear Probing

This thesis uses a cheap, off-the-shelf measure of Environmental, Social and Governance content in financial text by monitoring the internal activations of frozen, out-of-the-box LLMs and finds that these methods come close to fully fine-tuned models without any task-specific fine-tuning.