Research

TL;DR: We steer LLMs away from hallucinations by dynamically amplifying context-sensitive attention heads.

Large language models (LLMs) often produce fluent but factually incorrect statements, even when relevant evidence is available, due to misallocation of attention between contextual inputs and parametric knowledge. Ensuring that models actively reason over context and retrieve relevant information is critical for trustworthy and interpretable AI. We introduce COMPASS (Context-Modulated PID Attention Steering System), a lightweight, interpretable framework that dynamically steers attention to retrieved context during generation. Using the Context Reliance Score (CRS), COMPASS identifies which attention heads are underutilizing context, and a PID controller adjusts them in real time to improve evidence grounding and factual consistency. This mechanism enables the model to demonstrate advanced reasoning by actively returning to context and retrieving supporting information when needed, without retraining or multi-pass decoding. Across benchmarks including HotpotQA, XSum, HaluEval, and RAGTruth, COMPASS reduces hallucinations by 2.8–5.8% absolute while revealing how attention heads contribute to context-aligned reasoning. These results show that feedback-driven, interpretable control can enhance reasoning, retrieval, and evidence based generation in LLMs.

TL;DR: Using Colley's matrix (a traditional sports-ranking system), we propose an urban sustainability index/ranking list to rival Yale EPI.

Using different multipliers and b-vectors as applications of Colley's Matrix, we have produced many different viable rankings for different countries based on their environmental metrics: percent renewable electricity, pollution AQI, recycling EPI, CO2 emissions, waste, and wastewater generated. We found that all the different rankings produce similar results and trends as Yale EPI, even with some variation.

TL;DR: Currently working on a new research project. Details coming soon.

Research project currently in progress. More information will be added as the project develops.