Longju's Blogs

- A hub for technical explorations in research and curated papers that inspire :)

A Brief Summary on Positional Encoding Methods

A summary of positional encoding methods in transformers

5 min read · August 22, 2024

2024 · transformers positional-encoding · Research NLP-Foundations
Representation Engineering: A Top-Down Approach to AI Transparency

Exploring Representation Engineering (RepE) as a parallel research paradigm for interpretability and controllability in LLMs.

4 min read · July 15, 2024

2024 · representation-engineering interpretability · Paper-sharing