Temporal Belief Dynamics in BERT

Research project · Jun 2025 – Jul 2025

What it is

A study of how BERT's internal "beliefs" change while it is being fine-tuned.

• Mapped the evolution of BERT's internal "beliefs" across 10 fine-tuning epochs, using graph-theoretic networks and 2D embeddings to uncover and visualize hidden representation drift with research-grade clarity.
• Findings accepted for publication at the 7th International Conference on Communication and Intelligent Systems 2025.

Publication

M.D.K. et al., "Temporal Belief Dynamics in BERT: A Graph-Theoretic Approach to Interpretable Representation Drift," published at the 7th International Conference on Communication and Intelligent Systems (ICCIS 2025), BITS Pilani, Goa, Springer LNCS.

Where it came from

This work started during my research internship at RAPID Research Lab (May – Jun 2025).

Stack: BERT · graph-theoretic networks · 2D embeddings