Skip to content

Representation-Level Supervision

Home / Concepts / Representation-Level Supervision

Representation-Level Supervision

Auto-generated stub. Edit this file to add more details.

Supervising the intermediate encoder embeddings of a target model by aligning them with embeddings from a pretrained teacher model.

Why It Matters

This is the core technical contribution, contrasting with standard output-level error minimization to improve learned representations.

Evidence

we extract its intermediate embeddings, which are rich in temporal and semantic information, and align them with the target model’s encoder embeddings through representation-level supervision.

Metadata & Links