Annotation agreement: when κ = 0.8 is not enough
What a median of κ = 0.91 hides, when agreement coefficients mislead, and how stratified reporting replaces a single number.
Read articleINSIGHTS
We turn project experience into reusable method notes: how synchronization is measured, how field work is closed out, how agreement should be interpreted, and how ethics becomes part of the workflow.
01 / Featured
Start with the quality line that is easiest to overlook.
What a 1.4 ms sync error actually means, where it comes from, how to measure it, and what an auditable synchronization report should contain.
Read the article02 / All articles
Ordered by publication date. All articles are also available in Chinese.
What a median of κ = 0.91 hides, when agreement coefficients mislead, and how stratified reporting replaces a single number.
Read articleFrom research questions and on-site execution to transcription, alignment and ingest: a full walkthrough of a dialect field collection and the traps along the way.
Read articleInformed consent, voiceprint identifiability and de-identification for children's corpora, plus the engineering measures that make ethics operational.
Read article03 / Topics
04 / Keywords
Research partnership
If you are planning multimodal collection, annotation or validation, we can help you turn the research question into an executable protocol and a QA plan.
Reply within one business day · NDA and data licensing supported · Dedicated academic track