TPDL 2026

A Transparent Evidence Retrieval System for Scholarly Citation Verification its a publication presentation and this is the abstract of the paper

Data Management Plans (DMPs) are mandated by funders as instruments for promoting FAIR data practice, yet evaluating their
quality remains labour-intensive and does not scale. Machine-actionable DMP (maDMPs), structured according to the RDA DMP Common
Standard, open the door to automated assessment, but a communitygrounded, openly published catalog of evaluation criteria has so far been missing. This paper presents three contributions made within the OSTrails project. First, we describe a participatory co-design methodology through which practitioners, tool developers, and funder representatives elicited evaluation criteria grounded in real-world DMP workflows. Second, we present the resulting DMP Evaluation Metrics Catalogue that contains 94 metrics formalised as linked-data records using the FAIR Testing Results (FTR) vocabulary, anchored to RDA DCS schema fields. Third, we demonstrate automated evaluation of maDMPs against community specific benchmarks, showing that a substantial portion of the catalogue can be applied as deterministic, externally validated tests returning machine-readable, field-level feedback for researchers, data stewards, and funders.

Speakers: Tomasz Miksa, Andres Tabima, Maria Kontopidi and Elli Papadopoulou

For more information, please visit: TPDL 2026