WP26: Annotation, reputation and data quality

Objectives

Research into the commonalities of different types of annotation with special focus on the use of annotation to evaluate reputation including that of the quality of data.

Description of work and role of partners

Annotation in general terms is information added to data and it may be argued that all kinds of metadata are special types of annotation. Similarly reputation is likely to be increasingly important in the Information Society for people as well as data. In this workpackage we will review the requirements and the available techniques for annotation, reputation and data quality. For each we will then produce a research strategy to get from where we are to where we need to be

Task 2610: Annotation services

This WP will investigate the commonalities between the various types of annotations in the shape of Representation Information associated in some way with some digital data, Provenance and Descriptive Information. Each is associated with data in different ways yet there may be underlying commonalities which can be exploited; for example common techniques if annotations are stored in a database. There are several systems ([19]–[24]) in use providing annotation services which will be considered.

Task 2620: Reputation

Of particular interest is the use of annotation to gather comments and opinions from many contributors. This allows one to capture the wisdom of crowds to make a judgment about the trust which might be placed on a data object or individuals.

Digital reputation has become a topic of active concern and discussion (see [27]-[32]) and indeed commercial companies have arisen around reputation (e.g. see [33]) and discussion collection systems [34]-[36].

Task 2630: Data quality

Data quality related information is of critical importance for the correct long-term data applicability and interoperability. In this context for example, the Group on Earth Observation (GEO) has recognized that without a robust, internationally harmonized quality assurance strategy it will be unable to achieve its goal of a Global Earth Observation System of Systems (GEOSS) that delivers “fit for purpose” Earth Observation products meeting user needs. In response to this need, the Committee on Earth Observation Satellites (CEOS) Working Group on Calibration and Validation (WGCV) has led the establishment of the Quality QA4EO, which includes a set of guidelines to aid in implementation, in order to achieve this GEO objective. QA4EO is driven by the key principle that all measurements/processes must have associated with them quality (performance) indicators (QIs) based on documented evidence of traceability to reference standards agreed by the scientific community (ideally SI). To achieve this requires all steps and processes within a product processing chain, sensor and algorithm, to be fully evaluated and their traceability and QI documented and maintained appropriately together with the data themselves. The quality related information becomes as important as the data. It is also an objective of this work package to assess the current status of such activities and to investigate future evolutions that can respond to both the long term preservation requirements and the QA4EO needs.http://qa4eo.org/