Attaching evidence to an annotation
Knowledge graph annotations are more valuable in terms of reusability if the annotator can provide supporting evidence. Here we focus on evidence taken from scientific literature, although other sources of supporting evidence may exist: databases, technical reports, electronic lab notebooks, etc. Yet another category consists of (relatively) weak types of evidence: like-buttons, vote up/down, etc.
Here we propose several scenarios of literature-based evidence based on the PubAnnotation community framework.
Scenario 1: cite a document fragment
- user provides PMID
- ORKA retrieves abstract from PubAnnotation
- user selects a fragment (words or sentences) that support his annotation
- ORKA records the PubAnnotation fragment URI as supporting evidence in the nanopublication
Scenario 2: cite an existing annotation
- user provides PMID
- ORKA shows embedded TextAE (abstract with highlighted annotations)
- user selects a PubAnnotation-annotation
- ORKA records the PubAnnotation annotation URI as supporting evidence in the nanopublication
Scenario 3: create and cite annotation (extension of Scenario 2)
- if none of the existing annotations are suitable evidence:
- user creates a new PubAnnotation-annotation in TextAE (consider adding step-by-step guidance)
- proceed as in S2
- Note the difference between “ORKA annotations” (curator says relation X should actually be Y with evidence Z) and “PubAnnotation annotations” (essentially just markup of entities and relations in the text). In this proposal evidence for the former type of annotation is provided by a reference to the latter.
PubAnnotation supports markup of relations between entities: Cancer “caused by” Smoking. In PubAnnotation, projects containing entity-type annotations are in the majority. Perhaps we could consider a process where ORKA users follow a step-by-step wizard to identify their evidence: 1) select subject term, 2) select object term and 3) select predicate term.
The previous note’s suggestion as well as S3 create new content that may be pushed into PubAnnotation.
PubAnnotation is still in active development: PubMed/PMC corpora are not complete, many annotation contributions are not yet public. However, PubAnnotation will likely scale up in the near future.
- In S2 we want a URI to refer to an individual annotation: currently not supported by PubAnnotation. In discussion with PubAnnotation developers to add this feature.
PubAnnotation aims to store annotations, but its community also develops standard APIs for uniform access to on-the-fly annotation webservices. These may prove useful if ORKA users can not find the entities that make up their evidence.
We have evaluated other annotation services like Domeo (Paolo Ciccarese) and Utopia (Steve Pettifer). However, PubAnnotation seems to offer the most straight-forward possibilities for integration with ORKA. In any case, re-use and interoperability of created annotations between the three platforms should be relatively easy (use of APIs and OA ontology).