Please use this identifier to cite or link to this item: http://hdl.handle.net/1822/47820

TitleBenchmarking biomedical text mining web servers at BioCreative V.5: the technical Interoperability and Performance of annotation Servers - TIPS track
Author(s)Pérez-Pérez, Martin
Pérez-Rodríguez, Gael
Blanco-Míguez, Aitor
Fdez-Riverola, Florentino
Valencia, Alfonso
Krallinger, Martin
Lourenço, Anália
KeywordsTIPS
BeCalm metaserver
Document provider
Annotation server
Continuous evaluation
BioCreative
Text Mining
Issue date26-Apr-2017
CitationPérez-Pérez, Martin; Pérez-Rodríguez, Gael; Blanco-Míguez, Aitor; Fdez-Riverola, Florentino; Valencia, Alfonso; Krallinger, Martin; Lourenço, Anália, Benchmarking biomedical text mining web servers at BioCreative V.5: the technical Interoperability and Performance of annotation Servers - TIPS track. Proceedings of the BioCreative V.5 Challenge Evaluation Workshop. Barcelona, Spain, April 26-27, 19-27, 2017. ISBN: 978-84-933255-9-6
Abstract(s)The TIPS track consisted in a novel experimental task under the umbrella of the BioCreative text mining challenges with the aim to, for the first time ever, carry out a text mining challenge with particular focus on the continuous assessment of technical aspects of text annotation web servers, specifically of biomedical online named entity recognition systems. A total of 13 teams registered annotation servers, implemented in various programming languages, supporting up to 12 different general annotation types. The continuous evaluation period took place from February to March 2017. The systematic and continuous evaluation of server responses accounted for testing periods of low activity and moderate to high activity. Moreover three document provider settings were covered, including also NCBI PubMed. For a total of 4,092,502 requests, the median response time for most servers was below 3.74 s with a median of 10 annotations/document. Most of the servers showed great reliability and stability, being able to process 100,000 requests in 5 days.
TypeConference paper
URIhttp://hdl.handle.net/1822/47820
ISBN978-84-933255-9-6
Publisher versionhttp://www.biocreative.org/resources/publications/bcv5_proceedings/
Peer-Reviewedyes
AccessOpen access
Appears in Collections:CEB - Artigos em Livros de Atas / Papers in Proceedings

Files in This Item:
File Description SizeFormat 
document_46800_1.pdf943,28 kBAdobe PDFView/Open

Partilhe no FacebookPartilhe no TwitterPartilhe no DeliciousPartilhe no LinkedInPartilhe no DiggAdicionar ao Google BookmarksPartilhe no MySpacePartilhe no Orkut
Exporte no formato BibTex mendeley Exporte no formato Endnote Adicione ao seu ORCID