The BioASQ challenge comprises the following tasks.
BioASQ Task Synergy on Biomedical Semantic QA for COVID-19
In this task, biomedical experts pose unanswered questions for the developing problem of COVID-19. Participating systems are required to provide answers, which will in turn be assessed by the experts and fed back to the systems, together with updated questions. This task involves IR, QA, summarization and more on an continuously expanding dataset of documents for COVID-19. Through this process, this task aims to facilitate the incremental understanding of COVID-19 and contribute to the discovery of new solutions.
BioASQ Task a on Large-Scale Online Biomedical Semantic Indexing
In this task, the participants are asked to classify new PubMed documents, before PubMed curators annotate (in effect, classify) them manually. The classes come from the MeSH hierarchy. As new manual annotations become available, they are used to evaluate the classification performance of participating systems.
BioASQ Task b on Biomedical Semantic QA (involves IR, QA, summarization and more)
This task uses benchmark datasets containing development and test questions, in English, along with gold standard (reference) answers constructed by a team of biomedical experts. The participants have to respond with relevant concepts, articles, snippets and RDF triples, from designated resources, as well as exact and 'ideal' answers.
BioASQ Task MESINESP on Medical Semantic Indexing in Spanish
In this task, the participants are asked to classify new IBECS and LILACS documents, before curators annotate them manually. The classes come from the DeCS vocabulary. As new manual annotations become available, they are used to evaluate the classification performance of participating systems.
The BioASQ Task MESINESP is co-ogranized with the Barcelona Supercomputing Center Read more...