ISSA Pipeline
Abstract
The ISSA pipeline was developed by the ISSA project (https://issa.cirad.fr/) . It orchestrates the automatic indexing of a scientific archive by extracting from the articles full-text thematic descriptors and named entities, and linking them with terminological resources in the Semantic Web format.
The repository consists of various tools, scripts and configuration files involved in each step of the pipeline:
- retrieve the articles metadata from the archive's API;
- download and pre-process the PDF files of the articles;
- process the output to extract thematic descriptors and named entities;
- translate the output of each processing step into a unified, consistent RDF dataset;
- retrieve additional metadata from OpenAlex: topics, Sustainable Devlopment Goals (SDG), authorship with institutions
- upload the resulting dataset to a triple store equipped with a SPARQL endpoint.