This project proposes a set of style sheets for converting XML documents encoded in various scientific publisher formats into a common TEI format. Often called document ingestion, converting heterogeneous publisher formats into a common working format is a typical, painful and time-consuming sub-task for building scientific digital library applications.

These style sheets have been first developed in the context of the European Project PEER and have been then further extended over the last years. Depending on the publishers (see bellow), the encoding of bibliographical information, abstracts, citation and full texts are supported.

Note: the test XML documents present in the sub-directory Samples are dummy documents with realistic publisher structures but random content.

Requirement

XSLT 2.0 processor.

Note that there is unfortunately no open source nor free XSLT 2.0 processor implementation, as far as we know :(

Usage

The starting point of the transformation process is the style sheet Publisher.xsl.

The resulting TEI documents follow a TEI custumisation documented under the sub-directory Schemas. This TEI format is very close to the one used by GROBID, a complementary tool trying to convert documents in PDF into TEI.

Coverage

The following publisher's formats should be properly processed:

• ACS: metadata, header, bibliography, body
• BMJ: metadata, header, bibliography, body
• Brepols: metadata, header, bibliography, body
• Brill: metadata, header, bibliography, body
• Cambridge: metadata, header, bibliography, body
• De Gruyter: metadata, header, bibliography, body
• Droz: metadata, header, bibliography, body
• Duke: metadata, header, bibliography, body
• Elsevier (journals and conferences): metadata, header, bibliography, body
• Emerald: metadata, header, bibliography, body
• GSL: metadata, header, bibliography, body
• IOP: metadata, header, bibliography.
• Lavoisier: metadata, header, bibliography, body
• NPG (Nature): metadata, header, bibliography, body
• NLM: metadata, header, bibliography, body
• Numerique-premium: metadata, header, bibliography, body
• Open Edition Ebooks: metadata, header, bibliography, body
• OUP: metadata, header, bibliography, body
• PNAS: metadata, header, bibliography, body
• RSC: metadata, header, bibliography, body
• Sage: metadata, header
• ScholarOne: metadata, header
• Springer: metadata, header, bibliography, body
• Taylor & Francis: metadata, header, bibliography, body
• Wiley: metadata, header, bibliography, body

License

Pub2TEI is distributed under BSD 2-clause license.

authors:

• Laurent Romary, [email protected]
• Stephanie Gregorio, [email protected]
• Patrice Lopez, [email protected]