DANIEL: A fast Document Attention Network for Information Extraction and Labelling of handwritten documents - Laboratoire d'Informatique, de Traitement de l'Information et des Systèmes Accéder directement au contenu
Pré-Publication, Document De Travail Année : 2024

DANIEL: A fast Document Attention Network for Information Extraction and Labelling of handwritten documents

Résumé

Information extraction from handwritten documents involves traditionally three distinct steps: Document Layout Analysis, Handwritten Text Recognition, and Named Entity Recognition. Recent approaches have attempted to integrate these steps into a single process using fully end-to-end architectures. Despite this, these integrated approaches have not yet matched the performance of language models, when applied to information extraction in plain text. In this paper, we introduce DANIEL (Document Attention Network for Information Extraction and Labelling), a fully end-to-end architecture integrating a language model and designed for comprehensive handwritten document understanding. DANIEL performs layout recognition, handwriting recognition, and named entity recognition on full-page documents. Moreover, it can simultaneously learn across multiple languages, layouts, and tasks. For named entity recognition, the ontology to be applied can be specified via the input prompt. The architecture employs a convolutional encoder capable of processing images of any size without resizing, paired with an autoregressive decoder based on a transformer-based language model. DANIEL achieves competitive results on four datasets, including a new state-of-the-art performance on RIMES 2009 and M-POPP for Handwriting Text Recognition, and IAM NER for Named Entity Recognition. Furthermore, DANIEL is much faster than existing approaches. We provide the source code and the weights of the trained models at \url{https://github.com/Shulk97/daniel}.
Fichier principal
Vignette du fichier
Daniel_version_IJDAR-47.pdf (3.93 Mo) Télécharger le fichier
licence

Dates et versions

hal-04555188 , version 1 (15-07-2024)

Licence

Identifiants

Citer

Thomas Constum, Pierrick Tranouez, Thierry Paquet. DANIEL: A fast Document Attention Network for Information Extraction and Labelling of handwritten documents. 2024. ⟨hal-04555188⟩
33 Consultations
2 Téléchargements

Altmetric

Partager

Gmail Mastodon Facebook X LinkedIn More