Skip to content

AIL Framework version 3.4 released with a new language detection module and many improvements

Compare
Choose a tag to compare
@adulau adulau released this 20 Dec 14:47
· 1036 commits to master since this release
v3.4
9d2962c

AIL Framework version 3.4 released with a new language detection module and many small improvements

AIL Framework version 3.4 has been released with a new language detection which can classifies items analysed by
the language detected. The module relies on Compact Language Detector v3 (CLD3).
Older items will be updated (there is a background job doing the update, so it might take some time depending of your dataset).
You can then browse crawled items per language detected.

The trackers can now be edited and various bugs were fixed.

Thanks to all the contributors.

ail-v3 4-3
ail-v3 4-2
aiil-v3 4-1

Changes

  • [Languages]detect + search domains languages. [Terrtia]
  • [Tracker] edit tracker. [Terrtia]
  • [web] we process items nowadays not only pastes ;-) [Alexandre
    Dulaunoy]

Fix

  • [install] pycld3 dependency. [Jean-Louis Huynen]

    Without this Flask fails starting

  • [update v3.4] updater. [Terrtia]

  • [Languages] import + update message. [Terrtia]

  • [Languages] update. [Terrtia]

  • [UI trackers] None trackers values. [Terrtia]

  • [Tracker] edit tracker ACL. [Terrtia]

  • [Yara Tracker] catch yara timeout. [Terrtia]

  • [Terms Trackcers] fix item link. [Terrtia]

Other