You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
scraperlib grew significantly over the years, with modules very useful even beyond pure scraper usages. The ZIM wrapper is very useful in itself to name only one.
We are also considering addition of the currently separate kiwixstorage module, or the Kiwix catalog reader.
To support this Kiwix Swiss-army knife layout, we'd need to be able to install only some of the dependencies.
Dependencies would thus be organized into extra groups (ZIM, image, video, etc) with an all group that installs everything of course.
In addition, we could maybe had a try block on imports in each module to print a user-actionable message when importing code for which dependencies are not installed.
The text was updated successfully, but these errors were encountered:
Agreed, especially if it allows to much clearly define system dependencies. Currently the documentation says that we need a bunch of system dependencies, but it should be clearer that these are not required in all extra. And usually they are in fact needed only for few methods. Would be cool if you could map this information somewhere in the documentation.
scraperlib grew significantly over the years, with modules very useful even beyond pure scraper usages. The ZIM wrapper is very useful in itself to name only one.
We are also considering addition of the currently separate kiwixstorage module, or the Kiwix catalog reader.
To support this Kiwix Swiss-army knife layout, we'd need to be able to install only some of the dependencies.
Dependencies would thus be organized into extra groups (ZIM, image, video, etc) with an all group that installs everything of course.
In addition, we could maybe had a try block on imports in each module to print a user-actionable message when importing code for which dependencies are not installed.
The text was updated successfully, but these errors were encountered: