Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support à la carte dependencies #244

Open
rgaudin opened this issue Jan 14, 2025 · 1 comment
Open

Support à la carte dependencies #244

rgaudin opened this issue Jan 14, 2025 · 1 comment
Labels
enhancement New feature or request
Milestone

Comments

@rgaudin
Copy link
Member

rgaudin commented Jan 14, 2025

scraperlib grew significantly over the years, with modules very useful even beyond pure scraper usages. The ZIM wrapper is very useful in itself to name only one.

We are also considering addition of the currently separate kiwixstorage module, or the Kiwix catalog reader.

To support this Kiwix Swiss-army knife layout, we'd need to be able to install only some of the dependencies.

Dependencies would thus be organized into extra groups (ZIM, image, video, etc) with an all group that installs everything of course.

In addition, we could maybe had a try block on imports in each module to print a user-actionable message when importing code for which dependencies are not installed.

@rgaudin rgaudin added the enhancement New feature or request label Jan 14, 2025
@rgaudin rgaudin added this to the 6.0.0 milestone Jan 14, 2025
@benoit74
Copy link
Collaborator

Agreed, especially if it allows to much clearly define system dependencies. Currently the documentation says that we need a bunch of system dependencies, but it should be clearer that these are not required in all extra. And usually they are in fact needed only for few methods. Would be cool if you could map this information somewhere in the documentation.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants