Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reduce jekyll-scholar build time? #347

Open
FlamingLasrSwrd opened this issue Oct 31, 2022 · 2 comments
Open

Reduce jekyll-scholar build time? #347

FlamingLasrSwrd opened this issue Oct 31, 2022 · 2 comments

Comments

@FlamingLasrSwrd
Copy link

The build time for a single post with only 10 references jumps from 1.3 seconds to 215 seconds with jekyll-scholar enabled:

Screenshot from 2022-10-29 18-35-41

Screenshot from 2022-10-29 18-36-29

Building the whole website of 23 posts (with --profile and --trace) takes more than 90 minutes:
Screenshot from 2022-10-29 22-58-14

Is this typical behavior?
My default bib file has 4000+ references. Is that just too large for jekyll-scholar? Each post only has a few dozen references drawn from --files of a few hundred references. Is there something I can change in Zotero to speed things up?

@inukshuk
Copy link
Owner

This is probably a legitimate issue, because the bibliographies are currently not cached. So if you render a lot of pages, or even few pages with different bibliographies using the --file option, the bib files get parsed again and again. If the files are large and parsing takes a few seconds this just deteriorates quickly.

We need to add a bibliography cache to address this.

@gwgundersen
Copy link

+1 for this feature.

When I add a citation to my .bib file, my entire site is rebuilt. This takes 20-30 minutes. Here, the length of time isn't Jekyll Scholar per se; it's Jekyll Katex re-rendering all the pages. However, maybe a bibliography cache would help Jekyll know which pages need to be rebuilt?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants