Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow multiple databases ? #85

Open
erwanp opened this issue Nov 29, 2020 · 2 comments
Open

Allow multiple databases ? #85

erwanp opened this issue Nov 29, 2020 · 2 comments
Labels
🚀 enhancement New feature or request

Comments

@erwanp
Copy link
Collaborator

erwanp commented Nov 29, 2020

Hello @suzil .

I left you a mail : I just discovered this project, it's great to so RADIS being improved !

FYI, this is the current state-of-the-art of no-code molecular spectroscopy : 

https://www.spectraplot.com/emission
https://hitran.iao.ru/molecule/simlaunch

None of these provide multiple temperature calculations (non-equilibrium), which RADIS does and you seem to have implemented through your frontend already ! 🚀

The solutions above rely on the HITRAN & HITEMP databases. These databases contain all the spectral lines, and are more or less complete, hence accurate. HITRAN is typically ~tens of thousands of lines, HITEMP millions, others like CDSD are tens/hundred of millions, and some like ExoMol [state of the art used in astrophysics for exoplanet detection !] even contain billions of lines.

By default RADIS fetches HITRAN using their API. But what makes it stand out is that it becomes ~1000x faster than the backends used in the solutions above when used with large databases. I wondered if adding alternative database choices is something you considered in your roadmap ?

Anyway, I'd be glad to talk to know a little bit more about what you want to achieve with this cool project and if we can help : join our Slack if interested !

@erwanp erwanp added the 🚀 enhancement New feature or request label Dec 31, 2020
@minouHub
Copy link
Collaborator

I agree with Erwan that adding an option to at least HITEMP (from my perspective) would be great.

@erwanp
Copy link
Collaborator Author

erwanp commented Jan 13, 2021

This would be a major improvement but also a major change, because currently the HITRAN database is automatically fetched by RADIS.

RADIS doesn't have an automatic database download for HITEMP (too large), so having HITEMP will require to build a Docker image with HITEMP pre-configured. I did a similar work in updating the RADIS-Lab Docker to download and prepare the cache of the HITEMP files. I'm adding it here for reference: postBuild

Also for reference, SpectraPlot managed the databases with a Amazon RDS MySQL (their LBL algorithm is very slow compared to RADIS, but the database handling part is probably very good. !!)

SpectraPlot is written in Python (2.7) as a Flask application, and it is hosted on Amazon Web Services as an Elastic Beanstalk application. Databases are hosted on an Amazon RDS MySQL instance, and all spectroscopic simulations are run serially in Python on an Amazon EC2 instance. The user interface is built primarily using D3.js, an open source Javascript plotting library.

https://www.sciencedirect.com/science/article/pii/S0022407317302996?via%3Dihub

Also related to all the future work on the RADIS database format, which is on the 2021 Roadmap : radis/radis#166
Note : the HITEMP team themselves do not have a preferred format for handling the databases efficiently (SQL ends up being slow with HITEMP) and we will be discussing it with them !

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
🚀 enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants