5. Processes

The following processes are run automatically on the server.

process_uploads.py

Runs every minute if not already running. Will pull back the latest x amount of logs based on encounter time. X is defined as a command line argument during the initial start of the command. Currently, the default is 10 for the production servers.

Basic logic is as follows:

1. Pull latest x log files from the DB store
2. Grab latest log file (based on encounter time) off the stack
3. Check file format is ok and valid EVTC file
4. Process file
5. Store file in medium term storage.
6. Repeat for next file until finished.

restat.py

Restat is the main core component of GW2Raidar and is what ties everything together. Given the scope and magnitude of this function, it typically takes about 8-12 hours to run and will run back to back until told otherwise. At it's core, restat scans through all data and compiles the data used for percentiles, leaderboard, personal profiles and anything else where there is site wide aggregate data.

These data calcs are done per era and only if new encounters have appeared in that Era since the last restat run.