Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Start storing data and serving views in response to streaming events instead of cumulatively at the end #20

Open
trey-ivy opened this issue Oct 11, 2024 · 1 comment

Comments

@trey-ivy
Copy link
Collaborator

larger builds can take a long time to serialize to the database. Can we alleviate this by batching writes as they come in instead of waiting until the very end? some data isn't supplied until the build is complete, but we could show targets as their accumulated and build log output, etc.

@trey-ivy trey-ivy changed the title Start storing data an serving views in response to streaming events instead of cumulatively at the end Start storing data and serving views in response to streaming events instead of cumulatively at the end Oct 11, 2024
@trey-ivy
Copy link
Collaborator Author

a little additional discussion suggests we want to look at a message queue to help us achieve this. maybe roll in something like kafka to be deployed alongside bbportal

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant