Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

tools: Block Generator - allow exporting to files #5656

Closed
wants to merge 21 commits into from

Conversation

tzaffi
Copy link
Contributor

@tzaffi tzaffi commented Aug 11, 2023

Block Generator in File Exporting Mode + README + Makefile + Remove Python Runner

The only functional change is to allow exporting blocks into conduit's data directory. This is useful for generating Conduit fixtures.

Non functional changes:

  • Update the README with an explanation of the statistical distribution of block generator scenarios
  • Slight rewording of the runner's help output
  • Remove the python runner - all it's previous functionality can be achieved with make targets
  • Update the README and Makeflie to reflect the above changes

@tzaffi tzaffi changed the title README + Makefile + Remove Python Runner tools: Blockgenerator README + Makefile + Remove Python Runner Aug 11, 2023
@tzaffi tzaffi requested a review from a team August 11, 2023 16:51
@tzaffi tzaffi self-assigned this Aug 11, 2023
@codecov
Copy link

codecov bot commented Aug 11, 2023

Codecov Report

Merging #5656 (4df41db) into master (2670e94) will decrease coverage by 0.01%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master    #5656      +/-   ##
==========================================
- Coverage   55.51%   55.50%   -0.01%     
==========================================
  Files         473      473              
  Lines       66316    66316              
==========================================
- Hits        36814    36811       -3     
  Misses      27005    27005              
- Partials     2497     2500       +3     

see 14 files with indirect coverage changes

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

@tzaffi tzaffi changed the title tools: Blockgenerator README + Makefile + Remove Python Runner tools: Blockgenerator - allow exporting to files Aug 14, 2023
@tzaffi tzaffi changed the title tools: Blockgenerator - allow exporting to files tools: Block Generator - allow exporting to files Aug 14, 2023
@@ -46,18 +46,19 @@ func init() {
RunnerCmd.Flags().StringVarP(&runnerArgs.Path, "scenario", "s", "", "Directory containing scenarios, or specific scenario file.")
RunnerCmd.Flags().StringVarP(&runnerArgs.ConduitBinary, "conduit-binary", "i", "", "Path to conduit binary.")
RunnerCmd.Flags().Uint64VarP(&runnerArgs.MetricsPort, "metrics-port", "p", 9999, "Port to start the metrics server at.")
RunnerCmd.Flags().BoolVarP(&runnerArgs.FileExporterInsteadofPG, "file-exporter-instead-of-pg", "", false, "If set, use the runner will export blocks to files; otherwise, the postgres database is used.")
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

consider a "--template-override" option rather than baking in this custom template.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Introduced the optional --template flag: 2c267aa

@tzaffi tzaffi requested a review from winder August 14, 2023 22:40
@tzaffi tzaffi requested a review from shiqizng August 15, 2023 17:03
shiqizng
shiqizng previously approved these changes Aug 25, 2023
@tzaffi tzaffi marked this pull request as draft August 30, 2023 01:03
@tzaffi
Copy link
Contributor Author

tzaffi commented Aug 30, 2023

closing in favor of: #5714

@tzaffi tzaffi closed this Aug 30, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants