code-generation-2.0

Repository for the CyberAI Code Generation Project

Pipeline:

The Model Evaluation Folder

• Contains a folder with the generated code snippets and ESBMC outputs for each model

The Scripts Folder

• esbmc_call.py: calls the ESBMC model checker and runs it over the generated code folders
• parse_esbmc.py: functions that parse the ESBMC output
• model-specific pipeline files: runs the analysis pipeline for each of the model's outputs through ESBMC

The Data Folder

• summary_stats.ipynb: summary statistics aggregated over all models
• [model_name]_results.ipynb: granular results for each model