Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

PreFer Data Challenge #54

Open
wants to merge 33 commits into
base: master
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
33 commits
Select commit Hold shift + click to select a range
e893474
prepare submission
apiraccini Apr 20, 2024
dfaca4a
prepare submission v2
apiraccini Apr 20, 2024
d8aaa7c
Update environment.yml
apiraccini Apr 20, 2024
35c94cd
update submission
apiraccini Apr 20, 2024
74e5161
Merge branch 'master' of https://github.com/apiraccini/prefer_gas_off…
apiraccini Apr 20, 2024
2925479
fix bugs
apiraccini Apr 20, 2024
c081948
refine submission
apiraccini Apr 21, 2024
42ed7c3
prepare new submission
apiraccini Apr 21, 2024
91e30c5
submission 22/04
apiraccini Apr 21, 2024
2c0c66e
update logic to include notebooks for preprocessing
apiraccini Apr 22, 2024
2bb5cb6
submission 12/5
apiraccini May 12, 2024
6b5711f
update environment file
apiraccini May 12, 2024
3dadf59
fix environment
apiraccini May 12, 2024
5146011
fix environment pt 3
apiraccini May 12, 2024
93e12cb
final submission 12/5
apiraccini May 12, 2024
f6a91af
final submission 12/5
apiraccini May 12, 2024
39a3148
final submission
apiraccini May 31, 2024
dbc5bcc
fix env
apiraccini May 31, 2024
c43ff84
fix env 2
apiraccini May 31, 2024
e4776f2
final submission
apiraccini Jun 1, 2024
beae003
clean repo
apiraccini Jun 1, 2024
09f8d75
add final report
apiraccini Jun 2, 2024
70f884b
Update description.md
apiraccini Jun 3, 2024
a2e74d0
Update description.md
apiraccini Jun 3, 2024
de75e7f
Update description.md
apiraccini Jun 3, 2024
160724d
Update description.md
apiraccini Jun 3, 2024
7c9ceba
Update description.md
apiraccini Jun 3, 2024
5f19ecb
Update description.md
apiraccini Jun 3, 2024
adda19e
Update description.md
apiraccini Jun 3, 2024
01f3e44
Test slides
apiraccini-alk Nov 6, 2024
2a04546
Work on slides
apiraccini-alk Nov 6, 2024
23c2e47
Update slides
apiraccini-alk Nov 7, 2024
ebd1d73
Update slides
apiraccini-alk Nov 7, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 3 additions & 1 deletion .gitignore
Original file line number Diff line number Diff line change
@@ -1,7 +1,9 @@
.ipynb_checkpoints
catboost_info/

# macOS
.DS_Store
.AppleDouble
.LSOverride
__pycache__/
.tool-versions
.tool-versions
31,668 changes: 31,668 additions & 0 deletions PreFer_codebook.csv

Large diffs are not rendered by default.

60 changes: 30 additions & 30 deletions PreFer_fake_data.csv

Large diffs are not rendered by default.

519 changes: 518 additions & 1 deletion description.md

Large diffs are not rendered by default.

Binary file modified environment.yml
Binary file not shown.
Binary file modified model.joblib
Binary file not shown.
Binary file removed model.rds
Binary file not shown.
3 changes: 0 additions & 3 deletions mydata.csv

This file was deleted.

3 changes: 0 additions & 3 deletions packages.R

This file was deleted.

12 changes: 0 additions & 12 deletions r.Dockerfile

This file was deleted.

83 changes: 0 additions & 83 deletions run.R

This file was deleted.

6 changes: 2 additions & 4 deletions run.py
Original file line number Diff line number Diff line change
Expand Up @@ -22,10 +22,8 @@

parser = argparse.ArgumentParser(description="Process data.")

parser.add_argument("data_path", help="Path to data data CSV file.")
parser.add_argument(
"background_data_path", help="Path to background data data CSV file."
)
parser.add_argument("data_path", help="Path to data CSV file.")
parser.add_argument("background_data_path", help="Path to background data CSV file.")
parser.add_argument("--output", help="Path to prediction output CSV file.")

args = parser.parse_args()
Expand Down
Binary file added saved/FA_loadings.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added saved/FA_screeplot.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added saved/PreFer_logo.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
988 changes: 988 additions & 0 deletions saved/cleaned_df.csv

Large diffs are not rendered by default.

Binary file added saved/correlation_matrix.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added saved/eda_feature_plots.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
988 changes: 988 additions & 0 deletions saved/model_df.csv

Large diffs are not rendered by default.

988 changes: 988 additions & 0 deletions saved/model_df_display.csv

Large diffs are not rendered by default.

16 changes: 16 additions & 0 deletions saved/model_selection_metrics.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,16 @@
model,accuracy,precision,recall,f1
voting_s,0.9127946127946128,0.857655842332095,0.715625,0.7791283588871434
voting_h,0.9148148148148149,0.882570177083562,0.6984375,0.7788772847556219
catb,0.9141414141414141,0.876642223380349,0.7015625,0.7783646333847204
stacking lgb-catb,0.9020202020202019,0.7850379028346589,0.753125,0.7678774865522702
stacking et-catb-lgb,0.8993265993265993,0.7683470485290076,0.765625,0.7660368238861996
stacking et-catb,0.8979797979797979,0.7598225487523408,0.771875,0.7650820760768711
lgb,0.9033670033670033,0.8156425708098813,0.7140625,0.7606226540365956
et,0.9084175084175083,0.8751459981254814,0.671875,0.7594668918530201
xgb,0.8986531986531986,0.8134420781748741,0.6890625,0.7451552904907756
rf,0.8905723905723905,0.8155900332360261,0.6375,0.7143824210961051
svc,0.8764309764309764,0.8571573967159598,0.5125,0.6395062345966023
dt,0.8400673400673402,0.6284819142456894,0.6375,0.6314023658050075
mlp,0.8457912457912459,0.6611369798887063,0.603125,0.6284527078388321
lr,0.7855218855218855,0.5024562468626843,0.7265625,0.5931716897153938
knn,0.8494949494949495,0.7896225014928944,0.4171875,0.542875159699717
Binary file added saved/scores_newchild.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added saved/shap_bar.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added saved/shap_beeswarm.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added saved/shap_scatter_plots.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added saved/shap_values_cb.joblib
Binary file not shown.
Binary file added saved/tree_selection_2020.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added saved/tree_selection_2020_Imputed.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added saved/tree_selection_2020_Imputed2.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added saved/tree_selection_NAimputed.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added saved/tree_selection_background.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added saved/tree_selection_big_year.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added saved/tree_selection_cleaned.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading