Skip to content

Commit

Permalink
testBM
Browse files Browse the repository at this point in the history
  • Loading branch information
@babenek
babenek committed Aug 12, 2024
1 parent a076394 commit 04a15c3
Show file tree
Hide file tree
Showing 2 changed files with 59 additions and 34 deletions.
12 changes: 8 additions & 4 deletions .github/workflows/benchmark.yml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,8 @@ jobs:
- name: Checkout CredData
uses: actions/checkout@v4
with:
repository: Samsung/CredData
repository: babenek/CredData
ref: abspos

- name: Markup hashing
run: |
Expand Down Expand Up @@ -72,7 +73,8 @@ jobs:
- name: Checkout CredData
uses: actions/checkout@v4
with:
repository: Samsung/CredData
repository: babenek/CredData
ref: abspos

- name: Markup hashing
run: |
Expand Down Expand Up @@ -169,7 +171,8 @@ jobs:
- name: Checkout CredData
uses: actions/checkout@v4
with:
repository: Samsung/CredData
repository: babenek/CredData
ref: abspos

- name: Markup hashing
run: |
Expand Down Expand Up @@ -351,7 +354,8 @@ jobs:
- name: Checkout CredData
uses: actions/checkout@v4
with:
repository: Samsung/CredData
repository: babenek/CredData
ref: abspos

- name: Markup hashing
run: |
Expand Down
81 changes: 51 additions & 30 deletions cicd/benchmark.txt
View file
Original file line number Diff line number Diff line change
Expand Up @@ -221,46 +221,67 @@ FileType FileNumber ValidLines Positives Negatives Templat
.zsh 6 872 12
.zsh-theme 1 97 1
TOTAL: 10259 16348035 8759 59707 5182
credsweeper result_cnt : 7749, lost_cnt : 0, true_cnt : 7530, false_cnt : 219
WARNING: 'Key' is not mentioned in 43096,23c7d6d0,GitHub,23689bd1,data/23689bd1/src/23c7d6d0.ts,130,130,T,T,50,114,F,F,Any,,,Secret,3.67,64,F,F,F,Bitbucket Client Secret:Secret
UNMATCH (43, 49): 1381090,23c7d6d0,GitHub,23689bd1,data/23689bd1/src/23c7d6d0.ts,130,130,F,F,50,114,F,F,,,,,0.0,0,F,F,F,Key
ALMOST (16, 256) JSON Web Token: 1381091,9859a631,GitHub,23689bd1,data/23689bd1/src/9859a631.ts,48,48,F,F,16,36,F,F,,,,,0.0,0,F,F,F,Gitlab Feed Token
WARNING: 'AWS Multi' is not mentioned in 11037,d97e408a,GitHub,39def7b4,data/39def7b4/src/d97e408a.rb,94,94,T,F,32,93,F,F,,,,,0.0,0,F,F,F,Credential
ALMOST (32, 52) AWS Client ID: 1381092,d97e408a,GitHub,39def7b4,data/39def7b4/src/d97e408a.rb,94,94,F,F,32,93,F,F,,,,,0.0,0,F,F,F,AWS Multi
ALMOST (42, 424) JSON Web Token: 1381093,0c944631,GitHub,77a3d7d7,data/77a3d7d7/test/0c944631.groovy,29,29,F,F,42,62,F,F,,,,,0.0,0,F,F,F,Gitlab Feed Token
ALMOST (42, 594) JSON Web Token: 1381094,0c944631,GitHub,77a3d7d7,data/77a3d7d7/test/0c944631.groovy,30,30,F,F,42,62,F,F,,,,,0.0,0,F,F,F,Gitlab Feed Token
ALMOST (42, 765) JSON Web Token: 1381095,0c944631,GitHub,77a3d7d7,data/77a3d7d7/test/0c944631.groovy,31,31,F,F,42,62,F,F,,,,,0.0,0,F,F,F,Gitlab Feed Token
UNMATCH (87, 105): 1381096,953c13b1,GitHub,8ba59c91,data/8ba59c91/src/953c13b1.ts,85,85,F,F,127,145,F,F,,,,,0.0,0,F,F,F,Bitbucket Client ID
WARNING: 'Secret' is not mentioned in 35215,d54544b0,GitHub,b74193f1,data/b74193f1/test/d54544b0.go,18,18,T,T,36,68,F,F,Any,,,Secret,3.48,32,F,F,F,Bitbucket Client ID:Bitbucket Client Secret
ALMOST (36, 68) Bitbucket Client ID:Bitbucket Client Secret: 1381097,d54544b0,GitHub,b74193f1,data/b74193f1/test/d54544b0.go,18,18,F,F,36,68,F,F,,,,,0.0,0,F,F,F,Secret
WARNING: 'Secret' is not mentioned in 138055,fa3932ec,GitHub,bdf8ad40,data/bdf8ad40/src/fa3932ec.yml,32,32,T,F,155,165,F,F,,,,,0.0,0,F,F,F,Password
ALMOST (155, 165) Password: 1381098,fa3932ec,GitHub,bdf8ad40,data/bdf8ad40/src/fa3932ec.yml,32,32,F,F,155,165,F,F,,,,,0.0,0,F,F,F,Secret
WARNING: 'Secret' is not mentioned in 138057,fa3932ec,GitHub,bdf8ad40,data/bdf8ad40/src/fa3932ec.yml,52,52,T,F,155,165,F,F,,,,,0.0,0,F,F,F,Password
ALMOST (155, 165) Password: 1381099,fa3932ec,GitHub,bdf8ad40,data/bdf8ad40/src/fa3932ec.yml,52,52,F,F,155,165,F,F,,,,,0.0,0,F,F,F,Secret
WARNING: 'Secret' is not mentioned in 138060,fa3932ec,GitHub,bdf8ad40,data/bdf8ad40/src/fa3932ec.yml,72,72,T,F,155,165,F,F,,,,,0.0,0,F,F,F,Password
ALMOST (155, 165) Password: 1381100,fa3932ec,GitHub,bdf8ad40,data/bdf8ad40/src/fa3932ec.yml,72,72,F,F,155,165,F,F,,,,,0.0,0,F,F,F,Secret
WARNING: 'Secret' is not mentioned in 138061,fa3932ec,GitHub,bdf8ad40,data/bdf8ad40/src/fa3932ec.yml,92,92,T,F,155,165,F,F,,,,,0.0,0,F,F,F,Password
ALMOST (155, 165) Password: 1381101,fa3932ec,GitHub,bdf8ad40,data/bdf8ad40/src/fa3932ec.yml,92,92,F,F,155,165,F,F,,,,,0.0,0,F,F,F,Secret
ALMOST (13, 231) JSON Web Token: 1381102,74dff624,GitHub,ec138349,data/ec138349/test/74dff624.java,229,229,F,F,13,33,F,F,,,,,0.0,0,F,F,F,Gitlab Feed Token
ALMOST (24, 242) JSON Web Token: 1381103,74dff624,GitHub,ec138349,data/ec138349/test/74dff624.java,250,250,F,F,24,44,F,F,,,,,0.0,0,F,F,F,Gitlab Feed Token
credsweeper result_cnt : 6005, lost_cnt : 14, true_cnt : 5773, false_cnt : 218
Rules Positives Negatives Templates Reported TP FP TN FN FPR FNR ACC PRC RCL F1
------------------------------ ----------- ----------- ----------- ---------- ---- ---- ----- ---- -------- -------- -------- -------- -------- --------
API 128 3130 185 111 109 2 3313 19 0.000603 0.148438 0.993901 0.981982 0.851562 0.912134
AWS Client ID 167 18 0 160 160 0 18 7 0.000000 0.041916 0.962162 1.000000 0.958084 0.978593
AWS Multi 75 14 0 87 75 11 3 0 0.785714 0.000000 0.876404 0.872093 1.000000 0.931677
AWS S3 Bucket 66 24 0 92 66 24 0 0 1.000000 0.000000 0.733333 0.733333 1.000000 0.846154
Atlassian Old PAT token 27 208 3 12 3 8 203 24 0.037915 0.888889 0.865546 0.272727 0.111111 0.157895
Auth 412 2724 76 373 355 18 2782 57 0.006429 0.138350 0.976650 0.951743 0.861650 0.904459
Azure Access Token 19 0 0 12 12 0 0 7 0.368421 0.631579 1.000000 0.631579 0.774194
API 128 3130 185 106 104 2 3313 24 0.000603 0.187500 0.992448 0.981132 0.812500 0.888889
AWS Client ID 167 18 0 131 131 0 18 36 0.000000 0.215569 0.805405 1.000000 0.784431 0.879195
AWS Multi 75 14 0 85 72 11 3 3 0.785714 0.040000 0.842697 0.867470 0.960000 0.911392
AWS S3 Bucket 66 24 0 91 65 24 0 1 1.000000 0.015152 0.722222 0.730337 0.984848 0.838710
Atlassian Old PAT token 27 208 3 11 2 8 203 25 0.037915 0.925926 0.861345 0.200000 0.074074 0.108108
Auth 412 2724 76 342 324 18 2782 88 0.006429 0.213592 0.966999 0.947368 0.786408 0.859416
Azure Access Token 19 0 0 0 0 0 19 1.000000 0.000000 0.000000
BASE64 Private Key 7 2 0 7 7 0 2 0 0.000000 0.000000 1.000000 1.000000 1.000000 1.000000
BASE64 encoded PEM Private Key 7 0 0 5 5 0 0 2 0.285714 0.714286 1.000000 0.714286 0.833333
Bitbucket Client ID 142 1807 9 46 27 18 1798 115 0.009912 0.809859 0.932074 0.600000 0.190141 0.288770
Bitbucket Client Secret 230 527 10 44 33 11 526 197 0.020484 0.856522 0.728814 0.750000 0.143478 0.240876
Certificate 25 466 1 27 20 7 460 5 0.014989 0.200000 0.975610 0.740741 0.800000 0.769231
Credential 94 154 74 83 83 0 228 11 0.000000 0.117021 0.965839 1.000000 0.882979 0.937853
Docker Swarm Token 2 0 0 2 2 0 0 0 0.000000 1.000000 1.000000 1.000000 1.000000
Dropbox App secret 62 114 0 46 36 9 105 26 0.078947 0.419355 0.801136 0.800000 0.580645 0.672897
Bitbucket Client ID 142 1807 9 46 27 17 1799 115 0.009361 0.809859 0.932584 0.613636 0.190141 0.290323
Bitbucket Client Secret 230 527 10 43 32 11 526 198 0.020484 0.860870 0.727510 0.744186 0.139130 0.234432
Certificate 25 466 1 24 17 7 460 8 0.014989 0.320000 0.969512 0.708333 0.680000 0.693878
Credential 94 154 74 81 81 0 228 13 0.000000 0.138298 0.959627 1.000000 0.861702 0.925714
Docker Swarm Token 2 0 0 0 0 0 2 1.000000 0.000000 0.000000
Dropbox App secret 62 114 0 32 21 10 104 41 0.087719 0.661290 0.710227 0.677419 0.338710 0.451613
Facebook Access Token 0 1 0 0 0 1 0 0.000000 1.000000
Firebase Domain 6 1 0 7 6 1 0 0 1.000000 0.000000 0.857143 0.857143 1.000000 0.923077
Github Old Token 1 0 0 1 1 0 0 0 0.000000 1.000000 1.000000 1.000000 1.000000
Gitlab Feed Token 189 450 87 60 48 11 526 141 0.020484 0.746032 0.790634 0.813559 0.253968 0.387097
Gitlab Incoming Email Token 37 3 0 21 19 2 1 18 0.666667 0.486486 0.500000 0.904762 0.513514 0.655172
Google API Key 12 0 0 12 12 0 0 0 0.000000 1.000000 1.000000 1.000000 1.000000
Gitlab Feed Token 189 450 87 65 47 11 526 142 0.020484 0.751323 0.789256 0.810345 0.248677 0.380567
Gitlab Incoming Email Token 37 3 0 22 20 2 1 17 0.666667 0.459459 0.525000 0.909091 0.540541 0.677966
Google API Key 12 0 0 11 11 0 0 1 0.083333 0.916667 1.000000 0.916667 0.956522
Google Multi 10 2 0 11 10 1 1 0 0.500000 0.000000 0.916667 0.909091 1.000000 0.952381
Google OAuth Access Token 3 0 0 3 3 0 0 0 0.000000 1.000000 1.000000 1.000000 1.000000
Grafana Provisioned API Key 22 1 0 5 5 0 1 17 0.000000 0.772727 0.260870 1.000000 0.227273 0.370370
JSON Web Token 170 61 0 131 131 0 61 39 0.000000 0.229412 0.831169 1.000000 0.770588 0.870432
Grafana Provisioned API Key 22 1 0 2 2 0 1 20 0.000000 0.909091 0.130435 1.000000 0.090909 0.166667
JSON Web Token 170 61 0 19 19 0 61 151 0.000000 0.888235 0.346320 1.000000 0.111765 0.201058
Jira / Confluence PAT token 0 4 0 0 0 4 0 0.000000 1.000000
Jira 2FA 14 6 0 10 10 0 6 4 0.000000 0.285714 0.800000 1.000000 0.714286 0.833333
Key 538 8456 464 468 461 7 8913 77 0.000785 0.143123 0.991119 0.985043 0.856877 0.916501
Nonce 91 48 0 85 83 2 46 8 0.041667 0.087912 0.928058 0.976471 0.912088 0.943182
Jira 2FA 14 6 0 5 5 0 6 9 0.000000 0.642857 0.550000 1.000000 0.357143 0.526316
Key 538 8456 464 458 450 7 8913 88 0.000785 0.163569 0.989956 0.984683 0.836431 0.904523
Nonce 91 48 0 86 84 2 46 7 0.041667 0.076923 0.935252 0.976744 0.923077 0.949153
PEM Private Key 1019 1483 0 1023 1019 4 1479 0 0.002697 0.000000 0.998401 0.996090 1.000000 0.998041
Password 1842 7476 2724 1725 1656 69 10131 186 0.006765 0.100977 0.978824 0.960000 0.899023 0.928511
Salt 45 74 2 40 39 1 75 6 0.013158 0.133333 0.942149 0.975000 0.866667 0.917647
Secret 1367 28360 868 1240 1234 6 29222 133 0.000205 0.097293 0.995457 0.995161 0.902707 0.946682
Password 1842 7476 2724 1169 1100 69 10131 742 0.006765 0.402823 0.932652 0.940975 0.597177 0.730654
Salt 45 74 2 39 38 1 75 7 0.013158 0.155556 0.933884 0.974359 0.844444 0.904762
Secret 1367 28360 868 1203 1192 6 29222 175 0.000205 0.128018 0.994084 0.994992 0.871982 0.929435
Seed 1 6 0 0 0 6 1 0.000000 1.000000 0.857143 0.000000
Slack Token 4 1 0 4 4 0 1 0 0.000000 0.000000 1.000000 1.000000 1.000000 1.000000
Token 648 3952 437 545 539 6 4383 109 0.001367 0.168210 0.977169 0.988991 0.831790 0.903604
Slack Token 4 1 0 3 3 0 1 1 0.000000 0.250000 0.800000 1.000000 0.750000 0.857143
Token 648 3952 437 481 476 5 4384 172 0.001139 0.265432 0.964860 0.989605 0.734568 0.843224
Twilio API Key 0 5 2 0 0 7 0 0.000000 1.000000
URL Credentials 209 128 240 200 200 0 368 9 0.000000 0.043062 0.984402 1.000000 0.956938 0.977995
UUID 1068 1 0 1058 1057 1 0 11 1.000000 0.010300 0.988775 0.999055 0.989700 0.994356
8759 59707 5182 7756 7530 219 59488 1229 0.003668 0.140313 0.978851 0.971738 0.859687 0.912285
URL Credentials 209 128 240 146 146 0 368 63 0.000000 0.301435 0.890815 1.000000 0.698565 0.822535
UUID 1068 1 0 254 253 1 0 815 1.000000 0.763109 0.236670 0.996063 0.236891 0.382753
8759 59707 5182 6012 5773 218 59489 2986 0.003651 0.340906 0.953203 0.963612 0.659094 0.782780

0 comments on commit 04a15c3

Please sign in to comment.