Skip to content

Commit

Permalink
Markup distribution updated (#504)
Browse files Browse the repository at this point in the history 
* softreset

* result scores fix

* upd

* BM fix

* model_config.json reform

* model_config reform

* Rollback fixes in model.config

* benchmark scores fix 2

* Apply suggestions from code review
  • Loading branch information
@babenek
babenek authored Feb 9, 2024
1 parent 8ad4c0b commit 4028dd9
Show file tree
Hide file tree
Showing 2 changed files with 365 additions and 74 deletions.
46 changes: 23 additions & 23 deletions cicd/benchmark.txt
View file
Original file line number Diff line number Diff line change
Expand Up @@ -3,13 +3,13 @@ Category Positives Negatives Template
-------------------------- ----------- ----------- ----------
Authentication Credentials 91 2653 32
Cryptographic Primitives 54 171 1
Generic Secret 1064 29578 225
Generic Token 329 3718 555
Other 820 3760 544
Password 1402 7137 4129
Predefined Pattern 377 5289 11
Generic Secret 1204 29587 623
Generic Token 336 3719 556
Other 684 3709 37
Password 1430 7147 4224
Predefined Pattern 378 5293 11
Private Key 1011 1477
TOTAL: 5148 53783 5497
TOTAL: 5188 53756 5484
FileType FileNumber ValidLines Positives Negatives Template
--------------- ------------ ------------ ----------- ----------- ----------
189 36262 44 407 80
Expand Down Expand Up @@ -70,7 +70,7 @@ FileType FileNumber ValidLines Positives Negatives Templat
.gd 1 38 1
.gml 3 4011 16
.gni 3 6340 17
.go 1090 718367 496 4029 743
.go 1090 718367 497 4029 742
.golden 5 1246 1 12 31
.gradle 41 3647 2 79 59
.graphql 8 575 1 13
Expand All @@ -92,7 +92,7 @@ FileType FileNumber ValidLines Positives Negatives Templat
.java 589 169939 172 1265 177
.jenkinsfile 1 78 1 6
.jinja2 1 64 2
.js 665 705090 313 2451 363
.js 665 705090 321 2443 363
.json 856 15025976 279 10633 185
.jsp 13 4101 1 38 1
.jsx 7 1162 19
Expand Down Expand Up @@ -120,7 +120,7 @@ FileType FileNumber ValidLines Positives Negatives Templat
.markdown 3 146 2 2
.markerb 3 12 2 1
.marko 1 32 2
.md 659 172418 367 2429 721
.md 659 172418 393 2405 719
.mdx 3 723 7
.mjml 2 183 3
.mjs 22 5853 85 309
Expand Down Expand Up @@ -167,7 +167,7 @@ FileType FileNumber ValidLines Positives Negatives Templat
.pyx 2 1175 21
.r 5 83 5 4 2
.rake 2 66 2
.rb 868 173874 169 3283 584
.rb 868 173874 170 3283 583
.re 1 40 1
.red 1 232 1
.release 1 13 4
Expand All @@ -180,7 +180,7 @@ FileType FileNumber ValidLines Positives Negatives Templat
.rs 31 12604 2 228 11
.rsc 1 748 1
.rsp 16 7203 19 11 30
.rst 89 36385 29 303 63
.rst 89 36385 29 304 62
.rules 1 6 2
.sample 2 25 7 3
.sbt 3 652 1 5 2
Expand All @@ -201,7 +201,7 @@ FileType FileNumber ValidLines Positives Negatives Templat
.sum 43 23158 1128
.svg 1 798 12
.swift 6 373 13
.t 9 1903 6 34 12
.t 9 1903 6 35 11
.td 2 17425 6
.template 19 2604 3 35 8
.test 2 24 5 8
Expand All @@ -218,7 +218,7 @@ FileType FileNumber ValidLines Positives Negatives Templat
.ts 584 141059 88 1761 239
.tsx 55 13122 1 118 5
.ttar 2 6526 8 3
.txt 449 84341 1695 9471 91
.txt 449 84341 1695 9478 84
.utf8 1 79 2
.vsixmanifest 1 36 1
.vsmdi 1 6 1
Expand All @@ -227,21 +227,21 @@ FileType FileNumber ValidLines Positives Negatives Templat
.xcscheme 1 109 6
.xib 11 504 164
.xsl 1 315 1
.yaml 151 23500 87 383 52
.yaml 151 23500 91 379 52
.yml 447 41773 283 960 360
.zsh 7 1109 13
.zsh-theme 1 121 1
TOTAL: 10188 19071512 5148 53783 5497
Detected Credentials: 6127
credsweeper result_cnt : 5247, lost_cnt : 0, true_cnt : 4376, false_cnt : 871
TOTAL: 10188 19071512 5188 53756 5484
Detected Credentials: 6082
credsweeper result_cnt : 5232, lost_cnt : 0, true_cnt : 4388, false_cnt : 844
Category TP FP TN FN FPR FNR ACC PRC RCL F1
-------------------------- ---- ---- -------- ---- -------- -------- -------- -------- -------- --------
Authentication Credentials 76 78 2607 15 0.029050 0.164835 0.966499 0.493506 0.835165 0.620408
Cryptographic Primitives 47 14 158 7 0.081395 0.129630 0.907080 0.770492 0.870370 0.817391
Generic Secret 980 64 29739 84 0.002147 0.078947 0.995205 0.938697 0.921053 0.929791
Generic Token 292 33 4240 37 0.007723 0.112462 0.984789 0.898462 0.887538 0.892966
Other 574 367 3937 246 0.085270 0.300000 0.880367 0.609989 0.700000 0.651902
Password 1037 248 11018 365 0.022013 0.260342 0.951610 0.807004 0.739658 0.771865
Predefined Pattern 359 67 5233 18 0.012642 0.047745 0.985027 0.842723 0.952255 0.894147
Generic Secret 1061 71 30139 143 0.002350 0.118771 0.993188 0.937279 0.881229 0.908390
Generic Token 295 33 4242 41 0.007719 0.122024 0.983951 0.899390 0.877976 0.888554
Other 496 329 3417 188 0.087827 0.274854 0.883296 0.601212 0.725146 0.657389
Password 1049 248 11123 381 0.021810 0.266434 0.950863 0.808790 0.733566 0.769344
Predefined Pattern 353 71 5233 25 0.013386 0.066138 0.983105 0.832547 0.933862 0.880299
Private Key 1011 0 1477 0 1.000000 1.000000 1.000000 1.000000
4376 871 19065493 772 0.000046 0.149961 0.999914 0.834000 0.850039 0.841943
4388 844 19065480 800 0.000044 0.154202 0.999914 0.838685 0.845798 0.842226
Loading

0 comments on commit 4028dd9

Please sign in to comment.