diff --git a/ChangeLog b/ChangeLog index 043c93c..d958212 100644 --- a/ChangeLog +++ b/ChangeLog @@ -26,3 +26,10 @@ * Introduced third-order parts (as described in our ACL 2013 short paper). * Windows-compatible (tested under MSVC; thanks to Afonso Mendes). * TurboTagger is now faster. + +2014-06-26 TurboParser 2.2.0 afm@cs.cmu.edu + New release with some additional features: + * Implemented a Python wrapper using Cython. + * Added a semantic parser, TurboSemanticParser (as described in our SemEval + 2014 paper) + * Added a tokenizer for Portuguese. diff --git a/Makefile.am b/Makefile.am index 278bea3..baeb22f 100644 --- a/Makefile.am +++ b/Makefile.am @@ -26,6 +26,32 @@ scripts/train_test_parser.sh \ scripts/train_test_tagger.sh \ data/sample/sample_train.conll \ data/sample/sample_test.conll \ +scripts_srl/eval08.pl \ +scripts_srl/remove_augmented.py \ +scripts_srl/train_test_semantic_parser.sh \ +scripts_srl/train_test_submission_closed.sh \ +scripts_srl/train_test_submission_open.sh \ +semeval2014_data/README \ +semeval2014_data/scripts/augment_with_companion_data.py \ +semeval2014_data/scripts/dev_ids \ +semeval2014_data/scripts/generate_all_splits.sh \ +semeval2014_data/scripts/split_data.py \ +semeval2014_data/scripts/train+dev_ids \ +semeval2014_data/scripts/train_ids \ +libturboparser/Makefile \ +libturboparser/TurboParserInterface.cpp \ +libturboparser/TurboParserInterface.h \ +python/install_wrapper.sh \ +python/lemmatizer.py \ +python/nlp_pipeline.py \ +python/README \ +python/setup.py \ +python/turbo_parser.pyx \ +python/tokenizers/__init__.py \ +python/tokenizers/portuguese/__init__.py \ +python/tokenizers/portuguese/clitics.py \ +python/tokenizers/portuguese/contractions.py \ +python/tokenizers/portuguese/word_tokenizer.py \ install_deps.sh \ deps/AD3-2.0.2.tar.gz \ deps/gflags-2.0-no-svn-files.tar.gz \ diff --git a/configure.ac b/configure.ac index fb43ec2..95a1f9f 100644 --- a/configure.ac +++ b/configure.ac @@ -2,7 +2,7 @@ # Process this file with autoconf to produce a configure script. AC_PREREQ([2.59]) -AC_INIT([TurboParser], [2.1.0], [afm@cs.cmu.edu], [TurboParser], +AC_INIT([TurboParser], [2.2.0], [afm@cs.cmu.edu], [TurboParser], [http://www.ark.cs.cmu.edu/TurboParser/]) AM_INIT_AUTOMAKE([1.10 -Wall no-define]) diff --git a/scripts_srl/corpus_statistics.txt b/scripts_srl/corpus_statistics.txt deleted file mode 100644 index 9b2035c..0000000 --- a/scripts_srl/corpus_statistics.txt +++ /dev/null @@ -1,230 +0,0 @@ -===================== Options ====================== -Action: train -Formalism: dm -Algorithm: svm_mira -Regularization: 0.1 -decoder-a: 0.2 -====================================================== -Read 33547 sentences. -Read 267 sentences. -Read 189 sentences. -Number of argument labels: 51 -Label: _after_c #: 63790 # uniq: 63788 -Label: _not+to+mention_c #: 219715 # uniq: 219698 -Label: _and_c #: 133847 # uniq: 133770 -Label: appos #: 12916 # uniq: 12915 -Label: _formerly_c #: 60246 # uniq: 60246 -Label: subord #: 2514 # uniq: 2499 -Label: _much+less_c #: 4179 # uniq: 4179 -Label: _and+yet_c #: 3326 # uniq: 3325 -Label: _and+so_c #: 11737 # uniq: 11677 -Label: BV #: 4950 # uniq: 4592 -Label: _and+not_c #: 2736 # uniq: 2736 -Label: _versus_c #: 7989 # uniq: 7896 -Label: measure #: 25 # uniq: 25 -Label: conj #: 1155 # uniq: 1155 -Label: _except_c #: 6975 # uniq: 6975 -Label: loc #: 823 # uniq: 823 -Label: _instead+of_c #: 9 # uniq: 9 -Label: _if+not_c #: 5026 # uniq: 5021 -Label: _nor_c #: 87 # uniq: 87 -Label: neg #: 15 # uniq: 15 -Label: discourse #: 76 # uniq: 76 -Label: _not_c #: 1779 # uniq: 1771 -Label: _minus_c #: 167 # uniq: 167 -Label: _and+thus_c #: 28 # uniq: 26 -Label: mwe #: 321 # uniq: 321 -Label: _then_c #: 160 # uniq: 160 -Label: plus #: 245 # uniq: 245 -Label: _though_c #: 839 # uniq: 839 -Label: parenthetical #: 5 # uniq: 5 -Label: _and+then_c #: 1 # uniq: 1 -Label: _and+also_c #: 153 # uniq: 153 -Label: _but+also_c #: 282 # uniq: 282 -Label: _except+that_c #: 42 # uniq: 42 -Label: _yet_c #: 34 # uniq: 34 -Label: _rather+than_c #: 61 # uniq: 61 -Label: _even_c #: 8 # uniq: 8 -Label: compound #: 10 # uniq: 10 -Label: poss #: 10 # uniq: 10 -Label: temp #: 22 # uniq: 22 -Label: ARG1 #: 10 # uniq: 10 -Label: ARG2 #: 21 # uniq: 21 -Label: ARG3 #: 28 # uniq: 28 -Label: ARG4 #: 3 # uniq: 3 -Label: _plus_c #: 3 # uniq: 3 -Label: _but+not_c #: 7 # uniq: 7 -Label: times #: 2 # uniq: 2 -Label: _but_c #: 2 # uniq: 2 -Label: of #: 4 # uniq: 4 -Label: unspec_manner #: 3 # uniq: 3 -Label: _as+well+as_c #: 2 # uniq: 2 -Label: _or_c #: 1 # uniq: 1 -Average #components: 1.08078218619 -Max #components: 7 -# Sentences w/ zero components: 1 -# Sentences w/ single-component: 31303 -# Sentences w/ undirected loops: 10042 -# Sentences w/ cycles: 0 -# Edges: 546389 -# Nodes: 569226 -# Tokens: 735706 - - - -===================== Options ====================== -Action: train -Formalism: pas -Algorithm: svm_mira -Regularization: 0.1 -decoder-a: 0.2 -====================================================== -Read 33547 sentences. -Read 267 sentences. -Read 189 sentences. -Number of argument labels: 42 -Label: lparen_ARG2 #: 71416 # uniq: 71416 -Label: comp_ARG1 #: 69947 # uniq: 69947 -Label: comp_ARG2 #: 69119 # uniq: 69119 -Label: punct_ARG1 #: 22855 # uniq: 22855 -Label: coord_ARG1 #: 22920 # uniq: 22920 -Label: coord_ARG2 #: 5220 # uniq: 5220 -Label: verb_ARG4 #: 70143 # uniq: 70143 -Label: verb_ARG3 #: 71193 # uniq: 71193 -Label: verb_ARG2 #: 68360 # uniq: 68360 -Label: verb_ARG1 #: 100853 # uniq: 100853 -Label: lparen_ARG3 #: 13852 # uniq: 13852 -Label: lgs_ARG2 #: 39289 # uniq: 39289 -Label: prep_ARG1 #: 1568 # uniq: 1568 -Label: prep_ARG3 #: 17583 # uniq: 17583 -Label: prep_ARG2 #: 17594 # uniq: 17594 -Label: relative_ARG2 #: 9004 # uniq: 9004 -Label: relative_ARG1 #: 5736 # uniq: 5736 -Label: adj_ARG2 #: 626 # uniq: 626 -Label: adj_ARG1 #: 5141 # uniq: 5141 -Label: app_ARG1 #: 5141 # uniq: 5141 -Label: app_ARG2 #: 4641 # uniq: 4641 -Label: prep_MOD #: 1837 # uniq: 1837 -Label: poss_ARG1 #: 6380 # uniq: 6380 -Label: poss_ARG2 #: 6666 # uniq: 6666 -Label: quote_ARG1 #: 3138 # uniq: 3138 -Label: dtv_ARG2 #: 1119 # uniq: 1119 -Label: verb_MOD #: 806 # uniq: 806 -Label: det_ARG1 #: 806 # uniq: 806 -Label: quote_ARG2 #: 807 # uniq: 807 -Label: noun_ARG2 #: 408 # uniq: 408 -Label: noun_ARG1 #: 125 # uniq: 125 -Label: adj_MOD #: 98 # uniq: 98 -Label: comp_MOD #: 203 # uniq: 203 -Label: it_ARG1 #: 231 # uniq: 231 -Label: conj_ARG1 #: 119 # uniq: 119 -Label: conj_ARG2 #: 113 # uniq: 113 -Label: conj_ARG3 #: 191 # uniq: 191 -Label: aux_ARG1 #: 118 # uniq: 118 -Label: quote_ARG3 #: 89 # uniq: 89 -Label: aux_ARG2 #: 8 # uniq: 8 -Label: aux_MOD #: 12 # uniq: 12 -Label: lparen_ARG1 #: 21 # uniq: 21 -Average #components: 1.00238471398 -Max #components: 3 -# Sentences w/ zero components: 0 -# Sentences w/ single-component: 33470 -# Sentences w/ undirected loops: 23717 -# Sentences w/ cycles: 0 -# Edges: 715496 -# Nodes: 702655 -# Tokens: 735706 - - - - -===================== Options ====================== -Action: train -Formalism: pcedt -Algorithm: svm_mira -Regularization: 0.1 -decoder-a: 0.2 -====================================================== -Read 33547 sentences. -Read 267 sentences. -Read 189 sentences. -Number of argument labels: 68 -Label: LOC #: 21734 # uniq: 17973 -Label: DPHR #: 13081 # uniq: 11683 -Label: PAT #: 68587 # uniq: 63236 -Label: VOCAT #: 75529 # uniq: 68755 -Label: DESCR #: 4697 # uniq: 4256 -Label: RESTR #: 101907 # uniq: 84841 -Label: OPER.member #: 1257 # uniq: 1248 -Label: PAR #: 21277 # uniq: 20158 -Label: AIM #: 480 # uniq: 478 -Label: TWHEN #: 1002 # uniq: 921 -Label: EXT #: 3226 # uniq: 3051 -Label: COND #: 15815 # uniq: 14077 -Label: PREC #: 1076 # uniq: 545 -Label: ACT #: 1371 # uniq: 1277 -Label: CRIT #: 16229 # uniq: 15312 -Label: BEN #: 7863 # uniq: 7333 -Label: CPR #: 2197 # uniq: 2049 -Label: REG #: 4046 # uniq: 4014 -Label: CPHR #: 2063 # uniq: 1752 -Label: DIR3 #: 11879 # uniq: 5787 -Label: CONJ.member #: 27858 # uniq: 12850 -Label: DIR1 #: 1367 # uniq: 1211 -Label: TSIN #: 2072 # uniq: 1909 -Label: MEANS #: 7190 # uniq: 6964 -Label: CONTRA.member #: 1626 # uniq: 1502 -Label: HER #: 6780 # uniq: 6623 -Label: NE #: 573 # uniq: 573 -Label: ID #: 1906 # uniq: 1888 -Label: CAUS #: 2260 # uniq: 2013 -Label: REAS.member #: 1541 # uniq: 1522 -Label: ACMP #: 1550 # uniq: 1333 -Label: CONTRD #: 2600 # uniq: 1308 -Label: DIR2 #: 4737 # uniq: 4551 -Label: NE.member #: 739 # uniq: 707 -Label: ORIG #: 958 # uniq: 953 -Label: MANN #: 2670 # uniq: 2430 -Label: INTF #: 3233 # uniq: 3011 -Label: SUBS #: 1114 # uniq: 993 -Label: CM #: 1568 # uniq: 1483 -Label: DISJ.member #: 2621 # uniq: 2434 -Label: PARTL #: 979 # uniq: 954 -Label: AUTH #: 3097 # uniq: 2833 -Label: THO #: 2191 # uniq: 2046 -Label: INTT #: 346 # uniq: 345 -Label: THL #: 261 # uniq: 128 -Label: TTILL #: 381 # uniq: 367 -Label: CNCS #: 233 # uniq: 224 -Label: RESL #: 754 # uniq: 740 -Label: DIFF #: 383 # uniq: 365 -Label: TPAR #: 2340 # uniq: 1153 -Label: ADVS.member #: 608 # uniq: 604 -Label: EFF #: 2367 # uniq: 2104 -Label: MAT #: 770 # uniq: 752 -Label: TFRWH #: 405 # uniq: 326 -Label: ADDR #: 252 # uniq: 125 -Label: TOWH #: 233 # uniq: 218 -Label: RSTR #: 76 # uniq: 69 -Label: APP #: 188 # uniq: 173 -Label: CSQ.member #: 177 # uniq: 159 -Label: CONFR.member #: 82 # uniq: 75 -Label: ATT #: 36 # uniq: 30 -Label: COMPL #: 78 # uniq: 39 -Label: APPS.member #: 48 # uniq: 23 -Label: RHEM #: 77 # uniq: 39 -Label: SM #: 11 # uniq: 8 -Label: TFHL #: 18 # uniq: 10 -Label: GRAD.member #: 9 # uniq: 9 -Label: MOD #: 6 # uniq: 6 -Average #components: 1.00778012937 -Max #components: 6 -# Sentences w/ zero components: 0 -# Sentences w/ single-component: 33360 -# Sentences w/ undirected loops: 14276 -# Sentences w/ cycles: 0 -# Edges: 466685 -# Nodes: 472350 -# Tokens: 735706 - - diff --git a/scripts_srl/results_sdp.txt b/scripts_srl/results_sdp.txt deleted file mode 100644 index 9661493..0000000 --- a/scripts_srl/results_sdp.txt +++ /dev/null @@ -1,1433 +0,0 @@ -======================================================================================== -FINAL Open, af+cs+as+gp+cp pruned model deterministic, C=0.01, dm, 0.4/0.6 [pba28] -======================================================================================== - -out_open-true_deterministic_dm_0.01_0.4_0.6_af+as+cs+gp+cp+ccp:I0327 21:04:38.660398 2084 SemanticPipe.h:347] Unlabeled F1: 0.909524 -out_open-true_deterministic_dm_0.01_0.4_0.6_af+as+cs+gp+cp+ccp:I0327 21:04:38.660424 2084 SemanticPipe.h:364] Labeled F1: 0.899043 - -======================================================================================== -FINAL Open, af+cs+as+gp+cp pruned model deterministic, C=0.01, pas, 0.4/0.6 [pba28] -======================================================================================== - -I0328 15:41:24.215971 5897 SemanticPipe.h:347] Unlabeled F1: 0.928724 -I0328 15:41:24.215996 5897 SemanticPipe.h:364] Labeled F1: 0.918705 - -======================================================================================== -FINAL Open, af+cs+as+gp+cp pruned model deterministic, C=0.01, pcedt, 0.4/0.6 [pba28] -======================================================================================== - -I0328 18:06:26.412225 6430 SemanticPipe.h:347] Unlabeled F1: 0.901799 -I0328 18:06:26.412255 6430 SemanticPipe.h:364] Labeled F1: 0.800388 - - -======================================================================================== -FINAL Closed, af+cs+as+gp+cp pruned model deterministic, C=0.01, dm, 0.4/0.6 [pba28] -======================================================================================== - -out_open-false_deterministic_dm_0.01_0.4_0.6_af+as+cs+gp+cp+ccp:I0328 05:29:58.148488 60490 SemanticPipe.h:347] Unlabeled F1: 0.896626 -out_open-false_deterministic_dm_0.01_0.4_0.6_af+as+cs+gp+cp+ccp:I0328 05:29:58.148524 60490 SemanticPipe.h:364] Labeled F1: 0.886265 - -======================================================================================== -FINAL Closed, af+cs+as+gp+cp pruned model deterministic, C=0.01, dm, 0.3/0.7 [pba28] -> best -======================================================================================== - -out_open-false_deterministic_dm_0.01_0.3_0.7_af+as+cs+gp+cp+ccp:I0328 12:06:31.619197 61040 SemanticPipe.h:347] Unlabeled F1: 0.897936 -out_open-false_deterministic_dm_0.01_0.3_0.7_af+as+cs+gp+cp+ccp:I0328 12:06:31.619249 61040 SemanticPipe.h:364] Labeled F1: 0.886946 - -======================================================================================== -FINAL Closed, af+cs+as+gp+cp pruned model deterministic, C=0.1, dm, 0.4/0.6 [pba28] -> best -======================================================================================== - -I0329 00:10:45.247457 62621 SemanticPipe.h:347] Unlabeled F1: 0.897404 -I0329 00:10:45.247494 62621 SemanticPipe.h:364] Labeled F1: 0.886859 - - -======================================================================================== -FINAL Closed, af+cs+as+gp+cp pruned model deterministic, C=0.01, pas, 0.4/0.6 [pba28] -======================================================================================== - -out_open-false_deterministic_pas_0.01_0.4_0.6_af+as+cs+gp+cp+ccp:I0328 07:42:47.940095 60605 SemanticPipe.h:347] Unlabeled F1: 0.921248 -out_open-false_deterministic_pas_0.01_0.4_0.6_af+as+cs+gp+cp+ccp:I0328 07:42:47.940134 60605 SemanticPipe.h:364] Labeled F1: 0.910491 - -======================================================================================== -FINAL Closed, af+cs+as+gp+cp pruned model deterministic, C=0.01, pcedt, 0.4/0.6 [pba28] -======================================================================================== - -out_open-false_deterministic_pcedt_0.01_0.4_0.6_af+as+cs+gp+cp+ccp:I0328 17:28:49.944344 61399 SemanticPipe.h:347] Unlabeled F1: 0.884355 -out_open-false_deterministic_pcedt_0.01_0.4_0.6_af+as+cs+gp+cp+ccp:I0328 17:28:49.944382 61399 SemanticPipe.h:364] Labeled F1: 0.788557 - -======================================================================================== -FINAL Closed, af+cs+as+gp+cp pruned model deterministic, C=0.01, pcedt, 0.3/0.7 [pba28] -> best -======================================================================================== - -out_open-false_deterministic_pcedt_0.01_0.3_0.7_af+as+cs+gp+cp+ccp:I0328 17:24:59.930541 61343 SemanticPipe.h:347] Unlabeled F1: 0.888231 -out_open-false_deterministic_pcedt_0.01_0.3_0.7_af+as+cs+gp+cp+ccp:I0328 17:24:59.930579 61343 SemanticPipe.h:364] Labeled F1: 0.788829 - -======================================================================================== -FINAL Closed, af+cs+as+gp+cp pruned model deterministic, C=0.1, pcedt, 0.5/0.5 [pba28] -======================================================================================== - -I0328 22:25:30.789033 62296 SemanticPipe.h:347] Unlabeled F1: 0.878875 -I0328 22:25:30.789072 62296 SemanticPipe.h:364] Labeled F1: 0.786028 - - - -======================================================================================== -Open, af+cs+as+gp+cp pruned model deterministic, C=0.01, dm, best = 0.4/0.6 [pba28] -======================================================================================== - -out_open-true_deterministic_af+cs_dm_0.01_0.4_0.6_af+as+cs+gp+cp:I0321 05:14:11.548655 3356 SemanticPipe.h:347] Unlabeled F1: 0.90927 -out_open-true_deterministic_af+cs_dm_0.01_0.4_0.6_af+as+cs+gp+cp:I0321 05:14:11.548692 3356 SemanticPipe.h:364] Labeled F1: 0.898454 - -======================================================================================== -Open, af+cs+as+gp+cp pruned model deterministic, C=0.001, dm, best = 0.4/0.6 [pba28] -======================================================================================== - -out_open-true_deterministic_af+cs_dm_0.001_0.4_0.6_af+as+cs+gp+cp:I0321 12:29:19.650185 4150 SemanticPipe.h:347] Unlabeled F1: 0.905263 -out_open-true_deterministic_af+cs_dm_0.001_0.4_0.6_af+as+cs+gp+cp:I0321 12:29:19.650208 4150 SemanticPipe.h:364] Labeled F1: 0.892515 - -======================================================================================== -Open, af+cs+as+gp+cp pruned model deterministic, C=0.1, dm, best = 0.4/0.6 [pba28] --> best C -======================================================================================== - -out_open-true_deterministic_af+cs_dm_0.1_0.4_0.6_af+as+cs+gp+cp:I0321 19:50:24.073361 4625 SemanticPipe.h:347] Unlabeled F1: 0.90971 -out_open-true_deterministic_af+cs_dm_0.1_0.4_0.6_af+as+cs+gp+cp:I0321 19:50:24.073385 4625 SemanticPipe.h:364] Labeled F1: 0.898858 - - -======================================================================================== -Open, af+cs+as+gp+cp pruned model deterministic, C=0.01, pas, best = 0.4/0.6 [pba28] --> best C -======================================================================================== - -out_open-true_deterministic_af+cs_pas_0.01_0.4_0.6_af+as+cs+gp+cp:I0321 05:41:45.944953 3405 SemanticPipe.h:347] Unlabeled F1: 0.928286 -out_open-true_deterministic_af+cs_pas_0.01_0.4_0.6_af+as+cs+gp+cp:I0321 05:41:45.944975 3405 SemanticPipe.h:364] Labeled F1: 0.917705 - -======================================================================================== -Open, af+cs+as+gp+cp pruned model deterministic, C=0.001, pas, best = 0.5/0.5 [pba28] -======================================================================================== - -out_open-true_deterministic_af+cs_pas_0.001_0.5_0.5_af+as+cs+gp+cp:I0321 19:52:41.281522 4660 SemanticPipe.h:347] Unlabeled F1: 0.92638 -out_open-true_deterministic_af+cs_pas_0.001_0.5_0.5_af+as+cs+gp+cp:I0321 19:52:41.281545 4660 SemanticPipe.h:364] Labeled F1: 0.916132 - -======================================================================================== -Open, af+cs+as+gp+cp pruned model deterministic, C=0.1, pas, best = 0.5/0.5 [pba28] -======================================================================================== - -out_open-true_deterministic_af+cs_pas_0.1_0.5_0.5_af+as+cs+gp+cp:I0322 04:25:00.315819 6362 SemanticPipe.h:347] Unlabeled F1: 0.927396 -out_open-true_deterministic_af+cs_pas_0.1_0.5_0.5_af+as+cs+gp+cp:I0322 04:25:00.315842 6362 SemanticPipe.h:364] Labeled F1: 0.917128 - - -======================================================================================== -Open, af+cs+as+gp+cp pruned model deterministic, C=0.01, pcedt, best = 0.4/0.6 [pba28] -======================================================================================== - -out_open-true_deterministic_pcedt_0.01_0.4_0.6_af+as+cs+gp+cp:I0322 13:39:15.192270 8472 SemanticPipe.h:347] Unlabeled F1: 0.896627 -out_open-true_deterministic_pcedt_0.01_0.4_0.6_af+as+cs+gp+cp:I0322 13:39:15.192307 8472 SemanticPipe.h:364] Labeled F1: 0.800026 - -======================================================================================== -Open, af+cs+as+gp+cp pruned model deterministic, C=0.001, pcedt, best = 0.3/0.7 [pba28] -======================================================================================== - -out_open-true_deterministic_pcedt_0.001_0.3_0.7_af+as+cs+gp+cp:I0322 20:48:18.663514 9373 SemanticPipe.h:347] Unlabeled F1: 0.896891 -out_open-true_deterministic_pcedt_0.001_0.3_0.7_af+as+cs+gp+cp:I0322 20:48:18.663537 9373 SemanticPipe.h:364] Labeled F1: 0.79878 - -======================================================================================== -Open, af+cs+as+gp+cp pruned model deterministic, C=0.1, pcedt, best = 0.5/0.5 [pba28] --> best C -======================================================================================== - -out_open-true_deterministic_pcedt_0.1_0.5_0.5_af+as+cs+gp+cp:I0323 03:57:48.986974 10282 SemanticPipe.h:347] Unlabeled F1: 0.891179 -out_open-true_deterministic_pcedt_0.1_0.5_0.5_af+as+cs+gp+cp:I0323 03:57:48.986995 10282 SemanticPipe.h:364] Labeled F1: 0.800638 -out_open-true_deterministic_pcedt_0.1_0.5_0.5_af+as+cs+gp+cp:I0323 03:57:48.987010 10282 SemanticPipe.h:380] Speed: 1807.25 tokens per second. - - -======================================================================================== -Open, af+cs+gp+cp pruned model deterministic, C=0.01, dm, best = 0.4/0.6 [pba28] --> best C -======================================================================================== - -out_open-true_deterministic_dm_0.01_0.4_0.6_af+cs+gp+cp:I0322 14:08:23.848956 8519 SemanticPipe.h:347] Unlabeled F1: 0.909488 -out_open-true_deterministic_dm_0.01_0.4_0.6_af+cs+gp+cp:I0322 14:08:23.848979 8519 SemanticPipe.h:364] Labeled F1: 0.898824 -out_open-true_deterministic_dm_0.01_0.4_0.6_af+cs+gp+cp:I0322 14:08:23.848994 8519 SemanticPipe.h:380] Speed: 1523.59 tokens per second. - -======================================================================================== -Open, af+cs+gp+cp pruned model deterministic, C=0.001, dm, best = 0.4/0.6 [pba28] -======================================================================================== - -out_open-true_deterministic_dm_0.001_0.4_0.6_af+cs+gp+cp:I0322 20:49:04.629609 9408 SemanticPipe.h:347] Unlabeled F1: 0.904447 -out_open-true_deterministic_dm_0.001_0.4_0.6_af+cs+gp+cp:I0322 20:49:04.629633 9408 SemanticPipe.h:364] Labeled F1: 0.891704 - -======================================================================================== -Open, af+cs+gp+cp pruned model deterministic, C=0.1, dm, best = 0.4/0.6 [pba28] -======================================================================================== - -out_open-true_deterministic_dm_0.1_0.4_0.6_af+cs+gp+cp:I0323 03:32:22.410461 10236 SemanticPipe.h:347] Unlabeled F1: 0.909531 -out_open-true_deterministic_dm_0.1_0.4_0.6_af+cs+gp+cp:I0323 03:32:22.410485 10236 SemanticPipe.h:364] Labeled F1: 0.898575 - - -======================================================================================== -Open, af+cs+gp+cp pruned model deterministic, C=0.01, pas, best = 0.5/0.5 [pba28] --> best C -======================================================================================== - -out_open-true_deterministic_pas_0.01_0.5_0.5_af+cs+gp+cp:I0323 18:32:53.528162 11962 SemanticPipe.h:347] Unlabeled F1: 0.926699 -out_open-true_deterministic_pas_0.01_0.5_0.5_af+cs+gp+cp:I0323 18:32:53.528184 11962 SemanticPipe.h:364] Labeled F1: 0.916624 -out_open-true_deterministic_pas_0.01_0.5_0.5_af+cs+gp+cp:I0323 18:32:53.528199 11962 SemanticPipe.h:380] Speed: 1601.55 tokens per second. - -======================================================================================== -Open, af+cs+gp+cp pruned model deterministic, C=0.001, pas, best = 0.5/0.5 [pba28] -======================================================================================== - -out_open-true_deterministic_pas_0.001_0.5_0.5_af+cs+gp+cp:I0324 02:19:43.638890 12786 SemanticPipe.h:347] Unlabeled F1: 0.926069 -out_open-true_deterministic_pas_0.001_0.5_0.5_af+cs+gp+cp:I0324 02:19:43.638912 12786 SemanticPipe.h:364] Labeled F1: 0.915764 - -======================================================================================== -Open, af+cs+gp+cp pruned model deterministic, C=0.1, pas, best = 0.5/0.5 [pba28] -======================================================================================== - -out_open-true_deterministic_pas_0.1_0.5_0.5_af+cs+gp+cp:I0324 09:46:47.254998 13513 SemanticPipe.h:347] Unlabeled F1: 0.926533 -out_open-true_deterministic_pas_0.1_0.5_0.5_af+cs+gp+cp:I0324 09:46:47.255022 13513 SemanticPipe.h:364] Labeled F1: 0.916375 - - -======================================================================================== -Open, af+cs+gp+cp pruned model deterministic, C=0.01, pcedt, best = 0.5/0.5 [pba28] --> best C -======================================================================================== - -out_open-true_deterministic_pcedt_0.01_0.5_0.5_af+cs+gp+cp:I0323 15:23:20.658821 11730 SemanticPipe.h:347] Unlabeled F1: 0.890962 -out_open-true_deterministic_pcedt_0.01_0.5_0.5_af+cs+gp+cp:I0323 15:23:20.658843 11730 SemanticPipe.h:364] Labeled F1: 0.800448 -out_open-true_deterministic_pcedt_0.01_0.5_0.5_af+cs+gp+cp:I0323 15:23:20.658859 11730 SemanticPipe.h:380] Speed: 1958.92 tokens per second. - -======================================================================================== -Open, af+cs+gp+cp pruned model deterministic, C=0.001, pcedt, best = 0.3/0.7 [pba28] -======================================================================================== - -out_open-true_deterministic_pcedt_0.001_0.3_0.7_af+cs+gp+cp:I0323 18:35:45.603747 12000 SemanticPipe.h:347] Unlabeled F1: 0.895867 -out_open-true_deterministic_pcedt_0.001_0.3_0.7_af+cs+gp+cp:I0323 18:35:45.603778 12000 SemanticPipe.h:364] Labeled F1: 0.798171 - -======================================================================================== -Open, af+cs+gp+cp pruned model deterministic, C=0.1, pcedt, best = 0.5/0.5 [pba28] -======================================================================================== - -out_open-true_deterministic_pcedt_0.1_0.5_0.5_af+cs+gp+cp:I0324 01:00:50.791736 12718 SemanticPipe.h:347] Unlabeled F1: 0.890019 -out_open-true_deterministic_pcedt_0.1_0.5_0.5_af+cs+gp+cp:I0324 01:00:50.791759 12718 SemanticPipe.h:364] Labeled F1: 0.80025 - - -======================================================================================== -Open, af pruned model deterministic, C=0.01, dm, 0.4/0.6 [pba28] -======================================================================================== - -I0321 01:47:24.304813 2997 SemanticPipe.h:347] Unlabeled F1: 0.885418 -I0321 01:47:24.304853 2997 SemanticPipe.h:364] Labeled F1: -nan -I0321 02:40:17.535944 3110 SemanticPipe.h:347] Unlabeled F1: 0.897327 -I0321 02:40:17.535970 3110 SemanticPipe.h:364] Labeled F1: 0.887857 - -======================================================================================== -Open, af pruned model deterministic, C=0.01, pas, 0.4/0.6 [pba28] -======================================================================================== - -I0321 01:46:22.971887 2970 SemanticPipe.h:347] Unlabeled F1: 0.916069 -I0321 01:46:22.971911 2970 SemanticPipe.h:364] Labeled F1: -nan -I0321 02:39:41.149220 3084 SemanticPipe.h:347] Unlabeled F1: 0.922503 -I0321 02:39:41.149242 3084 SemanticPipe.h:364] Labeled F1: 0.91279 - -======================================================================================== -Open, af pruned model deterministic, C=0.01, pcedt, 0.4/0.6 [pba28] -======================================================================================== - -I0321 01:42:18.585459 2941 SemanticPipe.h:347] Unlabeled F1: 0.894255 -I0321 01:42:18.585482 2941 SemanticPipe.h:364] Labeled F1: -nan -I0321 02:34:03.299660 3056 SemanticPipe.h:347] Unlabeled F1: 0.875071 -I0321 02:34:03.299684 3056 SemanticPipe.h:364] Labeled F1: 0.795198 - - - -======================================================================================== -Closed, af+cs+as+gp+cp+ccp pruned model deterministic, C=0.01, dm, best = 0.4/0.6 [hyperv-ubuntu1] -======================================================================================== - -out_open-false_deterministic_dm_0.01_0.4_0.6_af+as+cs+gp+cp+ccp:I0326 05:49:23.582952 56979 SemanticPipe.h:347] Unlabeled F1: 0.893537 -out_open-false_deterministic_dm_0.01_0.4_0.6_af+as+cs+gp+cp+ccp:I0326 05:49:23.583029 56979 SemanticPipe.h:364] Labeled F1: 0.882392 - -======================================================================================== -Closed, af+cs+as+gp+cp+ccp pruned model deterministic, C=0.1, dm, best = 0.4/0.6 [hyperv-ubuntu1] -======================================================================================== - -out_open-false_deterministic_dm_0.1_0.4_0.6_af+as+cs+gp+cp+ccp:I0327 01:01:42.115736 58100 SemanticPipe.h:347] Unlabeled F1: 0.893316 -out_open-false_deterministic_dm_0.1_0.4_0.6_af+as+cs+gp+cp+ccp:I0327 01:01:42.115774 58100 SemanticPipe.h:364] Labeled F1: 0.88232 - -======================================================================================== -Closed, af+cs+as+gp+cp+ccp pruned model deterministic, C=0.01, pas, best = 0.4/0.6 [hyperv-ubuntu1] -======================================================================================== - -out_open-false_deterministic_pas_0.01_0.4_0.6_af+as+cs+gp+cp+ccp:I0326 08:19:22.553370 57304 SemanticPipe.h:347] Unlabeled F1: 0.921089 -out_open-false_deterministic_pas_0.01_0.4_0.6_af+as+cs+gp+cp+ccp:I0326 08:19:22.553410 57304 SemanticPipe.h:364] Labeled F1: 0.910388 - -======================================================================================== -Closed, af+cs+as+gp+cp+ccp pruned model deterministic, C=0.01, pcedt, best = 0.3/0.7 [hyperv-ubuntu1]--> best C -======================================================================================== - -out_open-false_deterministic_pcedt_0.01_0.3_0.7_af+as+cs+gp+cp+ccp:I0326 08:39:43.387931 57342 SemanticPipe.h:347] Unlabeled F1: 0.880805 -out_open-false_deterministic_pcedt_0.01_0.3_0.7_af+as+cs+gp+cp+ccp:I0326 08:39:43.387970 57342 SemanticPipe.h:364] Labeled F1: 0.780138 - -======================================================================================== -Closed, af+cs+as+gp+cp+ccp pruned model deterministic, C=0.1, pcedt, best = 0.4/0.6 [hyperv-ubuntu1] -======================================================================================== - -out_open-false_deterministic_pcedt_0.1_0.4_0.6_af+as+cs+gp+cp+ccp:I0326 17:30:40.922695 57674 SemanticPipe.h:347] Unlabeled F1: 0.876614 -out_open-false_deterministic_pcedt_0.1_0.4_0.6_af+as+cs+gp+cp+ccp:I0326 17:30:40.922732 57674 SemanticPipe.h:364] Labeled F1: 0.779189 - - -======================================================================================== -Closed, af+cs+as+gp+cp pruned model deterministic, C=0.01, dm, best = 0.4/0.6 [hyperv-ubuntu1] -======================================================================================== - -out_open-false_deterministic_af+cs_dm_0.01_0.4_0.6_af+as+cs+gp+cp:I0321 08:04:44.428120 48741 SemanticPipe.h:347] Unlabeled F1: 0.893025 -out_open-false_deterministic_af+cs_dm_0.01_0.4_0.6_af+as+cs+gp+cp:I0321 08:04:44.428164 48741 SemanticPipe.h:364] Labeled F1: 0.881902 - -======================================================================================== -Closed, af+cs+as+gp+cp pruned model deterministic, C=0.001, dm, best = 0.3/0.7 [hyperv-ubuntu1] -======================================================================================== - -out_open-false_deterministic_af+cs_dm_0.001_0.3_0.7_af+as+cs+gp+cp:I0322 02:07:48.760365 49569 SemanticPipe.h:347] Unlabeled F1: 0.88667 -out_open-false_deterministic_af+cs_dm_0.001_0.3_0.7_af+as+cs+gp+cp:I0322 02:07:48.760462 49569 SemanticPipe.h:364] Labeled F1: 0.871101 - -======================================================================================== -Closed, af+cs+as+gp+cp pruned model deterministic, C=0.1, dm, best = 0.3/0.7 [hyperv-ubuntu1] --> best C -======================================================================================== - -out_open-false_deterministic_af+cs_dm_0.1_0.3_0.7_af+as+cs+gp+cp:I0322 15:07:44.135422 50563 SemanticPipe.h:347] Unlabeled F1: 0.89349 -out_open-false_deterministic_af+cs_dm_0.1_0.3_0.7_af+as+cs+gp+cp:I0322 15:07:44.135462 50563 SemanticPipe.h:364] Labeled F1: 0.881938 - - -======================================================================================== -Closed, af+cs+as+gp+cp pruned model deterministic, C=0.01, pas, best = 0.4/0.6 [hyperv-ubuntu1] --> best C -======================================================================================== - -out_open-false_deterministic_af+cs_pas_0.01_0.5_0.5_af+as+cs+gp+cp:I0321 22:55:43.952608 49450 SemanticPipe.h:347] Unlabeled F1: 0.919577 -out_open-false_deterministic_af+cs_pas_0.01_0.5_0.5_af+as+cs+gp+cp:I0321 22:55:43.952651 49450 SemanticPipe.h:364] Labeled F1: 0.909399 - -======================================================================================== -Closed, af+cs+as+gp+cp pruned model deterministic, C=0.001, pas, best = 0.4/0.6 [hyperv-ubuntu1] -======================================================================================== - -out_open-false_deterministic_af+cs_pas_0.001_0.4_0.6_af+as+cs+gp+cp:I0322 05:23:00.469722 49692 SemanticPipe.h:347] Unlabeled F1: 0.916831 -out_open-false_deterministic_af+cs_pas_0.001_0.4_0.6_af+as+cs+gp+cp:I0322 05:23:00.469761 49692 SemanticPipe.h:364] Labeled F1: 0.905158 - -======================================================================================== -Closed, af+cs+as+gp+cp pruned model deterministic, C=0.1, pas, best = 0.5/0.5 [hyperv-ubuntu1] -======================================================================================== - -out_open-false_deterministic_af+cs_pas_0.1_0.5_0.5_af+as+cs+gp+cp:I0323 12:51:32.642770 52741 SemanticPipe.h:347] Unlabeled F1: 0.919448 -out_open-false_deterministic_af+cs_pas_0.1_0.5_0.5_af+as+cs+gp+cp:I0323 12:51:32.642812 52741 SemanticPipe.h:364] Labeled F1: 0.909298 - - -======================================================================================== -Closed, af+cs+as+gp+cp pruned model deterministic, C=0.01, pcedt, best = 0.3/0.7 [hyperv-ubuntu1] -======================================================================================== - -out_open-false_deterministic_af+cs_pcedt_0.01_0.3_0.7_af+as+cs+gp+cp:I0321 10:21:07.451601 48845 SemanticPipe.h:347] Unlabeled F1: 0.876198 -out_open-false_deterministic_af+cs_pcedt_0.01_0.3_0.7_af+as+cs+gp+cp:I0321 10:21:07.451650 48845 SemanticPipe.h:364] Labeled F1: 0.780854 - -======================================================================================== -Closed, af+cs+as+gp+cp pruned model deterministic, C=0.001, pcedt, best = 0.3/0.7 [hyperv-ubuntu1] -======================================================================================== - -out_open-false_deterministic_af+cs_pcedt_0.001_0.3_0.7_af+as+cs+gp+cp:I0321 21:21:36.001724 49360 SemanticPipe.h:347] Unlabeled F1: 0.866645 -out_open-false_deterministic_af+cs_pcedt_0.001_0.3_0.7_af+as+cs+gp+cp:I0321 21:21:36.001765 49360 SemanticPipe.h:364] Labeled F1: 0.772748 - -======================================================================================== -Closed, af+cs+as+gp+cp pruned model deterministic, C=0.1, pcedt, best = 0.4/0.6 [hyperv-ubuntu1] --> best C -======================================================================================== - -out_open-false_deterministic_af+cs_pcedt_0.1_0.4_0.6_af+as+cs+gp+cp:I0322 04:22:02.731698 49643 SemanticPipe.h:347] Unlabeled F1: 0.873334 -out_open-false_deterministic_af+cs_pcedt_0.1_0.4_0.6_af+as+cs+gp+cp:I0322 04:22:02.731739 49643 SemanticPipe.h:364] Labeled F1: 0.781234 - - -======================================================================================== -Closed, af+cs+gp+cp pruned model deterministic, C=0.01, dm, best = 0.4/0.6 [hyperv-ubuntu1] -======================================================================================== - -out_open-false_deterministic_af+cs_dm_0.01_0.4_0.6_af+cs+gp+cp:I0323 04:36:59.989497 51886 SemanticPipe.h:347] Unlabeled F1: 0.891813 -out_open-false_deterministic_af+cs_dm_0.01_0.4_0.6_af+cs+gp+cp:I0323 04:36:59.989537 51886 SemanticPipe.h:364] Labeled F1: 0.880963 - -======================================================================================== -Closed, af+cs+gp+cp pruned model deterministic, C=0.001, dm, best = 0.3/0.7 [hyperv-ubuntu1] -======================================================================================== - -out_open-false_deterministic_dm_0.001_0.3_0.7_af+cs+gp+cp:I0323 19:55:24.082449 52979 SemanticPipe.h:347] Unlabeled F1: 0.88461 -out_open-false_deterministic_dm_0.001_0.3_0.7_af+cs+gp+cp:I0323 19:55:24.082486 52979 SemanticPipe.h:364] Labeled F1: 0.868866 - -======================================================================================== -Closed, af+cs+gp+cp pruned model deterministic, C=0.1, dm, best = 0.4/0.6 [hyperv-ubuntu1] --> best C -======================================================================================== - -out_open-false_deterministic_af+cs_dm_0.1_0.4_0.6_af+cs+gp+cp:I0324 03:30:19.037987 53564 SemanticPipe.h:347] Unlabeled F1: 0.891931 -out_open-false_deterministic_af+cs_dm_0.1_0.4_0.6_af+cs+gp+cp:I0324 03:30:19.038027 53564 SemanticPipe.h:364] Labeled F1: 0.881045 - - -======================================================================================== -Closed, af+cs+gp+cp pruned model deterministic, C=0.01, pas, best = 0.5/0.5 [hyperv-ubuntu1] -======================================================================================== - -out_open-false_deterministic_pas_0.01_0.5_0.5_af+cs+gp+cp:I0324 18:00:09.881584 54343 SemanticPipe.h:347] Unlabeled F1: 0.918352 -out_open-false_deterministic_pas_0.01_0.5_0.5_af+cs+gp+cp:I0324 18:00:09.881621 54343 SemanticPipe.h:364] Labeled F1: 0.908028 - -======================================================================================== -Closed, af+cs+gp+cp pruned model deterministic, C=0.001, pas, best = 0.4/0.6 [hyperv-ubuntu1] -======================================================================================== - -out_open-false_deterministic_pas_0.001_0.4_0.6_af+cs+gp+cp:I0324 23:39:03.657102 54482 SemanticPipe.h:347] Unlabeled F1: 0.915632 -out_open-false_deterministic_pas_0.001_0.4_0.6_af+cs+gp+cp:I0324 23:39:03.657140 54482 SemanticPipe.h:364] Labeled F1: 0.904041 - -======================================================================================== -Closed, af+cs+gp+cp pruned model deterministic, C=0.1, pas, best = 0.3/0.7 [hyperv-ubuntu1] [NOTE: 0.5/0.5 missing] -======================================================================================== - -out_open-false_deterministic_pas_0.1_0.3_0.7_af+cs+gp+cp:I0325 22:31:36.968557 55634 SemanticPipe.h:347] Unlabeled F1: 0.918391 -out_open-false_deterministic_pas_0.1_0.3_0.7_af+cs+gp+cp:I0325 22:31:36.968598 55634 SemanticPipe.h:364] Labeled F1: 0.907134 - -======================================================================================== -Closed, af+cs+gp+cp pruned model deterministic, C=0.01, pcedt, best = 0.3/0.7 [hyperv-ubuntu1] --> best C -======================================================================================== - -out_open-false_deterministic_pcedt_0.01_0.3_0.7_af+cs+gp+cp:I0322 18:24:27.792114 50990 SemanticPipe.h:347] Unlabeled F1: 0.878921 -out_open-false_deterministic_pcedt_0.01_0.3_0.7_af+cs+gp+cp:I0322 18:24:27.792153 50990 SemanticPipe.h:364] Labeled F1: 0.781046 - -======================================================================================== -Closed, af+cs+gp+cp pruned model deterministic, C=0.001, pcedt, best = 0.3/0.7 [hyperv-ubuntu1] -======================================================================================== - -out_open-false_deterministic_pcedt_0.001_0.3_0.7_af+cs+gp+cp:I0323 03:45:55.867586 51837 SemanticPipe.h:347] Unlabeled F1: 0.866106 -out_open-false_deterministic_pcedt_0.001_0.3_0.7_af+cs+gp+cp:I0323 03:45:55.867630 51837 SemanticPipe.h:364] Labeled F1: 0.772142 - -======================================================================================== -Closed, af+cs+gp+cp pruned model deterministic, C=0.1, pcedt, best = 0.3/0.7 [hyperv-ubuntu1] -======================================================================================== - -out_open-false_deterministic_pcedt_0.1_0.3_0.7_af+cs+gp+cp:I0323 13:02:30.557625 52765 SemanticPipe.h:347] Unlabeled F1: 0.878545 -out_open-false_deterministic_pcedt_0.1_0.3_0.7_af+cs+gp+cp:I0323 13:02:30.557660 52765 SemanticPipe.h:364] Labeled F1: 0.780853 - - - -======================================================================================== -Closed, af+cs pruned model deterministic, C=0.01, pcedt, best = 0.3/0.7 [hyperv-ubuntu1] -======================================================================================== - -out_open-false_deterministic_pcedt_0.01_0.3_0.7_af+cs:I0324 04:05:36.376404 53601 SemanticPipe.h:347] Unlabeled F1: 0.854038 -out_open-false_deterministic_pcedt_0.01_0.3_0.7_af+cs:I0324 04:05:36.376443 53601 SemanticPipe.h:364] Labeled F1: 0.768819 - -======================================================================================== -Closed, af+cs pruned model deterministic, C=0.1, pcedt, best = 0.3/0.7 [hyperv-ubuntu1] --> best C -======================================================================================== - -out_open-false_deterministic_pcedt_0.1_0.3_0.7_af+cs:I0324 08:47:41.323659 54064 SemanticPipe.h:347] Unlabeled F1: 0.854057 -out_open-false_deterministic_pcedt_0.1_0.3_0.7_af+cs:I0324 08:47:41.323695 54064 SemanticPipe.h:364] Labeled F1: 0.76902 - - - -======================================================================================== -Closed, af pruned model deterministic, C=0.01, dm, 0.4/0.6 [hyperv-ubuntu1] -======================================================================================== - -I0321 02:28:31.220026 48125 SemanticPipe.h:347] Unlabeled F1: 0.850062 -I0321 02:28:31.220068 48125 SemanticPipe.h:364] Labeled F1: -nan -I0321 03:31:42.186511 48231 SemanticPipe.h:347] Unlabeled F1: 0.871191 -I0321 03:31:42.186549 48231 SemanticPipe.h:364] Labeled F1: 0.862542 - - -======================================================================================== -Closed, af pruned model deterministic, C=0.01, pas, 0.4/0.6 [hyperv-ubuntu1] -======================================================================================== - -I0321 02:28:42.804260 48148 SemanticPipe.h:347] Unlabeled F1: 0.880219 -I0321 02:28:42.804303 48148 SemanticPipe.h:364] Labeled F1: -nan -I0321 03:37:44.233330 48254 SemanticPipe.h:347] Unlabeled F1: 0.902664 -I0321 03:37:44.233369 48254 SemanticPipe.h:364] Labeled F1: 0.893095 - -======================================================================================== -Closed, af pruned model deterministic, C=0.01, pcedt, 0.4/0.6 [hyperv-ubuntu1] -======================================================================================== - -I0321 02:24:56.445627 48101 SemanticPipe.h:347] Unlabeled F1: 0.840499 -I0321 02:24:56.445672 48101 SemanticPipe.h:364] Labeled F1: -nan -I0321 03:26:37.499413 48192 SemanticPipe.h:347] Unlabeled F1: 0.832255 -I0321 03:26:37.499449 48192 SemanticPipe.h:364] Labeled F1: 0.760636 - - - - - - - - - - - - - - -************************************************************************************************************************** -************************************************************************************************************************** -************************************************************************************************************************** -************************************************************************************************************************** -OLD STUFF: - -======================================================================================== -Open, af+cs+as+gp+cp pruned model deterministic, C=0.01, dm, best = 0.5/0.5 [hyperv-ubuntu1] -======================================================================================== - -out_open_deterministic_dm_0.01_0.5_0.5_af+as+cs+gp+cp:I0319 12:29:43.150956 44833 SemanticPipe.h:347] Unlabeled F1: 0.894272 -out_open_deterministic_dm_0.01_0.5_0.5_af+as+cs+gp+cp:I0319 12:29:43.150998 44833 SemanticPipe.h:364] Labeled F1: 0.884873 -out_open_deterministic_dm_0.01_0.5_0.5_af+as+cs+gp+cp:I0319 12:31:11.228649 44854 SemanticPipe.h:347] Unlabeled F1: 0.889731 -out_open_deterministic_dm_0.01_0.5_0.5_af+as+cs+gp+cp:I0319 12:31:11.228696 44854 SemanticPipe.h:364] Labeled F1: 0.879339 -out_open_deterministic_dm_0.01_0.5_0.5_af+as+cs+gp+cp:I0319 12:47:33.813737 44876 SemanticPipe.h:347] Unlabeled F1: 0.989589 -out_open_deterministic_dm_0.01_0.5_0.5_af+as+cs+gp+cp:I0319 12:47:33.813777 44876 SemanticPipe.h:364] Labeled F1: 0.986526 - -======================================================================================== -Open, af+cs+as+gp+cp pruned model deterministic, C=0.001, dm, best = 0.4/0.6 [hyperv-ubuntu1] -======================================================================================== - -out_open_deterministic_dm_0.001_0.4_0.6_af+as+cs+gp+cp:I0319 17:24:38.716848 45446 SemanticPipe.h:347] Unlabeled F1: 0.891953 -out_open_deterministic_dm_0.001_0.4_0.6_af+as+cs+gp+cp:I0319 17:24:38.716888 45446 SemanticPipe.h:364] Labeled F1: 0.879705 -out_open_deterministic_dm_0.001_0.4_0.6_af+as+cs+gp+cp:I0319 17:25:57.282035 45467 SemanticPipe.h:347] Unlabeled F1: 0.887499 -out_open_deterministic_dm_0.001_0.4_0.6_af+as+cs+gp+cp:I0319 17:25:57.282074 45467 SemanticPipe.h:364] Labeled F1: 0.87382 -out_open_deterministic_dm_0.001_0.4_0.6_af+as+cs+gp+cp:I0319 17:39:19.859638 45489 SemanticPipe.h:347] Unlabeled F1: 0.965422 -out_open_deterministic_dm_0.001_0.4_0.6_af+as+cs+gp+cp:I0319 17:39:19.859678 45489 SemanticPipe.h:364] Labeled F1: 0.956224 - -======================================================================================== -Open, af+cs+as+gp+cp pruned model deterministic, C=0.1, dm, best = 0.4/0.6 [hyperv-ubuntu1] -======================================================================================== - -out_open_deterministic_dm_0.1_0.4_0.6_af+as+cs+gp+cp:I0320 06:40:54.040676 46352 SemanticPipe.h:347] Unlabeled F1: 0.895098 -out_open_deterministic_dm_0.1_0.4_0.6_af+as+cs+gp+cp:I0320 06:40:54.040715 46352 SemanticPipe.h:364] Labeled F1: 0.885378 -out_open_deterministic_dm_0.1_0.4_0.6_af+as+cs+gp+cp:I0320 06:42:10.282659 46373 SemanticPipe.h:347] Unlabeled F1: 0.890542 -out_open_deterministic_dm_0.1_0.4_0.6_af+as+cs+gp+cp:I0320 06:42:10.282711 46373 SemanticPipe.h:364] Labeled F1: 0.879697 -out_open_deterministic_dm_0.1_0.4_0.6_af+as+cs+gp+cp:I0320 06:55:21.793547 46394 SemanticPipe.h:347] Unlabeled F1: 0.990182 -out_open_deterministic_dm_0.1_0.4_0.6_af+as+cs+gp+cp:I0320 06:55:21.793586 46394 SemanticPipe.h:364] Labeled F1: 0.987051 - - -======================================================================================== -Open, af+cs+as+gp+cp pruned model deterministic, C=0.01, pcedt, best = 0.4/0.6 [hyperv-ubuntu1] -======================================================================================== - -out_open_deterministic_pcedt_0.01_0.4_0.6_af+as+cs+gp+cp:I0319 03:37:28.133611 43886 SemanticPipe.h:347] Unlabeled F1: 0.88569 -out_open_deterministic_pcedt_0.01_0.4_0.6_af+as+cs+gp+cp:I0319 03:37:28.133649 43886 SemanticPipe.h:364] Labeled F1: 0.797755 -out_open_deterministic_pcedt_0.01_0.4_0.6_af+as+cs+gp+cp:I0319 03:38:39.391377 43907 SemanticPipe.h:347] Unlabeled F1: 0.876751 -out_open_deterministic_pcedt_0.01_0.4_0.6_af+as+cs+gp+cp:I0319 03:38:39.391415 43907 SemanticPipe.h:364] Labeled F1: 0.783481 -out_open_deterministic_pcedt_0.01_0.4_0.6_af+as+cs+gp+cp:I0319 03:49:33.493494 43928 SemanticPipe.h:347] Unlabeled F1: 0.992453 -out_open_deterministic_pcedt_0.01_0.4_0.6_af+as+cs+gp+cp:I0319 03:49:33.493531 43928 SemanticPipe.h:364] Labeled F1: 0.960019 - -======================================================================================== -Open, af+cs+as+gp+cp pruned model deterministic, C=0.001, pcedt, best = 0.4/0.6 [hyperv-ubuntu1] -======================================================================================== - -out_open_deterministic_pcedt_0.001_0.4_0.6_af+as+cs+gp+cp:I0319 14:08:32.289512 44932 SemanticPipe.h:347] Unlabeled F1: 0.877782 -out_open_deterministic_pcedt_0.001_0.4_0.6_af+as+cs+gp+cp:I0319 14:08:32.289554 44932 SemanticPipe.h:364] Labeled F1: 0.798375 -out_open_deterministic_pcedt_0.001_0.4_0.6_af+as+cs+gp+cp:I0319 14:10:01.257769 44953 SemanticPipe.h:347] Unlabeled F1: 0.869332 -out_open_deterministic_pcedt_0.001_0.4_0.6_af+as+cs+gp+cp:I0319 14:10:01.257810 44953 SemanticPipe.h:364] Labeled F1: 0.78222 -out_open_deterministic_pcedt_0.001_0.4_0.6_af+as+cs+gp+cp:I0319 14:22:46.314667 44974 SemanticPipe.h:347] Unlabeled F1: 0.970553 -out_open_deterministic_pcedt_0.001_0.4_0.6_af+as+cs+gp+cp:I0319 14:22:46.314714 44974 SemanticPipe.h:364] Labeled F1: 0.916433 - -======================================================================================== -Open, af+cs+as+gp+cp pruned model deterministic, C=0.1, pcedt, best = 0.5/0.5 [hyperv-ubuntu1] -======================================================================================== - -out_open_deterministic_pcedt_0.1_0.5_0.5_af+as+cs+gp+cp:I0320 07:17:21.636879 46431 SemanticPipe.h:347] Unlabeled F1: 0.880793 -out_open_deterministic_pcedt_0.1_0.5_0.5_af+as+cs+gp+cp:I0320 07:17:21.636920 46431 SemanticPipe.h:364] Labeled F1: 0.79749 -out_open_deterministic_pcedt_0.1_0.5_0.5_af+as+cs+gp+cp:I0320 07:18:32.865217 46456 SemanticPipe.h:347] Unlabeled F1: 0.871384 -out_open_deterministic_pcedt_0.1_0.5_0.5_af+as+cs+gp+cp:I0320 07:18:32.865273 46456 SemanticPipe.h:364] Labeled F1: 0.783093 -out_open_deterministic_pcedt_0.1_0.5_0.5_af+as+cs+gp+cp:I0320 07:29:30.013533 46477 SemanticPipe.h:347] Unlabeled F1: 0.990283 -out_open_deterministic_pcedt_0.1_0.5_0.5_af+as+cs+gp+cp:I0320 07:29:30.013572 46477 SemanticPipe.h:364] Labeled F1: 0.958674 - -======================================================================================== -Open, af+cs+as+gp+cp pruned model deterministic, C=0.01, pas, best = 0.3/0.7 [hyperv-ubuntu1] -======================================================================================== - -out_open_deterministic_pas_0.01_0.3_0.7_af+as+cs+gp+cp:I0319 10:46:22.760709 44705 SemanticPipe.h:347] Unlabeled F1: 0.916176 -out_open_deterministic_pas_0.01_0.3_0.7_af+as+cs+gp+cp:I0319 10:46:22.760752 44705 SemanticPipe.h:364] Labeled F1: 0.907239 -out_open_deterministic_pas_0.01_0.3_0.7_af+as+cs+gp+cp:I0319 10:47:41.124869 44727 SemanticPipe.h:347] Unlabeled F1: 0.911444 -out_open_deterministic_pas_0.01_0.3_0.7_af+as+cs+gp+cp:I0319 10:47:41.124908 44727 SemanticPipe.h:364] Labeled F1: 0.900877 -out_open_deterministic_pas_0.01_0.3_0.7_af+as+cs+gp+cp:I0319 11:00:40.918699 44748 SemanticPipe.h:347] Unlabeled F1: 0.994471 -out_open_deterministic_pas_0.01_0.3_0.7_af+as+cs+gp+cp:I0319 11:00:40.918740 44748 SemanticPipe.h:364] Labeled F1: 0.990867 - -======================================================================================== -Open, af+cs+as+gp+cp pruned model deterministic, C=0.001, pas, best = 0.4/0.6 [hyperv-ubuntu1] -======================================================================================== - -out_open_deterministic_pas_0.001_0.4_0.6_af+as+cs+gp+cp:I0319 22:08:50.814008 45818 SemanticPipe.h:347] Unlabeled F1: 0.915282 -out_open_deterministic_pas_0.001_0.4_0.6_af+as+cs+gp+cp:I0319 22:08:50.814046 45818 SemanticPipe.h:364] Labeled F1: 0.906534 -out_open_deterministic_pas_0.001_0.4_0.6_af+as+cs+gp+cp:I0319 22:10:08.617668 45840 SemanticPipe.h:347] Unlabeled F1: 0.910539 -out_open_deterministic_pas_0.001_0.4_0.6_af+as+cs+gp+cp:I0319 22:10:08.617707 45840 SemanticPipe.h:364] Labeled F1: 0.899826 -out_open_deterministic_pas_0.001_0.4_0.6_af+as+cs+gp+cp:I0319 22:23:04.473513 45861 SemanticPipe.h:347] Unlabeled F1: 0.981194 -out_open_deterministic_pas_0.001_0.4_0.6_af+as+cs+gp+cp:I0319 22:23:04.473567 45861 SemanticPipe.h:364] Labeled F1: 0.973885 - -======================================================================================== -Open, af+cs+as+gp+cp pruned model deterministic, C=0.1, pas, best = 0.3/0.7 [hyperv-ubuntu1] -======================================================================================== - -out_open_deterministic_pas_0.1_0.5_0.5_af+as+cs+gp+cp:I0321 00:09:12.261065 47442 SemanticPipe.h:347] Unlabeled F1: 0.916102 -out_open_deterministic_pas_0.1_0.5_0.5_af+as+cs+gp+cp:I0321 00:09:12.261103 47442 SemanticPipe.h:364] Labeled F1: 0.907509 -out_open_deterministic_pas_0.1_0.5_0.5_af+as+cs+gp+cp:I0321 00:10:25.932679 47463 SemanticPipe.h:347] Unlabeled F1: 0.911746 -out_open_deterministic_pas_0.1_0.5_0.5_af+as+cs+gp+cp:I0321 00:10:25.932716 47463 SemanticPipe.h:364] Labeled F1: 0.902076 -out_open_deterministic_pas_0.1_0.5_0.5_af+as+cs+gp+cp:I0321 00:22:29.750586 47484 SemanticPipe.h:347] Unlabeled F1: 0.994174 -out_open_deterministic_pas_0.1_0.5_0.5_af+as+cs+gp+cp:I0321 00:22:29.750625 47484 SemanticPipe.h:364] Labeled F1: 0.990719 - - -======================================================================================== -Open, af+cs+gp+cp pruned model deterministic, C=0.01, dm, best = 0.5/0.5 [pba28] -======================================================================================== - -out_open_deterministic_af+cs_dm_0.01_0.5_0.5_af+cs+gp+cp:I0318 18:03:26.924506 24735 SemanticPipe.h:347] Unlabeled F1: 0.893988 -out_open_deterministic_af+cs_dm_0.01_0.5_0.5_af+cs+gp+cp:I0318 18:03:26.924530 24735 SemanticPipe.h:364] Labeled F1: 0.884592 -out_open_deterministic_af+cs_dm_0.01_0.5_0.5_af+cs+gp+cp:I0318 18:04:08.201517 24760 SemanticPipe.h:347] Unlabeled F1: 0.888655 -out_open_deterministic_af+cs_dm_0.01_0.5_0.5_af+cs+gp+cp:I0318 18:04:08.201539 24760 SemanticPipe.h:364] Labeled F1: 0.878154 -out_open_deterministic_af+cs_dm_0.01_0.5_0.5_af+cs+gp+cp:I0318 18:11:40.921054 24789 SemanticPipe.h:347] Unlabeled F1: 0.988115 -out_open_deterministic_af+cs_dm_0.01_0.5_0.5_af+cs+gp+cp:I0318 18:11:40.921077 24789 SemanticPipe.h:364] Labeled F1: 0.985054 - -======================================================================================== -Open, af+cs+gp+cp pruned model deterministic, C=0.001, dm, best = 0.5/0.5 [pba28] -======================================================================================== - -out_open_deterministic_af+cs_dm_0.001_0.5_0.5_af+cs+gp+cp:I0319 01:10:11.367696 25555 SemanticPipe.h:347] Unlabeled F1: 0.89058 -out_open_deterministic_af+cs_dm_0.001_0.5_0.5_af+cs+gp+cp:I0319 01:10:11.367718 25555 SemanticPipe.h:364] Labeled F1: 0.878842 -out_open_deterministic_af+cs_dm_0.001_0.5_0.5_af+cs+gp+cp:I0319 01:11:06.033699 25580 SemanticPipe.h:347] Unlabeled F1: 0.885568 -out_open_deterministic_af+cs_dm_0.001_0.5_0.5_af+cs+gp+cp:I0319 01:11:06.033723 25580 SemanticPipe.h:364] Labeled F1: 0.872624 -out_open_deterministic_af+cs_dm_0.001_0.5_0.5_af+cs+gp+cp:I0319 01:18:58.738890 25606 SemanticPipe.h:347] Unlabeled F1: 0.959645 -out_open_deterministic_af+cs_dm_0.001_0.5_0.5_af+cs+gp+cp:I0319 01:18:58.738914 25606 SemanticPipe.h:364] Labeled F1: 0.950921 - -======================================================================================== -Open, af+cs+gp+cp pruned model deterministic, C=0.1, dm, best = 0.4/0.6 [pba28] -======================================================================================== - -out_open_deterministic_af+cs_dm_0.1_0.4_0.6_af+cs+gp+cp:I0319 03:35:09.688380 25802 SemanticPipe.h:347] Unlabeled F1: 0.894565 -out_open_deterministic_af+cs_dm_0.1_0.4_0.6_af+cs+gp+cp:I0319 03:35:09.688402 25802 SemanticPipe.h:364] Labeled F1: 0.884771 -out_open_deterministic_af+cs_dm_0.1_0.4_0.6_af+cs+gp+cp:I0319 03:35:57.728075 25828 SemanticPipe.h:347] Unlabeled F1: 0.889919 -out_open_deterministic_af+cs_dm_0.1_0.4_0.6_af+cs+gp+cp:I0319 03:35:57.728098 25828 SemanticPipe.h:364] Labeled F1: 0.878892 -out_open_deterministic_af+cs_dm_0.1_0.4_0.6_af+cs+gp+cp:I0319 03:43:52.446151 25853 SemanticPipe.h:347] Unlabeled F1: 0.988692 -out_open_deterministic_af+cs_dm_0.1_0.4_0.6_af+cs+gp+cp:I0319 03:43:52.446174 25853 SemanticPipe.h:364] Labeled F1: 0.985605 - -======================================================================================== -Open, af+cs+gp+cp pruned model deterministic, C=0.01, pas, best = 0.5/0.5 [pba28] -======================================================================================== - -out_open_deterministic_af+cs_pas_0.01_0.5_0.5_af+cs+gp+cp:I0319 08:42:44.277570 26688 SemanticPipe.h:347] Unlabeled F1: 0.915106 -out_open_deterministic_af+cs_pas_0.01_0.5_0.5_af+cs+gp+cp:I0319 08:42:44.277593 26688 SemanticPipe.h:364] Labeled F1: 0.90654 -out_open_deterministic_af+cs_pas_0.01_0.5_0.5_af+cs+gp+cp:I0319 08:43:31.247264 26713 SemanticPipe.h:347] Unlabeled F1: 0.910822 -out_open_deterministic_af+cs_pas_0.01_0.5_0.5_af+cs+gp+cp:I0319 08:43:31.247287 26713 SemanticPipe.h:364] Labeled F1: 0.901231 -out_open_deterministic_af+cs_pas_0.01_0.5_0.5_af+cs+gp+cp:I0319 08:51:00.411604 26738 SemanticPipe.h:347] Unlabeled F1: 0.993082 -out_open_deterministic_af+cs_pas_0.01_0.5_0.5_af+cs+gp+cp:I0319 08:51:00.411629 26738 SemanticPipe.h:364] Labeled F1: 0.989656 - -I0319 08:42:44.277613 26688 SemanticPipe.h:380] Speed: 1485.15 tokens per second. -I0319 08:43:31.247303 26713 SemanticPipe.h:380] Speed: 1453.5 tokens per second. -I0319 08:51:00.411644 26738 SemanticPipe.h:380] Speed: 1659.08 tokens per second. - -======================================================================================== -Open, af+cs+gp+cp pruned model deterministic, C=0.001, pas, best = 0.4/0.6 [pba28] -======================================================================================== - -out_open_deterministic_af+cs_pas_0.001_0.4_0.6_af+cs+gp+cp:I0319 11:41:09.262423 26996 SemanticPipe.h:347] Unlabeled F1: 0.91416 -out_open_deterministic_af+cs_pas_0.001_0.4_0.6_af+cs+gp+cp:I0319 11:41:09.262444 26996 SemanticPipe.h:364] Labeled F1: 0.905315 -out_open_deterministic_af+cs_pas_0.001_0.4_0.6_af+cs+gp+cp:I0319 11:41:56.094980 27022 SemanticPipe.h:347] Unlabeled F1: 0.909354 -out_open_deterministic_af+cs_pas_0.001_0.4_0.6_af+cs+gp+cp:I0319 11:41:56.095005 27022 SemanticPipe.h:364] Labeled F1: 0.898638 -out_open_deterministic_af+cs_pas_0.001_0.4_0.6_af+cs+gp+cp:I0319 11:49:21.602723 27047 SemanticPipe.h:347] Unlabeled F1: 0.978954 -out_open_deterministic_af+cs_pas_0.001_0.4_0.6_af+cs+gp+cp:I0319 11:49:21.602746 27047 SemanticPipe.h:364] Labeled F1: 0.971705 - -======================================================================================== -Open, af+cs+gp+cp pruned model deterministic, C=0.1, pas, best = 0.4/0.6 [pba28] -======================================================================================== - -out_open_deterministic_af+cs_pas_0.1_0.4_0.6_af+cs+gp+cp:I0319 20:28:55.482039 28073 SemanticPipe.h:347] Unlabeled F1: 0.914825 -out_open_deterministic_af+cs_pas_0.1_0.4_0.6_af+cs+gp+cp:I0319 20:28:55.482063 28073 SemanticPipe.h:364] Labeled F1: 0.90604 -out_open_deterministic_af+cs_pas_0.1_0.4_0.6_af+cs+gp+cp:I0319 20:29:42.059733 28098 SemanticPipe.h:347] Unlabeled F1: 0.911132 -out_open_deterministic_af+cs_pas_0.1_0.4_0.6_af+cs+gp+cp:I0319 20:29:42.059756 28098 SemanticPipe.h:364] Labeled F1: 0.901039 -out_open_deterministic_af+cs_pas_0.1_0.4_0.6_af+cs+gp+cp:I0319 20:37:10.277665 28123 SemanticPipe.h:347] Unlabeled F1: 0.993449 -out_open_deterministic_af+cs_pas_0.1_0.4_0.6_af+cs+gp+cp:I0319 20:37:10.277688 28123 SemanticPipe.h:364] Labeled F1: 0.989925 - - -======================================================================================== -Open, af+cs pruned model deterministic, C=0.01, dm, best = 0.5/0.5 [pba28] -======================================================================================== - -out_open_deterministic_af+cs_dm_0.01_0.5_0.5:I0317 19:25:24.837010 18542 SemanticPipe.h:347] Unlabeled F1: 0.885311 -out_open_deterministic_af+cs_dm_0.01_0.5_0.5:I0317 19:25:24.837031 18542 SemanticPipe.h:364] Labeled F1: 0.876341 -out_open_deterministic_af+cs_dm_0.01_0.5_0.5I0319 08:42:44.277613 26688 SemanticPipe.h:380] Speed: 1485.15 tokens per second. │ 54 root 20 0 0 0 0 S 0 0.0 0:00.00 fsnotify_mark -I0319 08:43:31.247303 26713 SemanticPipe.h:380] Speed: 1453.5 tokens per second. │ 55 root 20 0 0 0 0 S 0 0.0 0:00.00 ecryptfs-kthrea -I0319 08:51:00.411644 26738 SemanticPipe.h:380] Speed: 1659.08 tokens per second. :I0317 19:25:57.173583 18567 SemanticPipe.h:347] Unlabeled F1: 0.882585 -out_open_deterministic_af+cs_dm_0.01_0.5_0.5:I0317 19:25:57.173607 18567 SemanticPipe.h:364] Labeled F1: 0.872962 -out_open_deterministic_af+cs_dm_0.01_0.5_0.5:I0317 19:31:43.599647 18592 SemanticPipe.h:347] Unlabeled F1: 0.973588 -out_open_deterministic_af+cs_dm_0.01_0.5_0.5:I0317 19:31:43.599669 18592 SemanticPipe.h:364] Labeled F1: 0.971168 - -out_open_deterministic_af+cs_dm_0.01_0.5_0.5:I0317 19:25:24.837045 18542 SemanticPipe.h:380] Speed: 2176.33 tokens per second. -out_open_deterministic_af+cs_dm_0.01_0.5_0.5:I0317 19:25:57.173622 18567 SemanticPipe.h:380] Speed: 2148.11 tokens per second. -out_open_deterministic_af+cs_dm_0.01_0.5_0.5:I0317 19:31:43.599684 18592 SemanticPipe.h:380] Speed: 2141.86 tokens per second. - -======================================================================================== -Open, af+cs pruned model deterministic, C=0.001, dm, best = 0.4/0.6 [pba28] -======================================================================================== - -out_open_deterministic_af+cs_dm_0.001_0.4_0.6:I0317 20:46:56.582526 18748 SemanticPipe.h:347] Unlabeled F1: 0.881656 -out_open_deterministic_af+cs_dm_0.001_0.4_0.6:I0317 20:46:56.582551 18748 SemanticPipe.h:364] Labeled F1: 0.869992 -out_open_deterministic_af+cs_dm_0.001_0.4_0.6:I0317 20:47:32.365900 18774 SemanticPipe.h:347] Unlabeled F1: 0.878914 -out_open_deterministic_af+cs_dm_0.001_0.4_0.6:I0317 20:47:32.365921 18774 SemanticPipe.h:364] Labeled F1: 0.865817 -out_open_deterministic_af+cs_dm_0.001_0.4_0.6:I0317 20:53:14.357439 18799 SemanticPipe.h:347] Unlabeled F1: 0.937584 -out_open_deterministic_af+cs_dm_0.001_0.4_0.6:I0317 20:53:14.357463 18799 SemanticPipe.h:364] Labeled F1: 0.929128 - -out_open_deterministic_af+cs_dm_0.001_0.4_0.6:I0317 20:46:56.582566 18748 SemanticPipe.h:380] Speed: 2230.63 tokens per second. -out_open_deterministic_af+cs_dm_0.001_0.4_0.6:I0317 20:47:32.365934 18774 SemanticPipe.h:380] Speed: 2208.29 tokens per second. -out_open_deterministic_af+cs_dm_0.001_0.4_0.6:I0317 20:53:14.357478 18799 SemanticPipe.h:380] Speed: 2190.2 tokens per second. - -======================================================================================== -Open, af+cs pruned model deterministic, C=0.1, dm, best = 0.5/0.5 [pba28] -======================================================================================== - -out_open_deterministic_af+cs_dm_0.1_0.5_0.5:I0318 03:16:49.162945 20094 SemanticPipe.h:347] Unlabeled F1: 0.88498 -out_open_deterministic_af+cs_dm_0.1_0.5_0.5:I0318 03:16:49.162977 20094 SemanticPipe.h:364] Labeled F1: 0.875974 -out_open_deterministic_af+cs_dm_0.1_0.5_0.5:I0318 03:17:21.774379 20120 SemanticPipe.h:347] Unlabeled F1: 0.882122 -out_open_deterministic_af+cs_dm_0.1_0.5_0.5:I0318 03:17:21.774404 20120 SemanticPipe.h:364] Labeled F1: 0.87257 -out_open_deterministic_af+cs_dm_0.1_0.5_0.5:I0318 03:23:08.535323 20148 SemanticPipe.h:347] Unlabeled F1: 0.973561 -out_open_deterministic_af+cs_dm_0.1_0.5_0.5:I0318 03:23:08.535347 20148 SemanticPipe.h:364] Labeled F1: 0.971195 - -out_open_deterministic_af+cs_dm_0.1_0.5_0.5:I0318 03:16:49.162992 20094 SemanticPipe.h:380] Speed: 2183.52 tokens per second. -out_open_deterministic_af+cs_dm_0.1_0.5_0.5:I0318 03:17:21.774418 20120 SemanticPipe.h:380] Speed: 2158.44 tokens per second. -out_open_deterministic_af+cs_dm_0.1_0.5_0.5:I0318 03:23:08.535362 20148 SemanticPipe.h:380] Speed: 2139.08 tokens per second. - -======================================================================================== -Open, af+cs pruned model deterministic, C=0.01, pas, best = 0.4/0.6 [pba28] -======================================================================================== - -out_open_deterministic_af+cs_pas_0.01_0.4_0.6:I0317 17:20:23.645136 18236 SemanticPipe.h:347] Unlabeled F1: 0.905862 -out_open_deterministic_af+cs_pas_0.01_0.4_0.6:I0317 17:20:23.645159 18236 SemanticPipe.h:364] Labeled F1: 0.897377 -out_open_deterministic_af+cs_pas_0.01_0.4_0.6:I0317 17:20:52.955574 18262 SemanticPipe.h:347] Unlabeled F1: 0.90166 -out_open_deterministic_af+cs_pas_0.01_0.4_0.6:I0317 17:20:52.955598 18262 SemanticPipe.h:364] Labeled F1: 0.891756 -out_open_deterministic_af+cs_pas_0.01_0.4_0.6:I0317 17:26:11.782297 18287 SemanticPipe.h:347] Unlabeled F1: 0.983903 -out_open_deterministic_af+cs_pas_0.01_0.4_0.6:I0317 17:26:11.782322 18287 SemanticPipe.h:364] Labeled F1: 0.98115 - -out_open_deterministic_af+cs_pas_0.01_0.4_0.6:I0317 17:20:23.645174 18236 SemanticPipe.h:380] Speed: 2324.94 tokens per second. -out_open_deterministic_af+cs_pas_0.01_0.4_0.6:I0317 17:20:52.955622 18262 SemanticPipe.h:380] Speed: 2264.12 tokens per second. -out_open_deterministic_af+cs_pas_0.01_0.4_0.6:I0317 17:26:11.782337 18287 SemanticPipe.h:380] Speed: 2319.66 tokens per second. - -======================================================================================== -Open, af+cs pruned model deterministic, C=0.001, pas, best = 0.4/0.6 [pba28] -======================================================================================== - -out_open_deterministic_af+cs_pas_0.001_0.4_0.6:I0317 21:14:38.344197 18844 SemanticPipe.h:347] Unlabeled F1: 0.905365 -out_open_deterministic_af+cs_pas_0.001_0.4_0.6:I0317 21:14:38.344219 18844 SemanticPipe.h:364] Labeled F1: 0.896679 -out_open_deterministic_af+cs_pas_0.001_0.4_0.6:I0317 21:15:11.909028 18869 SemanticPipe.h:347] Unlabeled F1: 0.900856 -out_open_deterministic_af+cs_pas_0.001_0.4_0.6:I0317 21:15:11.909049 18869 SemanticPipe.h:364] Labeled F1: 0.890536 -out_open_deterministic_af+cs_pas_0.001_0.4_0.6:I0317 21:20:27.830160 18894 SemanticPipe.h:347] Unlabeled F1: 0.956877 -out_open_deterministic_af+cs_pas_0.001_0.4_0.6:I0317 21:20:27.830183 18894 SemanticPipe.h:364] Labeled F1: 0.950109 - -out_open_deterministic_af+cs_pas_0.001_0.4_0.6:I0317 21:14:38.344233 18844 SemanticPipe.h:380] Speed: 2404.38 tokens per second. -out_open_deterministic_af+cs_pas_0.001_0.4_0.6:I0317 21:15:11.909064 18869 SemanticPipe.h:380] Speed: 2342.5 tokens per second. -out_open_deterministic_af+cs_pas_0.001_0.4_0.6:I0317 21:20:27.830199 18894 SemanticPipe.h:380] Speed: 2365.2 tokens per second. - -======================================================================================== -Open, af+cs pruned model deterministic, C=0.1, pas, best = 0.5/0.5 [pba28] -======================================================================================== - -out_open_deterministic_af+cs_pas_0.1_0.5_0.5:I0318 03:43:33.824606 20182 SemanticPipe.h:347] Unlabeled F1: 0.905316 -out_open_deterministic_af+cs_pas_0.1_0.5_0.5:I0318 03:43:33.824627 20182 SemanticPipe.h:364] Labeled F1: 0.897073 -out_open_deterministic_af+cs_pas_0.1_0.5_0.5:I0318 03:44:01.721531 20207 SemanticPipe.h:347] Unlabeled F1: 0.902051 -out_open_deterministic_af+cs_pas_0.1_0.5_0.5:I0318 03:44:01.721554 20207 SemanticPipe.h:364] Labeled F1: 0.892442 -out_open_deterministic_af+cs_pas_0.1_0.5_0.5:I0318 03:48:55.321287 20232 SemanticPipe.h:347] Unlabeled F1: 0.983502 -out_open_deterministic_af+cs_pas_0.1_0.5_0.5:I0318 03:48:55.321310 20232 SemanticPipe.h:364] Labeled F1: 0.980814 - -out_open_deterministic_af+cs_pas_0.1_0.5_0.5:I0318 03:43:33.824641 20182 SemanticPipe.h:380] Speed: 2537.8 tokens per second. -out_open_deterministic_af+cs_pas_0.1_0.5_0.5:I0318 03:44:01.721570 20207 SemanticPipe.h:380] Speed: 2451.06 tokens per second. -out_open_deterministic_af+cs_pas_0.1_0.5_0.5:I0318 03:48:55.321322 20232 SemanticPipe.h:380] Speed: 2525.42 tokens per second. - - -======================================================================================== -Open, Second-order pruned model deterministic, C=0.01, dm, best = 0.4/0.6 -======================================================================================== - -out_open_deterministic_af+as+gp+cp_dm_0.01_0.4_0.6:I0314 23:10:27.788532 35362 SemanticPipe.h:341] Unlabeled F1: 0.893407 -out_open_deterministic_af+as+gp+cp_dm_0.01_0.4_0.6:I0314 23:10:27.788625 35362 SemanticPipe.h:358] Labeled F1: 0.883974 -out_open_deterministic_af+as+gp+cp_dm_0.01_0.4_0.6:I0314 23:11:28.810359 35383 SemanticPipe.h:341] Unlabeled F1: 0.889564 -out_open_deterministic_af+as+gp+cp_dm_0.01_0.4_0.6:I0314 23:11:28.811846 35383 SemanticPipe.h:358] Labeled F1: 0.878816 -out_open_deterministic_af+as+gp+cp_dm_0.01_0.4_0.6:I0314 23:22:19.040706 35404 SemanticPipe.h:341] Unlabeled F1: 0.989907 -out_open_deterministic_af+as+gp+cp_dm_0.01_0.4_0.6:I0314 23:22:19.040804 35404 SemanticPipe.h:358] Labeled F1: 0.987211 - -======================================================================================== -Open, Second-order pruned model deterministic, C=0.001, dm, best = 0.5/0.5 -======================================================================================== - -out_open_deterministic_af+as+gp+cp_dm_0.001_0.4_0.6:I0315 12:40:04.136467 36754 SemanticPipe.h:341] Unlabeled F1: 0.887621 -out_open_deterministic_af+as+gp+cp_dm_0.001_0.4_0.6:I0315 12:40:04.136505 36754 SemanticPipe.h:358] Labeled F1: 0.875568 -out_open_deterministic_af+as+gp+cp_dm_0.001_0.4_0.6:I0315 12:41:01.980093 36775 SemanticPipe.h:341] Unlabeled F1: 0.884346 -out_open_deterministic_af+as+gp+cp_dm_0.001_0.4_0.6:I0315 12:41:01.980134 36775 SemanticPipe.h:358] Labeled F1: 0.870879 -out_open_deterministic_af+as+gp+cp_dm_0.001_0.4_0.6:I0315 12:51:57.332839 36796 SemanticPipe.h:341] Unlabeled F1: 0.957093 -out_open_deterministic_af+as+gp+cp_dm_0.001_0.4_0.6:I0315 12:51:57.332898 36796 SemanticPipe.h:358] Labeled F1: 0.948086 - -======================================================================================== -Open, Second-order pruned model deterministic, C=0.1, dm, best = 0.4/0.6 -======================================================================================== - -out_open_deterministic_af+as+gp+cp_dm_0.1_0.4_0.6:I0316 02:29:33.933732 38184 SemanticPipe.h:341] Unlabeled F1: 0.893408 -out_open_deterministic_af+as+gp+cp_dm_0.1_0.4_0.6:I0316 02:29:33.933770 38184 SemanticPipe.h:358] Labeled F1: 0.883853 -out_open_deterministic_af+as+gp+cp_dm_0.1_0.4_0.6:I0316 02:30:30.167145 38205 SemanticPipe.h:341] Unlabeled F1: 0.889785 -out_open_deterministic_af+as+gp+cp_dm_0.1_0.4_0.6:I0316 02:30:30.167187 38205 SemanticPipe.h:358] Labeled F1: 0.879365 -out_open_deterministic_af+as+gp+cp_dm_0.1_0.4_0.6:I0316 02:41:15.954359 38227 SemanticPipe.h:341] Unlabeled F1: 0.989926 -out_open_deterministic_af+as+gp+cp_dm_0.1_0.4_0.6:I0316 02:41:15.954397 38227 SemanticPipe.h:358] Labeled F1: 0.987225 - -======================================================================================== -Open, Second-order pruned model deterministic, C=0.01, pas, best = 0.4/0.6 -======================================================================================== - -out_open_deterministic_af+as+gp+cp_pas_0.01_0.4_0.6:I0315 22:51:15.227897 37710 SemanticPipe.h:341] Unlabeled F1: 0.915619 -out_open_deterministic_af+as+gp+cp_pas_0.01_0.4_0.6:I0315 22:51:15.227952 37710 SemanticPipe.h:358] Labeled F1: 0.907196 -out_open_deterministic_af+as+gp+cp_pas_0.01_0.4_0.6:I0315 22:52:18.318960 37731 SemanticPipe.h:341] Unlabeled F1: 0.910983 -out_open_deterministic_af+as+gp+cp_pas_0.01_0.4_0.6:I0315 22:52:18.319001 37731 SemanticPipe.h:358] Labeled F1: 0.901072 -out_open_deterministic_af+as+gp+cp_pas_0.01_0.4_0.6:I0315 23:03:31.575309 37753 SemanticPipe.h:341] Unlabeled F1: 0.994929 -out_open_deterministic_af+as+gp+cp_pas_0.01_0.4_0.6:I0315 23:03:31.575345 37753 SemanticPipe.h:358] Labeled F1: 0.991718 - -======================================================================================== -Open, Second-order pruned model deterministic, C=0.001, pas, best = 0.4/0.6 -======================================================================================== - -out_open_deterministic_af+as+gp+cp_pas_0.001_0.4_0.6:I0316 18:24:07.524392 39224 SemanticPipe.h:341] Unlabeled F1: 0.913625 -out_open_deterministic_af+as+gp+cp_pas_0.001_0.4_0.6:I0316 18:24:07.524448 39224 SemanticPipe.h:358] Labeled F1: 0.905111 -out_open_deterministic_af+as+gp+cp_pas_0.001_0.4_0.6:I0316 18:25:07.745481 39245 SemanticPipe.h:341] Unlabeled F1: 0.908696 -out_open_deterministic_af+as+gp+cp_pas_0.001_0.4_0.6:I0316 18:25:07.745529 39245 SemanticPipe.h:358] Labeled F1: 0.898133 -out_open_deterministic_af+as+gp+cp_pas_0.001_0.4_0.6:I0316 18:35:55.592844 39267 SemanticPipe.h:341] Unlabeled F1: 0.978088 -out_open_deterministic_af+as+gp+cp_pas_0.001_0.4_0.6:I0316 18:35:55.592882 39267 SemanticPipe.h:358] Labeled F1: 0.970881 - -======================================================================================== -Open, Second-order pruned model deterministic, C=0.1, pas, best = 0.4/0.6 [hyperv-ubuntu1] -======================================================================================== - -out_open_deterministic_af+as+gp+cp_pas_0.1_0.5_0.5:I0317 18:36:57.710022 41048 SemanticPipe.h:341] Unlabeled F1: 0.915287 -out_open_deterministic_af+as+gp+cp_pas_0.1_0.5_0.5:I0317 18:36:57.710063 41048 SemanticPipe.h:358] Labeled F1: 0.907109 -out_open_deterministic_af+as+gp+cp_pas_0.1_0.5_0.5:I0317 18:38:07.014298 41069 SemanticPipe.h:341] Unlabeled F1: 0.911445 -out_open_deterministic_af+as+gp+cp_pas_0.1_0.5_0.5:I0317 18:38:07.014350 41069 SemanticPipe.h:358] Labeled F1: 0.902091 -out_open_deterministic_af+as+gp+cp_pas_0.1_0.5_0.5:I0317 18:51:15.740500 41090 SemanticPipe.h:341] Unlabeled F1: 0.994577 -out_open_deterministic_af+as+gp+cp_pas_0.1_0.5_0.5:I0317 18:51:15.740546 41090 SemanticPipe.h:358] Labeled F1: 0.991467 - -out_open_deterministic_af+as+gp+cp_pas_0.1_0.5_0.5:I0317 18:36:57.710088 41048 SemanticPipe.h:374] Speed: 921.233 tokens per second. -out_open_deterministic_af+as+gp+cp_pas_0.1_0.5_0.5:I0317 18:38:07.014381 41069 SemanticPipe.h:374] Speed: 874.534 tokens per second. -out_open_deterministic_af+as+gp+cp_pas_0.1_0.5_0.5:I0317 18:51:15.740576 41090 SemanticPipe.h:374] Speed: 930.848 tokens per second. - -======================================================================================== -Open, Second-order pruned model deterministic, C=0.01, pcedt, best = 0.4/0.6 -======================================================================================== - -out_open_deterministic_af+as+gp+cp_pcedt_0.01_0.4_0.6:I0315 12:50:54.284286 36800 SemanticPipe.h:341] Unlabeled F1: 0.881393 -out_open_deterministic_af+as+gp+cp_pcedt_0.01_0.4_0.6:I0315 12:50:54.284332 36800 SemanticPipe.h:358] Labeled F1: 0.795924 -out_open_deterministic_af+as+gp+cp_pcedt_0.01_0.4_0.6:I0315 12:51:47.595700 36821 SemanticPipe.h:341] Unlabeled F1: 0.874251 -out_open_deterministic_af+as+gp+cp_pcedt_0.01_0.4_0.6:I0315 12:51:47.595736 36821 SemanticPipe.h:358] Labeled F1: 0.783415 -out_open_deterministic_af+as+gp+cp_pcedt_0.01_0.4_0.6:I0315 13:00:23.981546 36842 SemanticPipe.h:341] Unlabeled F1: 0.991254 -out_open_deterministic_af+as+gp+cp_pcedt_0.01_0.4_0.6:I0315 13:00:23.981590 36842 SemanticPipe.h:358] Labeled F1: 0.960041 - -======================================================================================== -Open, Second-order pruned model deterministic, C=0.001, pcedt, best = 0.3/0.7 -======================================================================================== - -(missing: 0.4/0.6) -out_open_deterministic_af+as+gp+cp_pcedt_0.001_0.3_0.7:I0314 18:56:51.254179 35080 SemanticPipe.h:341] Unlabeled F1: 0.8796 -out_open_deterministic_af+as+gp+cp_pcedt_0.001_0.3_0.7:I0314 18:56:51.254215 35080 SemanticPipe.h:358] Labeled F1: 0.795391 -out_open_deterministic_af+as+gp+cp_pcedt_0.001_0.3_0.7:I0314 18:57:43.989182 35101 SemanticPipe.h:341] Unlabeled F1: 0.87273 -out_open_deterministic_af+as+gp+cp_pcedt_0.001_0.3_0.7:I0314 18:57:43.989218 35101 SemanticPipe.h:358] Labeled F1: 0.77989 -out_open_deterministic_af+as+gp+cp_pcedt_0.001_0.3_0.7:I0314 19:06:01.776741 35123 SemanticPipe.h:341] Unlabeled F1: 0.97092 -out_open_deterministic_af+as+gp+cp_pcedt_0.001_0.3_0.7:I0314 19:06:01.776783 35123 SemanticPipe.h:358] Labeled F1: 0.91554 - -======================================================================================== -Open, Second-order pruned model deterministic, C=0.1, pcedt, best = 0.4/0.6 -======================================================================================== - -out_open_deterministic_af+as+gp+cp_pcedt_0.1_0.4_0.6:I0315 00:17:09.432034 35454 SemanticPipe.h:341] Unlabeled F1: 0.882476 -out_open_deterministic_af+as+gp+cp_pcedt_0.1_0.4_0.6:I0315 00:17:09.432085 35454 SemanticPipe.h:358] Labeled F1: 0.796209 -out_open_deterministic_af+as+gp+cp_pcedt_0.1_0.4_0.6:I0315 00:18:02.801911 35479 SemanticPipe.h:341] Unlabeled F1: 0.8745 -out_open_deterministic_af+as+gp+cp_pcedt_0.1_0.4_0.6:I0315 00:18:02.801949 35479 SemanticPipe.h:358] Labeled F1: 0.78305 -out_open_deterministic_af+as+gp+cp_pcedt_0.1_0.4_0.6:I0315 00:26:33.003571 35500 SemanticPipe.h:341] Unlabeled F1: 0.99127 -out_open_deterministic_af+as+gp+cp_pcedt_0.1_0.4_0.6:I0315 00:26:33.003608 35500 SemanticPipe.h:358] Labeled F1: 0.959923 - - - -======================================================================================== -Open, Second-order pruned model, C=0.01, dm, best = 0.5/0.5 -======================================================================================== - -out_open_af+as+gp+cp_dm_0.01_0.5_0.5:I0307 09:40:46.637729 20654 SemanticPipe.h:338] Unlabeled F1: 0.892066 -out_open_af+as+gp+cp_dm_0.01_0.5_0.5:I0307 09:40:46.637784 20654 SemanticPipe.h:355] Labeled F1: 0.88317 -out_open_af+as+gp+cp_dm_0.01_0.5_0.5:I0307 09:41:59.870955 20675 SemanticPipe.h:338] Unlabeled F1: 0.887738 -out_open_af+as+gp+cp_dm_0.01_0.5_0.5:I0307 09:41:59.870995 20675 SemanticPipe.h:355] Labeled F1: 0.877898 -out_open_af+as+gp+cp_dm_0.01_0.5_0.5:I0307 09:51:26.683609 20697 SemanticPipe.h:338] Unlabeled F1: 0.988575 -out_open_af+as+gp+cp_dm_0.01_0.5_0.5:I0307 09:51:26.683678 20697 SemanticPipe.h:355] Labeled F1: 0.985912 - -out_open_af+as+gp+cp_dm_0.01_0.4_0.6:I0307 04:43:32.202755 20094 SemanticPipe.h:338] Unlabeled F1: 0.892399 -out_open_af+as+gp+cp_dm_0.01_0.4_0.6:I0307 04:43:32.202790 20094 SemanticPipe.h:355] Labeled F1: 0.883034 -out_open_af+as+gp+cp_dm_0.01_0.4_0.6:I0307 04:44:46.377499 20115 SemanticPipe.h:338] Unlabeled F1: 0.889 -out_open_af+as+gp+cp_dm_0.01_0.4_0.6:I0307 04:44:46.377537 20115 SemanticPipe.h:355] Labeled F1: 0.878526 -out_open_af+as+gp+cp_dm_0.01_0.4_0.6:I0307 04:54:14.583519 20136 SemanticPipe.h:338] Unlabeled F1: 0.98942 -out_open_af+as+gp+cp_dm_0.01_0.4_0.6:I0307 04:54:14.583567 20136 SemanticPipe.h:355] Labeled F1: 0.986641 - -======================================================================================== -Open, Second-order pruned model, C=0.001, dm, best = 0.4/0.6 -======================================================================================== - -out_open_af+as+gp+cp_dm_0.001_0.4_0.6:I0308 00:52:14.729207 21466 SemanticPipe.h:338] Unlabeled F1: 0.887049 -out_open_af+as+gp+cp_dm_0.001_0.4_0.6:I0308 00:52:14.729244 21466 SemanticPipe.h:355] Labeled F1: 0.87507 -out_open_af+as+gp+cp_dm_0.001_0.4_0.6:I0308 00:53:29.011469 21508 SemanticPipe.h:338] Unlabeled F1: 0.883722 -out_open_af+as+gp+cp_dm_0.001_0.4_0.6:I0308 00:53:29.011507 21508 SemanticPipe.h:355] Labeled F1: 0.870393 -out_open_af+as+gp+cp_dm_0.001_0.4_0.6:I0308 01:03:08.955221 21529 SemanticPipe.h:338] Unlabeled F1: 0.95654 -out_open_af+as+gp+cp_dm_0.001_0.4_0.6:I0308 01:03:08.955258 21529 SemanticPipe.h:355] Labeled F1: 0.9475 - -======================================================================================== -Open, Second-order pruned model, C=0.1, dm, best = 0.4/0.6 -======================================================================================== - -out_open_af+as+gp+cp_dm_0.1_0.4_0.6:I0308 21:25:00.268812 22734 SemanticPipe.h:338] Unlabeled F1: 0.893059 -out_open_af+as+gp+cp_dm_0.1_0.4_0.6:I0308 21:25:00.268848 22734 SemanticPipe.h:355] Labeled F1: 0.883456 -out_open_af+as+gp+cp_dm_0.1_0.4_0.6:I0308 21:26:14.144513 22755 SemanticPipe.h:338] Unlabeled F1: 0.88936 -out_open_af+as+gp+cp_dm_0.1_0.4_0.6:I0308 21:26:14.144552 22755 SemanticPipe.h:355] Labeled F1: 0.878891 -out_open_af+as+gp+cp_dm_0.1_0.4_0.6:I0308 21:35:41.430071 22776 SemanticPipe.h:338] Unlabeled F1: 0.989429 -out_open_af+as+gp+cp_dm_0.1_0.4_0.6:I0308 21:35:41.430124 22776 SemanticPipe.h:355] Labeled F1: 0.986644 - - -======================================================================================== -Open, Second-order pruned model, C=0.01, pas, best = 0.5/0.5 -======================================================================================== - -out_open_af+as+gp+cp_pas_0.01_0.5_0.5:I0308 00:50:06.858942 21442 SemanticPipe.h:338] Unlabeled F1: 0.913233 -out_open_af+as+gp+cp_pas_0.01_0.5_0.5:I0308 00:50:06.858978 21442 SemanticPipe.h:355] Labeled F1: 0.905191 -out_open_af+as+gp+cp_pas_0.01_0.5_0.5:I0308 00:51:12.725618 21464 SemanticPipe.h:338] Unlabeled F1: 0.908851 -out_open_af+as+gp+cp_pas_0.01_0.5_0.5:I0308 00:51:12.725661 21464 SemanticPipe.h:355] Labeled F1: 0.899543 -out_open_af+as+gp+cp_pas_0.01_0.5_0.5:I0308 01:00:06.244628 21487 SemanticPipe.h:338] Unlabeled F1: 0.992515 -out_open_af+as+gp+cp_pas_0.01_0.5_0.5:I0308 01:00:06.244667 21487 SemanticPipe.h:355] Labeled F1: 0.98933 - -======================================================================================== -Open, Second-order pruned model, C=0.001, pas, best = 0.4/0.6 -======================================================================================== - -out_open_af+as+gp+cp_pas_0.001_0.4_0.6:I0308 13:28:24.914151 22367 SemanticPipe.h:338] Unlabeled F1: 0.912316 -out_open_af+as+gp+cp_pas_0.001_0.4_0.6:I0308 13:28:24.914190 22367 SemanticPipe.h:355] Labeled F1: 0.903642 -out_open_af+as+gp+cp_pas_0.001_0.4_0.6:I0308 13:29:29.264638 22388 SemanticPipe.h:338] Unlabeled F1: 0.908274 -out_open_af+as+gp+cp_pas_0.001_0.4_0.6:I0308 13:29:29.264678 22388 SemanticPipe.h:355] Labeled F1: 0.897639 -out_open_af+as+gp+cp_pas_0.001_0.4_0.6:I0308 13:38:29.507936 22410 SemanticPipe.h:338] Unlabeled F1: 0.974911 -out_open_af+as+gp+cp_pas_0.001_0.4_0.6:I0308 13:38:29.507974 22410 SemanticPipe.h:355] Labeled F1: 0.967772 - -======================================================================================== -Open, Second-order pruned model, C=0.1, pas, best = 0.4/0.6 -======================================================================================== - -out_open_af+as+gp+cp_pas_0.1_0.4_0.6:I0309 06:39:37.324110 23198 SemanticPipe.h:338] Unlabeled F1: 0.913338 -out_open_af+as+gp+cp_pas_0.1_0.4_0.6:I0309 06:39:37.324147 23198 SemanticPipe.h:355] Labeled F1: 0.90494 -out_open_af+as+gp+cp_pas_0.1_0.4_0.6:I0309 06:40:42.743542 23219 SemanticPipe.h:338] Unlabeled F1: 0.909615 -out_open_af+as+gp+cp_pas_0.1_0.4_0.6:I0309 06:40:42.743578 23219 SemanticPipe.h:355] Labeled F1: 0.899742 -out_open_af+as+gp+cp_pas_0.1_0.4_0.6:I0309 06:49:30.674816 23240 SemanticPipe.h:338] Unlabeled F1: 0.993163 -out_open_af+as+gp+cp_pas_0.1_0.4_0.6:I0309 06:49:30.674852 23240 SemanticPipe.h:355] Labeled F1: 0.989831 - - -======================================================================================== -Open, Second-order pruned model, C=0.01, pcedt, best = 0.3/0.7 -======================================================================================== - -out_open_af+as+gp+cp_pcedt_0.01_0.3_0.7:I0306 09:06:08.122335 18227 SemanticPipe.h:338] Unlabeled F1: 0.885009 -out_open_af+as+gp+cp_pcedt_0.01_0.3_0.7:I0306 09:06:08.122372 18227 SemanticPipe.h:355] Labeled F1: 0.79602 -out_open_af+as+gp+cp_pcedt_0.01_0.3_0.7:I0306 09:07:15.536550 18249 SemanticPipe.h:338] Unlabeled F1: 0.879141 -out_open_af+as+gp+cp_pcedt_0.01_0.3_0.7:I0306 09:07:15.536587 18249 SemanticPipe.h:355] Labeled F1: 0.782633 -out_open_af+as+gp+cp_pcedt_0.01_0.3_0.7:I0306 09:14:42.872730 18270 SemanticPipe.h:338] Unlabeled F1: 0.99232 -out_open_af+as+gp+cp_pcedt_0.01_0.3_0.7:I0306 09:14:42.872766 18270 SemanticPipe.h:355] Labeled F1: 0.960268 - -out_open_af+as+gp+cp_pcedt_0.01_0.4_0.6:I0306 03:02:44.022511 17723 SemanticPipe.h:338] Unlabeled F1: 0.881796 -out_open_af+as+gp+cp_pcedt_0.01_0.4_0.6:I0306 03:02:44.022620 17723 SemanticPipe.h:355] Labeled F1: 0.795535 -out_open_af+as+gp+cp_pcedt_0.01_0.4_0.6:I0306 03:03:50.146689 17744 SemanticPipe.h:338] Unlabeled F1: 0.874638 -out_open_af+as+gp+cp_pcedt_0.01_0.4_0.6:I0306 03:03:50.146728 17744 SemanticPipe.h:355] Labeled F1: 0.783976 -out_open_af+as+gp+cp_pcedt_0.01_0.4_0.6:I0306 03:11:20.886479 17765 SemanticPipe.h:338] Unlabeled F1: 0.991113 -out_open_af+as+gp+cp_pcedt_0.01_0.4_0.6:I0306 03:11:20.887069 17765 SemanticPipe.h:355] Labeled F1: 0.959685 - -======================================================================================== -Open, Second-order pruned model, C=0.001, pcedt, best = 0.4/0.6 -======================================================================================== - -out_open_af+as+gp+cp_pcedt_0.001_0.4_0.6:I0306 15:27:08.347769 19014 SemanticPipe.h:338] Unlabeled F1: 0.871834 -out_open_af+as+gp+cp_pcedt_0.001_0.4_0.6:I0306 15:27:08.347805 19014 SemanticPipe.h:355] Labeled F1: 0.795858 -out_open_af+as+gp+cp_pcedt_0.001_0.4_0.6:I0306 15:28:14.794742 19035 SemanticPipe.h:338] Unlabeled F1: 0.864065 -out_open_af+as+gp+cp_pcedt_0.001_0.4_0.6:I0306 15:28:14.794795 19035 SemanticPipe.h:355] Labeled F1: 0.779847 -out_open_af+as+gp+cp_pcedt_0.001_0.4_0.6:I0306 15:35:47.254722 19056 SemanticPipe.h:338] Unlabeled F1: 0.963501 -out_open_af+as+gp+cp_pcedt_0.001_0.4_0.6:I0306 15:35:47.254768 19056 SemanticPipe.h:355] Labeled F1: 0.910883 - -======================================================================================== -Open, Second-order pruned model, C=0.1, pcedt, best = 0.4/0.6 -======================================================================================== - -out_open_af+as+gp+cp_pcedt_0.1_0.4_0.6:I0307 05:27:02.287152 20181 SemanticPipe.h:338] Unlabeled F1: 0.882519 -out_open_af+as+gp+cp_pcedt_0.1_0.4_0.6:I0307 05:27:02.287201 20181 SemanticPipe.h:355] Labeled F1: 0.796267 -out_open_af+as+gp+cp_pcedt_0.1_0.4_0.6:I0307 05:28:10.685369 20203 SemanticPipe.h:338] Unlabeled F1: 0.874106 -out_open_af+as+gp+cp_pcedt_0.1_0.4_0.6:I0307 05:28:10.685406 20203 SemanticPipe.h:355] Labeled F1: 0.782759 -out_open_af+as+gp+cp_pcedt_0.1_0.4_0.6:I0307 05:35:58.935050 20224 SemanticPipe.h:338] Unlabeled F1: 0.991154 -out_open_af+as+gp+cp_pcedt_0.1_0.4_0.6:I0307 05:35:58.935104 20224 SemanticPipe.h:355] Labeled F1: 0.95967 - - - -======================================================================================== -Open, Basic pruned model, C=0.01, dm, best = 0.4/0.6 -======================================================================================== - -out_open_pruner_dm_0.01_0.4_0.6:I0304 20:34:07.103107 3696 SemanticPipe.h:338] Unlabeled F1: 0.871219 -out_open_pruner_dm_0.01_0.4_0.6:I0304 20:34:07.103131 3696 SemanticPipe.h:355] Labeled F1: -nan -out_open_pruner_dm_0.01_0.4_0.6:I0304 20:34:16.991791 3721 SemanticPipe.h:338] Unlabeled F1: 0.869054 -out_open_pruner_dm_0.01_0.4_0.6:I0304 20:34:16.991822 3721 SemanticPipe.h:355] Labeled F1: -nan -out_open_pruner_dm_0.01_0.4_0.6:I0304 20:36:33.300325 3746 SemanticPipe.h:338] Unlabeled F1: 0.940562 -out_open_pruner_dm_0.01_0.4_0.6:I0304 20:36:33.300350 3746 SemanticPipe.h:355] Labeled F1: -nan - -out_open_pruner_dm_0.01_0.4_0.6:I0304 21:13:28.007509 3991 SemanticPipe.h:338] Unlabeled F1: 0.87675 -out_open_pruner_dm_0.01_0.4_0.6:I0304 21:13:28.007534 3991 SemanticPipe.h:355] Labeled F1: 0.868259 -out_open_pruner_dm_0.01_0.4_0.6:I0304 21:13:47.302042 4017 SemanticPipe.h:338] Unlabeled F1: 0.875167 -out_open_pruner_dm_0.01_0.4_0.6:I0304 21:13:47.302065 4017 SemanticPipe.h:355] Labeled F1: 0.865775 -out_open_pruner_dm_0.01_0.4_0.6:I0304 21:17:34.889626 4042 SemanticPipe.h:338] Unlabeled F1: 0.962608 -out_open_pruner_dm_0.01_0.4_0.6:I0304 21:17:34.889649 4042 SemanticPipe.h:355] Labeled F1: 0.960544 - -======================================================================================== -Open, Basic pruned model, C=0.1, dm, best = 0.4/0.6 -======================================================================================== - -out_open_pruner_dm_0.1_0.4_0.6:I0305 08:55:45.868551 8816 SemanticPipe.h:338] Unlabeled F1: 0.871219 -out_open_pruner_dm_0.1_0.4_0.6:I0305 08:55:45.868577 8816 SemanticPipe.h:355] Labeled F1: -nan -out_open_pruner_dm_0.1_0.4_0.6:I0305 08:55:55.791627 8841 SemanticPipe.h:338] Unlabeled F1: 0.869054 -out_open_pruner_dm_0.1_0.4_0.6:I0305 08:55:55.791654 8841 SemanticPipe.h:355] Labeled F1: -nan -out_open_pruner_dm_0.1_0.4_0.6:I0305 08:58:13.086381 8866 SemanticPipe.h:338] Unlabeled F1: 0.940562 -out_open_pruner_dm_0.1_0.4_0.6:I0305 08:58:13.086407 8866 SemanticPipe.h:355] Labeled F1: -nan - -out_open_pruner_dm_0.1_0.4_0.6:I0305 09:35:47.043359 9064 SemanticPipe.h:338] Unlabeled F1: 0.876515 -out_open_pruner_dm_0.1_0.4_0.6:I0305 09:35:47.043383 9064 SemanticPipe.h:355] Labeled F1: 0.868142 -out_open_pruner_dm_0.1_0.4_0.6:I0305 09:36:06.972524 9089 SemanticPipe.h:338] Unlabeled F1: 0.874982 -out_open_pruner_dm_0.1_0.4_0.6:I0305 09:36:06.972547 9089 SemanticPipe.h:355] Labeled F1: 0.865588 -out_open_pruner_dm_0.1_0.4_0.6:I0305 09:39:58.072582 9114 SemanticPipe.h:338] Unlabeled F1: 0.962557 -out_open_pruner_dm_0.1_0.4_0.6:I0305 09:39:58.072605 9114 SemanticPipe.h:355] Labeled F1: 0.96048 - -======================================================================================== -Open, Basic pruned model, C=0.001, dm, best = 0.4/0.6 -======================================================================================== - -out_open_pruner_dm_0.001_0.4_0.6:I0305 02:41:01.330844 6148 SemanticPipe.h:338] Unlabeled F1: 0.871219 -out_open_pruner_dm_0.001_0.4_0.6:I0305 02:41:01.330868 6148 SemanticPipe.h:355] Labeled F1: -nan -out_open_pruner_dm_0.001_0.4_0.6:I0305 02:41:11.530150 6173 SemanticPipe.h:338] Unlabeled F1: 0.869054 -out_open_pruner_dm_0.001_0.4_0.6:I0305 02:41:11.530179 6173 SemanticPipe.h:355] Labeled F1: -nan -out_open_pruner_dm_0.001_0.4_0.6:I0305 02:43:31.455975 6198 SemanticPipe.h:338] Unlabeled F1: 0.940562 -out_open_pruner_dm_0.001_0.4_0.6:I0305 02:43:31.455999 6198 SemanticPipe.h:355] Labeled F1: -nan - -out_open_pruner_dm_0.001_0.4_0.6:I0305 03:21:46.661723 6412 SemanticPipe.h:338] Unlabeled F1: 0.871205 -out_open_pruner_dm_0.001_0.4_0.6:I0305 03:21:46.661746 6412 SemanticPipe.h:355] Labeled F1: 0.860232 -out_open_pruner_dm_0.001_0.4_0.6:I0305 03:22:06.230401 6437 SemanticPipe.h:338] Unlabeled F1: 0.868698 -out_open_pruner_dm_0.001_0.4_0.6:I0305 03:22:06.230425 6437 SemanticPipe.h:355] Labeled F1: 0.85651 -out_open_pruner_dm_0.001_0.4_0.6:I0305 03:25:54.440883 6463 SemanticPipe.h:338] Unlabeled F1: 0.917552 -out_open_pruner_dm_0.001_0.4_0.6:I0305 03:25:54.440908 6463 SemanticPipe.h:355] Labeled F1: 0.909424 - - -======================================================================================== -Open, Basic pruned model, C=0.01, pas, best = 0.5/0.5 -======================================================================================== - -out_open_pruner_pas_0.01_0.5_0.5:I0304 21:56:53.031843 4170 SemanticPipe.h:338] Unlabeled F1: 0.899944 -out_open_pruner_pas_0.01_0.5_0.5:I0304 21:56:53.031867 4170 SemanticPipe.h:355] Labeled F1: -nan -out_open_pruner_pas_0.01_0.5_0.5:I0304 21:57:02.697892 4195 SemanticPipe.h:338] Unlabeled F1: 0.897854 -out_open_pruner_pas_0.01_0.5_0.5:I0304 21:57:02.697921 4195 SemanticPipe.h:355] Labeled F1: -nan -out_open_pruner_pas_0.01_0.5_0.5:I0304 21:59:14.423447 4220 SemanticPipe.h:338] Unlabeled F1: 0.952649 -out_open_pruner_pas_0.01_0.5_0.5:I0304 21:59:14.423472 4220 SemanticPipe.h:355] Labeled F1: -nan - -out_open_pruner_pas_0.01_0.5_0.5:I0304 22:32:24.805165 4667 SemanticPipe.h:338] Unlabeled F1: 0.897885 -out_open_pruner_pas_0.01_0.5_0.5:I0304 22:32:24.805188 4667 SemanticPipe.h:355] Labeled F1: 0.890981 -out_open_pruner_pas_0.01_0.5_0.5:I0304 22:32:43.399220 4717 SemanticPipe.h:338] Unlabeled F1: 0.895067 -out_open_pruner_pas_0.01_0.5_0.5:I0304 22:32:43.399243 4717 SemanticPipe.h:355] Labeled F1: 0.886633 -out_open_pruner_pas_0.01_0.5_0.5:I0304 22:36:18.935971 4742 SemanticPipe.h:338] Unlabeled F1: 0.969328 -out_open_pruner_pas_0.01_0.5_0.5:I0304 22:36:18.935994 4742 SemanticPipe.h:355] Labeled F1: 0.967318 - -======================================================================================== -Open, Basic pruned model, C=0.1, pas, best = 0.4/0.6 -======================================================================================== - -out_open_pruner_pas_0.1_0.4_0.6:I0305 07:58:36.627552 8430 SemanticPipe.h:338] Unlabeled F1: 0.899944 -out_open_pruner_pas_0.1_0.4_0.6:I0305 07:58:36.627576 8430 SemanticPipe.h:355] Labeled F1: -nan -out_open_pruner_pas_0.1_0.4_0.6:I0305 07:58:47.439345 8455 SemanticPipe.h:338] Unlabeled F1: 0.897854 -out_open_pruner_pas_0.1_0.4_0.6:I0305 07:58:47.439375 8455 SemanticPipe.h:355] Labeled F1: -nan -out_open_pruner_pas_0.1_0.4_0.6:I0305 08:00:54.964401 8480 SemanticPipe.h:338] Unlabeled F1: 0.952649 -out_open_pruner_pas_0.1_0.4_0.6:I0305 08:00:54.964429 8480 SemanticPipe.h:355] Labeled F1: -nan - -out_open_pruner_pas_0.1_0.4_0.6:I0305 08:33:48.282367 8636 SemanticPipe.h:338] Unlabeled F1: 0.898658 -out_open_pruner_pas_0.1_0.4_0.6:I0305 08:33:48.282390 8636 SemanticPipe.h:355] Labeled F1: 0.890814 -out_open_pruner_pas_0.1_0.4_0.6:I0305 08:34:06.727833 8661 SemanticPipe.h:338] Unlabeled F1: 0.895603 -out_open_pruner_pas_0.1_0.4_0.6:I0305 08:34:06.727854 8661 SemanticPipe.h:355] Labeled F1: 0.886625 -out_open_pruner_pas_0.1_0.4_0.6:I0305 08:37:39.874521 8687 SemanticPipe.h:338] Unlabeled F1: 0.97033 -out_open_pruner_pas_0.1_0.4_0.6:I0305 08:37:39.874544 8687 SemanticPipe.h:355] Labeled F1: 0.968148 - -======================================================================================== -Open, Basic pruned model, C=0.001, pas, best = 0.4/0.6 -======================================================================================== - -out_open_pruner_pas_0.001_0.4_0.6:I0305 02:11:59.306951 6054 SemanticPipe.h:338] Unlabeled F1: 0.899944 -out_open_pruner_pas_0.001_0.4_0.6:I0305 02:11:59.306973 6054 SemanticPipe.h:355] Labeled F1: -nan -out_open_pruner_pas_0.001_0.4_0.6:I0305 02:12:09.079493 6079 SemanticPipe.h:338] Unlabeled F1: 0.897854 -out_open_pruner_pas_0.001_0.4_0.6:I0305 02:12:09.079521 6079 SemanticPipe.h:355] Labeled F1: -nan -out_open_pruner_pas_0.001_0.4_0.6:I0305 02:14:21.062824 6104 SemanticPipe.h:338] Unlabeled F1: 0.952649 -out_open_pruner_pas_0.001_0.4_0.6:I0305 02:14:21.062849 6104 SemanticPipe.h:355] Labeled F1: -nan - -out_open_pruner_pas_0.001_0.4_0.6:I0305 02:48:39.017328 6227 SemanticPipe.h:338] Unlabeled F1: 0.895852 -out_open_pruner_pas_0.001_0.4_0.6:I0305 02:48:39.017351 6227 SemanticPipe.h:355] Labeled F1: 0.887926 -out_open_pruner_pas_0.001_0.4_0.6:I0305 02:48:57.847923 6253 SemanticPipe.h:338] Unlabeled F1: 0.893213 -out_open_pruner_pas_0.001_0.4_0.6:I0305 02:48:57.847946 6253 SemanticPipe.h:355] Labeled F1: 0.883676 -out_open_pruner_pas_0.001_0.4_0.6:I0305 02:52:32.578814 6278 SemanticPipe.h:338] Unlabeled F1: 0.937954 -out_open_pruner_pas_0.001_0.4_0.6:I0305 02:52:32.578845 6278 SemanticPipe.h:355] Labeled F1: 0.931875 - - -======================================================================================== -Open, Basic pruned model, C=0.01, pcedt, best = 0.3/0.7 -======================================================================================== - -out_open_pruner_pcedt_0.01_0.3_0.7:I0304 23:17:27.029330 4929 SemanticPipe.h:338] Unlabeled F1: 0.875989 -out_open_pruner_pcedt_0.01_0.3_0.7:I0304 23:17:27.029355 4929 SemanticPipe.h:355] Labeled F1: -nan -out_open_pruner_pcedt_0.01_0.3_0.7:I0304 23:17:36.631697 4954 SemanticPipe.h:338] Unlabeled F1: 0.870119 -out_open_pruner_pcedt_0.01_0.3_0.7:I0304 23:17:36.631723 4954 SemanticPipe.h:355] Labeled F1: -nan -out_open_pruner_pcedt_0.01_0.3_0.7:I0304 23:19:49.615541 4979 SemanticPipe.h:338] Unlabeled F1: 0.9487 -out_open_pruner_pcedt_0.01_0.3_0.7:I0304 23:19:49.615566 4979 SemanticPipe.h:355] Labeled F1: -nan - -out_open_pruner_pcedt_0.01_0.3_0.7:I0304 23:57:16.666120 5174 SemanticPipe.h:338] Unlabeled F1: 0.866766 -out_open_pruner_pcedt_0.01_0.3_0.7:I0304 23:57:16.666142 5174 SemanticPipe.h:355] Labeled F1: 0.788887 -out_open_pruner_pcedt_0.01_0.3_0.7:I0304 23:57:38.890662 5199 SemanticPipe.h:338] Unlabeled F1: 0.860824 -out_open_pruner_pcedt_0.01_0.3_0.7:I0304 23:57:38.890686 5199 SemanticPipe.h:355] Labeled F1: 0.776957 -out_open_pruner_pcedt_0.01_0.3_0.7:I0305 00:01:24.427584 5252 SemanticPipe.h:338] Unlabeled F1: 0.970955 -out_open_pruner_pcedt_0.01_0.3_0.7:I0305 00:01:24.427608 5252 SemanticPipe.h:355] Labeled F1: 0.943783 - -======================================================================================== -Open, Basic pruned model, C=0.1, pcedt, best = 0.4/0.6 -======================================================================================== - -out_open_pruner_pcedt_0.1_0.4_0.6:I0305 07:58:13.321595 8378 SemanticPipe.h:338] Unlabeled F1: 0.875989 -out_open_pruner_pcedt_0.1_0.4_0.6:I0305 07:58:13.321619 8378 SemanticPipe.h:355] Labeled F1: -nan -out_open_pruner_pcedt_0.1_0.4_0.6:I0305 07:58:22.903991 8403 SemanticPipe.h:338] Unlabeled F1: 0.870119 -out_open_pruner_pcedt_0.1_0.4_0.6:I0305 07:58:22.904018 8403 SemanticPipe.h:355] Labeled F1: -nan -out_open_pruner_pcedt_0.1_0.4_0.6:I0305 08:00:34.276875 8428 SemanticPipe.h:338] Unlabeled F1: 0.9487 -out_open_pruner_pcedt_0.1_0.4_0.6:I0305 08:00:34.276901 8428 SemanticPipe.h:355] Labeled F1: -nan - -out_open_pruner_pcedt_0.1_0.4_0.6:I0305 08:37:56.453143 8694 SemanticPipe.h:338] Unlabeled F1: 0.859722 -out_open_pruner_pcedt_0.1_0.4_0.6:I0305 08:37:56.453166 8694 SemanticPipe.h:355] Labeled F1: 0.788857 -out_open_pruner_pcedt_0.1_0.4_0.6:I0305 08:38:18.453850 8751 SemanticPipe.h:338] Unlabeled F1: 0.852681 -out_open_pruner_pcedt_0.1_0.4_0.6:I0305 08:38:18.453874 8751 SemanticPipe.h:355] Labeled F1: 0.776735 -out_open_pruner_pcedt_0.1_0.4_0.6:I0305 08:42:01.857959 8776 SemanticPipe.h:338] Unlabeled F1: 0.967501 -out_open_pruner_pcedt_0.1_0.4_0.6:I0305 08:42:01.857982 8776 SemanticPipe.h:355] Labeled F1: 0.941577 - -======================================================================================== -Open, Basic pruned model, C=0.001, pcedt, best = 0.3/0.7 -======================================================================================== - -out_open_pruner_pcedt_0.001_0.3_0.7:I0305 05:02:42.498719 7030 SemanticPipe.h:338] Unlabeled F1: 0.875989 -out_open_pruner_pcedt_0.001_0.3_0.7:I0305 05:02:42.498744 7030 SemanticPipe.h:355] Labeled F1: -nan -out_open_pruner_pcedt_0.001_0.3_0.7:I0305 05:02:52.038163 7055 SemanticPipe.h:338] Unlabeled F1: 0.870119 -out_open_pruner_pcedt_0.001_0.3_0.7:I0305 05:02:52.038190 7055 SemanticPipe.h:355] Labeled F1: -nan -out_open_pruner_pcedt_0.001_0.3_0.7:I0305 05:05:05.171903 7080 SemanticPipe.h:338] Unlabeled F1: 0.9487 -out_open_pruner_pcedt_0.001_0.3_0.7:I0305 05:05:05.171928 7080 SemanticPipe.h:355] Labeled F1: -nan - -out_open_pruner_pcedt_0.001_0.3_0.7:I0305 05:45:00.154666 7260 SemanticPipe.h:338] Unlabeled F1: 0.857081 -out_open_pruner_pcedt_0.001_0.3_0.7:I0305 05:45:00.154690 7260 SemanticPipe.h:355] Labeled F1: 0.786758 -out_open_pruner_pcedt_0.001_0.3_0.7:I0305 05:45:22.763595 7285 SemanticPipe.h:338] Unlabeled F1: 0.850754 -out_open_pruner_pcedt_0.001_0.3_0.7:I0305 05:45:22.763618 7285 SemanticPipe.h:355] Labeled F1: 0.773298 -out_open_pruner_pcedt_0.001_0.3_0.7:I0305 05:49:08.064488 7311 SemanticPipe.h:338] Unlabeled F1: 0.93025 -out_open_pruner_pcedt_0.001_0.3_0.7:I0305 05:49:08.064513 7311 SemanticPipe.h:355] Labeled F1: 0.883258 - - -======================================================================================== -Open, Basic model, C=0.01, dm, best = 0.4/0.6 -======================================================================================== - -out_open_first_order_dm_0.01_0.4_0.6:I0303 17:24:22.036874 29521 SemanticPipe.h:338] Unlabeled F1: 0.87695 -out_open_first_order_dm_0.01_0.4_0.6:I0303 17:24:22.036898 29521 SemanticPipe.h:355] Labeled F1: 0.868808 -out_open_first_order_dm_0.01_0.4_0.6:I0303 17:24:44.348950 29546 SemanticPipe.h:338] Unlabeled F1: 0.875326 -out_open_first_order_dm_0.01_0.4_0.6:I0303 17:24:44.348975 29546 SemanticPipe.h:355] Labeled F1: 0.865781 -out_open_first_order_dm_0.01_0.4_0.6:I0303 17:30:09.360000 29571 SemanticPipe.h:338] Unlabeled F1: 0.962358 -out_open_first_order_dm_0.01_0.4_0.6:I0303 17:30:09.360036 29571 SemanticPipe.h:355] Labeled F1: 0.960247 - -======================================================================================== -Open, Basic model, C=0.1, dm, best = 0.4/0.6 -======================================================================================== - -out_open_first_order_dm_0.1_0.4_0.6:I0304 04:07:32.473532 346 SemanticPipe.h:338] Unlabeled F1: 0.877476 -out_open_first_order_dm_0.1_0.4_0.6:I0304 04:07:32.473556 346 SemanticPipe.h:355] Labeled F1: 0.869096 -out_open_first_order_dm_0.1_0.4_0.6:I0304 04:07:54.631297 371 SemanticPipe.h:338] Unlabeled F1: 0.875124 -out_open_first_order_dm_0.1_0.4_0.6:I0304 04:07:54.631322 371 SemanticPipe.h:355] Labeled F1: 0.86558 -out_open_first_order_dm_0.1_0.4_0.6:I0304 04:13:15.417235 399 SemanticPipe.h:338] Unlabeled F1: 0.962392 -out_open_first_order_dm_0.1_0.4_0.6:I0304 04:13:15.417260 399 SemanticPipe.h:355] Labeled F1: 0.960303 - -======================================================================================== -Open, Basic model, C=0.001, dm, best = 0.4/0.6 -======================================================================================== - -out_open_first_order_dm_0.001_0.4_0.6:I0303 22:44:10.618505 31407 SemanticPipe.h:338] Unlabeled F1: 0.871089 -out_open_first_order_dm_0.001_0.4_0.6:I0303 22:44:10.618532 31407 SemanticPipe.h:355] Labeled F1: 0.859955 -out_open_first_order_dm_0.001_0.4_0.6:I0303 22:44:32.796176 31432 SemanticPipe.h:338] Unlabeled F1: 0.868952 -out_open_first_order_dm_0.001_0.4_0.6:I0303 22:44:32.796200 31432 SemanticPipe.h:355] Labeled F1: 0.856905 -out_open_first_order_dm_0.001_0.4_0.6:I0303 22:49:52.590128 31457 SemanticPipe.h:338] Unlabeled F1: 0.917281 -out_open_first_order_dm_0.001_0.4_0.6:I0303 22:49:52.590152 31457 SemanticPipe.h:355] Labeled F1: 0.909139 - - -======================================================================================== -Open, Basic model, C=0.01, pas, best = 0.5/0.5 -======================================================================================== - -out_open_first_order_pas_0.01_0.5_0.5:I0303 20:37:42.063536 30805 SemanticPipe.h:338] Unlabeled F1: 0.897976 -out_open_first_order_pas_0.01_0.5_0.5:I0303 20:37:42.063562 30805 SemanticPipe.h:355] Labeled F1: 0.890755 -out_open_first_order_pas_0.01_0.5_0.5:I0303 20:38:00.991132 30830 SemanticPipe.h:338] Unlabeled F1: 0.894997 -out_open_first_order_pas_0.01_0.5_0.5:I0303 20:38:00.991154 30830 SemanticPipe.h:355] Labeled F1: 0.886479 -out_open_first_order_pas_0.01_0.5_0.5:I0303 20:42:22.457512 30855 SemanticPipe.h:338] Unlabeled F1: 0.969181 -out_open_first_order_pas_0.01_0.5_0.5:I0303 20:42:22.457537 30855 SemanticPipe.h:355] Labeled F1: 0.967133 - -======================================================================================== -Open, Basic model, C=0.001, pas, best = 0.4/0.6 -======================================================================================== - -out_open_first_order_pas_0.001_0.4_0.6:I0303 21:29:54.896301 31030 SemanticPipe.h:338] Unlabeled F1: 0.896312 -out_open_first_order_pas_0.001_0.4_0.6:I0303 21:29:54.896325 31030 SemanticPipe.h:355] Labeled F1: 0.888476 -out_open_first_order_pas_0.001_0.4_0.6:I0303 21:30:13.926386 31055 SemanticPipe.h:338] Unlabeled F1: 0.893443 -out_open_first_order_pas_0.001_0.4_0.6:I0303 21:30:13.926410 31055 SemanticPipe.h:355] Labeled F1: 0.883958 -out_open_first_order_pas_0.001_0.4_0.6:I0303 21:34:37.524556 31080 SemanticPipe.h:338] Unlabeled F1: 0.937911 -out_open_first_order_pas_0.001_0.4_0.6:I0303 21:34:37.524580 31080 SemanticPipe.h:355] Labeled F1: 0.931826 - -======================================================================================== -Open, Basic model, C=0.1, pas, best = 0.4/0.6 -======================================================================================== - -out_open_first_order_pas_0.1_0.4_0.6:I0304 01:49:40.173164 32165 SemanticPipe.h:338] Unlabeled F1: 0.89911 -out_open_first_order_pas_0.1_0.4_0.6:I0304 01:49:40.173189 32165 SemanticPipe.h:355] Labeled F1: 0.891233 -out_open_first_order_pas_0.1_0.4_0.6:I0304 01:49:59.133213 32190 SemanticPipe.h:338] Unlabeled F1: 0.896077 -out_open_first_order_pas_0.1_0.4_0.6:I0304 01:49:59.133239 32190 SemanticPipe.h:355] Labeled F1: 0.887014 -out_open_first_order_pas_0.1_0.4_0.6:I0304 01:54:22.706234 32215 SemanticPipe.h:338] Unlabeled F1: 0.97015 -out_open_first_order_pas_0.1_0.4_0.6:I0304 01:54:22.706259 32215 SemanticPipe.h:355] Labeled F1: 0.967959 - - -======================================================================================== -Open, Basic model, C=0.01, pcedt, best = 0.4/0.6 -======================================================================================== - -out_open_first_order_pcedt_0.01_0.4_0.6:I0303 17:34:32.000931 29717 SemanticPipe.h:338] Unlabeled F1: 0.860508 -out_open_first_order_pcedt_0.01_0.4_0.6:I0303 17:34:32.000957 29717 SemanticPipe.h:355] Labeled F1: 0.789647 -out_open_first_order_pcedt_0.01_0.4_0.6:I0303 17:34:59.216428 29742 SemanticPipe.h:338] Unlabeled F1: 0.851832 -out_open_first_order_pcedt_0.01_0.4_0.6:I0303 17:34:59.216457 29742 SemanticPipe.h:355] Labeled F1: 0.77598 -out_open_first_order_pcedt_0.01_0.4_0.6:I0303 17:41:06.719171 29767 SemanticPipe.h:338] Unlabeled F1: 0.967288 -out_open_first_order_pcedt_0.01_0.4_0.6:I0303 17:41:06.719197 29767 SemanticPipe.h:355] Labeled F1: 0.941363 - -======================================================================================== -Open, Basic model, C=0.001, pcedt, best = 0.3/0.7 -======================================================================================== - -out_open_first_order_pcedt_0.001_0.3_0.7:I0304 01:03:53.958814 32024 SemanticPipe.h:338] Unlabeled F1: 0.858347 -out_open_first_order_pcedt_0.001_0.3_0.7:I0304 01:03:53.958838 32024 SemanticPipe.h:355] Labeled F1: 0.787771 -out_open_first_order_pcedt_0.001_0.3_0.7:I0304 01:04:21.127738 32049 SemanticPipe.h:338] Unlabeled F1: 0.851055 -out_open_first_order_pcedt_0.001_0.3_0.7:I0304 01:04:21.127766 32049 SemanticPipe.h:355] Labeled F1: 0.773472 -out_open_first_order_pcedt_0.001_0.3_0.7:I0304 01:10:21.272635 32106 SemanticPipe.h:338] Unlabeled F1: 0.93001 -out_open_first_order_pcedt_0.001_0.3_0.7:I0304 01:10:21.272660 32106 SemanticPipe.h:355] Labeled F1: 0.88274 - -======================================================================================== -Open, Basic model, C=0.1, pcedt, best = 0.4/0.6 -======================================================================================== - -out_open_first_order_pcedt_0.1_0.4_0.6:I0304 06:02:34.675550 823 SemanticPipe.h:338] Unlabeled F1: 0.861282 -out_open_first_order_pcedt_0.1_0.4_0.6:I0304 06:02:34.675575 823 SemanticPipe.h:355] Labeled F1: 0.790009 -out_open_first_order_pcedt_0.1_0.4_0.6:I0304 06:03:00.144249 848 SemanticPipe.h:338] Unlabeled F1: 0.852014 -out_open_first_order_pcedt_0.1_0.4_0.6:I0304 06:03:00.144279 848 SemanticPipe.h:355] Labeled F1: 0.776053 -out_open_first_order_pcedt_0.1_0.4_0.6:I0304 06:08:40.277804 873 SemanticPipe.h:338] Unlabeled F1: 0.967229 -out_open_first_order_pcedt_0.1_0.4_0.6:I0304 06:08:40.277832 873 SemanticPipe.h:355] Labeled F1: 0.941352 - - -======================================================================================== -Closed, Basic model, C=0.01, dm, best = 0.4/0.6 -======================================================================================== - -dm/out_closed_first_order_dm_0.01_0.4_0.6:I0303 00:57:43.200875 23563 SemanticPipe.h:338] Unlabeled F1: 0.867029 -dm/out_closed_first_order_dm_0.01_0.4_0.6:I0303 00:57:43.200904 23563 SemanticPipe.h:355] Labeled F1: 0.858655 -dm/out_closed_first_order_dm_0.01_0.4_0.6:I0303 00:58:02.690052 23590 SemanticPipe.h:338] Unlabeled F1: 0.866158 -dm/out_closed_first_order_dm_0.01_0.4_0.6:I0303 00:58:02.690074 23590 SemanticPipe.h:355] Labeled F1: 0.856827 -dm/out_closed_first_order_dm_0.01_0.4_0.6:I0303 01:02:22.098635 23640 SemanticPipe.h:338] Unlabeled F1: 0.942835 -dm/out_closed_first_order_dm_0.01_0.4_0.6:I0303 01:02:22.098664 23640 SemanticPipe.h:355] Labeled F1: 0.939486 - -======================================================================================== -Closed, Basic model, C=0.001, dm, best = 0.3/0.7 -======================================================================================== - -dm/out_closed_first_order_dm_0.001_0.3_0.7:I0303 05:43:09.167479 25265 SemanticPipe.h:338] Unlabeled F1: 0.855337 -dm/out_closed_first_order_dm_0.001_0.3_0.7:I0303 05:43:09.167508 25265 SemanticPipe.h:355] Labeled F1: 0.841821 -dm/out_closed_first_order_dm_0.001_0.3_0.7:I0303 05:43:27.394352 25290 SemanticPipe.h:338] Unlabeled F1: 0.851416 -dm/out_closed_first_order_dm_0.001_0.3_0.7:I0303 05:43:27.394376 25290 SemanticPipe.h:355] Labeled F1: 0.836562 -dm/out_closed_first_order_dm_0.001_0.3_0.7:I0303 05:47:50.498096 25315 SemanticPipe.h:338] Unlabeled F1: 0.884861 -dm/out_closed_first_order_dm_0.001_0.3_0.7:I0303 05:47:50.498122 25315 SemanticPipe.h:355] Labeled F1: 0.872378 - -======================================================================================== -Closed, Basic model, C=0.1, dm, best = 0.4/0.6 -======================================================================================== - -dm/out_closed_first_order_dm_0.1_0.4_0.6:I0303 08:56:54.699408 26732 SemanticPipe.h:338] Unlabeled F1: 0.866806 -dm/out_closed_first_order_dm_0.1_0.4_0.6:I0303 08:56:54.699431 26732 SemanticPipe.h:355] Labeled F1: 0.858235 -dm/out_closed_first_order_dm_0.1_0.4_0.6:I0303 08:57:12.969288 26757 SemanticPipe.h:338] Unlabeled F1: 0.866357 -dm/out_closed_first_order_dm_0.1_0.4_0.6:I0303 08:57:12.969311 26757 SemanticPipe.h:355] Labeled F1: 0.857211 -dm/out_closed_first_order_dm_0.1_0.4_0.6:I0303 09:01:33.296825 26782 SemanticPipe.h:338] Unlabeled F1: 0.943051 -dm/out_closed_first_order_dm_0.1_0.4_0.6:I0303 09:01:33.296849 26782 SemanticPipe.h:355] Labeled F1: 0.93972 - -======================================================================================== -Closed, Basic model, C=0.1, pas, best = 0.4/0.6 -======================================================================================== - -pas/out_closed_first_order_pas_0.1_0.4_0.6:I0303 07:17:15.837741 25752 SemanticPipe.h:338] Unlabeled F1: 0.889707 -pas/out_closed_first_order_pas_0.1_0.4_0.6:I0303 07:17:15.837764 25752 SemanticPipe.h:355] Labeled F1: 0.88154 -pas/out_closed_first_order_pas_0.1_0.4_0.6:I0303 07:17:31.933979 25777 SemanticPipe.h:338] Unlabeled F1: 0.887794 -pas/out_closed_first_order_pas_0.1_0.4_0.6:I0303 07:17:31.934005 25777 SemanticPipe.h:355] Labeled F1: 0.878789 -pas/out_closed_first_order_pas_0.1_0.4_0.6:I0303 07:21:08.409705 25802 SemanticPipe.h:338] Unlabeled F1: 0.954548 -pas/out_closed_first_order_pas_0.1_0.4_0.6:I0303 07:21:08.409730 25802 SemanticPipe.h:355] Labeled F1: 0.951172 - -======================================================================================== -Closed, Basic model, C=0.01, pas, best = 0.4/0.6 -======================================================================================== - -pas/out_closed_first_order_pas_0.01_0.4_0.6:I0303 00:49:22.965160 23478 SemanticPipe.h:338] Unlabeled F1: 0.889286 -pas/out_closed_first_order_pas_0.01_0.4_0.6:I0303 00:49:22.965184 23478 SemanticPipe.h:355] Labeled F1: 0.880964 -pas/out_closed_first_order_pas_0.01_0.4_0.6:I0303 00:49:39.311713 23503 SemanticPipe.h:338] Unlabeled F1: 0.887768 -pas/out_closed_first_order_pas_0.01_0.4_0.6:I0303 00:49:39.311738 23503 SemanticPipe.h:355] Labeled F1: 0.878986 -pas/out_closed_first_order_pas_0.01_0.4_0.6:I0303 00:53:13.788544 23528 SemanticPipe.h:338] Unlabeled F1: 0.954375 -pas/out_closed_first_order_pas_0.01_0.4_0.6:I0303 00:53:13.788569 23528 SemanticPipe.h:355] Labeled F1: 0.950961 - -======================================================================================== -Closed, Basic model, C=0.001, pas, best = 0.3/0.7 -======================================================================================== - -pas/out_closed_first_order_pas_0.001_0.3_0.7:I0303 04:40:10.504537 24856 SemanticPipe.h:338] Unlabeled F1: 0.881256 -pas/out_closed_first_order_pas_0.001_0.3_0.7:I0303 04:40:10.504561 24856 SemanticPipe.h:355] Labeled F1: 0.872506 -pas/out_closed_first_order_pas_0.001_0.3_0.7:I0303 04:40:26.482605 24881 SemanticPipe.h:338] Unlabeled F1: 0.879238 -pas/out_closed_first_order_pas_0.001_0.3_0.7:I0303 04:40:26.482628 24881 SemanticPipe.h:355] Labeled F1: 0.868194 -pas/out_closed_first_order_pas_0.001_0.3_0.7:I0303 04:44:01.680111 24906 SemanticPipe.h:338] Unlabeled F1: 0.912261 -pas/out_closed_first_order_pas_0.001_0.3_0.7:I0303 04:44:01.680137 24906 SemanticPipe.h:355] Labeled F1: 0.904295 - -======================================================================================== -Closed, Basic model, C=0.01, pcedt, best = 0.3/0.7 -======================================================================================== - -pcedt/out_closed_first_order_pcedt_0.01_0.3_0.7:I0303 01:53:52.141866 23956 SemanticPipe.h:338] Unlabeled F1: 0.850752 -pcedt/out_closed_first_order_pcedt_0.01_0.3_0.7:I0303 01:53:52.141891 23956 SemanticPipe.h:355] Labeled F1: 0.776552 -pcedt/out_closed_first_order_pcedt_0.01_0.3_0.7:I0303 01:54:13.427223 23981 SemanticPipe.h:338] Unlabeled F1: 0.841216 -pcedt/out_closed_first_order_pcedt_0.01_0.3_0.7:I0303 01:54:13.427255 23981 SemanticPipe.h:355] Labeled F1: 0.76121 -pcedt/out_closed_first_order_pcedt_0.01_0.3_0.7:I0303 01:59:08.779611 24006 SemanticPipe.h:338] Unlabeled F1: 0.9505 -pcedt/out_closed_first_order_pcedt_0.01_0.3_0.7:I0303 01:59:08.779638 24006 SemanticPipe.h:355] Labeled F1: 0.915092 - -======================================================================================== -Closed, Basic model, C=0.1, pcedt, best = 0.3/0.7 -======================================================================================== - -pcedt/out_closed_first_order_pcedt_0.1_0.3_0.7:I0303 11:18:28.327687 27971 SemanticPipe.h:338] Unlabeled F1: 0.849986 -pcedt/out_closed_first_order_pcedt_0.1_0.3_0.7:I0303 11:18:28.327713 27971 SemanticPipe.h:355] Labeled F1: 0.775379 -pcedt/out_closed_first_order_pcedt_0.1_0.3_0.7:I0303 11:18:48.749308 28020 SemanticPipe.h:338] Unlabeled F1: 0.840473 -pcedt/out_closed_first_order_pcedt_0.1_0.3_0.7:I0303 11:18:48.749339 28020 SemanticPipe.h:355] Labeled F1: 0.760301 -pcedt/out_closed_first_order_pcedt_0.1_0.3_0.7:I0303 11:23:33.079251 28054 SemanticPipe.h:338] Unlabeled F1: 0.950623 -pcedt/out_closed_first_order_pcedt_0.1_0.3_0.7:I0303 11:23:33.079275 28054 SemanticPipe.h:355] Labeled F1: 0.915286 - -======================================================================================== -Closed, Basic model, C=0.001, pcedt, best = 0.2/0.8 -======================================================================================== - -pcedt/out_closed_first_order_pcedt_0.001_0.2_0.8:I0303 07:36:25.204982 25970 SemanticPipe.h:338] Unlabeled F1: 0.836571 -pcedt/out_closed_first_order_pcedt_0.001_0.2_0.8:I0303 07:36:25.205005 25970 SemanticPipe.h:355] Labeled F1: 0.764242 -pcedt/out_closed_first_order_pcedt_0.001_0.2_0.8:I0303 07:36:46.766206 25995 SemanticPipe.h:338] Unlabeled F1: 0.826105 -pcedt/out_closed_first_order_pcedt_0.001_0.2_0.8:I0303 07:36:46.766234 25995 SemanticPipe.h:355] Labeled F1: 0.745414 -pcedt/out_closed_first_order_pcedt_0.001_0.2_0.8:I0303 07:41:46.594873 26020 SemanticPipe.h:338] Unlabeled F1: 0.891181 -pcedt/out_closed_first_order_pcedt_0.001_0.2_0.8:I0303 07:41:46.594898 26020 SemanticPipe.h:355] Labeled F1: 0.831378 - - - - - - - - - - - -======================================================================================== -Basic probabilistic model, unlabeled (used to prune), C=0.01, pcedt -======================================================================================== -I0224 16:03:30.489624 25553 SemanticPipe.h:323] Unlabeled precision: 0.90027 (17684/19643) -I0224 16:03:30.489636 25553 SemanticPipe.h:326] Unlabeled recall: 0.802979 (17684/22023) -I0224 16:03:30.489640 25553 SemanticPipe.h:329] Unlabeled F1: 0.848846 -I0224 16:03:30.489645 25553 SemanticPipe.h:330] Pruning unlabeled recall: 0.998275 (21985/22023) -I0224 16:03:30.489650 25553 SemanticPipe.h:335] Pruning unlabeled efficiency: 12.2567 possible unlabeled arcs per token (413136/33707) --- -I0224 16:03:38.098300 25579 SemanticPipe.h:323] Unlabeled precision: 0.896413 (19367/21605) -I0224 16:03:38.098322 25579 SemanticPipe.h:326] Unlabeled recall: 0.797422 (19367/24287) -I0224 16:03:38.098327 25579 SemanticPipe.h:329] Unlabeled F1: 0.844025 -I0224 16:03:38.098332 25579 SemanticPipe.h:330] Pruning unlabeled recall: 0.996459 (24201/24287) -I0224 16:03:38.098337 25579 SemanticPipe.h:335] Pruning unlabeled efficiency: 12.3798 possible unlabeled arcs per token (455700/36810) --- -I0224 16:05:23.882752 25604 SemanticPipe.h:323] Unlabeled precision: 0.95403 (426707/447268) -I0224 16:05:23.882769 25604 SemanticPipe.h:326] Unlabeled recall: 0.918064 (426707/464790) -I0224 16:05:23.882776 25604 SemanticPipe.h:329] Unlabeled F1: 0.935701 -I0224 16:05:23.882779 25604 SemanticPipe.h:330] Pruning unlabeled recall: 1 (464790/464790) -I0224 16:05:23.882784 25604 SemanticPipe.h:335] Pruning unlabeled efficiency: 12.3251 possible unlabeled arcs per token (8738818/709029) - - -======================================================================================== -Basic model, C=0.01, 0.5/0.5, pcedt [hyperv] -======================================================================================== - -atm@hyperv-ubuntu1:~/TurboParser/scripts_srl$ grep -C2 'F1:' out_pcedt_basicpruning.txt -I0224 18:27:06.481441 53682 SemanticPipe.h:323] Unlabeled precision: 0.920755 (16348/17755) -I0224 18:27:06.481472 53682 SemanticPipe.h:326] Unlabeled recall: 0.742315 (16348/22023) -I0224 18:27:06.481497 53682 SemanticPipe.h:329] Unlabeled F1: 0.821962 -I0224 18:27:06.481519 53682 SemanticPipe.h:330] Pruning unlabeled recall: 0.998275 (21985/22023) -I0224 18:27:06.481551 53682 SemanticPipe.h:335] Pruning unlabeled efficiency: 12.2567 possible unlabeled arcs per token (413136/33707) -I0224 18:27:06.481580 53682 SemanticPipe.h:340] Labeled precision: 0.851873 (15125/17755) -I0224 18:27:06.481611 53682 SemanticPipe.h:343] Labeled recall: 0.686782 (15125/22023) -I0224 18:27:06.481647 53682 SemanticPipe.h:346] Labeled F1: 0.760471 -I0224 18:27:06.481681 53682 SemanticPipe.h:347] Pruning labeled recall: 0.995278 (21919/22023) -I0224 18:27:06.481705 53682 SemanticPipe.h:352] Pruning labeled efficiency: 236.404 possible labeled arcs per token (7968480/33707) --- -I0224 18:27:38.245790 53703 SemanticPipe.h:323] Unlabeled precision: 0.916912 (17778/19389) -I0224 18:27:38.245808 53703 SemanticPipe.h:326] Unlabeled recall: 0.731997 (17778/24287) -I0224 18:27:38.245816 53703 SemanticPipe.h:329] Unlabeled F1: 0.814086 -I0224 18:27:38.245823 53703 SemanticPipe.h:330] Pruning unlabeled recall: 0.996459 (24201/24287) -I0224 18:27:38.245831 53703 SemanticPipe.h:335] Pruning unlabeled efficiency: 12.3798 possible unlabeled arcs per token (455700/36810) -I0224 18:27:38.245841 53703 SemanticPipe.h:340] Labeled precision: 0.84156 (16317/19389) -I0224 18:27:38.245849 53703 SemanticPipe.h:343] Labeled recall: 0.671841 (16317/24287) -I0224 18:27:38.245857 53703 SemanticPipe.h:346] Labeled F1: 0.747184 -I0224 18:27:38.245864 53703 SemanticPipe.h:347] Pruning labeled recall: 0.993412 (24127/24287) -I0224 18:27:38.245872 53703 SemanticPipe.h:352] Pruning labeled efficiency: 240.361 possible labeled arcs per token (8847701/36810) --- -I0224 18:33:33.224424 53724 SemanticPipe.h:323] Unlabeled precision: 0.977404 (429097/439017) -I0224 18:33:33.224468 53724 SemanticPipe.h:326] Unlabeled recall: 0.923206 (429097/464790) -I0224 18:33:33.224493 53724 SemanticPipe.h:329] Unlabeled F1: 0.949532 -I0224 18:33:33.224525 53724 SemanticPipe.h:330] Pruning unlabeled recall: 1 (464790/464790) -I0224 18:33:33.224550 53724 SemanticPipe.h:335] Pruning unlabeled efficiency: 12.3251 possible unlabeled arcs per token (8738818/709029) -I0224 18:33:33.224584 53724 SemanticPipe.h:340] Labeled precision: 0.957198 (420226/439017) -I0224 18:33:33.224611 53724 SemanticPipe.h:343] Labeled recall: 0.90412 (420226/464790) -I0224 18:33:33.224634 53724 SemanticPipe.h:346] Labeled F1: 0.929902 -I0224 18:33:33.224678 53724 SemanticPipe.h:347] Pruning labeled recall: 1 (464790/464790) -I0224 18:33:33.224714 53724 SemanticPipe.h:352] Pruning labeled efficiency: 240.077 possible labeled arcs per token (170221737/709029) - - -======================================================================================== -Basic model after pruning (stupid pruning), C=0.01, 0.5/0.5, pcedt -======================================================================================== - -atm@pba28:~/workspace/CPP/TurboParser/scripts_srl$ grep -C2 'F1:' out_pruned_fixed.txt -I0224 17:44:37.784286 1053 SemanticPipe.h:323] Unlabeled precision: 0.92068 (15809/17171) -I0224 17:44:37.784297 1053 SemanticPipe.h:326] Unlabeled recall: 0.71784 (15809/22023) -I0224 17:44:37.784302 1053 SemanticPipe.h:329] Unlabeled F1: 0.806705 -I0224 17:44:37.784307 1053 SemanticPipe.h:330] Pruning unlabeled recall: 0.963084 (21210/22023) -I0224 17:44:37.784312 1053 SemanticPipe.h:335] Pruning unlabeled efficiency: 11.6718 possible unlabeled arcs per token (393423/33707) -I0224 17:44:37.784318 1053 SemanticPipe.h:340] Labeled precision: 0.852251 (14634/17171) -I0224 17:44:37.784322 1053 SemanticPipe.h:343] Labeled recall: 0.664487 (14634/22023) -I0224 17:44:37.784327 1053 SemanticPipe.h:346] Labeled F1: 0.746747 -I0224 17:44:37.784332 1053 SemanticPipe.h:347] Pruning labeled recall: 0.960133 (21145/22023) -I0224 17:44:37.784337 1053 SemanticPipe.h:352] Pruning labeled efficiency: 223.868 possible labeled arcs per token (7545921/33707) --- -I0224 17:45:04.989192 1082 SemanticPipe.h:323] Unlabeled precision: 0.915968 (17157/18731) -I0224 17:45:04.989204 1082 SemanticPipe.h:326] Unlabeled recall: 0.706427 (17157/24287) -I0224 17:45:04.989209 1082 SemanticPipe.h:329] Unlabeled F1: 0.797666 -I0224 17:45:04.989214 1082 SemanticPipe.h:330] Pruning unlabeled recall: 0.961008 (23340/24287) -I0224 17:45:04.989219 1082 SemanticPipe.h:335] Pruning unlabeled efficiency: 11.7956 possible unlabeled arcs per token (434196/36810) -I0224 17:45:04.989226 1082 SemanticPipe.h:340] Labeled precision: 0.841012 (15753/18731) -I0224 17:45:04.989230 1082 SemanticPipe.h:343] Labeled recall: 0.648619 (15753/24287) -I0224 17:45:04.989235 1082 SemanticPipe.h:346] Labeled F1: 0.732391 -I0224 17:45:04.989241 1082 SemanticPipe.h:347] Pruning labeled recall: 0.958085 (23269/24287) -I0224 17:45:04.989256 1082 SemanticPipe.h:352] Pruning labeled efficiency: 227.977 possible labeled arcs per token (8391843/36810) --- -I0224 17:50:10.556403 1114 SemanticPipe.h:323] Unlabeled precision: 0.977719 (414104/423541) -I0224 17:50:10.556416 1114 SemanticPipe.h:326] Unlabeled recall: 0.890949 (414104/464790) -I0224 17:50:10.556421 1114 SemanticPipe.h:329] Unlabeled F1: 0.932319 -I0224 17:50:10.556426 1114 SemanticPipe.h:330] Pruning unlabeled recall: 0.963876 (448000/464790) -I0224 17:50:10.556431 1114 SemanticPipe.h:335] Pruning unlabeled efficiency: 11.737 possible unlabeled arcs per token (8321862/709029) -I0224 17:50:10.556437 1114 SemanticPipe.h:340] Labeled precision: 0.95786 (405693/423541) -I0224 17:50:10.556442 1114 SemanticPipe.h:343] Labeled recall: 0.872852 (405693/464790) -I0224 17:50:10.556447 1114 SemanticPipe.h:346] Labeled F1: 0.913383 -I0224 17:50:10.556452 1114 SemanticPipe.h:347] Pruning labeled recall: 0.963876 (448000/464790) -I0224 17:50:10.556457 1114 SemanticPipe.h:352] Pruning labeled efficiency: 227.453 possible labeled arcs per token (161270895/709029) - diff --git a/semeval2014_data/README b/semeval2014_data/README new file mode 100644 index 0000000..b7200d2 --- /dev/null +++ b/semeval2014_data/README @@ -0,0 +1,37 @@ +To reproduce the SemEval 2014 paper [1]: + +1) Place the SemEval 2014 original data in folders "train" and "test". +The directory contents should be: + +train/sb.bn.cpn +train/dm.sdp +train/pas.sdp +train/pcedt.sdp +train/sb.berkeley.cpn + +test/dm.sdp +test/pas.sdp +test/pcedt.sdp +test/sb.berkeley.cpn +test/sb.bn.cpn + +2) Type: + +cd scripts +./generate_all_splits.sh + +This will create folders "dm", "pas", "pcedt" where the train/dev/test splits +will be stored. + +3) Type: + +cd ../../scripts_srl +./train_test_submission_closed.sh +./train_test_submission_open.sh + +It should take a few hours to train and run the semantic parsers. + + +[1] André F.T. Martins and Mariana S.C. Almeida (2014). +"Priberam: A Turbo Semantic Parser with Second Order Features." +Proc. of SemEval 2014 task 8 (Broad-Coverage Semantic Dependency Parsing).