-
Notifications
You must be signed in to change notification settings - Fork 4
/
Copy pathJPQ_MSRVTT_full.txt
3278 lines (3278 loc) · 231 KB
/
JPQ_MSRVTT_full.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
Experiment directory: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_full
Preparing the dataloaders ...
Loading dataset MSRVTT_full_train in ram ...
Finish loading dataset MSRVTT_full_train in ram, taking 217.36518692970276 s.
Loading dataset MSRVTT_full_val in ram ...
Finish loading dataset MSRVTT_full_val in ram, taking 14.611334800720215 s.
Loading dataset MSRVTT_full_test in ram ...
Finish loading dataset MSRVTT_full_test in ram, taking 98.4012598991394 s.
Loading dataset MSRVTT_full_test in ram ...
Experiment directory: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_full
Preparing the dataloaders ...
Loading dataset MSRVTT_full_train in ram ...
Finish loading dataset MSRVTT_full_train in ram, taking 211.6974995136261 s.
Loading dataset MSRVTT_full_val in ram ...
Finish loading dataset MSRVTT_full_val in ram, taking 17.992865085601807 s.
Loading dataset MSRVTT_full_test in ram ...
Finish loading dataset MSRVTT_full_test in ram, taking 106.69628286361694 s.
Loading dataset MSRVTT_full_test in ram ...
Finish loading dataset MSRVTT_full_test in ram, taking 53.96823215484619 s.
Training ...
Saving checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_full/checkpoint-epoch0.pth ...
Done in 1.371s
Updating 'best' checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_full/checkpoint-epoch0.pth ...
Done in 2.697s
epoch : 0
loss : 0
learning_rate : 5e-05
n_samples : 0
n_steps : 0
MSRVTT_full_val/t2v_metrics/R1: 0.2012072434607646
MSRVTT_full_val/t2v_metrics/R5: 0.4024144869215292
MSRVTT_full_val/t2v_metrics/R10: 1.2072434607645874
MSRVTT_full_val/t2v_metrics/R50: 9.859154929577464
MSRVTT_full_val/t2v_metrics/MedR: 240.0
MSRVTT_full_val/t2v_metrics/MeanR: 247.95774647887325
MSRVTT_full_val/t2v_metrics/geometric_mean_R1-R5-R10: 0.4606495945888659
MSRVTT_full_val/v2t_metrics/R1: 0.4024144869215292
MSRVTT_full_val/v2t_metrics/R5: 1.8108651911468814
MSRVTT_full_val/v2t_metrics/R10: 2.6156941649899395
MSRVTT_full_val/v2t_metrics/R50: 8.651911468812877
MSRVTT_full_val/v2t_metrics/MedR: 248.0
MSRVTT_full_val/v2t_metrics/MeanR: 249.13279678068412
MSRVTT_full_val/v2t_metrics/geometric_mean_R1-R5-R10: 1.2398873536718387
MSRVTT_full_test/t2v_metrics/R1: 0.033444816053511704
MSRVTT_full_test/t2v_metrics/R5: 0.10033444816053512
MSRVTT_full_test/t2v_metrics/R10: 0.20066889632107024
MSRVTT_full_test/t2v_metrics/R50: 1.806020066889632
MSRVTT_full_test/t2v_metrics/MedR: 1486.5
MSRVTT_full_test/t2v_metrics/MeanR: 1496.0063545150501
MSRVTT_full_test/t2v_metrics/geometric_mean_R1-R5-R10: 0.08765021385314037
MSRVTT_full_test/v2t_metrics/R1: 0.033444816053511704
MSRVTT_full_test/v2t_metrics/R5: 0.10033444816053512
MSRVTT_full_test/v2t_metrics/R10: 0.16722408026755853
MSRVTT_full_test/v2t_metrics/R50: 1.705685618729097
MSRVTT_full_test/v2t_metrics/MedR: 1462.0
MSRVTT_full_test/v2t_metrics/MeanR: 1493.7871237458194
MSRVTT_full_test/v2t_metrics/geometric_mean_R1-R5-R10: 0.08248200917493209
mnt_best : 0.08765021385314037
not_improved_count: 0
Train Epoch: 1 [1/250 128/32000 (0%)] Loss: 0.10266 (QuantReg: 0.14085) QuantErr: 0.14085 batch_time=28.77063
Train Epoch: 1 [12/250 1536/32000 (5%)] Loss: 0.09924 (QuantReg: 0.13802) QuantErr: 0.13802 batch_time=0.41313
Train Epoch: 1 [23/250 2944/32000 (9%)] Loss: 0.09521 (QuantReg: 0.13885) QuantErr: 0.13885 batch_time=0.41030
Train Epoch: 1 [34/250 4352/32000 (14%)] Loss: 0.08026 (QuantReg: 0.14070) QuantErr: 0.14070 batch_time=0.42695
Train Epoch: 1 [45/250 5760/32000 (18%)] Loss: 0.06360 (QuantReg: 0.13927) QuantErr: 0.13927 batch_time=0.43996
Train Epoch: 1 [56/250 7168/32000 (22%)] Loss: 0.05087 (QuantReg: 0.14004) QuantErr: 0.14004 batch_time=0.45513
Train Epoch: 1 [67/250 8576/32000 (27%)] Loss: 0.04538 (QuantReg: 0.13844) QuantErr: 0.13844 batch_time=0.42956
Train Epoch: 1 [78/250 9984/32000 (31%)] Loss: 0.03546 (QuantReg: 0.13887) QuantErr: 0.13887 batch_time=0.40936
Train Epoch: 1 [89/250 11392/32000 (36%)] Loss: 0.03656 (QuantReg: 0.13712) QuantErr: 0.13712 batch_time=0.41907
Train Epoch: 1 [100/250 12800/32000 (40%)] Loss: 0.03293 (QuantReg: 0.13854) QuantErr: 0.13854 batch_time=0.46113
Train Epoch: 1 [111/250 14208/32000 (44%)] Loss: 0.03036 (QuantReg: 0.13872) QuantErr: 0.13872 batch_time=0.83663
Train Epoch: 1 [122/250 15616/32000 (49%)] Loss: 0.02884 (QuantReg: 0.13710) QuantErr: 0.13710 batch_time=0.53509
Train Epoch: 1 [133/250 17024/32000 (53%)] Loss: 0.02718 (QuantReg: 0.13387) QuantErr: 0.13387 batch_time=0.58686
Train Epoch: 1 [144/250 18432/32000 (58%)] Loss: 0.02444 (QuantReg: 0.13529) QuantErr: 0.13529 batch_time=0.40951
Train Epoch: 1 [155/250 19840/32000 (62%)] Loss: 0.02837 (QuantReg: 0.13350) QuantErr: 0.13350 batch_time=0.41837
Train Epoch: 1 [166/250 21248/32000 (66%)] Loss: 0.02007 (QuantReg: 0.13642) QuantErr: 0.13642 batch_time=0.40631
Train Epoch: 1 [177/250 22656/32000 (71%)] Loss: 0.02916 (QuantReg: 0.13871) QuantErr: 0.13871 batch_time=0.45813
Train Epoch: 1 [188/250 24064/32000 (75%)] Loss: 0.02222 (QuantReg: 0.13644) QuantErr: 0.13644 batch_time=0.41396
Train Epoch: 1 [199/250 25472/32000 (80%)] Loss: 0.02203 (QuantReg: 0.13590) QuantErr: 0.13590 batch_time=0.42499
Train Epoch: 1 [210/250 26880/32000 (84%)] Loss: 0.01651 (QuantReg: 0.13649) QuantErr: 0.13649 batch_time=0.42005
Train Epoch: 1 [221/250 28288/32000 (88%)] Loss: 0.02045 (QuantReg: 0.13469) QuantErr: 0.13469 batch_time=0.41661
Train Epoch: 1 [232/250 29696/32000 (93%)] Loss: 0.01965 (QuantReg: 0.13766) QuantErr: 0.13766 batch_time=0.43747
Train Epoch: 1 [243/250 31104/32000 (97%)] Loss: 0.01807 (QuantReg: 0.13620) QuantErr: 0.13620 batch_time=0.44190
Saving checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_full/checkpoint-epoch1.pth ...
Done in 3.872s
Updating 'best' checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_full/checkpoint-epoch1.pth ...
Done in 7.572s
epoch : 1
loss : 0.0388739013671875
quant_reg : 0.13723494184017182
quant_err : 0.13723494184017182
learning_rate : 5e-05
n_samples : 32000
n_steps : 250
MSRVTT_full_val/t2v_metrics/R1: 6.237424547283702
MSRVTT_full_val/t2v_metrics/R5: 24.346076458752513
MSRVTT_full_val/t2v_metrics/R10: 41.24748490945674
MSRVTT_full_val/t2v_metrics/R50: 84.90945674044265
MSRVTT_full_val/t2v_metrics/MedR: 16.0
MSRVTT_full_val/t2v_metrics/MeanR: 28.327967806841045
MSRVTT_full_val/t2v_metrics/geometric_mean_R1-R5-R10: 18.433618126319118
MSRVTT_full_val/v2t_metrics/R1: 7.2434607645875255
MSRVTT_full_val/v2t_metrics/R5: 29.979879275653925
MSRVTT_full_val/v2t_metrics/R10: 45.47283702213279
MSRVTT_full_val/v2t_metrics/R50: 86.51911468812877
MSRVTT_full_val/v2t_metrics/MedR: 12.0
MSRVTT_full_val/v2t_metrics/MeanR: 26.030181086519114
MSRVTT_full_val/v2t_metrics/geometric_mean_R1-R5-R10: 21.45405291151144
MSRVTT_full_test/t2v_metrics/R1: 1.806020066889632
MSRVTT_full_test/t2v_metrics/R5: 6.622073578595318
MSRVTT_full_test/t2v_metrics/R10: 11.806020066889632
MSRVTT_full_test/t2v_metrics/R50: 37.324414715719065
MSRVTT_full_test/t2v_metrics/MedR: 86.0
MSRVTT_full_test/t2v_metrics/MeanR: 163.21839464882945
MSRVTT_full_test/t2v_metrics/geometric_mean_R1-R5-R10: 5.207229235340729
MSRVTT_full_test/v2t_metrics/R1: 1.6722408026755853
MSRVTT_full_test/v2t_metrics/R5: 8.060200668896321
MSRVTT_full_test/v2t_metrics/R10: 14.147157190635452
MSRVTT_full_test/v2t_metrics/R50: 41.67224080267559
MSRVTT_full_test/v2t_metrics/MedR: 68.0
MSRVTT_full_test/v2t_metrics/MeanR: 148.54882943143812
MSRVTT_full_test/v2t_metrics/geometric_mean_R1-R5-R10: 5.755785707533093
mnt_best : 5.207229235340729
not_improved_count: 0
Train Epoch: 2 [1/250 128/32000 (0%)] Loss: 0.01566 (QuantReg: 0.13633) QuantErr: 0.13633 batch_time=37.47107
Train Epoch: 2 [12/250 1536/32000 (5%)] Loss: 0.02530 (QuantReg: 0.13729) QuantErr: 0.13729 batch_time=0.42947
Train Epoch: 2 [23/250 2944/32000 (9%)] Loss: 0.01466 (QuantReg: 0.13659) QuantErr: 0.13659 batch_time=0.40573
Train Epoch: 2 [34/250 4352/32000 (14%)] Loss: 0.01605 (QuantReg: 0.13520) QuantErr: 0.13520 batch_time=0.40388
Train Epoch: 2 [45/250 5760/32000 (18%)] Loss: 0.02158 (QuantReg: 0.13925) QuantErr: 0.13925 batch_time=0.41767
Train Epoch: 2 [56/250 7168/32000 (22%)] Loss: 0.01892 (QuantReg: 0.13634) QuantErr: 0.13634 batch_time=0.41906
Train Epoch: 2 [67/250 8576/32000 (27%)] Loss: 0.01846 (QuantReg: 0.13478) QuantErr: 0.13478 batch_time=0.42248
Train Epoch: 2 [78/250 9984/32000 (31%)] Loss: 0.01663 (QuantReg: 0.13576) QuantErr: 0.13576 batch_time=0.41293
Train Epoch: 2 [89/250 11392/32000 (36%)] Loss: 0.01453 (QuantReg: 0.13838) QuantErr: 0.13838 batch_time=0.85529
Train Epoch: 2 [100/250 12800/32000 (40%)] Loss: 0.01240 (QuantReg: 0.13631) QuantErr: 0.13631 batch_time=0.40585
Train Epoch: 2 [111/250 14208/32000 (44%)] Loss: 0.01416 (QuantReg: 0.13831) QuantErr: 0.13831 batch_time=0.42658
Train Epoch: 2 [122/250 15616/32000 (49%)] Loss: 0.01584 (QuantReg: 0.13656) QuantErr: 0.13656 batch_time=0.42465
Train Epoch: 2 [133/250 17024/32000 (53%)] Loss: 0.01401 (QuantReg: 0.13798) QuantErr: 0.13798 batch_time=0.41912
Train Epoch: 2 [144/250 18432/32000 (58%)] Loss: 0.01297 (QuantReg: 0.13895) QuantErr: 0.13895 batch_time=2.03916
Train Epoch: 2 [155/250 19840/32000 (62%)] Loss: 0.01201 (QuantReg: 0.13696) QuantErr: 0.13696 batch_time=0.42498
Train Epoch: 2 [166/250 21248/32000 (66%)] Loss: 0.02020 (QuantReg: 0.13458) QuantErr: 0.13458 batch_time=0.41245
Train Epoch: 2 [177/250 22656/32000 (71%)] Loss: 0.01770 (QuantReg: 0.13506) QuantErr: 0.13506 batch_time=0.41917
Train Epoch: 2 [188/250 24064/32000 (75%)] Loss: 0.01254 (QuantReg: 0.13451) QuantErr: 0.13451 batch_time=0.43627
Train Epoch: 2 [199/250 25472/32000 (80%)] Loss: 0.01552 (QuantReg: 0.13624) QuantErr: 0.13624 batch_time=0.40420
Train Epoch: 2 [210/250 26880/32000 (84%)] Loss: 0.01639 (QuantReg: 0.13602) QuantErr: 0.13602 batch_time=0.41065
Train Epoch: 2 [221/250 28288/32000 (88%)] Loss: 0.01306 (QuantReg: 0.13699) QuantErr: 0.13699 batch_time=0.42130
Train Epoch: 2 [232/250 29696/32000 (93%)] Loss: 0.01559 (QuantReg: 0.13553) QuantErr: 0.13553 batch_time=0.54766
Train Epoch: 2 [243/250 31104/32000 (97%)] Loss: 0.01337 (QuantReg: 0.13634) QuantErr: 0.13634 batch_time=0.40763
Saving checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_full/checkpoint-epoch2.pth ...
Done in 3.816s
Updating 'best' checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_full/checkpoint-epoch2.pth ...
Done in 7.525s
removing stale ckpt [epoch 1] [took 0.00s]
removing stale ckpt [epoch 0] [took 0.00s]
epoch : 2
loss : 0.016006423950195314
quant_reg : 0.13628272491693497
quant_err : 0.13628272491693497
learning_rate : 4.75e-05
n_samples : 64000
n_steps : 500
MSRVTT_full_val/t2v_metrics/R1: 9.6579476861167
MSRVTT_full_val/t2v_metrics/R5: 35.61368209255533
MSRVTT_full_val/t2v_metrics/R10: 53.31991951710262
MSRVTT_full_val/t2v_metrics/R50: 90.14084507042253
MSRVTT_full_val/t2v_metrics/MedR: 10.0
MSRVTT_full_val/t2v_metrics/MeanR: 19.227364185110662
MSRVTT_full_val/t2v_metrics/geometric_mean_R1-R5-R10: 26.37123105106504
MSRVTT_full_val/v2t_metrics/R1: 12.474849094567404
MSRVTT_full_val/v2t_metrics/R5: 39.03420523138833
MSRVTT_full_val/v2t_metrics/R10: 57.74647887323944
MSRVTT_full_val/v2t_metrics/R50: 92.95774647887323
MSRVTT_full_val/v2t_metrics/MedR: 8.0
MSRVTT_full_val/v2t_metrics/MeanR: 16.663983903420522
MSRVTT_full_val/v2t_metrics/geometric_mean_R1-R5-R10: 30.4089937951046
MSRVTT_full_test/t2v_metrics/R1: 3.3444816053511706
MSRVTT_full_test/t2v_metrics/R5: 11.103678929765886
MSRVTT_full_test/t2v_metrics/R10: 17.959866220735787
MSRVTT_full_test/t2v_metrics/R50: 50.903010033444815
MSRVTT_full_test/t2v_metrics/MedR: 49.0
MSRVTT_full_test/t2v_metrics/MeanR: 108.29331103678929
MSRVTT_full_test/t2v_metrics/geometric_mean_R1-R5-R10: 8.73707911178362
MSRVTT_full_test/v2t_metrics/R1: 3.6454849498327757
MSRVTT_full_test/v2t_metrics/R5: 12.474916387959865
MSRVTT_full_test/v2t_metrics/R10: 21.505016722408026
MSRVTT_full_test/v2t_metrics/R50: 55.45150501672241
MSRVTT_full_test/v2t_metrics/MedR: 42.0
MSRVTT_full_test/v2t_metrics/MeanR: 95.86688963210702
MSRVTT_full_test/v2t_metrics/geometric_mean_R1-R5-R10: 9.926075614653227
mnt_best : 8.73707911178362
not_improved_count: 0
Train Epoch: 3 [1/250 128/32000 (0%)] Loss: 0.01253 (QuantReg: 0.13341) QuantErr: 0.13341 batch_time=33.45087
Train Epoch: 3 [12/250 1536/32000 (5%)] Loss: 0.01060 (QuantReg: 0.13862) QuantErr: 0.13862 batch_time=0.43376
Train Epoch: 3 [23/250 2944/32000 (9%)] Loss: 0.01500 (QuantReg: 0.13503) QuantErr: 0.13503 batch_time=0.44092
Train Epoch: 3 [34/250 4352/32000 (14%)] Loss: 0.01086 (QuantReg: 0.13605) QuantErr: 0.13605 batch_time=0.42564
Train Epoch: 3 [45/250 5760/32000 (18%)] Loss: 0.01105 (QuantReg: 0.13635) QuantErr: 0.13635 batch_time=0.41720
Train Epoch: 3 [56/250 7168/32000 (22%)] Loss: 0.00971 (QuantReg: 0.13700) QuantErr: 0.13700 batch_time=0.47050
Train Epoch: 3 [67/250 8576/32000 (27%)] Loss: 0.01350 (QuantReg: 0.13464) QuantErr: 0.13464 batch_time=0.42067
Train Epoch: 3 [78/250 9984/32000 (31%)] Loss: 0.01714 (QuantReg: 0.13432) QuantErr: 0.13432 batch_time=0.42014
Train Epoch: 3 [89/250 11392/32000 (36%)] Loss: 0.01260 (QuantReg: 0.13663) QuantErr: 0.13663 batch_time=0.43863
Train Epoch: 3 [100/250 12800/32000 (40%)] Loss: 0.01418 (QuantReg: 0.13390) QuantErr: 0.13390 batch_time=0.42301
Train Epoch: 3 [111/250 14208/32000 (44%)] Loss: 0.01363 (QuantReg: 0.13679) QuantErr: 0.13679 batch_time=0.44218
Train Epoch: 3 [122/250 15616/32000 (49%)] Loss: 0.00887 (QuantReg: 0.13401) QuantErr: 0.13401 batch_time=0.46466
Train Epoch: 3 [133/250 17024/32000 (53%)] Loss: 0.01254 (QuantReg: 0.13517) QuantErr: 0.13517 batch_time=2.86594
Train Epoch: 3 [144/250 18432/32000 (58%)] Loss: 0.01054 (QuantReg: 0.13682) QuantErr: 0.13682 batch_time=0.48104
Train Epoch: 3 [155/250 19840/32000 (62%)] Loss: 0.01285 (QuantReg: 0.13423) QuantErr: 0.13423 batch_time=0.43272
Train Epoch: 3 [166/250 21248/32000 (66%)] Loss: 0.00864 (QuantReg: 0.13370) QuantErr: 0.13370 batch_time=0.44418
Train Epoch: 3 [177/250 22656/32000 (71%)] Loss: 0.01013 (QuantReg: 0.13301) QuantErr: 0.13301 batch_time=0.45482
Train Epoch: 3 [188/250 24064/32000 (75%)] Loss: 0.01283 (QuantReg: 0.13543) QuantErr: 0.13543 batch_time=0.44783
Train Epoch: 3 [199/250 25472/32000 (80%)] Loss: 0.01160 (QuantReg: 0.13492) QuantErr: 0.13492 batch_time=0.42941
Train Epoch: 3 [210/250 26880/32000 (84%)] Loss: 0.00822 (QuantReg: 0.13401) QuantErr: 0.13401 batch_time=0.42276
Train Epoch: 3 [221/250 28288/32000 (88%)] Loss: 0.01064 (QuantReg: 0.13549) QuantErr: 0.13549 batch_time=0.42215
Train Epoch: 3 [232/250 29696/32000 (93%)] Loss: 0.01180 (QuantReg: 0.13399) QuantErr: 0.13399 batch_time=0.44202
Train Epoch: 3 [243/250 31104/32000 (97%)] Loss: 0.00919 (QuantReg: 0.13277) QuantErr: 0.13277 batch_time=0.42062
Saving checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_full/checkpoint-epoch3.pth ...
Done in 3.578s
Updating 'best' checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_full/checkpoint-epoch3.pth ...
Done in 6.859s
removing stale ckpt [epoch 2] [took 0.31s]
epoch : 3
loss : 0.01211529541015625
quant_reg : 0.13510741955041886
quant_err : 0.13510741955041886
learning_rate : 4.5125e-05
n_samples : 96000
n_steps : 750
MSRVTT_full_val/t2v_metrics/R1: 12.474849094567404
MSRVTT_full_val/t2v_metrics/R5: 45.87525150905432
MSRVTT_full_val/t2v_metrics/R10: 62.776659959758554
MSRVTT_full_val/t2v_metrics/R50: 95.37223340040241
MSRVTT_full_val/t2v_metrics/MedR: 6.0
MSRVTT_full_val/t2v_metrics/MeanR: 14.585513078470825
MSRVTT_full_val/t2v_metrics/geometric_mean_R1-R5-R10: 32.99671113182316
MSRVTT_full_val/v2t_metrics/R1: 13.682092555331993
MSRVTT_full_val/v2t_metrics/R5: 47.88732394366197
MSRVTT_full_val/v2t_metrics/R10: 68.00804828973843
MSRVTT_full_val/v2t_metrics/R50: 94.76861167002012
MSRVTT_full_val/v2t_metrics/MedR: 6.0
MSRVTT_full_val/v2t_metrics/MeanR: 13.722334004024145
MSRVTT_full_val/v2t_metrics/geometric_mean_R1-R5-R10: 35.45230426663663
MSRVTT_full_test/t2v_metrics/R1: 4.147157190635451
MSRVTT_full_test/t2v_metrics/R5: 15.518394648829432
MSRVTT_full_test/t2v_metrics/R10: 24.013377926421406
MSRVTT_full_test/t2v_metrics/R50: 60.635451505016725
MSRVTT_full_test/t2v_metrics/MedR: 34.0
MSRVTT_full_test/t2v_metrics/MeanR: 82.19297658862877
MSRVTT_full_test/t2v_metrics/geometric_mean_R1-R5-R10: 11.561570941018749
MSRVTT_full_test/v2t_metrics/R1: 3.879598662207358
MSRVTT_full_test/v2t_metrics/R5: 16.387959866220736
MSRVTT_full_test/v2t_metrics/R10: 26.65551839464883
MSRVTT_full_test/v2t_metrics/R50: 63.57859531772575
MSRVTT_full_test/v2t_metrics/MedR: 29.0
MSRVTT_full_test/v2t_metrics/MeanR: 73.64598662207358
MSRVTT_full_test/v2t_metrics/geometric_mean_R1-R5-R10: 11.922471013419765
mnt_best : 11.561570941018749
not_improved_count: 0
Train Epoch: 4 [1/250 128/32000 (0%)] Loss: 0.01155 (QuantReg: 0.13384) QuantErr: 0.13384 batch_time=30.59860
Train Epoch: 4 [12/250 1536/32000 (5%)] Loss: 0.01061 (QuantReg: 0.13819) QuantErr: 0.13819 batch_time=0.41859
Train Epoch: 4 [23/250 2944/32000 (9%)] Loss: 0.01285 (QuantReg: 0.13446) QuantErr: 0.13446 batch_time=0.48541
Train Epoch: 4 [34/250 4352/32000 (14%)] Loss: 0.01006 (QuantReg: 0.13472) QuantErr: 0.13472 batch_time=0.45443
Train Epoch: 4 [45/250 5760/32000 (18%)] Loss: 0.00916 (QuantReg: 0.13493) QuantErr: 0.13493 batch_time=0.41670
Train Epoch: 4 [56/250 7168/32000 (22%)] Loss: 0.01132 (QuantReg: 0.13288) QuantErr: 0.13288 batch_time=0.42111
Train Epoch: 4 [67/250 8576/32000 (27%)] Loss: 0.01250 (QuantReg: 0.13635) QuantErr: 0.13635 batch_time=0.43494
Train Epoch: 4 [78/250 9984/32000 (31%)] Loss: 0.00887 (QuantReg: 0.13409) QuantErr: 0.13409 batch_time=0.43651
Train Epoch: 4 [89/250 11392/32000 (36%)] Loss: 0.01027 (QuantReg: 0.13392) QuantErr: 0.13392 batch_time=0.42680
Train Epoch: 4 [100/250 12800/32000 (40%)] Loss: 0.01073 (QuantReg: 0.13427) QuantErr: 0.13427 batch_time=0.43775
Train Epoch: 4 [111/250 14208/32000 (44%)] Loss: 0.00967 (QuantReg: 0.13521) QuantErr: 0.13521 batch_time=0.41947
Train Epoch: 4 [122/250 15616/32000 (49%)] Loss: 0.01186 (QuantReg: 0.13596) QuantErr: 0.13596 batch_time=0.48048
Train Epoch: 4 [133/250 17024/32000 (53%)] Loss: 0.01405 (QuantReg: 0.13230) QuantErr: 0.13230 batch_time=0.41739
Train Epoch: 4 [144/250 18432/32000 (58%)] Loss: 0.01564 (QuantReg: 0.13360) QuantErr: 0.13360 batch_time=3.92669
Train Epoch: 4 [155/250 19840/32000 (62%)] Loss: 0.01151 (QuantReg: 0.13347) QuantErr: 0.13347 batch_time=0.45414
Train Epoch: 4 [166/250 21248/32000 (66%)] Loss: 0.01089 (QuantReg: 0.13484) QuantErr: 0.13484 batch_time=0.42004
Train Epoch: 4 [177/250 22656/32000 (71%)] Loss: 0.01151 (QuantReg: 0.13490) QuantErr: 0.13490 batch_time=0.43869
Train Epoch: 4 [188/250 24064/32000 (75%)] Loss: 0.00903 (QuantReg: 0.13611) QuantErr: 0.13611 batch_time=0.42883
Train Epoch: 4 [199/250 25472/32000 (80%)] Loss: 0.00793 (QuantReg: 0.13711) QuantErr: 0.13711 batch_time=1.22904
Train Epoch: 4 [210/250 26880/32000 (84%)] Loss: 0.01165 (QuantReg: 0.13417) QuantErr: 0.13417 batch_time=0.43223
Train Epoch: 4 [221/250 28288/32000 (88%)] Loss: 0.00744 (QuantReg: 0.13632) QuantErr: 0.13632 batch_time=0.42548
Train Epoch: 4 [232/250 29696/32000 (93%)] Loss: 0.00932 (QuantReg: 0.13716) QuantErr: 0.13716 batch_time=0.43068
Train Epoch: 4 [243/250 31104/32000 (97%)] Loss: 0.00781 (QuantReg: 0.13581) QuantErr: 0.13581 batch_time=0.43745
Saving checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_full/checkpoint-epoch4.pth ...
Done in 3.868s
Updating 'best' checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_full/checkpoint-epoch4.pth ...
Done in 7.423s
removing stale ckpt [epoch 3] [took 0.00s]
epoch : 4
loss : 0.010452835083007813
quant_reg : 0.1350173153281212
quant_err : 0.1350173153281212
learning_rate : 4.2868749999999995e-05
n_samples : 128000
n_steps : 1000
MSRVTT_full_val/t2v_metrics/R1: 15.694164989939638
MSRVTT_full_val/t2v_metrics/R5: 43.86317907444668
MSRVTT_full_val/t2v_metrics/R10: 63.58148893360161
MSRVTT_full_val/t2v_metrics/R50: 94.56740442655935
MSRVTT_full_val/t2v_metrics/MedR: 7.0
MSRVTT_full_val/t2v_metrics/MeanR: 14.3158953722334
MSRVTT_full_val/t2v_metrics/geometric_mean_R1-R5-R10: 35.241658427972446
MSRVTT_full_val/v2t_metrics/R1: 15.694164989939638
MSRVTT_full_val/v2t_metrics/R5: 49.496981891348085
MSRVTT_full_val/v2t_metrics/R10: 68.2092555331992
MSRVTT_full_val/v2t_metrics/R50: 95.97585513078471
MSRVTT_full_val/v2t_metrics/MedR: 6.0
MSRVTT_full_val/v2t_metrics/MeanR: 13.283702213279678
MSRVTT_full_val/v2t_metrics/geometric_mean_R1-R5-R10: 37.55952407595598
MSRVTT_full_test/t2v_metrics/R1: 4.214046822742475
MSRVTT_full_test/t2v_metrics/R5: 15.384615384615385
MSRVTT_full_test/t2v_metrics/R10: 26.02006688963211
MSRVTT_full_test/t2v_metrics/R50: 61.77257525083612
MSRVTT_full_test/t2v_metrics/MedR: 31.0
MSRVTT_full_test/t2v_metrics/MeanR: 77.37224080267559
MSRVTT_full_test/t2v_metrics/geometric_mean_R1-R5-R10: 11.904143028017932
MSRVTT_full_test/v2t_metrics/R1: 5.117056856187291
MSRVTT_full_test/v2t_metrics/R5: 18.22742474916388
MSRVTT_full_test/v2t_metrics/R10: 29.331103678929765
MSRVTT_full_test/v2t_metrics/R50: 66.45484949832776
MSRVTT_full_test/v2t_metrics/MedR: 27.0
MSRVTT_full_test/v2t_metrics/MeanR: 67.93645484949833
MSRVTT_full_test/v2t_metrics/geometric_mean_R1-R5-R10: 13.985929041709772
mnt_best : 11.904143028017932
not_improved_count: 0
Train Epoch: 5 [1/250 128/32000 (0%)] Loss: 0.00874 (QuantReg: 0.13551) QuantErr: 0.13551 batch_time=33.97293
Train Epoch: 5 [12/250 1536/32000 (5%)] Loss: 0.00608 (QuantReg: 0.13416) QuantErr: 0.13416 batch_time=0.43339
Train Epoch: 5 [23/250 2944/32000 (9%)] Loss: 0.00854 (QuantReg: 0.13524) QuantErr: 0.13524 batch_time=0.41802
Train Epoch: 5 [34/250 4352/32000 (14%)] Loss: 0.01036 (QuantReg: 0.13684) QuantErr: 0.13684 batch_time=0.42070
Train Epoch: 5 [45/250 5760/32000 (18%)] Loss: 0.01196 (QuantReg: 0.13547) QuantErr: 0.13547 batch_time=0.41057
Train Epoch: 5 [56/250 7168/32000 (22%)] Loss: 0.01059 (QuantReg: 0.13459) QuantErr: 0.13459 batch_time=0.44381
Train Epoch: 5 [67/250 8576/32000 (27%)] Loss: 0.01013 (QuantReg: 0.13693) QuantErr: 0.13693 batch_time=0.42809
Train Epoch: 5 [78/250 9984/32000 (31%)] Loss: 0.01320 (QuantReg: 0.13368) QuantErr: 0.13368 batch_time=0.45618
Train Epoch: 5 [89/250 11392/32000 (36%)] Loss: 0.00742 (QuantReg: 0.13475) QuantErr: 0.13475 batch_time=0.44965
Train Epoch: 5 [100/250 12800/32000 (40%)] Loss: 0.01286 (QuantReg: 0.13571) QuantErr: 0.13571 batch_time=0.45112
Train Epoch: 5 [111/250 14208/32000 (44%)] Loss: 0.00755 (QuantReg: 0.13666) QuantErr: 0.13666 batch_time=0.44220
Train Epoch: 5 [122/250 15616/32000 (49%)] Loss: 0.01175 (QuantReg: 0.13674) QuantErr: 0.13674 batch_time=0.42724
Train Epoch: 5 [133/250 17024/32000 (53%)] Loss: 0.00777 (QuantReg: 0.13544) QuantErr: 0.13544 batch_time=1.62501
Train Epoch: 5 [144/250 18432/32000 (58%)] Loss: 0.00920 (QuantReg: 0.13737) QuantErr: 0.13737 batch_time=0.43059
Train Epoch: 5 [155/250 19840/32000 (62%)] Loss: 0.00759 (QuantReg: 0.13569) QuantErr: 0.13569 batch_time=0.44260
Train Epoch: 5 [166/250 21248/32000 (66%)] Loss: 0.00798 (QuantReg: 0.13748) QuantErr: 0.13748 batch_time=0.42352
Train Epoch: 5 [177/250 22656/32000 (71%)] Loss: 0.00944 (QuantReg: 0.13737) QuantErr: 0.13737 batch_time=0.44893
Train Epoch: 5 [188/250 24064/32000 (75%)] Loss: 0.00692 (QuantReg: 0.13735) QuantErr: 0.13735 batch_time=0.67915
Train Epoch: 5 [199/250 25472/32000 (80%)] Loss: 0.00885 (QuantReg: 0.13613) QuantErr: 0.13613 batch_time=0.43935
Train Epoch: 5 [210/250 26880/32000 (84%)] Loss: 0.00993 (QuantReg: 0.13731) QuantErr: 0.13731 batch_time=0.45126
Train Epoch: 5 [221/250 28288/32000 (88%)] Loss: 0.01174 (QuantReg: 0.13401) QuantErr: 0.13401 batch_time=0.42931
Train Epoch: 5 [232/250 29696/32000 (93%)] Loss: 0.01120 (QuantReg: 0.13649) QuantErr: 0.13649 batch_time=0.41578
Train Epoch: 5 [243/250 31104/32000 (97%)] Loss: 0.00624 (QuantReg: 0.13564) QuantErr: 0.13564 batch_time=0.41972
Saving checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_full/checkpoint-epoch5.pth ...
Done in 14.796s
Updating 'best' checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_full/checkpoint-epoch5.pth ...
Done in 18.484s
removing stale ckpt [epoch 4] [took 0.00s]
epoch : 5
loss : 0.00920770263671875
quant_reg : 0.13603034764528274
quant_err : 0.13603034764528274
learning_rate : 4.072531249999999e-05
n_samples : 160000
n_steps : 1250
MSRVTT_full_val/t2v_metrics/R1: 15.090543259557345
MSRVTT_full_val/t2v_metrics/R5: 47.686116700201204
MSRVTT_full_val/t2v_metrics/R10: 66.39839034205231
MSRVTT_full_val/t2v_metrics/R50: 94.16498993963782
MSRVTT_full_val/t2v_metrics/MedR: 6.0
MSRVTT_full_val/t2v_metrics/MeanR: 13.561368209255534
MSRVTT_full_val/t2v_metrics/geometric_mean_R1-R5-R10: 36.28703311295852
MSRVTT_full_val/v2t_metrics/R1: 19.517102615694164
MSRVTT_full_val/v2t_metrics/R5: 51.7102615694165
MSRVTT_full_val/v2t_metrics/R10: 68.81287726358148
MSRVTT_full_val/v2t_metrics/R50: 95.57344064386318
MSRVTT_full_val/v2t_metrics/MedR: 5.0
MSRVTT_full_val/v2t_metrics/MeanR: 12.122736418511066
MSRVTT_full_val/v2t_metrics/geometric_mean_R1-R5-R10: 41.10430086913212
MSRVTT_full_test/t2v_metrics/R1: 5.68561872909699
MSRVTT_full_test/t2v_metrics/R5: 17.892976588628763
MSRVTT_full_test/t2v_metrics/R10: 27.959866220735787
MSRVTT_full_test/t2v_metrics/R50: 63.812709030100336
MSRVTT_full_test/t2v_metrics/MedR: 29.0
MSRVTT_full_test/t2v_metrics/MeanR: 73.09615384615384
MSRVTT_full_test/t2v_metrics/geometric_mean_R1-R5-R10: 14.168758737492707
MSRVTT_full_test/v2t_metrics/R1: 5.451505016722408
MSRVTT_full_test/v2t_metrics/R5: 20.066889632107024
MSRVTT_full_test/v2t_metrics/R10: 31.137123745819398
MSRVTT_full_test/v2t_metrics/R50: 68.56187290969899
MSRVTT_full_test/v2t_metrics/MedR: 23.0
MSRVTT_full_test/v2t_metrics/MeanR: 62.832107023411375
MSRVTT_full_test/v2t_metrics/geometric_mean_R1-R5-R10: 15.046136250652742
mnt_best : 14.168758737492707
not_improved_count: 0
Train Epoch: 6 [1/250 128/32000 (0%)] Loss: 0.00865 (QuantReg: 0.13513) QuantErr: 0.13513 batch_time=32.31959
Train Epoch: 6 [12/250 1536/32000 (5%)] Loss: 0.01135 (QuantReg: 0.13597) QuantErr: 0.13597 batch_time=1.14959
Train Epoch: 6 [23/250 2944/32000 (9%)] Loss: 0.00826 (QuantReg: 0.13488) QuantErr: 0.13488 batch_time=0.42836
Train Epoch: 6 [34/250 4352/32000 (14%)] Loss: 0.01044 (QuantReg: 0.13607) QuantErr: 0.13607 batch_time=0.40855
Train Epoch: 6 [45/250 5760/32000 (18%)] Loss: 0.00964 (QuantReg: 0.13559) QuantErr: 0.13559 batch_time=0.41384
Train Epoch: 6 [56/250 7168/32000 (22%)] Loss: 0.00941 (QuantReg: 0.13865) QuantErr: 0.13865 batch_time=0.43603
Train Epoch: 6 [67/250 8576/32000 (27%)] Loss: 0.00683 (QuantReg: 0.13529) QuantErr: 0.13529 batch_time=4.45451
Train Epoch: 6 [78/250 9984/32000 (31%)] Loss: 0.00867 (QuantReg: 0.13517) QuantErr: 0.13517 batch_time=0.41619
Train Epoch: 6 [89/250 11392/32000 (36%)] Loss: 0.00900 (QuantReg: 0.13463) QuantErr: 0.13463 batch_time=0.44213
Train Epoch: 6 [100/250 12800/32000 (40%)] Loss: 0.00671 (QuantReg: 0.13648) QuantErr: 0.13648 batch_time=0.71251
Train Epoch: 6 [111/250 14208/32000 (44%)] Loss: 0.00702 (QuantReg: 0.13590) QuantErr: 0.13590 batch_time=0.41047
Train Epoch: 6 [122/250 15616/32000 (49%)] Loss: 0.00935 (QuantReg: 0.13676) QuantErr: 0.13676 batch_time=0.40620
Train Epoch: 6 [133/250 17024/32000 (53%)] Loss: 0.01518 (QuantReg: 0.13460) QuantErr: 0.13460 batch_time=0.41544
Train Epoch: 6 [144/250 18432/32000 (58%)] Loss: 0.00677 (QuantReg: 0.13347) QuantErr: 0.13347 batch_time=2.65052
Train Epoch: 6 [155/250 19840/32000 (62%)] Loss: 0.00608 (QuantReg: 0.13395) QuantErr: 0.13395 batch_time=0.42695
Train Epoch: 6 [166/250 21248/32000 (66%)] Loss: 0.00729 (QuantReg: 0.13489) QuantErr: 0.13489 batch_time=0.41845
Train Epoch: 6 [177/250 22656/32000 (71%)] Loss: 0.01131 (QuantReg: 0.13513) QuantErr: 0.13513 batch_time=0.41901
Train Epoch: 6 [188/250 24064/32000 (75%)] Loss: 0.00694 (QuantReg: 0.13662) QuantErr: 0.13662 batch_time=0.41769
Train Epoch: 6 [199/250 25472/32000 (80%)] Loss: 0.00569 (QuantReg: 0.13647) QuantErr: 0.13647 batch_time=0.41562
Train Epoch: 6 [210/250 26880/32000 (84%)] Loss: 0.00737 (QuantReg: 0.13897) QuantErr: 0.13897 batch_time=0.41778
Train Epoch: 6 [221/250 28288/32000 (88%)] Loss: 0.00687 (QuantReg: 0.13525) QuantErr: 0.13525 batch_time=0.41865
Train Epoch: 6 [232/250 29696/32000 (93%)] Loss: 0.00959 (QuantReg: 0.13595) QuantErr: 0.13595 batch_time=0.41433
Train Epoch: 6 [243/250 31104/32000 (97%)] Loss: 0.00604 (QuantReg: 0.13640) QuantErr: 0.13640 batch_time=0.41887
Saving checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_full/checkpoint-epoch6.pth ...
Done in 8.713s
removing stale ckpt [epoch 5] [took 0.00s]
epoch : 6
loss : 0.008135498046875
quant_reg : 0.13588493889570236
quant_err : 0.13588493889570236
learning_rate : 3.868904687499999e-05
n_samples : 192000
n_steps : 1500
MSRVTT_full_val/t2v_metrics/R1: 14.88933601609658
MSRVTT_full_val/t2v_metrics/R5: 44.46680080482897
MSRVTT_full_val/t2v_metrics/R10: 62.374245472837025
MSRVTT_full_val/t2v_metrics/R50: 94.56740442655935
MSRVTT_full_val/t2v_metrics/MedR: 7.0
MSRVTT_full_val/t2v_metrics/MeanR: 13.818913480885312
MSRVTT_full_val/t2v_metrics/geometric_mean_R1-R5-R10: 34.565181393953026
MSRVTT_full_val/v2t_metrics/R1: 21.52917505030181
MSRVTT_full_val/v2t_metrics/R5: 54.32595573440644
MSRVTT_full_val/v2t_metrics/R10: 72.03219315895372
MSRVTT_full_val/v2t_metrics/R50: 95.57344064386318
MSRVTT_full_val/v2t_metrics/MedR: 5.0
MSRVTT_full_val/v2t_metrics/MeanR: 12.146881287726359
MSRVTT_full_val/v2t_metrics/geometric_mean_R1-R5-R10: 43.83830973193508
MSRVTT_full_test/t2v_metrics/R1: 5.117056856187291
MSRVTT_full_test/t2v_metrics/R5: 18.494983277591974
MSRVTT_full_test/t2v_metrics/R10: 28.762541806020067
MSRVTT_full_test/t2v_metrics/R50: 66.22073578595318
MSRVTT_full_test/t2v_metrics/MedR: 27.0
MSRVTT_full_test/t2v_metrics/MeanR: 70.69598662207358
MSRVTT_full_test/t2v_metrics/geometric_mean_R1-R5-R10: 13.962627421362493
MSRVTT_full_test/v2t_metrics/R1: 6.120401337792642
MSRVTT_full_test/v2t_metrics/R5: 21.505016722408026
MSRVTT_full_test/v2t_metrics/R10: 33.979933110367895
MSRVTT_full_test/v2t_metrics/R50: 71.03678929765886
MSRVTT_full_test/v2t_metrics/MedR: 21.0
MSRVTT_full_test/v2t_metrics/MeanR: 60.78260869565217
MSRVTT_full_test/v2t_metrics/geometric_mean_R1-R5-R10: 16.475833781647236
mnt_best : 14.168758737492707
not_improved_count: 1
Train Epoch: 7 [1/250 128/32000 (0%)] Loss: 0.00870 (QuantReg: 0.13577) QuantErr: 0.13577 batch_time=42.38554
Train Epoch: 7 [12/250 1536/32000 (5%)] Loss: 0.00832 (QuantReg: 0.13464) QuantErr: 0.13464 batch_time=0.42698
Train Epoch: 7 [23/250 2944/32000 (9%)] Loss: 0.00996 (QuantReg: 0.13373) QuantErr: 0.13373 batch_time=0.44229
Train Epoch: 7 [34/250 4352/32000 (14%)] Loss: 0.00903 (QuantReg: 0.13290) QuantErr: 0.13290 batch_time=0.44796
Train Epoch: 7 [45/250 5760/32000 (18%)] Loss: 0.00572 (QuantReg: 0.13294) QuantErr: 0.13294 batch_time=0.41595
Train Epoch: 7 [56/250 7168/32000 (22%)] Loss: 0.00877 (QuantReg: 0.13443) QuantErr: 0.13443 batch_time=0.42122
Train Epoch: 7 [67/250 8576/32000 (27%)] Loss: 0.00750 (QuantReg: 0.13537) QuantErr: 0.13537 batch_time=1.61495
Train Epoch: 7 [78/250 9984/32000 (31%)] Loss: 0.00602 (QuantReg: 0.13409) QuantErr: 0.13409 batch_time=0.42122
Train Epoch: 7 [89/250 11392/32000 (36%)] Loss: 0.00569 (QuantReg: 0.13669) QuantErr: 0.13669 batch_time=0.42909
Train Epoch: 7 [100/250 12800/32000 (40%)] Loss: 0.00894 (QuantReg: 0.13485) QuantErr: 0.13485 batch_time=0.44725
Train Epoch: 7 [111/250 14208/32000 (44%)] Loss: 0.00757 (QuantReg: 0.13328) QuantErr: 0.13328 batch_time=0.45966
Train Epoch: 7 [122/250 15616/32000 (49%)] Loss: 0.00595 (QuantReg: 0.13511) QuantErr: 0.13511 batch_time=0.41950
Train Epoch: 7 [133/250 17024/32000 (53%)] Loss: 0.00740 (QuantReg: 0.13625) QuantErr: 0.13625 batch_time=0.40953
Train Epoch: 7 [144/250 18432/32000 (58%)] Loss: 0.00667 (QuantReg: 0.13409) QuantErr: 0.13409 batch_time=0.42697
Train Epoch: 7 [155/250 19840/32000 (62%)] Loss: 0.00917 (QuantReg: 0.13830) QuantErr: 0.13830 batch_time=0.42050
Train Epoch: 7 [166/250 21248/32000 (66%)] Loss: 0.00568 (QuantReg: 0.13517) QuantErr: 0.13517 batch_time=0.42877
Train Epoch: 7 [177/250 22656/32000 (71%)] Loss: 0.00758 (QuantReg: 0.13511) QuantErr: 0.13511 batch_time=0.45574
Train Epoch: 7 [188/250 24064/32000 (75%)] Loss: 0.00528 (QuantReg: 0.13635) QuantErr: 0.13635 batch_time=0.42181
Train Epoch: 7 [199/250 25472/32000 (80%)] Loss: 0.00730 (QuantReg: 0.13456) QuantErr: 0.13456 batch_time=0.40744
Train Epoch: 7 [210/250 26880/32000 (84%)] Loss: 0.00529 (QuantReg: 0.13718) QuantErr: 0.13718 batch_time=2.15314
Train Epoch: 7 [221/250 28288/32000 (88%)] Loss: 0.00583 (QuantReg: 0.13433) QuantErr: 0.13433 batch_time=0.43380
Train Epoch: 7 [232/250 29696/32000 (93%)] Loss: 0.00662 (QuantReg: 0.13502) QuantErr: 0.13502 batch_time=0.42996
Train Epoch: 7 [243/250 31104/32000 (97%)] Loss: 0.00576 (QuantReg: 0.13908) QuantErr: 0.13908 batch_time=0.43032
Saving checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_full/checkpoint-epoch7.pth ...
Done in 3.417s
Updating 'best' checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_full/checkpoint-epoch7.pth ...
Done in 7.080s
removing stale ckpt [epoch 6] [took 0.00s]
epoch : 7
loss : 0.00735614013671875
quant_reg : 0.1352961921095848
quant_err : 0.1352961921095848
learning_rate : 3.675459453124999e-05
n_samples : 224000
n_steps : 1750
MSRVTT_full_val/t2v_metrics/R1: 17.10261569416499
MSRVTT_full_val/t2v_metrics/R5: 50.70422535211268
MSRVTT_full_val/t2v_metrics/R10: 70.82494969818913
MSRVTT_full_val/t2v_metrics/R50: 94.96981891348088
MSRVTT_full_val/t2v_metrics/MedR: 5.0
MSRVTT_full_val/t2v_metrics/MeanR: 12.591549295774648
MSRVTT_full_val/t2v_metrics/geometric_mean_R1-R5-R10: 39.45460089306212
MSRVTT_full_val/v2t_metrics/R1: 21.52917505030181
MSRVTT_full_val/v2t_metrics/R5: 59.55734406438632
MSRVTT_full_val/v2t_metrics/R10: 75.45271629778672
MSRVTT_full_val/v2t_metrics/R50: 95.37223340040241
MSRVTT_full_val/v2t_metrics/MedR: 4.0
MSRVTT_full_val/v2t_metrics/MeanR: 11.03420523138833
MSRVTT_full_val/v2t_metrics/geometric_mean_R1-R5-R10: 45.90703001974047
MSRVTT_full_test/t2v_metrics/R1: 5.986622073578595
MSRVTT_full_test/t2v_metrics/R5: 19.732441471571907
MSRVTT_full_test/t2v_metrics/R10: 30.96989966555184
MSRVTT_full_test/t2v_metrics/R50: 66.5886287625418
MSRVTT_full_test/t2v_metrics/MedR: 26.0
MSRVTT_full_test/t2v_metrics/MeanR: 71.29197324414716
MSRVTT_full_test/t2v_metrics/geometric_mean_R1-R5-R10: 15.408752807197152
MSRVTT_full_test/v2t_metrics/R1: 6.989966555183947
MSRVTT_full_test/v2t_metrics/R5: 23.34448160535117
MSRVTT_full_test/v2t_metrics/R10: 35.31772575250836
MSRVTT_full_test/v2t_metrics/R50: 72.3076923076923
MSRVTT_full_test/v2t_metrics/MedR: 19.0
MSRVTT_full_test/v2t_metrics/MeanR: 57.907023411371235
MSRVTT_full_test/v2t_metrics/geometric_mean_R1-R5-R10: 17.928777902682423
mnt_best : 15.408752807197152
not_improved_count: 0
Train Epoch: 8 [1/250 128/32000 (0%)] Loss: 0.00512 (QuantReg: 0.13599) QuantErr: 0.13599 batch_time=45.26411
Train Epoch: 8 [12/250 1536/32000 (5%)] Loss: 0.00549 (QuantReg: 0.13645) QuantErr: 0.13645 batch_time=1.05709
Train Epoch: 8 [23/250 2944/32000 (9%)] Loss: 0.00542 (QuantReg: 0.13454) QuantErr: 0.13454 batch_time=0.41288
Train Epoch: 8 [34/250 4352/32000 (14%)] Loss: 0.00633 (QuantReg: 0.13728) QuantErr: 0.13728 batch_time=0.51898
Train Epoch: 8 [45/250 5760/32000 (18%)] Loss: 0.00771 (QuantReg: 0.13688) QuantErr: 0.13688 batch_time=0.43224
Train Epoch: 8 [56/250 7168/32000 (22%)] Loss: 0.00706 (QuantReg: 0.13566) QuantErr: 0.13566 batch_time=0.42124
Train Epoch: 8 [67/250 8576/32000 (27%)] Loss: 0.00664 (QuantReg: 0.13765) QuantErr: 0.13765 batch_time=0.42831
Train Epoch: 8 [78/250 9984/32000 (31%)] Loss: 0.00810 (QuantReg: 0.13499) QuantErr: 0.13499 batch_time=0.40869
Train Epoch: 8 [89/250 11392/32000 (36%)] Loss: 0.00826 (QuantReg: 0.13556) QuantErr: 0.13556 batch_time=0.41852
Train Epoch: 8 [100/250 12800/32000 (40%)] Loss: 0.00669 (QuantReg: 0.13540) QuantErr: 0.13540 batch_time=0.40733
Train Epoch: 8 [111/250 14208/32000 (44%)] Loss: 0.00984 (QuantReg: 0.13636) QuantErr: 0.13636 batch_time=0.42023
Train Epoch: 8 [122/250 15616/32000 (49%)] Loss: 0.00897 (QuantReg: 0.13275) QuantErr: 0.13275 batch_time=0.41924
Train Epoch: 8 [133/250 17024/32000 (53%)] Loss: 0.00748 (QuantReg: 0.13379) QuantErr: 0.13379 batch_time=0.42094
Train Epoch: 8 [144/250 18432/32000 (58%)] Loss: 0.00832 (QuantReg: 0.13668) QuantErr: 0.13668 batch_time=0.41999
Train Epoch: 8 [155/250 19840/32000 (62%)] Loss: 0.00673 (QuantReg: 0.13623) QuantErr: 0.13623 batch_time=0.41158
Train Epoch: 8 [166/250 21248/32000 (66%)] Loss: 0.00771 (QuantReg: 0.13661) QuantErr: 0.13661 batch_time=0.41586
Train Epoch: 8 [177/250 22656/32000 (71%)] Loss: 0.00654 (QuantReg: 0.13827) QuantErr: 0.13827 batch_time=0.41688
Train Epoch: 8 [188/250 24064/32000 (75%)] Loss: 0.00811 (QuantReg: 0.13684) QuantErr: 0.13684 batch_time=0.41054
Train Epoch: 8 [199/250 25472/32000 (80%)] Loss: 0.00610 (QuantReg: 0.13662) QuantErr: 0.13662 batch_time=0.86165
Train Epoch: 8 [210/250 26880/32000 (84%)] Loss: 0.00582 (QuantReg: 0.13776) QuantErr: 0.13776 batch_time=0.40919
Train Epoch: 8 [221/250 28288/32000 (88%)] Loss: 0.00746 (QuantReg: 0.13764) QuantErr: 0.13764 batch_time=0.44335
Train Epoch: 8 [232/250 29696/32000 (93%)] Loss: 0.00716 (QuantReg: 0.13801) QuantErr: 0.13801 batch_time=0.46201
Train Epoch: 8 [243/250 31104/32000 (97%)] Loss: 0.00690 (QuantReg: 0.13391) QuantErr: 0.13391 batch_time=0.42495
Saving checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_full/checkpoint-epoch8.pth ...
Done in 6.638s
Updating 'best' checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_full/checkpoint-epoch8.pth ...
Done in 10.334s
removing stale ckpt [epoch 7] [took 0.00s]
epoch : 8
loss : 0.006649032592773437
quant_reg : 0.13625012350082397
quant_err : 0.13625012350082397
learning_rate : 3.4916864804687486e-05
n_samples : 256000
n_steps : 2000
MSRVTT_full_val/t2v_metrics/R1: 18.10865191146881
MSRVTT_full_val/t2v_metrics/R5: 50.905432595573444
MSRVTT_full_val/t2v_metrics/R10: 70.82494969818913
MSRVTT_full_val/t2v_metrics/R50: 95.17102615694165
MSRVTT_full_val/t2v_metrics/MedR: 5.0
MSRVTT_full_val/t2v_metrics/MeanR: 12.0
MSRVTT_full_val/t2v_metrics/geometric_mean_R1-R5-R10: 40.26665087988759
MSRVTT_full_val/v2t_metrics/R1: 19.718309859154928
MSRVTT_full_val/v2t_metrics/R5: 58.95372233400403
MSRVTT_full_val/v2t_metrics/R10: 75.65392354124748
MSRVTT_full_val/v2t_metrics/R50: 95.57344064386318
MSRVTT_full_val/v2t_metrics/MedR: 4.0
MSRVTT_full_val/v2t_metrics/MeanR: 10.587525150905433
MSRVTT_full_val/v2t_metrics/geometric_mean_R1-R5-R10: 44.470374990173454
MSRVTT_full_test/t2v_metrics/R1: 5.986622073578595
MSRVTT_full_test/t2v_metrics/R5: 19.899665551839465
MSRVTT_full_test/t2v_metrics/R10: 32.608695652173914
MSRVTT_full_test/t2v_metrics/R50: 69.33110367892976
MSRVTT_full_test/t2v_metrics/MedR: 22.0
MSRVTT_full_test/t2v_metrics/MeanR: 63.436120401337796
MSRVTT_full_test/t2v_metrics/geometric_mean_R1-R5-R10: 15.72004129225575
MSRVTT_full_test/v2t_metrics/R1: 7.1237458193979935
MSRVTT_full_test/v2t_metrics/R5: 23.110367892976587
MSRVTT_full_test/v2t_metrics/R10: 35.551839464882946
MSRVTT_full_test/v2t_metrics/R50: 73.61204013377926
MSRVTT_full_test/v2t_metrics/MedR: 18.0
MSRVTT_full_test/v2t_metrics/MeanR: 52.889966555183946
MSRVTT_full_test/v2t_metrics/geometric_mean_R1-R5-R10: 18.021562822764167
mnt_best : 15.72004129225575
not_improved_count: 0
Train Epoch: 9 [1/250 128/32000 (0%)] Loss: 0.00634 (QuantReg: 0.13493) QuantErr: 0.13493 batch_time=37.38682
Train Epoch: 9 [12/250 1536/32000 (5%)] Loss: 0.00712 (QuantReg: 0.13463) QuantErr: 0.13463 batch_time=0.87755
Train Epoch: 9 [23/250 2944/32000 (9%)] Loss: 0.00900 (QuantReg: 0.13574) QuantErr: 0.13574 batch_time=0.41367
Train Epoch: 9 [34/250 4352/32000 (14%)] Loss: 0.00655 (QuantReg: 0.13767) QuantErr: 0.13767 batch_time=0.43234
Train Epoch: 9 [45/250 5760/32000 (18%)] Loss: 0.00638 (QuantReg: 0.13643) QuantErr: 0.13643 batch_time=0.42600
Train Epoch: 9 [56/250 7168/32000 (22%)] Loss: 0.00795 (QuantReg: 0.13547) QuantErr: 0.13547 batch_time=0.42102
Train Epoch: 9 [67/250 8576/32000 (27%)] Loss: 0.00510 (QuantReg: 0.13750) QuantErr: 0.13750 batch_time=0.42632
Train Epoch: 9 [78/250 9984/32000 (31%)] Loss: 0.00582 (QuantReg: 0.13372) QuantErr: 0.13372 batch_time=0.43043
Train Epoch: 9 [89/250 11392/32000 (36%)] Loss: 0.00494 (QuantReg: 0.13622) QuantErr: 0.13622 batch_time=0.43923
Train Epoch: 9 [100/250 12800/32000 (40%)] Loss: 0.00673 (QuantReg: 0.13729) QuantErr: 0.13729 batch_time=0.42649
Train Epoch: 9 [111/250 14208/32000 (44%)] Loss: 0.00616 (QuantReg: 0.13728) QuantErr: 0.13728 batch_time=0.42991
Train Epoch: 9 [122/250 15616/32000 (49%)] Loss: 0.00699 (QuantReg: 0.13582) QuantErr: 0.13582 batch_time=0.45203
Train Epoch: 9 [133/250 17024/32000 (53%)] Loss: 0.00464 (QuantReg: 0.13736) QuantErr: 0.13736 batch_time=0.41539
Train Epoch: 9 [144/250 18432/32000 (58%)] Loss: 0.00639 (QuantReg: 0.13639) QuantErr: 0.13639 batch_time=0.42042
Train Epoch: 9 [155/250 19840/32000 (62%)] Loss: 0.00588 (QuantReg: 0.13466) QuantErr: 0.13466 batch_time=0.44591
Train Epoch: 9 [166/250 21248/32000 (66%)] Loss: 0.00695 (QuantReg: 0.13538) QuantErr: 0.13538 batch_time=0.42716
Train Epoch: 9 [177/250 22656/32000 (71%)] Loss: 0.00555 (QuantReg: 0.13607) QuantErr: 0.13607 batch_time=0.47428
Train Epoch: 9 [188/250 24064/32000 (75%)] Loss: 0.00491 (QuantReg: 0.13500) QuantErr: 0.13500 batch_time=0.41251
Train Epoch: 9 [199/250 25472/32000 (80%)] Loss: 0.00662 (QuantReg: 0.13563) QuantErr: 0.13563 batch_time=0.43303
Train Epoch: 9 [210/250 26880/32000 (84%)] Loss: 0.00513 (QuantReg: 0.13790) QuantErr: 0.13790 batch_time=3.40568
Train Epoch: 9 [221/250 28288/32000 (88%)] Loss: 0.00736 (QuantReg: 0.13727) QuantErr: 0.13727 batch_time=0.42637
Train Epoch: 9 [232/250 29696/32000 (93%)] Loss: 0.00631 (QuantReg: 0.13525) QuantErr: 0.13525 batch_time=0.44468
Train Epoch: 9 [243/250 31104/32000 (97%)] Loss: 0.00516 (QuantReg: 0.13495) QuantErr: 0.13495 batch_time=0.42457
Saving checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_full/checkpoint-epoch9.pth ...
Done in 3.578s
Updating 'best' checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_full/checkpoint-epoch9.pth ...
Done in 7.017s
removing stale ckpt [epoch 8] [took 0.00s]
epoch : 9
loss : 0.0060645599365234375
quant_reg : 0.13606975531578064
quant_err : 0.13606975531578064
learning_rate : 3.317102156445311e-05
n_samples : 288000
n_steps : 2250
MSRVTT_full_val/t2v_metrics/R1: 17.303822937625753
MSRVTT_full_val/t2v_metrics/R5: 52.91750503018109
MSRVTT_full_val/t2v_metrics/R10: 72.43460764587525
MSRVTT_full_val/t2v_metrics/R50: 95.37223340040241
MSRVTT_full_val/t2v_metrics/MedR: 5.0
MSRVTT_full_val/t2v_metrics/MeanR: 12.01609657947686
MSRVTT_full_val/t2v_metrics/geometric_mean_R1-R5-R10: 40.478944357679524
MSRVTT_full_val/v2t_metrics/R1: 21.730382293762574
MSRVTT_full_val/v2t_metrics/R5: 57.947686116700204
MSRVTT_full_val/v2t_metrics/R10: 75.25150905432595
MSRVTT_full_val/v2t_metrics/R50: 95.57344064386318
MSRVTT_full_val/v2t_metrics/MedR: 4.0
MSRVTT_full_val/v2t_metrics/MeanR: 10.911468812877263
MSRVTT_full_val/v2t_metrics/geometric_mean_R1-R5-R10: 45.590346510741405
MSRVTT_full_test/t2v_metrics/R1: 6.622073578595318
MSRVTT_full_test/t2v_metrics/R5: 21.53846153846154
MSRVTT_full_test/t2v_metrics/R10: 32.84280936454849
MSRVTT_full_test/t2v_metrics/R50: 69.7324414715719
MSRVTT_full_test/t2v_metrics/MedR: 23.0
MSRVTT_full_test/t2v_metrics/MeanR: 61.97257525083612
MSRVTT_full_test/t2v_metrics/geometric_mean_R1-R5-R10: 16.732069511696682
MSRVTT_full_test/v2t_metrics/R1: 6.555183946488294
MSRVTT_full_test/v2t_metrics/R5: 23.51170568561873
MSRVTT_full_test/v2t_metrics/R10: 37.591973244147155
MSRVTT_full_test/v2t_metrics/R50: 74.94983277591973
MSRVTT_full_test/v2t_metrics/MedR: 17.0
MSRVTT_full_test/v2t_metrics/MeanR: 50.40869565217391
MSRVTT_full_test/v2t_metrics/geometric_mean_R1-R5-R10: 17.960622334856044
mnt_best : 16.732069511696682
not_improved_count: 0
Train Epoch: 10 [1/250 128/32000 (0%)] Loss: 0.00426 (QuantReg: 0.13434) QuantErr: 0.13434 batch_time=35.88723
Train Epoch: 10 [12/250 1536/32000 (5%)] Loss: 0.00481 (QuantReg: 0.13631) QuantErr: 0.13631 batch_time=0.44279
Train Epoch: 10 [23/250 2944/32000 (9%)] Loss: 0.00597 (QuantReg: 0.13475) QuantErr: 0.13475 batch_time=0.41819
Train Epoch: 10 [34/250 4352/32000 (14%)] Loss: 0.00756 (QuantReg: 0.13540) QuantErr: 0.13540 batch_time=0.43407
Train Epoch: 10 [45/250 5760/32000 (18%)] Loss: 0.00551 (QuantReg: 0.13488) QuantErr: 0.13488 batch_time=0.42846
Train Epoch: 10 [56/250 7168/32000 (22%)] Loss: 0.00471 (QuantReg: 0.13480) QuantErr: 0.13480 batch_time=0.41554
Train Epoch: 10 [67/250 8576/32000 (27%)] Loss: 0.00503 (QuantReg: 0.13463) QuantErr: 0.13463 batch_time=0.41814
Train Epoch: 10 [78/250 9984/32000 (31%)] Loss: 0.00463 (QuantReg: 0.13447) QuantErr: 0.13447 batch_time=0.43581
Train Epoch: 10 [89/250 11392/32000 (36%)] Loss: 0.00367 (QuantReg: 0.13576) QuantErr: 0.13576 batch_time=0.41858
Train Epoch: 10 [100/250 12800/32000 (40%)] Loss: 0.00767 (QuantReg: 0.13453) QuantErr: 0.13453 batch_time=0.42808
Train Epoch: 10 [111/250 14208/32000 (44%)] Loss: 0.00713 (QuantReg: 0.13599) QuantErr: 0.13599 batch_time=0.41857
Train Epoch: 10 [122/250 15616/32000 (49%)] Loss: 0.00573 (QuantReg: 0.13343) QuantErr: 0.13343 batch_time=0.42627
Train Epoch: 10 [133/250 17024/32000 (53%)] Loss: 0.00576 (QuantReg: 0.13420) QuantErr: 0.13420 batch_time=0.42675
Train Epoch: 10 [144/250 18432/32000 (58%)] Loss: 0.00696 (QuantReg: 0.13537) QuantErr: 0.13537 batch_time=0.41945
Train Epoch: 10 [155/250 19840/32000 (62%)] Loss: 0.00513 (QuantReg: 0.13599) QuantErr: 0.13599 batch_time=0.89139
Train Epoch: 10 [166/250 21248/32000 (66%)] Loss: 0.00571 (QuantReg: 0.13490) QuantErr: 0.13490 batch_time=0.42941
Train Epoch: 10 [177/250 22656/32000 (71%)] Loss: 0.00591 (QuantReg: 0.13524) QuantErr: 0.13524 batch_time=0.41503
Train Epoch: 10 [188/250 24064/32000 (75%)] Loss: 0.00410 (QuantReg: 0.13655) QuantErr: 0.13655 batch_time=0.41413
Train Epoch: 10 [199/250 25472/32000 (80%)] Loss: 0.00542 (QuantReg: 0.13732) QuantErr: 0.13732 batch_time=0.41545
Train Epoch: 10 [210/250 26880/32000 (84%)] Loss: 0.00516 (QuantReg: 0.13821) QuantErr: 0.13821 batch_time=2.50699
Train Epoch: 10 [221/250 28288/32000 (88%)] Loss: 0.00928 (QuantReg: 0.13664) QuantErr: 0.13664 batch_time=0.79254
Train Epoch: 10 [232/250 29696/32000 (93%)] Loss: 0.00490 (QuantReg: 0.13667) QuantErr: 0.13667 batch_time=0.42862
Train Epoch: 10 [243/250 31104/32000 (97%)] Loss: 0.00607 (QuantReg: 0.13616) QuantErr: 0.13616 batch_time=0.41825
Saving checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_full/checkpoint-epoch10.pth ...
Done in 3.712s
removing stale ckpt [epoch 9] [took 0.00s]
epoch : 10
loss : 0.005865798950195312
quant_reg : 0.13559187442064286
quant_err : 0.13559187442064286
learning_rate : 3.151247048623045e-05
n_samples : 320000
n_steps : 2500
MSRVTT_full_val/t2v_metrics/R1: 15.694164989939638
MSRVTT_full_val/t2v_metrics/R5: 52.313883299798796
MSRVTT_full_val/t2v_metrics/R10: 69.81891348088531
MSRVTT_full_val/t2v_metrics/R50: 93.76257545271629
MSRVTT_full_val/t2v_metrics/MedR: 5.0
MSRVTT_full_val/t2v_metrics/MeanR: 12.633802816901408
MSRVTT_full_val/t2v_metrics/geometric_mean_R1-R5-R10: 38.557549051333595
MSRVTT_full_val/v2t_metrics/R1: 21.12676056338028
MSRVTT_full_val/v2t_metrics/R5: 60.36217303822938
MSRVTT_full_val/v2t_metrics/R10: 77.66599597585513
MSRVTT_full_val/v2t_metrics/R50: 95.37223340040241
MSRVTT_full_val/v2t_metrics/MedR: 4.0
MSRVTT_full_val/v2t_metrics/MeanR: 10.867203219315895
MSRVTT_full_val/v2t_metrics/geometric_mean_R1-R5-R10: 46.26752099995385
MSRVTT_full_test/t2v_metrics/R1: 5.919732441471572
MSRVTT_full_test/t2v_metrics/R5: 20.535117056856187
MSRVTT_full_test/t2v_metrics/R10: 32.30769230769231
MSRVTT_full_test/t2v_metrics/R50: 68.49498327759197
MSRVTT_full_test/t2v_metrics/MedR: 24.0
MSRVTT_full_test/t2v_metrics/MeanR: 65.98494983277592
MSRVTT_full_test/t2v_metrics/geometric_mean_R1-R5-R10: 15.777386561838359
MSRVTT_full_test/v2t_metrics/R1: 6.923076923076923
MSRVTT_full_test/v2t_metrics/R5: 24.2809364548495
MSRVTT_full_test/v2t_metrics/R10: 37.458193979933114
MSRVTT_full_test/v2t_metrics/R50: 74.84949832775919
MSRVTT_full_test/v2t_metrics/MedR: 19.0
MSRVTT_full_test/v2t_metrics/MeanR: 53.13344481605351
MSRVTT_full_test/v2t_metrics/geometric_mean_R1-R5-R10: 18.465899798450423
mnt_best : 16.732069511696682
not_improved_count: 1
Train Epoch: 11 [1/250 128/32000 (0%)] Loss: 0.00650 (QuantReg: 0.13614) QuantErr: 0.13614 batch_time=36.77464
Train Epoch: 11 [12/250 1536/32000 (5%)] Loss: 0.00626 (QuantReg: 0.13517) QuantErr: 0.13517 batch_time=0.41166
Train Epoch: 11 [23/250 2944/32000 (9%)] Loss: 0.00485 (QuantReg: 0.13516) QuantErr: 0.13516 batch_time=3.07364
Train Epoch: 11 [34/250 4352/32000 (14%)] Loss: 0.00646 (QuantReg: 0.13503) QuantErr: 0.13503 batch_time=0.41537
Train Epoch: 11 [45/250 5760/32000 (18%)] Loss: 0.00453 (QuantReg: 0.13721) QuantErr: 0.13721 batch_time=0.42109
Train Epoch: 11 [56/250 7168/32000 (22%)] Loss: 0.00424 (QuantReg: 0.13732) QuantErr: 0.13732 batch_time=0.43797
Train Epoch: 11 [67/250 8576/32000 (27%)] Loss: 0.00385 (QuantReg: 0.13424) QuantErr: 0.13424 batch_time=1.35090
Train Epoch: 11 [78/250 9984/32000 (31%)] Loss: 0.00533 (QuantReg: 0.13686) QuantErr: 0.13686 batch_time=0.44604
Train Epoch: 11 [89/250 11392/32000 (36%)] Loss: 0.00661 (QuantReg: 0.13672) QuantErr: 0.13672 batch_time=0.43468
Train Epoch: 11 [100/250 12800/32000 (40%)] Loss: 0.00336 (QuantReg: 0.13777) QuantErr: 0.13777 batch_time=0.42338
Train Epoch: 11 [111/250 14208/32000 (44%)] Loss: 0.00335 (QuantReg: 0.13647) QuantErr: 0.13647 batch_time=0.46190
Train Epoch: 11 [122/250 15616/32000 (49%)] Loss: 0.00737 (QuantReg: 0.13753) QuantErr: 0.13753 batch_time=0.53324
Train Epoch: 11 [133/250 17024/32000 (53%)] Loss: 0.00553 (QuantReg: 0.13570) QuantErr: 0.13570 batch_time=0.43332
Train Epoch: 11 [144/250 18432/32000 (58%)] Loss: 0.00772 (QuantReg: 0.13589) QuantErr: 0.13589 batch_time=1.20799
Train Epoch: 11 [155/250 19840/32000 (62%)] Loss: 0.00623 (QuantReg: 0.13772) QuantErr: 0.13772 batch_time=0.43867
Train Epoch: 11 [166/250 21248/32000 (66%)] Loss: 0.00552 (QuantReg: 0.13753) QuantErr: 0.13753 batch_time=0.42562
Train Epoch: 11 [177/250 22656/32000 (71%)] Loss: 0.00556 (QuantReg: 0.13671) QuantErr: 0.13671 batch_time=0.42614
Train Epoch: 11 [188/250 24064/32000 (75%)] Loss: 0.00698 (QuantReg: 0.13512) QuantErr: 0.13512 batch_time=0.42519
Train Epoch: 11 [199/250 25472/32000 (80%)] Loss: 0.00543 (QuantReg: 0.13817) QuantErr: 0.13817 batch_time=0.41658
Train Epoch: 11 [210/250 26880/32000 (84%)] Loss: 0.00494 (QuantReg: 0.13793) QuantErr: 0.13793 batch_time=0.41191
Train Epoch: 11 [221/250 28288/32000 (88%)] Loss: 0.00601 (QuantReg: 0.13733) QuantErr: 0.13733 batch_time=0.42189
Train Epoch: 11 [232/250 29696/32000 (93%)] Loss: 0.00537 (QuantReg: 0.13783) QuantErr: 0.13783 batch_time=0.41885
Train Epoch: 11 [243/250 31104/32000 (97%)] Loss: 0.00495 (QuantReg: 0.13689) QuantErr: 0.13689 batch_time=0.43335
Saving checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_full/checkpoint-epoch11.pth ...
Done in 4.124s
removing stale ckpt [epoch 10] [took 0.00s]
epoch : 11
loss : 0.005459152221679688
quant_reg : 0.13668715059757233
quant_err : 0.13668715059757233
learning_rate : 2.993684696191893e-05
n_samples : 352000
n_steps : 2750
MSRVTT_full_val/t2v_metrics/R1: 17.10261569416499
MSRVTT_full_val/t2v_metrics/R5: 50.70422535211268
MSRVTT_full_val/t2v_metrics/R10: 68.41046277665995
MSRVTT_full_val/t2v_metrics/R50: 95.57344064386318
MSRVTT_full_val/t2v_metrics/MedR: 5.0
MSRVTT_full_val/t2v_metrics/MeanR: 12.951710261569417
MSRVTT_full_val/t2v_metrics/geometric_mean_R1-R5-R10: 39.00105955205883
MSRVTT_full_val/v2t_metrics/R1: 22.132796780684103
MSRVTT_full_val/v2t_metrics/R5: 58.35010060362173
MSRVTT_full_val/v2t_metrics/R10: 73.44064386317908
MSRVTT_full_val/v2t_metrics/R50: 94.56740442655935
MSRVTT_full_val/v2t_metrics/MedR: 4.0
MSRVTT_full_val/v2t_metrics/MeanR: 11.088531187122737
MSRVTT_full_val/v2t_metrics/geometric_mean_R1-R5-R10: 45.604194974472286
MSRVTT_full_test/t2v_metrics/R1: 5.88628762541806
MSRVTT_full_test/t2v_metrics/R5: 20.96989966555184
MSRVTT_full_test/t2v_metrics/R10: 33.34448160535117
MSRVTT_full_test/t2v_metrics/R50: 69.23076923076923
MSRVTT_full_test/t2v_metrics/MedR: 22.5
MSRVTT_full_test/t2v_metrics/MeanR: 66.31538461538462
MSRVTT_full_test/t2v_metrics/geometric_mean_R1-R5-R10: 16.025832552547932
MSRVTT_full_test/v2t_metrics/R1: 7.792642140468227
MSRVTT_full_test/v2t_metrics/R5: 26.05351170568562
MSRVTT_full_test/v2t_metrics/R10: 38.561872909699
MSRVTT_full_test/v2t_metrics/R50: 75.05016722408027
MSRVTT_full_test/v2t_metrics/MedR: 17.0
MSRVTT_full_test/v2t_metrics/MeanR: 51.684615384615384
MSRVTT_full_test/v2t_metrics/geometric_mean_R1-R5-R10: 19.856515555348366
mnt_best : 16.732069511696682
not_improved_count: 2
Train Epoch: 12 [1/250 128/32000 (0%)] Loss: 0.00533 (QuantReg: 0.13529) QuantErr: 0.13529 batch_time=31.57515
Train Epoch: 12 [12/250 1536/32000 (5%)] Loss: 0.00427 (QuantReg: 0.13730) QuantErr: 0.13730 batch_time=0.40936
Train Epoch: 12 [23/250 2944/32000 (9%)] Loss: 0.00526 (QuantReg: 0.13528) QuantErr: 0.13528 batch_time=0.45082
Train Epoch: 12 [34/250 4352/32000 (14%)] Loss: 0.00538 (QuantReg: 0.13604) QuantErr: 0.13604 batch_time=0.41027
Train Epoch: 12 [45/250 5760/32000 (18%)] Loss: 0.00584 (QuantReg: 0.13540) QuantErr: 0.13540 batch_time=0.40293
Train Epoch: 12 [56/250 7168/32000 (22%)] Loss: 0.00751 (QuantReg: 0.13582) QuantErr: 0.13582 batch_time=0.45855
Train Epoch: 12 [67/250 8576/32000 (27%)] Loss: 0.00484 (QuantReg: 0.13787) QuantErr: 0.13787 batch_time=0.87290
Train Epoch: 12 [78/250 9984/32000 (31%)] Loss: 0.00580 (QuantReg: 0.13502) QuantErr: 0.13502 batch_time=0.43830
Train Epoch: 12 [89/250 11392/32000 (36%)] Loss: 0.00427 (QuantReg: 0.13783) QuantErr: 0.13783 batch_time=0.41072
Train Epoch: 12 [100/250 12800/32000 (40%)] Loss: 0.00598 (QuantReg: 0.13596) QuantErr: 0.13596 batch_time=0.41379
Train Epoch: 12 [111/250 14208/32000 (44%)] Loss: 0.00303 (QuantReg: 0.13340) QuantErr: 0.13340 batch_time=0.40513
Train Epoch: 12 [122/250 15616/32000 (49%)] Loss: 0.00355 (QuantReg: 0.13590) QuantErr: 0.13590 batch_time=0.45169
Train Epoch: 12 [133/250 17024/32000 (53%)] Loss: 0.00652 (QuantReg: 0.13531) QuantErr: 0.13531 batch_time=0.40965
Train Epoch: 12 [144/250 18432/32000 (58%)] Loss: 0.00700 (QuantReg: 0.13432) QuantErr: 0.13432 batch_time=0.40442
Train Epoch: 12 [155/250 19840/32000 (62%)] Loss: 0.00499 (QuantReg: 0.13465) QuantErr: 0.13465 batch_time=0.41887
Train Epoch: 12 [166/250 21248/32000 (66%)] Loss: 0.00483 (QuantReg: 0.13495) QuantErr: 0.13495 batch_time=0.40624
Train Epoch: 12 [177/250 22656/32000 (71%)] Loss: 0.00328 (QuantReg: 0.13667) QuantErr: 0.13667 batch_time=0.41971
Train Epoch: 12 [188/250 24064/32000 (75%)] Loss: 0.00359 (QuantReg: 0.13504) QuantErr: 0.13504 batch_time=0.42534
Train Epoch: 12 [199/250 25472/32000 (80%)] Loss: 0.00482 (QuantReg: 0.13883) QuantErr: 0.13883 batch_time=0.43048
Train Epoch: 12 [210/250 26880/32000 (84%)] Loss: 0.00633 (QuantReg: 0.13660) QuantErr: 0.13660 batch_time=1.57272
Train Epoch: 12 [221/250 28288/32000 (88%)] Loss: 0.00414 (QuantReg: 0.13331) QuantErr: 0.13331 batch_time=3.14949
Train Epoch: 12 [232/250 29696/32000 (93%)] Loss: 0.00482 (QuantReg: 0.13430) QuantErr: 0.13430 batch_time=0.40465
Train Epoch: 12 [243/250 31104/32000 (97%)] Loss: 0.00445 (QuantReg: 0.13732) QuantErr: 0.13732 batch_time=0.43208
Saving checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_full/checkpoint-epoch12.pth ...
Done in 3.585s
Updating 'best' checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_full/checkpoint-epoch12.pth ...
Done in 7.109s
removing stale ckpt [epoch 11] [took 0.00s]
epoch : 12
loss : 0.005158294677734375
quant_reg : 0.13611840736865996
quant_err : 0.13611840736865996
learning_rate : 2.844000461382298e-05
n_samples : 384000
n_steps : 3000
MSRVTT_full_val/t2v_metrics/R1: 19.3158953722334
MSRVTT_full_val/t2v_metrics/R5: 54.72837022132797
MSRVTT_full_val/t2v_metrics/R10: 70.4225352112676
MSRVTT_full_val/t2v_metrics/R50: 95.17102615694165
MSRVTT_full_val/t2v_metrics/MedR: 4.0
MSRVTT_full_val/t2v_metrics/MeanR: 12.189134808853119
MSRVTT_full_val/t2v_metrics/geometric_mean_R1-R5-R10: 42.06746464531399
MSRVTT_full_val/v2t_metrics/R1: 25.35211267605634
MSRVTT_full_val/v2t_metrics/R5: 61.16700201207244
MSRVTT_full_val/v2t_metrics/R10: 74.44668008048289
MSRVTT_full_val/v2t_metrics/R50: 95.57344064386318
MSRVTT_full_val/v2t_metrics/MedR: 4.0
MSRVTT_full_val/v2t_metrics/MeanR: 10.496981891348089
MSRVTT_full_val/v2t_metrics/geometric_mean_R1-R5-R10: 48.69214375568633
MSRVTT_full_test/t2v_metrics/R1: 7.8595317725752505
MSRVTT_full_test/t2v_metrics/R5: 22.608695652173914
MSRVTT_full_test/t2v_metrics/R10: 35.28428093645485
MSRVTT_full_test/t2v_metrics/R50: 70.76923076923077
MSRVTT_full_test/t2v_metrics/MedR: 20.0
MSRVTT_full_test/t2v_metrics/MeanR: 58.87290969899666
MSRVTT_full_test/t2v_metrics/geometric_mean_R1-R5-R10: 18.439585353737368
MSRVTT_full_test/v2t_metrics/R1: 7.65886287625418
MSRVTT_full_test/v2t_metrics/R5: 25.11705685618729
MSRVTT_full_test/v2t_metrics/R10: 38.66220735785953
MSRVTT_full_test/v2t_metrics/R50: 75.18394648829431
MSRVTT_full_test/v2t_metrics/MedR: 17.0
MSRVTT_full_test/v2t_metrics/MeanR: 50.17391304347826
MSRVTT_full_test/v2t_metrics/geometric_mean_R1-R5-R10: 19.51970408168433
mnt_best : 18.439585353737368
not_improved_count: 0
Train Epoch: 13 [1/250 128/32000 (0%)] Loss: 0.00443 (QuantReg: 0.13709) QuantErr: 0.13709 batch_time=32.86286
Train Epoch: 13 [12/250 1536/32000 (5%)] Loss: 0.00485 (QuantReg: 0.13380) QuantErr: 0.13380 batch_time=0.41570
Train Epoch: 13 [23/250 2944/32000 (9%)] Loss: 0.00399 (QuantReg: 0.13402) QuantErr: 0.13402 batch_time=0.41768
Train Epoch: 13 [34/250 4352/32000 (14%)] Loss: 0.00552 (QuantReg: 0.13698) QuantErr: 0.13698 batch_time=0.41749
Train Epoch: 13 [45/250 5760/32000 (18%)] Loss: 0.00373 (QuantReg: 0.13501) QuantErr: 0.13501 batch_time=0.43846
Train Epoch: 13 [56/250 7168/32000 (22%)] Loss: 0.00412 (QuantReg: 0.13488) QuantErr: 0.13488 batch_time=0.42732
Train Epoch: 13 [67/250 8576/32000 (27%)] Loss: 0.00655 (QuantReg: 0.13493) QuantErr: 0.13493 batch_time=0.41737
Train Epoch: 13 [78/250 9984/32000 (31%)] Loss: 0.00505 (QuantReg: 0.13461) QuantErr: 0.13461 batch_time=0.40859
Train Epoch: 13 [89/250 11392/32000 (36%)] Loss: 0.00373 (QuantReg: 0.13349) QuantErr: 0.13349 batch_time=0.41370
Train Epoch: 13 [100/250 12800/32000 (40%)] Loss: 0.00396 (QuantReg: 0.13651) QuantErr: 0.13651 batch_time=0.43812
Train Epoch: 13 [111/250 14208/32000 (44%)] Loss: 0.00407 (QuantReg: 0.13614) QuantErr: 0.13614 batch_time=0.42147
Train Epoch: 13 [122/250 15616/32000 (49%)] Loss: 0.00418 (QuantReg: 0.13614) QuantErr: 0.13614 batch_time=0.42618
Train Epoch: 13 [133/250 17024/32000 (53%)] Loss: 0.00328 (QuantReg: 0.13496) QuantErr: 0.13496 batch_time=0.43350
Train Epoch: 13 [144/250 18432/32000 (58%)] Loss: 0.00511 (QuantReg: 0.13308) QuantErr: 0.13308 batch_time=0.41620
Train Epoch: 13 [155/250 19840/32000 (62%)] Loss: 0.00483 (QuantReg: 0.13523) QuantErr: 0.13523 batch_time=0.44487
Train Epoch: 13 [166/250 21248/32000 (66%)] Loss: 0.00525 (QuantReg: 0.13688) QuantErr: 0.13688 batch_time=0.41608
Train Epoch: 13 [177/250 22656/32000 (71%)] Loss: 0.00578 (QuantReg: 0.13546) QuantErr: 0.13546 batch_time=0.42091
Train Epoch: 13 [188/250 24064/32000 (75%)] Loss: 0.00425 (QuantReg: 0.13734) QuantErr: 0.13734 batch_time=0.41564
Train Epoch: 13 [199/250 25472/32000 (80%)] Loss: 0.00362 (QuantReg: 0.13597) QuantErr: 0.13597 batch_time=4.54844
Train Epoch: 13 [210/250 26880/32000 (84%)] Loss: 0.00407 (QuantReg: 0.13450) QuantErr: 0.13450 batch_time=1.84304
Train Epoch: 13 [221/250 28288/32000 (88%)] Loss: 0.00604 (QuantReg: 0.13342) QuantErr: 0.13342 batch_time=0.41891
Train Epoch: 13 [232/250 29696/32000 (93%)] Loss: 0.00439 (QuantReg: 0.13464) QuantErr: 0.13464 batch_time=0.42331
Train Epoch: 13 [243/250 31104/32000 (97%)] Loss: 0.00488 (QuantReg: 0.13752) QuantErr: 0.13752 batch_time=0.45548
Saving checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_full/checkpoint-epoch13.pth ...
Done in 12.200s
removing stale ckpt [epoch 12] [took 0.00s]
epoch : 13
loss : 0.004803932189941406
quant_reg : 0.1353490087389946
quant_err : 0.1353490087389946
learning_rate : 2.7018004383131832e-05
n_samples : 416000
n_steps : 3250
MSRVTT_full_val/t2v_metrics/R1: 21.12676056338028
MSRVTT_full_val/t2v_metrics/R5: 54.929577464788736
MSRVTT_full_val/t2v_metrics/R10: 70.62374245472837
MSRVTT_full_val/t2v_metrics/R50: 94.16498993963782
MSRVTT_full_val/t2v_metrics/MedR: 4.0
MSRVTT_full_val/t2v_metrics/MeanR: 12.088531187122737
MSRVTT_full_val/t2v_metrics/geometric_mean_R1-R5-R10: 43.43734765782663
MSRVTT_full_val/v2t_metrics/R1: 23.34004024144869
MSRVTT_full_val/v2t_metrics/R5: 60.563380281690144
MSRVTT_full_val/v2t_metrics/R10: 74.64788732394366
MSRVTT_full_val/v2t_metrics/R50: 95.57344064386318
MSRVTT_full_val/v2t_metrics/MedR: 4.0
MSRVTT_full_val/v2t_metrics/MeanR: 11.325955734406438
MSRVTT_full_val/v2t_metrics/geometric_mean_R1-R5-R10: 47.25448953528219
MSRVTT_full_test/t2v_metrics/R1: 7.491638795986622
MSRVTT_full_test/t2v_metrics/R5: 23.377926421404684
MSRVTT_full_test/t2v_metrics/R10: 35.719063545150505
MSRVTT_full_test/t2v_metrics/R50: 70.50167224080268
MSRVTT_full_test/t2v_metrics/MedR: 20.0
MSRVTT_full_test/t2v_metrics/MeanR: 61.16053511705686
MSRVTT_full_test/t2v_metrics/geometric_mean_R1-R5-R10: 18.425854068861916
MSRVTT_full_test/v2t_metrics/R1: 8.595317725752508
MSRVTT_full_test/v2t_metrics/R5: 26.956521739130434
MSRVTT_full_test/v2t_metrics/R10: 40.2675585284281
MSRVTT_full_test/v2t_metrics/R50: 75.01672240802675
MSRVTT_full_test/v2t_metrics/MedR: 16.0
MSRVTT_full_test/v2t_metrics/MeanR: 50.97591973244147
MSRVTT_full_test/v2t_metrics/geometric_mean_R1-R5-R10: 21.05201620728207
mnt_best : 18.439585353737368
not_improved_count: 1
Train Epoch: 14 [1/250 128/32000 (0%)] Loss: 0.00658 (QuantReg: 0.13347) QuantErr: 0.13347 batch_time=35.32794
Train Epoch: 14 [12/250 1536/32000 (5%)] Loss: 0.00510 (QuantReg: 0.13594) QuantErr: 0.13594 batch_time=0.42045
Train Epoch: 14 [23/250 2944/32000 (9%)] Loss: 0.00383 (QuantReg: 0.13437) QuantErr: 0.13437 batch_time=1.72360
Train Epoch: 14 [34/250 4352/32000 (14%)] Loss: 0.00362 (QuantReg: 0.13344) QuantErr: 0.13344 batch_time=0.40972
Train Epoch: 14 [45/250 5760/32000 (18%)] Loss: 0.00471 (QuantReg: 0.13675) QuantErr: 0.13675 batch_time=0.41642
Train Epoch: 14 [56/250 7168/32000 (22%)] Loss: 0.00359 (QuantReg: 0.13260) QuantErr: 0.13260 batch_time=0.40502
Train Epoch: 14 [67/250 8576/32000 (27%)] Loss: 0.00355 (QuantReg: 0.13130) QuantErr: 0.13130 batch_time=3.05205
Train Epoch: 14 [78/250 9984/32000 (31%)] Loss: 0.00448 (QuantReg: 0.13643) QuantErr: 0.13643 batch_time=0.42198
Train Epoch: 14 [89/250 11392/32000 (36%)] Loss: 0.00564 (QuantReg: 0.13507) QuantErr: 0.13507 batch_time=0.43418
Train Epoch: 14 [100/250 12800/32000 (40%)] Loss: 0.00399 (QuantReg: 0.13445) QuantErr: 0.13445 batch_time=0.43270
Train Epoch: 14 [111/250 14208/32000 (44%)] Loss: 0.00458 (QuantReg: 0.13441) QuantErr: 0.13441 batch_time=0.41739
Train Epoch: 14 [122/250 15616/32000 (49%)] Loss: 0.00415 (QuantReg: 0.13518) QuantErr: 0.13518 batch_time=0.41102
Train Epoch: 14 [133/250 17024/32000 (53%)] Loss: 0.00438 (QuantReg: 0.13565) QuantErr: 0.13565 batch_time=0.42208
Train Epoch: 14 [144/250 18432/32000 (58%)] Loss: 0.00443 (QuantReg: 0.13427) QuantErr: 0.13427 batch_time=0.41994
Train Epoch: 14 [155/250 19840/32000 (62%)] Loss: 0.00316 (QuantReg: 0.13462) QuantErr: 0.13462 batch_time=0.42912
Train Epoch: 14 [166/250 21248/32000 (66%)] Loss: 0.00540 (QuantReg: 0.13575) QuantErr: 0.13575 batch_time=0.42185
Train Epoch: 14 [177/250 22656/32000 (71%)] Loss: 0.00574 (QuantReg: 0.13448) QuantErr: 0.13448 batch_time=0.42742
Train Epoch: 14 [188/250 24064/32000 (75%)] Loss: 0.00372 (QuantReg: 0.13307) QuantErr: 0.13307 batch_time=0.40377
Train Epoch: 14 [199/250 25472/32000 (80%)] Loss: 0.00434 (QuantReg: 0.13402) QuantErr: 0.13402 batch_time=0.42627
Train Epoch: 14 [210/250 26880/32000 (84%)] Loss: 0.00412 (QuantReg: 0.13534) QuantErr: 0.13534 batch_time=0.41991
Train Epoch: 14 [221/250 28288/32000 (88%)] Loss: 0.00422 (QuantReg: 0.13384) QuantErr: 0.13384 batch_time=0.44561
Train Epoch: 14 [232/250 29696/32000 (93%)] Loss: 0.00401 (QuantReg: 0.13835) QuantErr: 0.13835 batch_time=0.45450
Train Epoch: 14 [243/250 31104/32000 (97%)] Loss: 0.00511 (QuantReg: 0.13239) QuantErr: 0.13239 batch_time=0.40634
Saving checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_full/checkpoint-epoch14.pth ...
Done in 13.121s
removing stale ckpt [epoch 13] [took 0.00s]
epoch : 14
loss : 0.004471176147460938
quant_reg : 0.13511754792928696
quant_err : 0.13511754792928696
learning_rate : 2.566710416397524e-05
n_samples : 448000
n_steps : 3500
MSRVTT_full_val/t2v_metrics/R1: 21.12676056338028
MSRVTT_full_val/t2v_metrics/R5: 55.331991951710265
MSRVTT_full_val/t2v_metrics/R10: 71.42857142857143
MSRVTT_full_val/t2v_metrics/R50: 94.16498993963782
MSRVTT_full_val/t2v_metrics/MedR: 4.0
MSRVTT_full_val/t2v_metrics/MeanR: 12.142857142857142
MSRVTT_full_val/t2v_metrics/geometric_mean_R1-R5-R10: 43.70794553765725
MSRVTT_full_val/v2t_metrics/R1: 23.34004024144869
MSRVTT_full_val/v2t_metrics/R5: 61.56941649899397
MSRVTT_full_val/v2t_metrics/R10: 76.05633802816901
MSRVTT_full_val/v2t_metrics/R50: 95.77464788732394
MSRVTT_full_val/v2t_metrics/MedR: 4.0
MSRVTT_full_val/v2t_metrics/MeanR: 10.241448692152918
MSRVTT_full_val/v2t_metrics/geometric_mean_R1-R5-R10: 47.81168135488829
MSRVTT_full_test/t2v_metrics/R1: 6.655518394648829
MSRVTT_full_test/t2v_metrics/R5: 22.876254180602007
MSRVTT_full_test/t2v_metrics/R10: 34.68227424749164
MSRVTT_full_test/t2v_metrics/R50: 69.09698996655518
MSRVTT_full_test/t2v_metrics/MedR: 21.0
MSRVTT_full_test/t2v_metrics/MeanR: 65.12642140468228
MSRVTT_full_test/t2v_metrics/geometric_mean_R1-R5-R10: 17.413715969338597
MSRVTT_full_test/v2t_metrics/R1: 7.290969899665551
MSRVTT_full_test/v2t_metrics/R5: 25.217391304347824
MSRVTT_full_test/v2t_metrics/R10: 39.49832775919732
MSRVTT_full_test/v2t_metrics/R50: 75.88628762541806
MSRVTT_full_test/v2t_metrics/MedR: 16.0
MSRVTT_full_test/v2t_metrics/MeanR: 48.84280936454849
MSRVTT_full_test/v2t_metrics/geometric_mean_R1-R5-R10: 19.365173426644073
mnt_best : 18.439585353737368
not_improved_count: 2
Train Epoch: 15 [1/250 128/32000 (0%)] Loss: 0.00550 (QuantReg: 0.13445) QuantErr: 0.13445 batch_time=29.47384
Train Epoch: 15 [12/250 1536/32000 (5%)] Loss: 0.00330 (QuantReg: 0.13388) QuantErr: 0.13388 batch_time=0.40878
Train Epoch: 15 [23/250 2944/32000 (9%)] Loss: 0.00384 (QuantReg: 0.13553) QuantErr: 0.13553 batch_time=0.67091
Train Epoch: 15 [34/250 4352/32000 (14%)] Loss: 0.00336 (QuantReg: 0.13565) QuantErr: 0.13565 batch_time=0.40914
Train Epoch: 15 [45/250 5760/32000 (18%)] Loss: 0.00433 (QuantReg: 0.13655) QuantErr: 0.13655 batch_time=0.41244
Train Epoch: 15 [56/250 7168/32000 (22%)] Loss: 0.00437 (QuantReg: 0.13608) QuantErr: 0.13608 batch_time=0.41174
Train Epoch: 15 [67/250 8576/32000 (27%)] Loss: 0.00437 (QuantReg: 0.13585) QuantErr: 0.13585 batch_time=0.97937
Train Epoch: 15 [78/250 9984/32000 (31%)] Loss: 0.00632 (QuantReg: 0.13510) QuantErr: 0.13510 batch_time=0.42778
Train Epoch: 15 [89/250 11392/32000 (36%)] Loss: 0.00504 (QuantReg: 0.13576) QuantErr: 0.13576 batch_time=0.42239
Train Epoch: 15 [100/250 12800/32000 (40%)] Loss: 0.00527 (QuantReg: 0.13495) QuantErr: 0.13495 batch_time=0.43441
Train Epoch: 15 [111/250 14208/32000 (44%)] Loss: 0.00439 (QuantReg: 0.13379) QuantErr: 0.13379 batch_time=0.40381
Train Epoch: 15 [122/250 15616/32000 (49%)] Loss: 0.00412 (QuantReg: 0.13431) QuantErr: 0.13431 batch_time=0.45040
Train Epoch: 15 [133/250 17024/32000 (53%)] Loss: 0.00358 (QuantReg: 0.13299) QuantErr: 0.13299 batch_time=3.92166
Train Epoch: 15 [144/250 18432/32000 (58%)] Loss: 0.00333 (QuantReg: 0.13419) QuantErr: 0.13419 batch_time=0.43520
Train Epoch: 15 [155/250 19840/32000 (62%)] Loss: 0.00374 (QuantReg: 0.13561) QuantErr: 0.13561 batch_time=0.41696
Train Epoch: 15 [166/250 21248/32000 (66%)] Loss: 0.00341 (QuantReg: 0.13513) QuantErr: 0.13513 batch_time=0.41629
Train Epoch: 15 [177/250 22656/32000 (71%)] Loss: 0.00305 (QuantReg: 0.13585) QuantErr: 0.13585 batch_time=0.40525
Train Epoch: 15 [188/250 24064/32000 (75%)] Loss: 0.00362 (QuantReg: 0.13427) QuantErr: 0.13427 batch_time=0.41429
Train Epoch: 15 [199/250 25472/32000 (80%)] Loss: 0.00514 (QuantReg: 0.13502) QuantErr: 0.13502 batch_time=0.41698
Train Epoch: 15 [210/250 26880/32000 (84%)] Loss: 0.00558 (QuantReg: 0.13532) QuantErr: 0.13532 batch_time=4.36167
Train Epoch: 15 [221/250 28288/32000 (88%)] Loss: 0.00531 (QuantReg: 0.13758) QuantErr: 0.13758 batch_time=0.41812
Train Epoch: 15 [232/250 29696/32000 (93%)] Loss: 0.00336 (QuantReg: 0.13516) QuantErr: 0.13516 batch_time=0.42192
Train Epoch: 15 [243/250 31104/32000 (97%)] Loss: 0.00424 (QuantReg: 0.13438) QuantErr: 0.13438 batch_time=0.52782
Saving checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_full/checkpoint-epoch15.pth ...
Done in 15.924s
Updating 'best' checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_full/checkpoint-epoch15.pth ...
Done in 19.676s
removing stale ckpt [epoch 14] [took 0.00s]
epoch : 15
loss : 0.004247291564941406
quant_reg : 0.13527133613824843
quant_err : 0.13527133613824843
learning_rate : 2.4383748955776477e-05
n_samples : 480000
n_steps : 3750
MSRVTT_full_val/t2v_metrics/R1: 22.736418511066397
MSRVTT_full_val/t2v_metrics/R5: 56.33802816901409
MSRVTT_full_val/t2v_metrics/R10: 73.2394366197183
MSRVTT_full_val/t2v_metrics/R50: 96.17706237424547
MSRVTT_full_val/t2v_metrics/MedR: 4.0
MSRVTT_full_val/t2v_metrics/MeanR: 10.559356136820925