hd_root completing with exit code 0 but truncated output files #859
Assignees
Comments
|
I reprocessed 1378 files from Sasha's list. 310 files failed with error
code !=0, all others seemingly completed successfully.
The output of the successful jobs can be found here:
/cache/halld/RunPeriod-2022-08/recon/ver01a/
This time, the log files for all jobs were saved permanently on the work
disk:
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/
Please check the files and let me know if the issue still appeared.
|
|
There is 158 files with the error message: Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/110743/stdout.110743_028.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/110746/stdout.110746_003.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/110771/stdout.110771_014.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/110773/stdout.110773_017.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/110788/stdout.110788_078.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/110800/stdout.110800_122.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/110802/stdout.110802_064.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/110808/stdout.110808_005.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/110810/stdout.110810_022.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/110812/stdout.110812_075.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/110820/stdout.110820_018.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/110820/stdout.110820_045.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/110822/stdout.110822_022.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/110822/stdout.110822_080.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/110846/stdout.110846_036.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/110852/stdout.110852_017.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/110858/stdout.110858_015.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/110869/stdout.110869_029.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/110931/stdout.110931_055.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/110937/stdout.110937_002.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/110942/stdout.110942_108.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/110943/stdout.110943_111.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/110944/stdout.110944_036.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/110951/stdout.110951_014.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/110951/stdout.110951_015.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/110953/stdout.110953_057.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/110954/stdout.110954_060.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/110955/stdout.110955_092.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/110961/stdout.110961_030.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/110961/stdout.110961_113.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/110965/stdout.110965_106.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/110971/stdout.110971_034.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/110972/stdout.110972_050.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/110972/stdout.110972_074.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111005/stdout.111005_006.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111006/stdout.111006_004.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111009/stdout.111009_055.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111009/stdout.111009_086.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111031/stdout.111031_014.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111048/stdout.111048_088.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111062/stdout.111062_061.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111078/stdout.111078_007.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111078/stdout.111078_098.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111082/stdout.111082_038.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111093/stdout.111093_018.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111101/stdout.111101_016.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111112/stdout.111112_012.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111114/stdout.111114_000.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111120/stdout.111120_008.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111124/stdout.111124_075.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111124/stdout.111124_111.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111136/stdout.111136_028.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111146/stdout.111146_066.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111156/stdout.111156_065.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111158/stdout.111158_069.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111163/stdout.111163_059.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111165/stdout.111165_039.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111172/stdout.111172_070.out:Error reading EVIO block header (at EOF - truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111172/stdout.111172_071.out:Error reading EVIO block header (at EOF - truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111173/stdout.111173_036.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111187/stdout.111187_017.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111222/stdout.111222_037.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111235/stdout.111235_011.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111239/stdout.111239_013.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111243/stdout.111243_011.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111257/stdout.111257_088.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111259/stdout.111259_040.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111267/stdout.111267_036.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111268/stdout.111268_081.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111272/stdout.111272_007.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111275/stdout.111275_002.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111282/stdout.111282_119.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111283/stdout.111283_013.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111287/stdout.111287_005.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111294/stdout.111294_044.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111335/stdout.111335_053.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111338/stdout.111338_069.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111342/stdout.111342_006.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111350/stdout.111350_031.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111353/stdout.111353_021.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111356/stdout.111356_088.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111366/stdout.111366_011.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111367/stdout.111367_088.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111370/stdout.111370_091.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111370/stdout.111370_092.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111378/stdout.111378_058.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111396/stdout.111396_024.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111419/stdout.111419_034.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111433/stdout.111433_007.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111437/stdout.111437_007.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111443/stdout.111443_012.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111446/stdout.111446_006.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111446/stdout.111446_026.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111460/stdout.111460_124.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111461/stdout.111461_085.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111475/stdout.111475_086.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111478/stdout.111478_114.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111501/stdout.111501_105.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111504/stdout.111504_067.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111512/stdout.111512_070.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111539/stdout.111539_018.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111558/stdout.111558_031.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111573/stdout.111573_021.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111576/stdout.111576_003.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111586/stdout.111586_112.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111588/stdout.111588_068.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111590/stdout.111590_063.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111592/stdout.111592_024.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111594/stdout.111594_064.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111595/stdout.111595_044.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111602/stdout.111602_012.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111611/stdout.111611_094.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111617/stdout.111617_114.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111625/stdout.111625_064.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111643/stdout.111643_081.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111656/stdout.111656_015.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111663/stdout.111663_015.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111700/stdout.111700_023.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111723/stdout.111723_046.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111731/stdout.111731_028.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111749/stdout.111749_101.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111752/stdout.111752_043.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111756/stdout.111756_070.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111759/stdout.111759_094.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111759/stdout.111759_116.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111777/stdout.111777_009.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111781/stdout.111781_039.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111785/stdout.111785_107.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111789/stdout.111789_007.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111820/stdout.111820_106.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111824/stdout.111824_057.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111831/stdout.111831_096.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111850/stdout.111850_067.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111856/stdout.111856_047.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111860/stdout.111860_106.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111865/stdout.111865_063.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111866/stdout.111866_041.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111880/stdout.111880_025.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111883/stdout.111883_083.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111884/stdout.111884_005.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111889/stdout.111889_012.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111896/stdout.111896_014.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111908/stdout.111908_020.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111933/stdout.111933_000.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111933/stdout.111933_004.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111950/stdout.111950_025.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111960/stdout.111960_004.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111971/stdout.111971_076.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111972/stdout.111972_032.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111978/stdout.111978_020.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111978/stdout.111978_121.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111986/stdout.111986_055.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111988/stdout.111988_054.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111988/stdout.111988_078.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111989/stdout.111989_040.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111997/stdout.111997_035.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111998/stdout.111998_079.out:Error reading EVIO event (truncated?)
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111999/stdout.111999_086.out:Error reading EVIO event (truncated?)
tks ig.
…________________________________
From: Alexander Austregesilo ***@***.***>
Sent: Tuesday, December 17, 2024 2:50 PM
To: ***@***.*** ***@***.***>
Cc: Alexander Somov ***@***.***>; Igal Jaegle ***@***.***>
Subject: Re: [EXTERNAL] [JeffersonLab/halld_recon] hd_root completing with exit code 0 but truncated output files (Issue #859)
I reprocessed 1378 files from Sasha's list. 310 files failed with error
code !=0, all others seemingly completed successfully.
The output of the successful jobs can be found here:
/cache/halld/RunPeriod-2022-08/recon/ver01a/
This time, the log files for all jobs were saved permanently on the work
disk:
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/
Please check the files and let me know if the issue still appeared.
|
|
Thanks !
…________________________________
From: Alexander Austregesilo ***@***.***>
Sent: Tuesday, December 17, 2024 3:05 PM
To: JeffersonLab/halld_recon ***@***.***>
Cc: Subscribed ***@***.***>
Subject: [EXTERNAL] Re: [JeffersonLab/halld_recon] hd_root completing with exit code 0 but truncated output files (Issue #859)
Let me add most of them have a Return Code 0 but not all
grep truncated /work/halld2/recon/RunPeriod-2022-08/ver01a/log/*/*.out | grep "Return Code" /work/halld2/recon/RunPeriod-2022-08/ver01a/log/*/*.out
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111977/stdout.111977_090.out:Return Code = 255
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111978/stdout.111978_020.out:Return Code = 3
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111978/stdout.111978_055.out:Return Code = 255
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111978/stdout.111978_121.out:Return Code = 3
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111984/stdout.111984_016.out:Return Code = 139
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111984/stdout.111984_084.out:Return Code = 0
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111985/stdout.111985_047.out:Return Code = 0
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111985/stdout.111985_065.out:Return Code = 0
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/111985/stdout.111985_068.out:Return Code = 0
________________________________
From: Alexander Austregesilo ***@***.***>
Sent: Tuesday, December 17, 2024 2:50 PM
To: ***@***.*** ***@***.***>
Cc: Alexander Somov ***@***.***>; Igal Jaegle ***@***.***>
Subject: Re: [EXTERNAL] [JeffersonLab/halld_recon] hd_root completing with exit code 0 but truncated output files (Issue #859)
I reprocessed 1378 files from Sasha's list. 310 files failed with error
code !=0, all others seemingly completed successfully.
The output of the successful jobs can be found here:
/cache/halld/RunPeriod-2022-08/recon/ver01a/
This time, the log files for all jobs were saved permanently on the work
disk:
/work/halld2/recon/RunPeriod-2022-08/ver01a/log/
Please check the files and let me know if the issue still appeared.
—
Reply to this email directly, view it on GitHub<https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_JeffersonLab_halld-5Frecon_issues_859-23issuecomment-2D2549500109&d=DwMFaQ&c=CJqEzB1piLOyyvZjb8YUQw&r=UEJkvUcBvE4mBa6l1pQs5Q&m=4n6x0zR-u2jyEmfwwCKI7uJ5RNI58JzuVIrtsBcAIIC-DanT9bUIgrMwS0YbCcqU&s=jOxOg5TVzBBBIQ4bLhuEf1ac1Dfd6Dd1FCdS96vXU-M&e=>, or unsubscribe<https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_notifications_unsubscribe-2Dauth_AD4KOGZQ2NPQHTI3ACZZFOD2GB7ZTAVCNFSM6AAAAABTOJRHY6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDKNBZGUYDAMJQHE&d=DwMFaQ&c=CJqEzB1piLOyyvZjb8YUQw&r=UEJkvUcBvE4mBa6l1pQs5Q&m=4n6x0zR-u2jyEmfwwCKI7uJ5RNI58JzuVIrtsBcAIIC-DanT9bUIgrMwS0YbCcqU&s=60O8-13mpPY9gEM7x-DamWNQ5p-tuUznoBUuBHAlLf0&e=>.
You are receiving this because you are subscribed to this thread.Message ID: ***@***.***>
|
|
All of the jobs that show the message "Error reading EVIO event (truncated?)" have a non-zero exit code, either 3 or 134. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
As reported by Igal in C&P. The production jobs are usually configured so that they do not save the log files if the hd_root exit code is 0, which indicates success. Igal found that approx 0.25 % of CPP jobs were affected by hd_root completing with exit code 0 but the output REST and skim files were truncated. When Ilya repeated these jobs he found no problems. Sasha reported some similar problems with approx 1% of PrimEx files, he sent Alex a list of evio files that caused these problems.
The text was updated successfully, but these errors were encountered: