Skip to content

Commit

Permalink
ignore tmp folder of rsync (transferred but rsync got a failure)
Browse files Browse the repository at this point in the history
  • Loading branch information
nicolas-f committed Jun 26, 2024
1 parent 65952d3 commit 5979f4f
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -54,7 +54,7 @@ def epoch_to_elasticsearch_date(epoch):
def fetch_data(args):
for root, dirs, files in os.walk(args.json_input_folder):
# ignore partially transferred files of rsync (will be re-downloaded/completed later)
if ".~tmp~" in dirs:
if ".~tmp~" in root:
continue
for name in files:
file_path = os.path.join(root, name)
Expand Down

0 comments on commit 5979f4f

Please sign in to comment.