Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Download error, maybe joblib problem #5

Open
anson-07 opened this issue Jul 23, 2020 · 0 comments
Open

Download error, maybe joblib problem #5

anson-07 opened this issue Jul 23, 2020 · 0 comments

Comments

@anson-07
Copy link

I used --trim --num-jobs 10 and got this error after downloading for like around 30 videos... Please help...

Start downloading:  -4Tdepho0iU
Start downloading:  -54-4pEYATY
exception calling callback for <Future at 0x152f0363a08 state=finished raised BrokenProcessPool>
joblib.externals.loky.process_executor._RemoteTraceback:
"""
Traceback (most recent call last):
  File "C:\Users\roxas\Anaconda3\envs\tf_gpu\lib\site-packages\joblib\externals\loky\process_executor.py", line 616, in wait_result_broken_or_wakeup
    result_item = result_reader.recv()
  File "C:\Users\roxas\Anaconda3\envs\tf_gpu\lib\multiprocessing\connection.py", line 251, in recv
    return _ForkingPickler.loads(buf.getbuffer())
TypeError: __init__() missing 1 required positional argument: 'pattern'
"""

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "C:\Users\roxas\Anaconda3\envs\tf_gpu\lib\site-packages\joblib\externals\loky\_base.py", line 625, in _invoke_callbacks
    callback(self)
  File "C:\Users\roxas\Anaconda3\envs\tf_gpu\lib\site-packages\joblib\parallel.py", line 347, in __call__
    self.parallel.dispatch_next()
  File "C:\Users\roxas\Anaconda3\envs\tf_gpu\lib\site-packages\joblib\parallel.py", line 780, in dispatch_next
    if not self.dispatch_one_batch(self._original_iterator):
  File "C:\Users\roxas\Anaconda3\envs\tf_gpu\lib\site-packages\joblib\parallel.py", line 847, in dispatch_one_batch
    self._dispatch(tasks)
  File "C:\Users\roxas\Anaconda3\envs\tf_gpu\lib\site-packages\joblib\parallel.py", line 765, in _dispatch
    job = self._backend.apply_async(batch, callback=cb)
  File "C:\Users\roxas\Anaconda3\envs\tf_gpu\lib\site-packages\joblib\_parallel_backends.py", line 531, in apply_async
    future = self._workers.submit(SafeFunction(func))
  File "C:\Users\roxas\Anaconda3\envs\tf_gpu\lib\site-packages\joblib\externals\loky\reusable_executor.py", line 178, in submit
    fn, *args, **kwargs)
  File "C:\Users\roxas\Anaconda3\envs\tf_gpu\lib\site-packages\joblib\externals\loky\process_executor.py", line 1102, in submit
    raise self._flags.broken
joblib.externals.loky.process_executor.BrokenProcessPool: A result has failed to un-serialize. Please ensure that the objects returned by the function are always picklable.
joblib.externals.loky.process_executor._RemoteTraceback: 
"""
Traceback (most recent call last):
  File "C:\Users\roxas\Anaconda3\envs\tf_gpu\lib\site-packages\joblib\externals\loky\process_executor.py", line 616, in wait_result_broken_or_wakeup
    result_item = result_reader.recv()
  File "C:\Users\roxas\Anaconda3\envs\tf_gpu\lib\multiprocessing\connection.py", line 251, in recv
    return _ForkingPickler.loads(buf.getbuffer())
TypeError: __init__() missing 1 required positional argument: 'pattern'
"""

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "download.py", line 165, in <module>
    main(**vars(p.parse_args()))
  File "download.py", line 143, in main
    row, label_to_dir, trim, count) for count, row in links_df.iterrows())
  File "C:\Users\roxas\Anaconda3\envs\tf_gpu\lib\site-packages\joblib\parallel.py", line 1042, in __call__
    self.retrieve()
  File "C:\Users\roxas\Anaconda3\envs\tf_gpu\lib\site-packages\joblib\parallel.py", line 921, in retrieve
    self._output.extend(job.get(timeout=self.timeout))
  File "C:\Users\roxas\Anaconda3\envs\tf_gpu\lib\site-packages\joblib\_parallel_backends.py", line 542, in wrap_future_result
    return future.result(timeout=timeout)
  File "C:\Users\roxas\Anaconda3\envs\tf_gpu\lib\concurrent\futures\_base.py", line 435, in result
    return self.__get_result()
  File "C:\Users\roxas\Anaconda3\envs\tf_gpu\lib\concurrent\futures\_base.py", line 384, in __get_result
    raise self._exception
  File "C:\Users\roxas\Anaconda3\envs\tf_gpu\lib\site-packages\joblib\externals\loky\_base.py", line 625, in _invoke_callbacks
    callback(self)
  File "C:\Users\roxas\Anaconda3\envs\tf_gpu\lib\site-packages\joblib\parallel.py", line 347, in __call__
    self.parallel.dispatch_next()
  File "C:\Users\roxas\Anaconda3\envs\tf_gpu\lib\site-packages\joblib\parallel.py", line 780, in dispatch_next
    if not self.dispatch_one_batch(self._original_iterator):
  File "C:\Users\roxas\Anaconda3\envs\tf_gpu\lib\site-packages\joblib\parallel.py", line 847, in dispatch_one_batch
    self._dispatch(tasks)
  File "C:\Users\roxas\Anaconda3\envs\tf_gpu\lib\site-packages\joblib\parallel.py", line 765, in _dispatch
    job = self._backend.apply_async(batch, callback=cb)
  File "C:\Users\roxas\Anaconda3\envs\tf_gpu\lib\site-packages\joblib\_parallel_backends.py", line 531, in apply_async
    future = self._workers.submit(SafeFunction(func))
  File "C:\Users\roxas\Anaconda3\envs\tf_gpu\lib\site-packages\joblib\externals\loky\reusable_executor.py", line 178, in submit
    fn, *args, **kwargs)
  File "C:\Users\roxas\Anaconda3\envs\tf_gpu\lib\site-packages\joblib\externals\loky\process_executor.py", line 1102, in submit
    raise self._flags.broken
joblib.externals.loky.process_executor.BrokenProcessPool: A result has failed to un-serialize. Please ensure that the objects returned by the function are always picklable.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant