You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Presently, lace.Engine in PyLace does not support Pickling and cannot be easily used with Multiprocessing.
A workaround for this is to save the Engine to disk with Engine.save; however, the ergonomics of this could be improved.
There are a few options here:
Add #[derive(Serialize,Deserialize)] to CoreEngine and implement pickle as a wrapper around bincode or the like. This is memory inefficient as the entire Engine, data and all, are copied to each Python instance, but it is the simplest method.
Implement an out-of-process, perhaps a server/client model, which allows for Multiprocessing without the memory inefficiency.
I'm open to discussing potential solutions, as there's no clear best path.
The text was updated successfully, but these errors were encountered:
Presently,
lace.Engine
in PyLace does not support Pickling and cannot be easily used with Multiprocessing.A workaround for this is to save the Engine to disk with
Engine.save
; however, the ergonomics of this could be improved.There are a few options here:
#[derive(Serialize,Deserialize)]
toCoreEngine
and implement pickle as a wrapper aroundbincode
or the like. This is memory inefficient as the entireEngine
, data and all, are copied to each Python instance, but it is the simplest method.I'm open to discussing potential solutions, as there's no clear best path.
The text was updated successfully, but these errors were encountered: