Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Helm #8085

Merged
merged 258 commits into from
Dec 2, 2023
Merged

Helm #8085

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
258 commits
Select commit Hold shift + click to select a range
e77a650
fix zmq rebase issue
tthoraldson Sep 27, 2023
a718464
add checks for producer port and consumer port
tthoraldson Sep 27, 2023
6ecefaa
default to 0 consumers
tthoraldson Sep 27, 2023
178e8f9
fix two more unit tests
tthoraldson Sep 27, 2023
152e4fe
-
koenvanderveen Sep 27, 2023
d9354e3
Merge branch 'helm' of github.com:OpenMined/PySyft into helm
koenvanderveen Sep 27, 2023
ce54f9d
fix merge
koenvanderveen Sep 27, 2023
43190a0
-
koenvanderveen Sep 28, 2023
454418c
added shorter helm versions
teo-milea Sep 28, 2023
3acff4d
fixed non syft shorter helm code
teo-milea Sep 28, 2023
9a58e2c
found bug with serialization for hashabledict
teo-milea Sep 29, 2023
b1e7487
working shorter helm notebook with syft batch
teo-milea Oct 2, 2023
84437a1
clean up pr
koenvanderveen Oct 2, 2023
e6b2e58
fix testing setup
koenvanderveen Oct 2, 2023
5c29f70
Merge branch 'dev' of github.com:OpenMined/PySyft into helm
koenvanderveen Oct 2, 2023
e0282b6
clean up code
koenvanderveen Oct 2, 2023
84a6959
-
koenvanderveen Oct 4, 2023
c3df0c8
added parallel downloading and processing
teo-milea Oct 5, 2023
f93a5c1
added new ExecuteOncePerCombination
teo-milea Oct 5, 2023
57f9a25
added test notebook for parallel download for lines
teo-milea Oct 5, 2023
fbb2bda
trying to make docker work
koenvanderveen Oct 5, 2023
ac0e9f6
Merge branch 'helm' of github.com:OpenMined/PySyft into demo_improvem…
teo-milea Oct 6, 2023
92b3180
modified jobs printing
teo-milea Oct 9, 2023
a0fe1fa
added input policy state saving
teo-milea Oct 9, 2023
9c98183
added domain.jobs
teo-milea Oct 9, 2023
9c4c84e
fix lint
teo-milea Oct 9, 2023
431fc98
added test notebook
teo-milea Oct 10, 2023
fc60e2f
-
koenvanderveen Oct 10, 2023
1c9baf5
init mongo action store
koenvanderveen Oct 10, 2023
4c2df81
docker
koenvanderveen Oct 10, 2023
1fd920a
restructure notebook files
koenvanderveen Oct 11, 2023
55de3df
Merge branch 'helm' of github.com:OpenMined/PySyft into demo_improvem…
teo-milea Oct 11, 2023
0241f60
cleanup pr
koenvanderveen Oct 11, 2023
3167748
Merge branch 'helm' of github.com:OpenMined/PySyft into demo_improvem…
teo-milea Oct 11, 2023
f86f348
refactor docker compose files
koenvanderveen Oct 11, 2023
9be1bd7
add docker command instructions
koenvanderveen Oct 11, 2023
51640cf
added job time estimation
teo-milea Oct 13, 2023
87b9126
fixed concurrent logs issue
teo-milea Oct 13, 2023
5c62bee
moved new policy
teo-milea Oct 13, 2023
1df1cc6
revert accidental removal of ExactMatch
teo-milea Oct 13, 2023
12f46fa
removed new policy from init
teo-milea Oct 13, 2023
1224603
some clean up
teo-milea Oct 13, 2023
2eefe18
changes after feedback
teo-milea Oct 13, 2023
de718e5
fix lint
teo-milea Oct 16, 2023
0350660
finish docker setup
koenvanderveen Oct 16, 2023
1133f8f
clean up some stuff
koenvanderveen Oct 16, 2023
395e192
merge
koenvanderveen Oct 16, 2023
e943295
Merge branch 'dev' of github.com:OpenMined/PySyft into helm
teo-milea Oct 17, 2023
d026f15
merge dev
koenvanderveen Oct 20, 2023
a0a9346
added new service methods
teo-milea Oct 20, 2023
ca19c57
added new seaweed docker files
teo-milea Oct 20, 2023
f5a24b0
added new notebook for testing ux
teo-milea Oct 20, 2023
b98a724
Merge pull request #8187 from OpenMined/dataset_ux
koenvanderveen Oct 20, 2023
5a74e2e
fix merge
koenvanderveen Oct 20, 2023
cc0d819
replaced shell2http with flask server
teo-milea Oct 20, 2023
a3bc6c0
docker compose for seaweed moungting
koenvanderveen Oct 20, 2023
132efb4
fixing docker setup
koenvanderveen Oct 25, 2023
d1953b6
Updated docker compose for hagrid
madhavajay Oct 26, 2023
db37c2f
fix linting
koenvanderveen Oct 27, 2023
3504b2b
fix reprs, add buffer for downloading
koenvanderveen Oct 27, 2023
3c3d6eb
Fix list repr when something goes wrong one of the jobs
IonesioJunior Nov 7, 2023
ea35820
added safer context
teo-milea Nov 7, 2023
cf63128
fix lint
teo-milea Nov 7, 2023
de40e27
fix spawning up workers
koenvanderveen Nov 9, 2023
638977a
fix nb
koenvanderveen Nov 9, 2023
fec3985
merge
koenvanderveen Nov 10, 2023
ebf9d83
update port nb
koenvanderveen Nov 10, 2023
a69a0ef
Merge pull request #8196 from madhavajay/madhava/helm_improvements
koenvanderveen Nov 10, 2023
746a6ab
added context for producers
teo-milea Nov 13, 2023
2ab76c4
delay task consumption if not all inputs are ready
teo-milea Nov 13, 2023
9871c68
added notebook for testing
teo-milea Nov 13, 2023
d5fbec1
fix: fix rounding issue in eta_string
tcp Nov 13, 2023
b8fb1fc
refactor: use divmod in eta_string format_timedelta
tcp Nov 13, 2023
8893b97
lint: tox lint
tcp Nov 13, 2023
d5bf52b
test: some initial tests for eta_string
tcp Nov 13, 2023
658de66
test: parametrized eta_string
tcp Nov 13, 2023
64ca187
test: add float seconds timedelta case
tcp Nov 13, 2023
2bd7ceb
test: cleanup job instantiation
tcp Nov 13, 2023
e9e579f
lint: tox lint test
tcp Nov 13, 2023
8a5daea
lint: fix filename
tcp Nov 13, 2023
5020b76
split out sequential job part, fix linting
koenvanderveen Nov 14, 2023
82a33ee
merge
koenvanderveen Nov 14, 2023
8cb9365
implement file ux
koenvanderveen Nov 14, 2023
b821558
Merge pull request #8253 from OpenMined/syftfileux
koenvanderveen Nov 14, 2023
5e34e08
also show progress when done
koenvanderveen Nov 14, 2023
dc1f1a9
Merge branch 'helm-fix-time-rounding' of github.com:OpenMined/PySyft …
koenvanderveen Nov 14, 2023
f394eee
Merge branch 'helm-fix-time-rounding' of github.com:OpenMined/PySyft …
koenvanderveen Nov 14, 2023
6202d58
Merge branch 'helm' of github.com:OpenMined/PySyft into helm
koenvanderveen Nov 14, 2023
05ba394
Update SyftLog Object Version to also store stderr logs
IonesioJunior Nov 15, 2023
408ce5f
ADD new log service to allow Node ADMIN inspect error logs
IonesioJunior Nov 15, 2023
734b8d1
ADD exception stack trace (server side) in case of an Exception
IonesioJunior Nov 15, 2023
a55b74d
ADD new flags to Job.log, allowing client to also retrieve error logs
IonesioJunior Nov 15, 2023
e575789
added launch_job visitor
teo-milea Nov 15, 2023
ea57923
added nested requests to SubmitUserCode and UserCode
teo-milea Nov 15, 2023
6dfeeca
changed service api to take into account nested requests
teo-milea Nov 15, 2023
e27319b
added nested approval
teo-milea Nov 15, 2023
3643aeb
removed log line
teo-milea Nov 15, 2023
4ec625d
remove input policy state update
teo-milea Nov 15, 2023
58ef092
saved progress
teo-milea Nov 15, 2023
bf715d5
refactor datastructures
koenvanderveen Nov 16, 2023
e6ba933
Merge pull request #8268 from OpenMined/data_structures_refactor
koenvanderveen Nov 16, 2023
2a405be
merge with adding stacktrace + breaking code
koenvanderveen Nov 16, 2023
9f56ee4
update reprs, include code when throwing exceptions, merge helm, incl…
koenvanderveen Nov 16, 2023
1993d1a
Merge pull request #8224 from OpenMined/fix_broken_subjobs_list
koenvanderveen Nov 16, 2023
0a93e74
remove debug code
koenvanderveen Nov 17, 2023
4c84093
improved visitor search for launch_job
teo-milea Nov 20, 2023
095b337
removed nested requests at submit time
teo-milea Nov 20, 2023
2fb760a
added usercode search by service_func_name
teo-milea Nov 20, 2023
e65fd16
changed logic for code request
teo-milea Nov 20, 2023
fea704a
added nested request logic
teo-milea Nov 20, 2023
bd0861e
changed request service to use nested requests
teo-milea Nov 20, 2023
2e35d11
fix merge
teo-milea Nov 20, 2023
ba53e1d
fixed zmq queue after refactoring
teo-milea Nov 20, 2023
87c9088
Merge branch 'helm' of github.com:OpenMined/PySyft into nested_requests
teo-milea Nov 20, 2023
dc4c5d7
ADD new job_pid and JobStatus.INTERRUPTED variables
IonesioJunior Nov 20, 2023
06d340b
Move a piece of handle_message function to be executed via multiproce…
IonesioJunior Nov 20, 2023
f2edb0c
ADD new job_service.kill method
IonesioJunior Nov 20, 2023
e7da91d
ADD Job restart service
IonesioJunior Nov 20, 2023
22cb937
ADD Log.restart service
IonesioJunior Nov 20, 2023
9df527b
added new permissions to queue items
teo-milea Nov 21, 2023
e061c51
added error return to linked obj update
teo-milea Nov 21, 2023
6a541d7
added new queue permissions to handle message
teo-milea Nov 21, 2023
85d10d2
restricted usercode access in execute_byte_code
teo-milea Nov 21, 2023
edf982c
changed usercode execution to use new permission
teo-milea Nov 21, 2023
dc37cdf
changed action service to use new permission
teo-milea Nov 21, 2023
169ca10
fixed bug with nested_requests
teo-milea Nov 21, 2023
bf91f27
removed cascading approval of nested user_codes
teo-milea Nov 21, 2023
472b82a
added nested requests in UserCodeStatusChange repr
teo-milea Nov 21, 2023
fab79c2
added codes and nested requests to request repr
teo-milea Nov 21, 2023
b383bed
protocol updates
koenvanderveen Nov 21, 2023
dedddb4
merge dev
koenvanderveen Nov 21, 2023
cac6288
write migrations
koenvanderveen Nov 21, 2023
4e2cd57
rewrite some funcs
koenvanderveen Nov 21, 2023
52fce0d
ADD subjob check in restart method
IonesioJunior Nov 21, 2023
7a9a88a
remove deleted classes from protocol.json
shubham3121 Nov 22, 2023
d46a08e
- reset protocol version to dev
shubham3121 Nov 22, 2023
ccb17e3
Merge pull request #8270 from OpenMined/helm-migrations
koenvanderveen Nov 22, 2023
992d4a4
added syft info message for nested_requests
teo-milea Nov 22, 2023
4530e57
added identation to nested_requests repr
teo-milea Nov 22, 2023
96520fa
moved nested requests from UserCodeStatusChange to UserCode
teo-milea Nov 22, 2023
5b8ea81
-
koenvanderveen Nov 22, 2023
bed497a
add a test
koenvanderveen Nov 22, 2023
a843c52
add notebook
koenvanderveen Nov 22, 2023
904857c
fix stop param
koenvanderveen Nov 22, 2023
912a80f
Merge branch 'helm' of github.com:OpenMined/PySyft into helm
koenvanderveen Nov 22, 2023
398618c
fix/bug: fix iteration over data items in migrate data in action store
shubham3121 Nov 22, 2023
a1c4683
Merge branch 'helm-tests' of github.com:OpenMined/PySyft into helm
koenvanderveen Nov 22, 2023
2ee46b4
Merge branch 'helm' into feature/add_job_kill
IonesioJunior Nov 22, 2023
b1a9a77
added test for nested_requests
teo-milea Nov 22, 2023
2121331
finish nested_requests test
teo-milea Nov 22, 2023
9fb222b
modified usercode migration
teo-milea Nov 22, 2023
d131916
add pydantic attrs to pass through attrs in Action Object to make to_…
shubham3121 Nov 23, 2023
17c799a
added result object initialization when creating the job
teo-milea Nov 23, 2023
8672551
added syft_resolved field in action object
teo-milea Nov 23, 2023
159710b
added peek function to action_service
teo-milea Nov 23, 2023
1f27783
working job promise
teo-milea Nov 23, 2023
a482706
test fixes
koenvanderveen Nov 23, 2023
04e5c19
Merge branch 'helm' of github.com:OpenMined/PySyft into job_composition
teo-milea Nov 23, 2023
47e7d65
another test
koenvanderveen Nov 23, 2023
af0ddea
test with allowed inputs for node identity
koenvanderveen Nov 23, 2023
7a1df79
fix test accept deny
koenvanderveen Nov 23, 2023
4d1db8f
Merge branch 'dev' of github.com:OpenMined/PySyft into helm
koenvanderveen Nov 23, 2023
85fe51a
fix notebook tests api
koenvanderveen Nov 23, 2023
f49f9ea
Remove job kill from job service
IonesioJunior Nov 23, 2023
d0a40f5
Remove unused package
IonesioJunior Nov 23, 2023
fb674fa
ADD Monitor thread to monitor jobs
IonesioJunior Nov 23, 2023
71026bf
ADD INTERRUPTED Enum into QueueItem status enums to match with JobSta…
IonesioJunior Nov 23, 2023
0d048b3
Merge remote-tracking branch 'origin/feature/add_job_kill' into featu…
IonesioJunior Nov 23, 2023
28f634e
ADD psutil as a syft dependency
IonesioJunior Nov 23, 2023
121be9b
Merge branch 'helm' into feature/job_restart
IonesioJunior Nov 23, 2023
7215c5c
Merge branch 'helm' into feature/add_job_kill
IonesioJunior Nov 23, 2023
b48feaa
Remove artificial JobItem from protocol_version
IonesioJunior Nov 23, 2023
4519211
Merge remote-tracking branch 'origin/feature/add_job_kill' into featu…
IonesioJunior Nov 23, 2023
efe8c33
added test notebook
teo-milea Nov 24, 2023
ceb94e9
Merge branch 'helm' of github.com:OpenMined/PySyft into nested_requests
teo-milea Nov 24, 2023
047292d
fixed usercodeV1
teo-milea Nov 24, 2023
4609bfb
usercodestatuschange version
teo-milea Nov 24, 2023
94d5c5e
added queue versioning
teo-milea Nov 24, 2023
9e64283
fixed object versioning
teo-milea Nov 24, 2023
8498fe7
fix notebooks tests except enclave tests
koenvanderveen Nov 24, 2023
41a346e
Merge branch 'helm' of github.com:OpenMined/PySyft into job_composition
teo-milea Nov 24, 2023
9749a6e
fix action None in node.py
teo-milea Nov 24, 2023
ce128d7
fix .get.get()
koenvanderveen Nov 24, 2023
5b6aa65
fixed request test failling
teo-milea Nov 24, 2023
f916dde
latest versions
teo-milea Nov 24, 2023
7204016
Merge branch 'job_composition' of github.com:OpenMined/PySyft into helm
koenvanderveen Nov 24, 2023
ac083e7
add test notebook
teo-milea Nov 24, 2023
dcda5e7
lint
koenvanderveen Nov 24, 2023
deefaf7
merge
koenvanderveen Nov 24, 2023
c4884d7
fix
koenvanderveen Nov 27, 2023
b4926be
merge job restart
koenvanderveen Nov 27, 2023
9681ea7
fix problems with worker serialization
koenvanderveen Nov 27, 2023
4df732f
merge dev
koenvanderveen Nov 27, 2023
57f7b0e
add and set migrate flag only during node orchestration
shubham3121 Nov 28, 2023
50df439
Merge branch 'dev' into helm
shubham3121 Nov 28, 2023
bfb8ab0
debug blob storage access via global scope
koenvanderveen Nov 28, 2023
12b6dfd
reset locks when resetting node
koenvanderveen Nov 28, 2023
91b93f4
Merge branch 'helm' of github.com:OpenMined/PySyft into feature/add_j…
koenvanderveen Nov 28, 2023
8687cee
skip some tests on mac
koenvanderveen Nov 28, 2023
eb1de94
Merge pull request #8272 from OpenMined/feature/add_job_kill
koenvanderveen Nov 28, 2023
d7c3437
fix bug with enclaves
koenvanderveen Nov 28, 2023
30f77a1
security fixes + add flaky for zmq test
koenvanderveen Nov 29, 2023
6ab073f
add flaky
koenvanderveen Nov 29, 2023
6fa599e
merge dev
koenvanderveen Nov 29, 2023
7df7007
fix circular import
koenvanderveen Nov 29, 2023
a188278
mark syft function test as flaky
koenvanderveen Nov 29, 2023
e46dbbb
fix imports
koenvanderveen Nov 29, 2023
f854378
ulimit
koenvanderveen Nov 29, 2023
731ad2c
tox
koenvanderveen Nov 29, 2023
276578c
Detect json lines based on file extension
kiendang Nov 29, 2023
450cb4d
Fix typo
kiendang Nov 29, 2023
4d73a38
Remove redundant is_ok check
kiendang Nov 29, 2023
d5f24ac
skip zmq tests on windows
koenvanderveen Nov 29, 2023
647320d
Merge branch 'helm' of github.com:OpenMined/PySyft into helm
koenvanderveen Nov 29, 2023
54bfff2
fixtures for zmq tests
koenvanderveen Nov 29, 2023
d8b25cb
remove protocol files
koenvanderveen Nov 29, 2023
2a67129
kill zmq properly on flaky retries
koenvanderveen Nov 29, 2023
4a8c647
-
koenvanderveen Nov 30, 2023
6384193
-
koenvanderveen Nov 30, 2023
4b39a63
-
koenvanderveen Nov 30, 2023
416cf6e
add some type annotations for queue consumer and producer
khoaguin Nov 30, 2023
67354e3
fix zmq_queue test
shubham3121 Nov 30, 2023
def79ba
add missing lock at consumer level
shubham3121 Nov 30, 2023
f0e9d9d
revert to creating a global lock
shubham3121 Nov 30, 2023
8e30bbc
remove locking from sqlite backing store
shubham3121 Nov 30, 2023
b4ff657
fix test
koenvanderveen Nov 30, 2023
7497c1f
fix fixture
koenvanderveen Nov 30, 2023
9f563fa
fix sec
koenvanderveen Nov 30, 2023
7908d55
ADD missing env vars in default.env
IonesioJunior Dec 1, 2023
075518e
Update default.env
IonesioJunior Dec 1, 2023
8867ff7
Remove unused script / fix seaweedfs docker entrypoint
IonesioJunior Dec 1, 2023
90fd8d5
Merge pull request #8298 from OpenMined/hotfix/hb_880
shubham3121 Dec 1, 2023
7c848a3
Merge branch 'helm' into hotfix/hb_881
shubham3121 Dec 1, 2023
9cd067f
Merge pull request #8297 from OpenMined/hotfix/hb_881
shubham3121 Dec 1, 2023
91c1582
Fixed SQLiteBackingStore to handle concurrency
madhavajay Dec 1, 2023
c92a723
Changed hardcoded /tmp path to tempfile.TemporaryDirectory
madhavajay Dec 1, 2023
02ee5b0
Merge pull request #8300 from madhavajay/madhava/fix-sqlite-fd
koenvanderveen Dec 1, 2023
69d4b4f
-
koenvanderveen Dec 1, 2023
c641b32
fix notebook test
koenvanderveen Dec 1, 2023
e848cb2
fix stack tests
koenvanderveen Dec 1, 2023
8ac3113
fix notebook
koenvanderveen Dec 1, 2023
a8a7d1a
fix few comments
koenvanderveen Dec 1, 2023
d1cbb28
remove settings
koenvanderveen Dec 1, 2023
97d926d
fix notebook
koenvanderveen Dec 1, 2023
54a4475
trigger CI
koenvanderveen Dec 1, 2023
3407060
fix nb
koenvanderveen Dec 1, 2023
16b42a0
fix typo
koenvanderveen Dec 1, 2023
928905b
Merge branch 'helm' into file-debugging
koenvanderveen Dec 1, 2023
ed3a7ea
Merge pull request #8292 from OpenMined/file-debugging
koenvanderveen Dec 1, 2023
fee7b26
clean up notebooks
koenvanderveen Dec 1, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -71,5 +71,7 @@ js/node_modules/*
#nohup
nohup.out

# notebook data
notebooks/helm/scenario_data.jsonl
# tox syft.build.helm generated file
out.txt
9 changes: 8 additions & 1 deletion notebooks/api/0.8/00-load-data.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -662,6 +662,13 @@
"if node.node_type.value == \"python\":\n",
" node.land()"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {},
"outputs": [],
"source": []
}
],
"metadata": {
Expand All @@ -680,7 +687,7 @@
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.10.8"
"version": "3.9.16"
},
"toc": {
"base_numbering": 1,
Expand Down
4 changes: 2 additions & 2 deletions notebooks/api/0.8/01-submit-code.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -504,7 +504,7 @@
},
"outputs": [],
"source": [
"assert isinstance(result, sy.SyftNotReady)"
"assert isinstance(result, sy.SyftError)"
]
},
{
Expand Down Expand Up @@ -554,7 +554,7 @@
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.11.3"
"version": "3.9.16"
},
"toc": {
"base_numbering": 1,
Expand Down
12 changes: 10 additions & 2 deletions notebooks/api/0.8/07-domain-register-control-flow.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -56,7 +56,7 @@
"metadata": {},
"outputs": [],
"source": [
"node = sy.orchestra.launch(name=\"test-domain-1\", port=\"auto\", dev_mode=True)"
"node = sy.orchestra.launch(name=\"test-domain-1\", port=\"auto\", dev_mode=True, reset=True)"
]
},
{
Expand Down Expand Up @@ -284,6 +284,14 @@
"if node.node_type.value == \"python\":\n",
" node.land()"
]
},
{
"cell_type": "code",
"execution_count": null,
"id": "58f96130",
"metadata": {},
"outputs": [],
"source": []
}
],
"metadata": {
Expand All @@ -302,7 +310,7 @@
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.10.8"
"version": "3.9.16"
},
"toc": {
"base_numbering": 1,
Expand Down
30 changes: 27 additions & 3 deletions notebooks/api/0.8/09-blob-storage.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -164,6 +164,9 @@
"def retrieve_file(client, blob_storage_entry_id: sy.UID) -> Path:\n",
" blob_retrieval = client.api.services.blob_storage.read(blob_storage_entry_id)\n",
" file = blob_retrieval.read()\n",
" content = file.read()\n",
" with open(file.file_name, \"wb\") as f:\n",
" f.write(content)\n",
" return Path(file.file_name)"
]
},
Expand Down Expand Up @@ -193,15 +196,17 @@
"metadata": {},
"outputs": [],
"source": [
"retrieved_file = retrieve_file(domain_client, uploaded_file_storage_id)"
"blob_retrieval = domain_client.api.services.blob_storage.read(uploaded_file_storage_id)"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {},
"outputs": [],
"source": []
"source": [
"retrieved_file = retrieve_file(domain_client, uploaded_file_storage_id)"
]
},
{
"cell_type": "markdown",
Expand All @@ -226,6 +231,15 @@
"Retrieved file"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {},
"outputs": [],
"source": [
"data_file"
]
},
{
"cell_type": "code",
"execution_count": null,
Expand Down Expand Up @@ -271,6 +285,16 @@
"data_ptr = action_object.send(domain_client)"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {},
"outputs": [],
"source": [
"with open(action_object.syft_action_data.file_name, \"wb\") as f:\n",
" f.write(action_object.syft_action_data.read())"
]
},
{
"cell_type": "code",
"execution_count": null,
Expand Down Expand Up @@ -400,7 +424,7 @@
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.11.1"
"version": "3.9.16"
},
"toc": {
"base_numbering": 1,
Expand Down
Loading
Loading