DAV Upload of a 38 MB file as guest user is very slow

[jnweiger]

Seen with 0.12.4-rc.1

A 38 MB SafarSetup.exe file upload via desktop client took ca 30 min to complete.

From the client log, it seems, that some throtteling is active. But the client settings page has everything deactivated.

---

client log has:

24-01-23 15:49:18:927 [ info sync.networkjob.propfind ]:        LSCOL of QUrl("https://oc10134-guests-0124rc1-20240123.jw-qa.owncloud.works/
remote.php/dav/files/[email protected]/") FINISHED WITH STATUS "OK"
24-01-23 15:49:18:928 [ debug sync.networkjob ] [ OCC::AbstractNetworkJob::slotFinished ]:      Network job finished OCC::RequestEtagJob(OCC
::Account("[email protected]@oc10134-guests-0124rc1-20240123.jw-qa.owncloud.works"), "https://oc10134-guests-0124rc1-20240123.jw-qa.owncloud
.works/remote.php/dav/files/[email protected]/", "PROPFIND", Original-Request-ID: "a9216b1a-2f21-48f8-a8c1-47681fe2f7a9", X-Request-ID: "a92
16b1a-2f21-48f8-a8c1-47681fe2f7a9")
24-01-23 15:49:19:681 [ info sync.httplogger ]: "dcdfa937-a676-4b1d-a7ca-c590cd49ae8c: Response: PROPFIND 207 (994ms) https://oc10134-guests
-0124rc1-20240123.jw-qa.owncloud.works/remote.php/dav/files/admin/ Header: { Date: Tue, 23 Jan 2024 14:49:20 GMT, Server: Apache/2.4.41 (Ubu
ntu), Strict-Transport-Security: max-age=15552000; includeSubDomains, X-Content-Type-Options: nosniff, X-XSS-Protection: 0, X-Robots-Tag: no
ne, X-Frame-Options: SAMEORIGIN, X-Download-Options: noopen, X-Permitted-Cross-Domain-Policies: none, Expires: Thu, 19 Nov 1981 08:52:00 GMT
, Cache-Control: no-store, no-cache, must-revalidate, Pragma: no-cache, Set-Cookie: oc_sessionPassphrase=0oQbHUaKhn7%2BoT43sgStXdxkD2w5cpMaN
MuZuNlttdQGzErxopvQqrBRvq1pBNGQu%2Fbye8C6NdlmIznNv0EjEQXXgZRjx%2FgLOXdGk1KxNihYTafAXXTytR1lbsWupypr; expires=Tue, 23-Jan-2024 15:09:20 GMT; 
Max-Age=1200; path=/; secure; HttpOnly; SameSite=Strict, Content-Security-Policy: default-src 'none';, Vary: Brief,Prefer, DAV: 1, 3, extend
ed-mkcol, 2, Content-Length: 351, Keep-Alive: timeout=5, max=100, Connection: Keep-Alive, Content-Type: application/xml; charset=utf-8, } Da
ta: [<?xml version=\"1.0\"?>\n<d:multistatus xmlns:d=\"DAV:\" xmlns:s=\"http://sabredav.org/ns\" xmlns:oc=\"http://owncloud.org/ns\"><d:resp
onse><d:href>/remote.php/dav/files/admin/</d:href><d:propstat><d:prop><d:getetag>&quot;e56cf18c675cc73b4f6d32c9bfea93be&quot;</d:getetag></d
:prop><d:status>HTTP/1.1 200 OK</d:status></d:propstat></d:response></d:multistatus>\n]"
24-01-23 15:49:19:681 [ info sync.networkjob.propfind ]:        LSCOL of QUrl("https://oc10134-guests-0124rc1-20240123.jw-qa.owncloud.works/
remote.php/dav/files/admin/") FINISHED WITH STATUS "OK"
24-01-23 15:49:19:682 [ debug sync.networkjob ] [ OCC::AbstractNetworkJob::slotFinished ]:      Network job finished OCC::RequestEtagJob(OCC
::Account("[email protected]"), "https://oc10134-guests-0124rc1-20240123.jw-qa.owncloud.works/remot
e.php/dav/files/admin/", "PROPFIND", Original-Request-ID: "dcdfa937-a676-4b1d-a7ca-c590cd49ae8c", X-Request-ID: "dcdfa937-a676-4b1d-a7ca-c59
0cd49ae8c")
24-01-23 15:49:31:964 [ info sync.httplogger ]: "e7643319-c58c-4c79-91a1-3de2bd12b474: Response: PUT 201 (52074ms) https://oc10134-guests-01
24rc1-20240123.jw-qa.owncloud.works/remote.php/dav/uploads/[email protected]/840352976/0000000037569032 Header: { Date: Tue, 23 Jan 2024 14:
48:40 GMT, Server: Apache/2.4.41 (Ubuntu), Strict-Transport-Security: max-age=15552000; includeSubDomains, X-Content-Type-Options: nosniff, 
X-XSS-Protection: 0, X-Robots-Tag: none, X-Frame-Options: SAMEORIGIN, X-Download-Options: noopen, X-Permitted-Cross-Domain-Policies: none, E
xpires: Thu, 19 Nov 1981 08:52:00 GMT, Cache-Control: no-store, no-cache, must-revalidate, Pragma: no-cache, Set-Cookie: oc_sessionPassphras
e=YapqlAq1Gv6iMbSOul2JEcvRVWeh7CdvUbfPq%2Fuvs%2Fu%2BG7pjbPlNIaUoTT7zZmhGxk53esXvMHW%2BaIS%2FtjPIItSNdBE0cUhIDxaYLqdwS12A8Yuhoctv65nS%2FJjHrU
t9; expires=Tue, 23-Jan-2024 15:08:40 GMT; Max-Age=1200; path=/; secure; HttpOnly; SameSite=Strict, Content-Security-Policy: default-src 'no
ne';, OC-FileId: 00000143ocq33b9jd04f, Content-Length: 0, Keep-Alive: timeout=5, max=81, Connection: Keep-Alive, Content-Type: text/html; ch
arset=UTF-8, } Data: []"
24-01-23 15:49:31:964 [ info sync.networkjob.put ]:     PUT of "https://oc10134-guests-0124rc1-20240123.jw-qa.owncloud.works/remote.php/dav/
uploads/[email protected]/840352976/0000000037569032" FINISHED WITH STATUS "OK" 201 "Created"
24-01-23 15:49:31:964 [ info sync.propagator.upload.ng ]:       Chunked upload of 925544 bytes took 52077 ms, desired is 60000 ms, expected 
good chunk size is 1066356 bytes and nudged next chunk size to  1086675 bytes
24-01-23 15:49:31:965 [ info sync.networkjob ]: Created OCC::MoveJob(OCC::Account("[email protected]@oc10134-guests-0124rc1-20240123.jw-qa.o
wncloud.works"), "https://oc10134-guests-0124rc1-20240123.jw-qa.owncloud.works/remote.php/dav/uploads/[email protected]/840352976/.file", "M
OVE", Original-Request-ID: "90cbecbe-ed80-4122-98f3-96f19837de66", X-Request-ID: "90cbecbe-ed80-4122-98f3-96f19837de66") for OCC::PropagateU
ploadFileNG(0x1e28510)

---

https://oc10134-guests-0124rc1-20240123.jw-qa.owncloud.works/ocs/v1.php/cloud/capabilities?format=json returns

{"ocs":{"meta":{"status":"ok","statuscode":100,"message":"OK","totalitems":"","itemsperpage":""},"data":{"version":{"major":10,"minor":13,"micro":4,"string":"10.13.4","edition":"Community","product":"ownCloud"},"capabilities":{"core":{"pollinterval":30000,"webdav-root":"remote.php\/webdav","status":{"installed":true,"maintenance":false,"needsDbUpgrade":false,"version":"10.13.4.1","versionstring":"10.13.4","edition":"Community","productname":"ownCloud","product":"ownCloud","hostname":"jw-oc10134-guests-0124rc1-20240123-o8l"},"support-url-signing":true},"files":{"app_providers":[{"enabled":true,"version":"1.1.0","apps_url":"\/app\/list","open_web_url":"\/app\/open-with-web","new_url":"\/app\/new"}],"privateLinks":true,"privateLinksDetailsParam":true,"bigfilechunking":true,"blacklisted_files":[".htaccess"],"blacklisted_files_regex":"\\.(part|filepart)$","favorites":true,"file_locking_support":true,"file_locking_enable_file_action":false,"undelete":true,"versioning":true},"guests_v1":{"enabled":true},"checksums":{"supportedTypes":["SHA1"],"preferredUploadType":"SHA1"},"dav":{"chunking":"1.0","reports":["search-files"],"propfind":{"depth_infinity":false},"trashbin":"1.0"},"files_sharing":{"api_enabled":true,"public":{"enabled":true,"password":{"enforced_for":{"read_only":false,"read_write":false,"upload_only":false,"read_write_delete":false},"enforced":false},"roles_api":true,"can_create_public_link":true,"expire_date":{"enabled":false},"send_mail":false,"social_share":true,"upload":true,"multiple":true,"supports_upload_only":true,"defaultPublicLinkShareName":"\u00d6ffentlicher Link"},"user":{"send_mail":false,"profile_picture":true,"expire_date":{"enabled":false}},"group":{"expire_date":{"enabled":false}},"remote":{"expire_date":{"enabled":false}},"resharing":true,"group_sharing":true,"auto_accept_share":true,"share_with_group_members_only":true,"share_with_membership_groups_only":true,"can_share":true,"user_enumeration":{"enabled":true,"group_members_only":false},"default_permissions":31,"providers_capabilities":{"ocinternal":{"user":["shareExpiration"],"group":["shareExpiration"],"link":["shareExpiration","passwordProtected"]},"ocFederatedSharing":{"remote":["shareExpiration"]}},"federation":{"outgoing":true,"incoming":true},"search_min_length":2},"notifications":{"ocs-endpoints":["list","get","delete"]}}}}}

---

Server log has:

{"reqId":"5f3b33bb-1a61-41e2-a7a7-a709f70c9d2b","level":0,"time":"2024-01-23T14:50:11+00:00","remoteAddr":"80.139.80.57","user":"[email protected]","app":"filesystem","method":"PROPFIND","url":"\/remote.php\/dav\/files\/[email protected]\/","message":"Storage wrapper 'oc_readonly' was not registered via the 'OC_Filesystem - preSetup' hook which could cause potential problems."}
{"reqId":"Za-SJ33H0Wf6VsTLMmaUtQAAABE","level":0,"time":"2024-01-23T14:50:15+00:00","remoteAddr":"80.139.80.57","user":"admin","app":"OC\\User\\Session::validateToken","method":"GET","url":"\/ocs\/v2.php\/apps\/notifications\/api\/v1\/notifications?format=json","message":"token d588b439ce01e4f29774e3a99e41fd8c4722bc76d4371affc5ad7674dcc0cd0d7b113192bc992bdabb10432b47eca4187ce97c3d56cb654dbf9add7fc936b197 with token id 1 found, validating"}
{"reqId":"Za-SJ33H0Wf6VsTLMmaUtQAAABE","level":0,"time":"2024-01-23T14:50:15+00:00","remoteAddr":"80.139.80.57","user":"admin","app":"OC\\Authentication\\Token\\DefaultTokenProvider::updateTokenActivity","method":"GET","url":"\/ocs\/v2.php\/apps\/notifications\/api\/v1\/notifications?format=json","message":"updating activity of token 1 to 1706021415"}
{"reqId":"Za-SJ33H0Wf6VsTLMmaUtQAAABE","level":0,"time":"2024-01-23T14:50:15+00:00","remoteAddr":"80.139.80.57","user":"admin","app":"OC\\User\\Session::validateToken","method":"GET","url":"\/ocs\/v2.php\/apps\/notifications\/api\/v1\/notifications?format=json","message":"token d588b439ce01e4f29774e3a99e41fd8c4722bc76d4371affc5ad7674dcc0cd0d7b113192bc992bdabb10432b47eca4187ce97c3d56cb654dbf9add7fc936b197 with token id 1 found, validating"}
{"reqId":"dc9a1234-82f7-42b0-aa6e-46cffb9912b1","level":0,"time":"2024-01-23T14:50:19+00:00","remoteAddr":"80.139.80.57","user":"[email protected]","app":"no app in context","method":"PROPFIND","url":"\/remote.php\/dav\/files\/[email protected]\/","message":"Add new user attributes key 'whitelistedAppsForGuests' has value ',core,files,dav,federatedfilesharing,guests,encryption,files_primary_s3,files_antivirus,files_external,files_external_dropbox,files_external_ftp,files_ldap_home,files_onedrive,sharepoint,files_external_s3,windows_network_drive,admin_audit,firewall,ransomware_protection,settings,avatar,files_texteditor,files_trashbin,files_versions,files_sharing,activity,firstrunwizard,gallery,notifications,password_policy,oauth2,files_pdfviewer,files_mediaviewer,richdocuments,onlyoffice,wopi,oco_selfservice,twofactor_totp,impersonate' for guest user [email protected]"}
{"reqId":"dc9a1234-82f7-42b0-aa6e-46cffb9912b1","level":0,"time":"2024-01-23T14:50:19+00:00","remoteAddr":"80.139.80.57","user":"[email protected]","app":"filesystem","method":"PROPFIND","url":"\/remote.php\/dav\/files\/[email protected]\/","message":"Storage wrapper 'oc_readonly' was not registered via the 'OC_Filesystem - preSetup' hook which could cause potential problems."}
{"reqId":"8c82b2c2-b676-4b55-a3d0-67de0b34e935","level":0,"time":"2024-01-23T14:50:19+00:00","remoteAddr":"80.139.80.57","user":"[email protected]","app":"no app in context","method":"PROPFIND","url":"\/remote.php\/dav\/files\/[email protected]\/","message":"Add new user attributes key 'whitelistedAppsForGuests' has value ',core,files,dav,federatedfilesharing,guests,encryption,files_primary_s3,files_antivirus,files_external,files_external_dropbox,files_external_ftp,files_ldap_home,files_onedrive,sharepoint,files_external_s3,windows_network_drive,admin_audit,firewall,ransomware_protection,settings,avatar,files_texteditor,files_trashbin,files_versions,files_sharing,activity,firstrunwizard,gallery,notifications,password_policy,oauth2,files_pdfviewer,files_mediaviewer,richdocuments,onlyoffice,wopi,oco_selfservice,twofactor_totp,impersonate' for guest user [email protected]"}
{"reqId":"8c82b2c2-b676-4b55-a3d0-67de0b34e935","level":0,"time":"2024-01-23T14:50:19+00:00","remoteAddr":"80.139.80.57","user":"[email protected]","app":"filesystem","method":"PROPFIND","url":"\/remote.php\/dav\/files\/[email protected]\/","message":"Storage wrapper 'oc_readonly' was not registered via the 'OC_Filesystem - preSetup' hook which could cause potential problems."}

[jnweiger]

Same server same client, same 38 MB test file, but admin user: The upload succeeds in a few seconds.
Same server, same 38 MB test file, guest user, but upload via web browser: The upload succeeds in a few seconds.

Grrr.
The issue is not reproducable. On a second attempt, everything is fast as expected.