feat(webdav): add list and improve create

[imWildCat]

I hereby agree to the terms of the CLA available at: https://databend.rs/dev/policies/cla/

Summary

• list
  • Define response schema of the list operation from WebDAV service
  • Define response handling
• create
  • Create directories recursively
    • In the future, we can apply for naive optimization like checking whether a directory exists, before creating dir or file recursively (which might be super expensive)
  • Add MKCOL http method support for creating directories

[imWildCat]

Posting this WIP PR because I'm pretty new and a bit worried that I will go on the wrong directory.

Please feel free to point out problems. Thanks in advance!

[imWildCat]

hyperium/http#587 There's another blocker for this PR, which is to define PROPFIND.

Not a problem anymore

[imWildCat]

Still seeing this error:

warning: `opendal-example` (bin "opendal-example") generated 7 warnings
    Finished dev [unoptimized + debuginfo] target(s) in 0.15s
     Running `target/debug/opendal-example`
test_file_content: "f"
Error: Unsupported (permanent) at list, context: { service: webdav } => operation is not supported

Not sure where to fix?

[imWildCat]

@Xuanwo I have to go to sleep today. Will (probably) refine this PR tomorrow.

I noticed some logic error of my implementation at this moment.

Very appreciate your review!

[Xuanwo]

@Xuanwo I have to go to sleep today. Will (probably) refine this PR tomorrow.

Wish you a beautiful night ❤️ ! Thank you so much!

[imWildCat]

Hi @Xuanwo, I spent most of today to debug this issue but haven't found a clue. May I have some hints on this?
Thanks in advance!

Some behavior tests always fail.

I'm not sure about its reason after I managed to attaching debugger to tests.
For example, services_webdav_list::test_check failed due to 404 not found, when I ran this test separately: cargo test --color=always --package opendal --test behavior services_webdav_list::test_check --features compress --no-fail-fast -- --format=json --exact -Z unstable-options --show-output

nginx_webdav_1  | [source IP] - - [18/Feb/2023:04:32:18 +0000] "PROPFIND /48403624-4f57-4ed6-b300-be94526aaebe/ HTTP/1.1" 404 162 "-" "-"

Environment variables:

export RUST_BACKTRACE=full
export RUST_LOG=debug
export OPENDAL_WEBDAV_TEST=on
export OPENDAL_WEBDAV_ENDPOINT=http://my_internal_ip_on_linux:port

[Xuanwo]

Please always return Ok for dir. Take http service or s3 service as an example.

Sorry for the confusion, I will add it in docs.

[imWildCat]

Please always return Ok for dir. Take http service or s3 service as an example.

Sorry for the confusion, I will add it in docs.

Thanks! This is super quick reply!

[Xuanwo]

Thank you so much for the effort you put into this feature! It's a lot more complex than I expected, but you've mastered them all. Good job!

[imWildCat]

Thank you, @Xuanwo !

I really appreciate the help from you and @ClSlaid !
I think this is the best way for me to learn Rust programming.

I will be using OpenDAL for WebDAV/GDrive/Dropbox/OneDrive in the future of client (not cloud) applications.
Happy to chat about its future!