Skip to content

Commit

Permalink
deploy: 16c90db
Browse files Browse the repository at this point in the history
  • Loading branch information
@LoveEatCandy
LoveEatCandy committed Dec 12, 2024
1 parent 84ea96b commit c770a93
Show file tree
Hide file tree
Showing 57 changed files with 445 additions and 222 deletions.
Binary file modified .doctrees/changelog.doctree
View file
Binary file not shown.
Binary file modified .doctrees/environment.pickle
View file
Binary file not shown.
Binary file modified .doctrees/index.doctree
View file
Binary file not shown.
Binary file modified .doctrees/readme.doctree
View file
Binary file not shown.
Binary file added .doctrees/speed_test.doctree
View file
Binary file not shown.
1 change: 1 addition & 0 deletions _modules/index.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -49,6 +49,7 @@
<li class="toctree-l1"><a class="reference internal" href="../megfile.html">API Reference</a></li>
<li class="toctree-l1"><a class="reference internal" href="../cli.html">Command Line Interface</a></li>
<li class="toctree-l1"><a class="reference internal" href="../advanced.html">Advanced User Guide</a></li>
<li class="toctree-l1"><a class="reference internal" href="../speed_test.html">Speed Test</a></li>
<li class="toctree-l1"><a class="reference internal" href="../changelog.html">CHANGELOG</a></li>
<li class="toctree-l1"><a class="reference external" href="https://github.com/megvii-research/megfile">GitHub</a></li>
</ul>
Expand Down
1 change: 1 addition & 0 deletions _modules/megfile/fs.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -49,6 +49,7 @@
<li class="toctree-l1"><a class="reference internal" href="../../megfile.html">API Reference</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../cli.html">Command Line Interface</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../advanced.html">Advanced User Guide</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../speed_test.html">Speed Test</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../changelog.html">CHANGELOG</a></li>
<li class="toctree-l1"><a class="reference external" href="https://github.com/megvii-research/megfile">GitHub</a></li>
</ul>
Expand Down
1 change: 1 addition & 0 deletions _modules/megfile/fs_path.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -49,6 +49,7 @@
<li class="toctree-l1"><a class="reference internal" href="../../megfile.html">API Reference</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../cli.html">Command Line Interface</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../advanced.html">Advanced User Guide</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../speed_test.html">Speed Test</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../changelog.html">CHANGELOG</a></li>
<li class="toctree-l1"><a class="reference external" href="https://github.com/megvii-research/megfile">GitHub</a></li>
</ul>
Expand Down
1 change: 1 addition & 0 deletions _modules/megfile/hdfs.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -49,6 +49,7 @@
<li class="toctree-l1"><a class="reference internal" href="../../megfile.html">API Reference</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../cli.html">Command Line Interface</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../advanced.html">Advanced User Guide</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../speed_test.html">Speed Test</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../changelog.html">CHANGELOG</a></li>
<li class="toctree-l1"><a class="reference external" href="https://github.com/megvii-research/megfile">GitHub</a></li>
</ul>
Expand Down
1 change: 1 addition & 0 deletions _modules/megfile/hdfs_path.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -49,6 +49,7 @@
<li class="toctree-l1"><a class="reference internal" href="../../megfile.html">API Reference</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../cli.html">Command Line Interface</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../advanced.html">Advanced User Guide</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../speed_test.html">Speed Test</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../changelog.html">CHANGELOG</a></li>
<li class="toctree-l1"><a class="reference external" href="https://github.com/megvii-research/megfile">GitHub</a></li>
</ul>
Expand Down
1 change: 1 addition & 0 deletions _modules/megfile/http.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -49,6 +49,7 @@
<li class="toctree-l1"><a class="reference internal" href="../../megfile.html">API Reference</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../cli.html">Command Line Interface</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../advanced.html">Advanced User Guide</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../speed_test.html">Speed Test</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../changelog.html">CHANGELOG</a></li>
<li class="toctree-l1"><a class="reference external" href="https://github.com/megvii-research/megfile">GitHub</a></li>
</ul>
Expand Down
1 change: 1 addition & 0 deletions _modules/megfile/http_path.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -49,6 +49,7 @@
<li class="toctree-l1"><a class="reference internal" href="../../megfile.html">API Reference</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../cli.html">Command Line Interface</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../advanced.html">Advanced User Guide</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../speed_test.html">Speed Test</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../changelog.html">CHANGELOG</a></li>
<li class="toctree-l1"><a class="reference external" href="https://github.com/megvii-research/megfile">GitHub</a></li>
</ul>
Expand Down
1 change: 1 addition & 0 deletions _modules/megfile/s3.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -49,6 +49,7 @@
<li class="toctree-l1"><a class="reference internal" href="../../megfile.html">API Reference</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../cli.html">Command Line Interface</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../advanced.html">Advanced User Guide</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../speed_test.html">Speed Test</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../changelog.html">CHANGELOG</a></li>
<li class="toctree-l1"><a class="reference external" href="https://github.com/megvii-research/megfile">GitHub</a></li>
</ul>
Expand Down
1 change: 1 addition & 0 deletions _modules/megfile/s3_path.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -49,6 +49,7 @@
<li class="toctree-l1"><a class="reference internal" href="../../megfile.html">API Reference</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../cli.html">Command Line Interface</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../advanced.html">Advanced User Guide</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../speed_test.html">Speed Test</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../changelog.html">CHANGELOG</a></li>
<li class="toctree-l1"><a class="reference external" href="https://github.com/megvii-research/megfile">GitHub</a></li>
</ul>
Expand Down
1 change: 1 addition & 0 deletions _modules/megfile/sftp.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -49,6 +49,7 @@
<li class="toctree-l1"><a class="reference internal" href="../../megfile.html">API Reference</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../cli.html">Command Line Interface</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../advanced.html">Advanced User Guide</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../speed_test.html">Speed Test</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../changelog.html">CHANGELOG</a></li>
<li class="toctree-l1"><a class="reference external" href="https://github.com/megvii-research/megfile">GitHub</a></li>
</ul>
Expand Down
1 change: 1 addition & 0 deletions _modules/megfile/sftp_path.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -49,6 +49,7 @@
<li class="toctree-l1"><a class="reference internal" href="../../megfile.html">API Reference</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../cli.html">Command Line Interface</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../advanced.html">Advanced User Guide</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../speed_test.html">Speed Test</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../changelog.html">CHANGELOG</a></li>
<li class="toctree-l1"><a class="reference external" href="https://github.com/megvii-research/megfile">GitHub</a></li>
</ul>
Expand Down
4 changes: 3 additions & 1 deletion _modules/megfile/smart.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -49,6 +49,7 @@
<li class="toctree-l1"><a class="reference internal" href="../../megfile.html">API Reference</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../cli.html">Command Line Interface</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../advanced.html">Advanced User Guide</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../speed_test.html">Speed Test</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../changelog.html">CHANGELOG</a></li>
<li class="toctree-l1"><a class="reference external" href="https://github.com/megvii-research/megfile">GitHub</a></li>
</ul>
Expand Down Expand Up @@ -1199,7 +1200,8 @@ <h1>Source code for megfile.smart</h1><div class="highlight"><pre>
<span class="n">offset</span> <span class="o">=</span> <span class="o">-</span><span class="mi">1</span>
<span class="k">if</span> <span class="n">stop</span> <span class="ow">is</span> <span class="ow">not</span> <span class="kc">None</span><span class="p">:</span>
<span class="n">offset</span> <span class="o">=</span> <span class="n">stop</span> <span class="o">-</span> <span class="p">(</span><span class="n">start</span> <span class="ow">or</span> <span class="mi">0</span><span class="p">)</span> <span class="c1"># start may be None</span>
<span class="k">assert</span> <span class="n">offset</span> <span class="o">&gt;=</span> <span class="mi">0</span><span class="p">,</span> <span class="s2">&quot;stop should be greater than start&quot;</span>
<span class="k">if</span> <span class="n">offset</span> <span class="o">&lt;</span> <span class="mi">0</span><span class="p">:</span>
<span class="k">raise</span> <span class="ne">ValueError</span><span class="p">(</span><span class="s2">&quot;stop should be greater than start&quot;</span><span class="p">)</span>
<span class="k">return</span> <span class="n">fd</span><span class="o">.</span><span class="n">read</span><span class="p">(</span><span class="n">offset</span><span class="p">)</span> <span class="c1"># pytype: disable=bad-return-type</span></div>


Expand Down
1 change: 1 addition & 0 deletions _modules/megfile/smart_path.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -49,6 +49,7 @@
<li class="toctree-l1"><a class="reference internal" href="../../megfile.html">API Reference</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../cli.html">Command Line Interface</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../advanced.html">Advanced User Guide</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../speed_test.html">Speed Test</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../changelog.html">CHANGELOG</a></li>
<li class="toctree-l1"><a class="reference external" href="https://github.com/megvii-research/megfile">GitHub</a></li>
</ul>
Expand Down
1 change: 1 addition & 0 deletions _modules/megfile/stdio.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -49,6 +49,7 @@
<li class="toctree-l1"><a class="reference internal" href="../../megfile.html">API Reference</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../cli.html">Command Line Interface</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../advanced.html">Advanced User Guide</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../speed_test.html">Speed Test</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../changelog.html">CHANGELOG</a></li>
<li class="toctree-l1"><a class="reference external" href="https://github.com/megvii-research/megfile">GitHub</a></li>
</ul>
Expand Down
1 change: 1 addition & 0 deletions _modules/megfile/stdio_path.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -49,6 +49,7 @@
<li class="toctree-l1"><a class="reference internal" href="../../megfile.html">API Reference</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../cli.html">Command Line Interface</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../advanced.html">Advanced User Guide</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../speed_test.html">Speed Test</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../changelog.html">CHANGELOG</a></li>
<li class="toctree-l1"><a class="reference external" href="https://github.com/megvii-research/megfile">GitHub</a></li>
</ul>
Expand Down
1 change: 1 addition & 0 deletions _sources/index.rst.txt
View file
Original file line number Diff line number Diff line change
Expand Up @@ -16,6 +16,7 @@ Welcome to megfile's documentation!
megfile
cli
advanced
speed_test
changelog
GitHub <https://github.com/megvii-research/megfile>

Expand Down
8 changes: 8 additions & 0 deletions _sources/speed_test.md.txt
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@
## Speed Test

Benchmark was performed on an 8-core, 32G RAM virtual machine, using docker-compose to start MinIO with a rate limit of 100 MiB/s.

[Script and related files](https://github.com/megvii-research/megfile/tree/main/scripts/speed_test)

[10GiB](https://github.com/megvii-research/megfile/blob/main/scripts/speed_test/10GiB.png?raw=true)
[10MiB](https://github.com/megvii-research/megfile/blob/main/scripts/speed_test/10MiB.png?raw=true)
1 change: 1 addition & 0 deletions advanced.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -56,6 +56,7 @@
<li class="toctree-l2"><a class="reference internal" href="advanced/glob.html">Glob Pattern</a></li>
</ul>
</li>
<li class="toctree-l1"><a class="reference internal" href="speed_test.html">Speed Test</a></li>
<li class="toctree-l1"><a class="reference internal" href="changelog.html">CHANGELOG</a></li>
<li class="toctree-l1"><a class="reference external" href="https://github.com/megvii-research/megfile">GitHub</a></li>
</ul>
Expand Down
1 change: 1 addition & 0 deletions advanced/custom_protocol.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -56,6 +56,7 @@
<li class="toctree-l2"><a class="reference internal" href="glob.html">Glob Pattern</a></li>
</ul>
</li>
<li class="toctree-l1"><a class="reference internal" href="../speed_test.html">Speed Test</a></li>
<li class="toctree-l1"><a class="reference internal" href="../changelog.html">CHANGELOG</a></li>
<li class="toctree-l1"><a class="reference external" href="https://github.com/megvii-research/megfile">GitHub</a></li>
</ul>
Expand Down
5 changes: 3 additions & 2 deletions advanced/glob.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -21,7 +21,7 @@
<script src="../_static/js/theme.js"></script>
<link rel="index" title="Index" href="../genindex.html" />
<link rel="search" title="Search" href="../search.html" />
<link rel="next" title="CHANGELOG" href="../changelog.html" />
<link rel="next" title="Speed Test" href="../speed_test.html" />
<link rel="prev" title="Define Custom Protocol" href="custom_protocol.html" />
</head>

Expand Down Expand Up @@ -59,6 +59,7 @@
</li>
</ul>
</li>
<li class="toctree-l1"><a class="reference internal" href="../speed_test.html">Speed Test</a></li>
<li class="toctree-l1"><a class="reference internal" href="../changelog.html">CHANGELOG</a></li>
<li class="toctree-l1"><a class="reference external" href="https://github.com/megvii-research/megfile">GitHub</a></li>
</ul>
Expand Down Expand Up @@ -128,7 +129,7 @@ <h2>Patterns are Unix shell style:<a class="headerlink" href="#patterns-are-unix
</div>
<footer><div class="rst-footer-buttons" role="navigation" aria-label="Footer">
<a href="custom_protocol.html" class="btn btn-neutral float-left" title="Define Custom Protocol" accesskey="p" rel="prev"><span class="fa fa-arrow-circle-left" aria-hidden="true"></span> Previous</a>
<a href="../changelog.html" class="btn btn-neutral float-right" title="CHANGELOG" accesskey="n" rel="next">Next <span class="fa fa-arrow-circle-right" aria-hidden="true"></span></a>
<a href="../speed_test.html" class="btn btn-neutral float-right" title="Speed Test" accesskey="n" rel="next">Next <span class="fa fa-arrow-circle-right" aria-hidden="true"></span></a>
</div>

<hr/>
Expand Down
Loading

0 comments on commit c770a93

Please sign in to comment.