Skip to content

Commit

Permalink
doc update for tag python-v0.16.3
Browse files Browse the repository at this point in the history
  • Loading branch information
@deltars
deltars committed Mar 25, 2024
1 parent 138338a commit d4f6cd1
Show file tree
Hide file tree
Showing 4 changed files with 54 additions and 38 deletions.
16 changes: 16 additions & 0 deletions api/delta_table/index.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -3723,6 +3723,22 @@ <h4 id="deltalake.DeltaTable.to_pyarrow_dataset" class="doc doc-heading">
</table>
<p>More info: https://arrow.apache.org/docs/python/generated/pyarrow.dataset.ParquetReadOptions.html</p>

<details class="example" open>
<summary>Example</summary>
<p><code>deltalake</code> will work with any storage compliant with :class:<code>pyarrow.fs.FileSystem</code>, however the root of the filesystem has
to be adjusted to point at the root of the Delta table. We can achieve this by wrapping the custom filesystem into
a :class:<code>pyarrow.fs.SubTreeFileSystem</code>.
<div class="language-text highlight"><pre><span></span><code><span id="__span-0-1"><a id="__codelineno-0-1" name="__codelineno-0-1" href="#__codelineno-0-1"></a>import pyarrow.fs as fs
</span><span id="__span-0-2"><a id="__codelineno-0-2" name="__codelineno-0-2" href="#__codelineno-0-2"></a>from deltalake import DeltaTable
</span><span id="__span-0-3"><a id="__codelineno-0-3" name="__codelineno-0-3" href="#__codelineno-0-3"></a>
</span><span id="__span-0-4"><a id="__codelineno-0-4" name="__codelineno-0-4" href="#__codelineno-0-4"></a>table_uri = &quot;s3://&lt;bucket&gt;/&lt;path&gt;&quot;
</span><span id="__span-0-5"><a id="__codelineno-0-5" name="__codelineno-0-5" href="#__codelineno-0-5"></a>raw_fs, normalized_path = fs.FileSystem.from_uri(table_uri)
</span><span id="__span-0-6"><a id="__codelineno-0-6" name="__codelineno-0-6" href="#__codelineno-0-6"></a>filesystem = fs.SubTreeFileSystem(normalized_path, raw_fs)
</span><span id="__span-0-7"><a id="__codelineno-0-7" name="__codelineno-0-7" href="#__codelineno-0-7"></a>
</span><span id="__span-0-8"><a id="__codelineno-0-8" name="__codelineno-0-8" href="#__codelineno-0-8"></a>dt = DeltaTable(table_uri)
</span><span id="__span-0-9"><a id="__codelineno-0-9" name="__codelineno-0-9" href="#__codelineno-0-9"></a>ds = dt.to_pyarrow_dataset(filesystem=filesystem)
</span></code></pre></div></p>
</details>


<p><strong>Returns:</strong></p>
Expand Down
2 changes: 1 addition & 1 deletion search/search_index.json
View file

Large diffs are not rendered by default.

74 changes: 37 additions & 37 deletions sitemap.xml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -2,187 +2,187 @@
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
<url>
<loc>https://github.com/delta-io/delta-rs/</loc>
<lastmod>2024-03-21</lastmod>
<lastmod>2024-03-25</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://github.com/delta-io/delta-rs/delta-lake-best-practices/</loc>
<lastmod>2024-03-21</lastmod>
<lastmod>2024-03-25</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://github.com/delta-io/delta-rs/delta-lake-big-data-small-data/</loc>
<lastmod>2024-03-21</lastmod>
<lastmod>2024-03-25</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://github.com/delta-io/delta-rs/why-use-delta-lake/</loc>
<lastmod>2024-03-21</lastmod>
<lastmod>2024-03-25</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://github.com/delta-io/delta-rs/api/catalog/</loc>
<lastmod>2024-03-21</lastmod>
<lastmod>2024-03-25</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://github.com/delta-io/delta-rs/api/delta_writer/</loc>
<lastmod>2024-03-21</lastmod>
<lastmod>2024-03-25</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://github.com/delta-io/delta-rs/api/exceptions/</loc>
<lastmod>2024-03-21</lastmod>
<lastmod>2024-03-25</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://github.com/delta-io/delta-rs/api/schema/</loc>
<lastmod>2024-03-21</lastmod>
<lastmod>2024-03-25</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://github.com/delta-io/delta-rs/api/storage/</loc>
<lastmod>2024-03-21</lastmod>
<lastmod>2024-03-25</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://github.com/delta-io/delta-rs/api/delta_table/</loc>
<lastmod>2024-03-21</lastmod>
<lastmod>2024-03-25</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://github.com/delta-io/delta-rs/api/delta_table/delta_table_alterer/</loc>
<lastmod>2024-03-21</lastmod>
<lastmod>2024-03-25</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://github.com/delta-io/delta-rs/api/delta_table/delta_table_merger/</loc>
<lastmod>2024-03-21</lastmod>
<lastmod>2024-03-25</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://github.com/delta-io/delta-rs/api/delta_table/delta_table_optimizer/</loc>
<lastmod>2024-03-21</lastmod>
<lastmod>2024-03-25</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://github.com/delta-io/delta-rs/api/delta_table/metadata/</loc>
<lastmod>2024-03-21</lastmod>
<lastmod>2024-03-25</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://github.com/delta-io/delta-rs/how-delta-lake-works/architecture-of-delta-table/</loc>
<lastmod>2024-03-21</lastmod>
<lastmod>2024-03-25</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://github.com/delta-io/delta-rs/how-delta-lake-works/delta-lake-acid-transactions/</loc>
<lastmod>2024-03-21</lastmod>
<lastmod>2024-03-25</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://github.com/delta-io/delta-rs/how-delta-lake-works/delta-lake-file-skipping/</loc>
<lastmod>2024-03-21</lastmod>
<lastmod>2024-03-25</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://github.com/delta-io/delta-rs/integrations/delta-lake-arrow/</loc>
<lastmod>2024-03-21</lastmod>
<lastmod>2024-03-25</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://github.com/delta-io/delta-rs/integrations/delta-lake-dagster/</loc>
<lastmod>2024-03-21</lastmod>
<lastmod>2024-03-25</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://github.com/delta-io/delta-rs/integrations/delta-lake-dask/</loc>
<lastmod>2024-03-21</lastmod>
<lastmod>2024-03-25</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://github.com/delta-io/delta-rs/integrations/delta-lake-datafusion/</loc>
<lastmod>2024-03-21</lastmod>
<lastmod>2024-03-25</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://github.com/delta-io/delta-rs/integrations/delta-lake-pandas/</loc>
<lastmod>2024-03-21</lastmod>
<lastmod>2024-03-25</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://github.com/delta-io/delta-rs/integrations/delta-lake-polars/</loc>
<lastmod>2024-03-21</lastmod>
<lastmod>2024-03-25</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://github.com/delta-io/delta-rs/usage/appending-overwriting-delta-lake-table/</loc>
<lastmod>2024-03-21</lastmod>
<lastmod>2024-03-25</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://github.com/delta-io/delta-rs/usage/constraints/</loc>
<lastmod>2024-03-21</lastmod>
<lastmod>2024-03-25</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://github.com/delta-io/delta-rs/usage/create-delta-lake-table/</loc>
<lastmod>2024-03-21</lastmod>
<lastmod>2024-03-25</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://github.com/delta-io/delta-rs/usage/deleting-rows-from-delta-lake-table/</loc>
<lastmod>2024-03-21</lastmod>
<lastmod>2024-03-25</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://github.com/delta-io/delta-rs/usage/examining-table/</loc>
<lastmod>2024-03-21</lastmod>
<lastmod>2024-03-25</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://github.com/delta-io/delta-rs/usage/installation/</loc>
<lastmod>2024-03-21</lastmod>
<lastmod>2024-03-25</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://github.com/delta-io/delta-rs/usage/loading-table/</loc>
<lastmod>2024-03-21</lastmod>
<lastmod>2024-03-25</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://github.com/delta-io/delta-rs/usage/managing-tables/</loc>
<lastmod>2024-03-21</lastmod>
<lastmod>2024-03-25</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://github.com/delta-io/delta-rs/usage/overview/</loc>
<lastmod>2024-03-21</lastmod>
<lastmod>2024-03-25</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://github.com/delta-io/delta-rs/usage/querying-delta-tables/</loc>
<lastmod>2024-03-21</lastmod>
<lastmod>2024-03-25</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://github.com/delta-io/delta-rs/usage/optimize/delta-lake-z-order/</loc>
<lastmod>2024-03-21</lastmod>
<lastmod>2024-03-25</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://github.com/delta-io/delta-rs/usage/optimize/small-file-compaction-with-optimize/</loc>
<lastmod>2024-03-21</lastmod>
<lastmod>2024-03-25</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://github.com/delta-io/delta-rs/usage/writing/</loc>
<lastmod>2024-03-21</lastmod>
<lastmod>2024-03-25</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://github.com/delta-io/delta-rs/usage/writing/writing-to-s3-with-locking-provider/</loc>
<lastmod>2024-03-21</lastmod>
<lastmod>2024-03-25</lastmod>
<changefreq>daily</changefreq>
</url>
</urlset>
Binary file modified sitemap.xml.gz
View file
Binary file not shown.

0 comments on commit d4f6cd1

Please sign in to comment.