dependabot[bot] opened a new pull request, #840: URL: https://github.com/apache/hudi-rs/pull/840
Updates the requirements on [tpchgen-arrow](https://github.com/datafusion-contrib/tpcgen-rs) to permit the latest version. <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/datafusion-contrib/tpcgen-rs/releases";>tpchgen-arrow's releases</a>.</em></p> <blockquote> <p>v4.0.0 is the first stable release with TPC-DS support.</p> <ul> <li><strong><code>tpcgen-cli</code></strong> is the new CLI for both TPC-H (<code>tpcgen-cli tpch</code>) and TPC-DS (<code>tpcgen-cli tpcds</code>).</li> <li><strong><code>tpchgen-cli</code></strong> is kept for backwards compatibility. It uses the same code as <code>tpcgen-cli tpch</code>.</li> </ul> <p>Run it with <a href="https://docs.astral.sh/uv/";>uv</a>, no install needed:</p> <pre lang="shell"><code>uvx tpcgen-cli tpch parquet -s 10 --output-dir=/tmp/tpch uvx tpcgen-cli tpcds parquet -s 10 --output-dir=/tmp/tpcds </code></pre> <p>Also available via <code>pip install tpcgen-cli</code>, <code>cargo install tpcgen-cli</code> and <code>brew install tpcgen-cli</code>.</p> <h2>Packages</h2> <p>All packages now share one version, 4.0.0 (<a href="https://redirect.github.com/datafusion-contrib/tpcgen-rs/issues/546";>#546</a>).</p> <table> <thead> <tr> <th>Package</th> <th>Registry</th> <th>Description</th> </tr> </thead> <tbody> <tr> <td><a href="https://pypi.org/project/tpcgen-cli/";><code>tpcgen-cli</code></a></td> <td>PyPI</td> <td><strong>New.</strong> CLI for TPC-H and TPC-DS</td> </tr> <tr> <td><a href="https://crates.io/crates/tpcgen-cli";><code>tpcgen-cli</code></a></td> <td>crates.io</td> <td><strong>New.</strong> CLI for TPC-H and TPC-DS</td> </tr> <tr> <td><a href="https://pypi.org/project/tpchgen-cli/";><code>tpchgen-cli</code></a></td> <td>PyPI</td> <td>TPC-H CLI, same as <code>tpcgen-cli tpch</code></td> </tr> <tr> <td><a href="https://crates.io/crates/tpchgen-cli";><code>tpchgen-cli</code></a></td> <td>crates.io</td> <td>TPC-H CLI, same as <code>tpcgen-cli tpch</code></td> </tr> <tr> <td><a href="https://crates.io/crates/tpcdsgen";><code>tpcdsgen</code></a></td> <td>crates.io</td> <td><strong>New.</strong> TPC-DS data generator library</td> </tr> <tr> <td><a href="https://crates.io/crates/tpcdsgen-arrow";><code>tpcdsgen-arrow</code></a></td> <td>crates.io</td> <td><strong>New.</strong> TPC-DS data as Arrow record batches</td> </tr> <tr> <td><a href="https://crates.io/crates/tpchgen";><code>tpchgen</code></a></td> <td>crates.io</td> <td>TPC-H data generator library</td> </tr> <tr> <td><a href="https://crates.io/crates/tpchgen-arrow";><code>tpchgen-arrow</code></a></td> <td>crates.io</td> <td>TPC-H data as Arrow record batches</td> </tr> </tbody> </table> <h2>Highlights</h2> <ul> <li><strong>TPC-DS generation</strong> in DAT, CSV and Parquet (<a href="https://redirect.github.com/datafusion-contrib/tpcgen-rs/issues/329";>#329</a>, <a href="https://redirect.github.com/datafusion-contrib/tpcgen-rs/issues/331";>#331</a>), generated in parallel (<a href="https://redirect.github.com/datafusion-contrib/tpcgen-rs/issues/360";>#360</a>, <a href="https://redirect.github.com/datafusion-contrib/tpcgen-rs/issues/361";>#361</a>, <a href="https://redirect.github.com/datafusion-contrib/tpcgen-rs/issues/463";>#463</a>), with <code>--parts</code>/<code>--part</code> (<a href="https://redirect.github.com/datafusion-contrib/tpcgen-rs/issues/406";>#406</a>) and <code>--stdout</code> (<a href="https://redirect.github.com/datafusion-contrib/tpcgen-rs/issues/482";>#482</a>). Output matches the C <code>dsdgen</code> by default; use <code>--compat trino</code> to match Trino (<a href="https://redirect.github.com/datafusion-contrib/tpcgen-rs/issues/628";>#628</a>).</li> <li><strong>Parquet options:</strong> per-column encodings with <code>--column-encoding</code> (<a href="https://redirect.github.com/datafusion-contrib/tpcgen-rs/issues/405";>#405</a>) and human-readable <code>--row-group-bytes</code> such as <code>128MB</code> (<a href="https://redirect.github.com/datafusion-contrib/tpcgen-rs/issues/486";>#486</a>).</li> <li><strong>Parquet field IDs</strong> are written by default. Use <code>--field-ids=false</code> to turn them off (<a href="https://redirect.github.com/datafusion-contrib/tpcgen-rs/issues/509";>#509</a>, <a href="https://redirect.github.com/datafusion-contrib/tpcgen-rs/issues/537";>#537</a>).</li> <li><strong><code>--overwrite</code></strong> replaces existing output files (<a href="https://redirect.github.com/datafusion-contrib/tpcgen-rs/issues/494";>#494</a>).</li> <li><strong>Progress bars</strong> show ETA and write throughput, and render more cleanly (<a href="https://redirect.github.com/datafusion-contrib/tpcgen-rs/issues/356";>#356</a>, <a href="https://redirect.github.com/datafusion-contrib/tpcgen-rs/issues/386";>#386</a>, <a href="https://redirect.github.com/datafusion-contrib/tpcgen-rs/issues/393";>#393</a>, <a href="https://redirect.github.com/datafusion-contrib/tpcgen-rs/issues/399";>#399</a>, <a href="https://redirect.github.com/datafusion-contrib/tpcgen-rs/issues/507";>#507</a>).</li> <li><strong>Logging:</strong> clearer per-table messages, a summary of sizes and throughput at the end of each run, and readable error messages (<a href="https://redirect.github.com/datafusion-contrib/tpcgen-rs/issues/501";>#501</a>, <a href="https://redirect.github.com/datafusion-contrib/tpcgen-rs/issues/504";>#504</a>, <a href="https://redirect.github.com/datafusion-contrib/tpcgen-rs/issues/506";>#506</a>, <a href="https://redirect.github.com/datafusion-contrib/tpcgen-rs/issues/520";>#520</a>).</li> <li><strong>Input validation:</strong> invalid options are rejected before any output is created (<a href="https://redirect.github.com/datafusion-contrib/tpcgen-rs/issues/519";>#519</a>), and TPC-H table names are case-insensitive (<a href="https://redirect.github.com/datafusion-contrib/tpcgen-rs/issues/426";>#426</a>).</li> <li><strong>Arrow 59 and 60 support:</strong> <code>tpchgen-arrow</code> and <code>tpcdsgen-arrow</code> use Arrow 60 by default, or Arrow 59 with the <code>arrow_59</code> feature (<a href="https://redirect.github.com/datafusion-contrib/tpcgen-rs/issues/473";>#473</a>).</li> <li><strong>Minimum supported Rust version</strong> is declared as 1.88 for all crates (<a href="https://redirect.github.com/datafusion-contrib/tpcgen-rs/issues/583";>#583</a>).</li> <li><strong><code>schema_ref()</code></strong> on every <code>tpchgen-arrow</code> and <code>tpcdsgen-arrow</code> reader returns a table's Arrow schema without creating a generator (<a href="https://redirect.github.com/datafusion-contrib/tpcgen-rs/issues/427";>#427</a>).</li> <li><strong>New home:</strong> the project moved to <code>datafusion-contrib/tpcgen-rs</code> (<a href="https://redirect.github.com/datafusion-contrib/tpcgen-rs/issues/407";>#407</a>).</li> </ul> <h2>Breaking changes</h2> <ul> <li><strong><code>--delimiter</code></strong> only accepts comma, pipe, tab and semicolon (<a href="https://redirect.github.com/datafusion-contrib/tpcgen-rs/issues/500";>#500</a>).</li> <li><strong><code>--parts 0</code></strong> is rejected (<a href="https://redirect.github.com/datafusion-contrib/tpcgen-rs/issues/519";>#519</a>).</li> <li><strong><code>tpchgen-cli</code> flags</strong> deprecated in 2.x are removed (<a href="https://redirect.github.com/datafusion-contrib/tpcgen-rs/issues/421";>#421</a>). Use the <code>tbl</code>, <code>csv</code> or <code>parquet</code> subcommand instead of <code>--format</code>, and <code>parquet --compression</code> / <code>parquet --row-group-bytes</code> instead of <code>--parquet-compression</code> / <code>--parquet-row-group-bytes</code>.</li> <li><strong>TPC-H <code>--parts N --part K</code></strong> writes the <code>nation</code> and <code>region</code> tables only for part 1, so combining all parts no longer repeats them (<a href="https://redirect.github.com/datafusion-contrib/tpcgen-rs/issues/641";>#641</a>).</li> <li><strong><code>tpchgen-arrow</code>:</strong> generators implement Arrow's <code>RecordBatchReader</code> instead of the crate's own <code>RecordBatchIterator</code> trait (<a href="https://redirect.github.com/datafusion-contrib/tpcgen-rs/issues/345";>#345</a>).</li> </ul> <!-- raw HTML omitted --> </blockquote> <p>... (truncated)</p> </details> <details> <summary>Commits</summary> <ul> <li><a href="https://github.com/datafusion-contrib/tpcgen-rs/commit/2a9b8868aa1006aded4176abff45318a9e808ba4";><code>2a9b886</code></a> fix(tpch-cli): only write nation and region for --part 1 (<a href="https://redirect.github.com/datafusion-contrib/tpcgen-rs/issues/641";>#641</a>)</li> <li><a href="https://github.com/datafusion-contrib/tpcgen-rs/commit/5a96dc21ab19909bd5bd4814c83d3c40cdefdcd5";><code>5a96dc2</code></a> Reorder and group tpcgen-cli options in --help (<a href="https://redirect.github.com/datafusion-contrib/tpcgen-rs/issues/635";>#635</a>)</li> <li><a href="https://github.com/datafusion-contrib/tpcgen-rs/commit/5f71e66dbed6432cdfcd8da4219f6b84f448ea81";><code>5f71e66</code></a> Reformat tpcgen-cli help text (<a href="https://redirect.github.com/datafusion-contrib/tpcgen-rs/issues/634";>#634</a>)</li> <li><a href="https://github.com/datafusion-contrib/tpcgen-rs/commit/701091f90f8974634191f8f6c1046fdba859f61f";><code>701091f</code></a> chore(deps): bump rust-toolchain from 1.99.0 to 1.99.1 (<a href="https://redirect.github.com/datafusion-contrib/tpcgen-rs/issues/639";>#639</a>)</li> <li><a href="https://github.com/datafusion-contrib/tpcgen-rs/commit/9a4aa1f1ceb835193e08f808d33e1f24f59c26ec";><code>9a4aa1f</code></a> chore(deps): bump tokio from 1.53.2 to 1.53.3 (<a href="https://redirect.github.com/datafusion-contrib/tpcgen-rs/issues/638";>#638</a>)</li> <li><a href="https://github.com/datafusion-contrib/tpcgen-rs/commit/f73a3205f5e8f7cb3a454d3fb68f183d21afd9c2";><code>f73a320</code></a> chore(deps): bump taiki-e/install-action from 2.87.22 to 2.87.29 (<a href="https://redirect.github.com/datafusion-contrib/tpcgen-rs/issues/637";>#637</a>)</li> <li><a href="https://github.com/datafusion-contrib/tpcgen-rs/commit/78bd64367b4f24d1568e61e55a95532e946fd428";><code>78bd643</code></a> chore(deps): bump actions/setup-java from 6.0.1 to 6.1.0 (<a href="https://redirect.github.com/datafusion-contrib/tpcgen-rs/issues/636";>#636</a>)</li> <li><a href="https://github.com/datafusion-contrib/tpcgen-rs/commit/b3ca2d65684ca63496ffd59731df99d907719293";><code>b3ca2d6</code></a> Bump version to 4.0.0 (<a href="https://redirect.github.com/datafusion-contrib/tpcgen-rs/issues/631";>#631</a>)</li> <li><a href="https://github.com/datafusion-contrib/tpcgen-rs/commit/bbd6446d29c26dd007e9353e0af63393e7dae1d9";><code>bbd6446</code></a> Guard release publishing against user error (<a href="https://redirect.github.com/datafusion-contrib/tpcgen-rs/issues/630";>#630</a>)</li> <li><a href="https://github.com/datafusion-contrib/tpcgen-rs/commit/47685790c06f2b001f700a20bcad3701f2accb32";><code>4768579</code></a> Fix packaging issues found in v4.0.0-rc.1 (<a href="https://redirect.github.com/datafusion-contrib/tpcgen-rs/issues/632";>#632</a>)</li> <li>Additional commits viewable in <a href="https://github.com/datafusion-contrib/tpcgen-rs/compare/v3.0.0...v4.0.0";>compare view</a></li> </ul> </details> <br /> Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
