Mailing lists matching datafusion.apache.org
commits datafusion.apache.orgdev datafusion.apache.org
github datafusion.apache.org
(datafusion) branch asf-site updated: Publish built docs triggered by bec88c835c1235d3268c028fea87fc5249bc41c4
@@ The following related subprojects target end users and have separate documentati - `DataFusion Python <https://datafusion.apache.org/python/>`_ offers a Python interface for SQL and DataFrame queries. +- `DataFusion Java <https://datafusion.apache.org/java/>`_ offers a Java i
(datafusion) branch asf-site updated: Publish built docs triggered by b092bd41171980fc147904a6f6d06a3ee4dc6d4e
, articles, and other resources. ## 📅 Release Notes & Updates -- **2025-03-24** [Apache DataFusion 46.0.0 Released](https://datafusion.apache.org/blog/2025/03/24/datafusion-46.0.0/) - -- **2024-09-14** [Apache DataFusion Python 43.1.0 Released](https://datafusion.apache.org/blog/2024/12/14/datafu
(datafusion) branch main updated: Update releases links with releases in 2025-2026 (#20630)
? - Closes #. ## Rationale for this change While reviewing https://datafusion.apache.org/user-guide/concepts-readings-events.html I noticed it was quite out of date for recent releases, so let's update it with the releases in the last 2 years ## What change
(datafusion-site) branch asf-site updated: Revert "update path"
a/404.html +++ b/404.html @@ -9,19 +9,19 @@ -https://datafusion.apache.org/404.html"; /> -https://datafusion.apache.org/404.html"; /> +https://datafusion.apache.org/blog/404.html"; /> +https://datafusion.apache.org/blog/404.html"; /> -{"@cont
Re: [PR] Update links to point to datafusion.apache.org [datafusion]
://arrow.apache.org/datafusion/user-guide/dataframe.html) +- [Project Site](https://datafusion.apache.org/) +- [Installation](https://datafusion.apache.org/user-guide/cli/installation.html) +- [Rust Getting Started](https://datafusion.apache.org/user-guide/example-usage.html) +- [Rust DataFrame API](https
(datafusion-site) branch asf-staging updated: Commit build products
log/author/pmc.html b/blog/author/pmc.html index 0466942..e9764fc 100644 --- a/blog/author/pmc.html +++ b/blog/author/pmc.html @@ -21,9 +21,9 @@ - https://datafusion.apache.org/blog/2025/09/13/datafusion-comet-0.10.0"; rel="bookmark" title="Permali
(datafusion-site) branch asf-site updated: update path
ion-donation/index.html rename to 2019/02/03/datafusion-donation/index.html index 90aca93..29a351e 100644 --- a/blog/2019/02/03/datafusion-donation/index.html +++ b/2019/02/03/datafusion-donation/index.html @@ -10,20 +10,20 @@ -https://datafusion.apache.org/blog/blog/2019/02/03/datafus
(datafusion) branch asf-site updated: Publish built docs triggered by 350c5da8728ed0195cccb1061bae3189f5b7c0ba
..574c285b0e 100644 --- a/_sources/index.rst.txt +++ b/_sources/index.rst.txt @@ -51,12 +51,14 @@ The following related subprojects target end users and have separate documentati queries. - `DataFusion Comet <https://datafusion.apache.org/comet/>`_ is an accelerator for Apache Spark ba
Re: [VOTE] Release Apache DataFusion 49.0.0 RC1
+1 (binding) Sorry forgot about it in the last message On 2025/07/22 15:20:03 "Oleks V." wrote: > +1 > > Verified on a Mac M3 > > Thank you! > > - > To unsubscribe, e-mail: dev-unsub
Re: [I] User guide should have a reference listing all the built-in functions [datafusion]
alamb commented on issue #2872: URL: https://github.com/apache/datafusion/issues/2872#issuecomment-2214856406 I think we now have this: https://datafusion.apache.org/user-guide/sql/scalar_functions.html, https://datafusion.apache.org/user-guide/sql/aggregate_functions.html , https
Re: [PR] Update .asf.yaml to publish docs to datafusion.apache.org [datafusion]
homepage: https://arrow.apache.org/datafusion + homepage: https://datafusion.apache.org/ Review Comment: It should be `https://datafusion.apache.org/datafusion/`. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a
Re: [PR] Update .asf.yaml to publish docs to datafusion.apache.org [datafusion]
homepage: https://arrow.apache.org/datafusion + homepage: https://datafusion.apache.org/ Review Comment: It should be `https://datafusion.apache.org/datafusion/`? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a
Re: [PR] Update links to point to datafusion.apache.org [datafusion]
://arrow.apache.org/datafusion/user-guide/dataframe.html) +- [Project Site](https://datafusion.apache.org/) +- [Installation](https://datafusion.apache.org/user-guide/cli/installation.html) +- [Rust Getting Started](https://datafusion.apache.org/user-guide/example-usage.html) +- [Rust DataFrame API](https
Re: [PR] Update links to point to datafusion.apache.org [datafusion]
/datafusion/user-guide/dataframe.html) +- [Project Site](https://datafusion.apache.org/) +- [Installation](https://datafusion.apache.org/user-guide/cli/installation.html) +- [Rust Getting Started](https://datafusion.apache.org/user-guide/example-usage.html) +- [Rust DataFrame API](https
(datafusion-ballista) branch asf-site updated: Publish built docs triggered by c4336a83d93209591c31e180294e37d0b8de5fc5
--- .asf.yaml | 23 ++- 1 file changed, 18 insertions(+), 5 deletions(-) diff --git a/.asf.yaml b/.asf.yaml index dae11d120..d3cb7cb97 100644 --- a/.asf.yaml +++ b/.asf.yaml @@ -16,8 +16,8 @@ # under the License. notifications: - commits: [email protected]
[D] Apache DataFusion Comet 0.16.0 Release - Apache DataFusion Blog [datafusion-site]
GitHub user giscus[bot] created a discussion: Apache DataFusion Comet 0.16.0 Release - Apache DataFusion Blog # Apache DataFusion Comet 0.16.0 Release - Apache DataFusion Blog https://datafusion.apache.org/blog/output/2026/05/07/datafusion-comet-0.16.0/ GitHub link: https://github.com
[D] Apache DataFusion 53.0.0 Released - Apache DataFusion Blog [datafusion-site]
GitHub user giscus[bot] created a discussion: Apache DataFusion 53.0.0 Released - Apache DataFusion Blog # Apache DataFusion 53.0.0 Released - Apache DataFusion Blog https://datafusion.apache.org/blog/output/2026/04/02/datafusion-53.0.0/ GitHub link: https://github.com/apache/datafusion
(datafusion) branch main updated: Add mailing list descriptions to documentation (#10284)
iling list for release coordination and occasional design discussions. Other -than the release process, most DataFusion mailing list traffic will link to a GitHub issue or PR for discussion. -([subscribe](mailto:[email protected]), -[unsubscribe](mailto:dev-uns
Re: [PR] Update .asf.yaml to publish docs to datafusion.apache.org [datafusion]
ngine" - homepage: https://arrow.apache.org/datafusion + homepage: https://datafusion.apache.org/ Review Comment: After this change it should start publishing to https://datafusion.apache.org without needing the subdirectory 🤞 -- This is an automated message from the Apache Git Service. To
Re: [I] "Fatal Python error: Bus error" when using datafusion 49 [datafusion-python]
kevinjqliu commented on issue #1217: URL: https://github.com/apache/datafusion-python/issues/1217#issuecomment-3238913303 it could be the case that datafusion 49 contains a breaking change... https://datafusion.apache.org/blog/2025/07/28/datafusion-49.0.0/ https://datafusion.apache.org
(datafusion) branch asf-site updated: Publish built docs triggered by 110a90aeebe6cad3e2963f46463fb1e7c4e2cca7
@@ -44,6 +44,7 @@ DOCUMENTATION_OPTIONS.pagename = 'contributor-guide/api-health'; DOCUMENTATION_OPTIONS.search_as_you_type = false; + https://datafusion.apache.org/contributor-guide/api-health.html"; /> diff --git a/contributor-guide/architecture.h
(datafusion-ballista) branch main updated: Set up default protection ruleset for default and release branches (#1715)
) --- .asf.yaml | 23 ++- 1 file changed, 18 insertions(+), 5 deletions(-) diff --git a/.asf.yaml b/.asf.yaml index dae11d120..d3cb7cb97 100644 --- a/.asf.yaml +++ b/.asf.yaml @@ -16,8 +16,8 @@ # under the License. notifications: - commits: [email protected]
[PR] Fix giscus origin validation in giscus.json [datafusion-site]
kevinjqliu opened a new pull request, #174: URL: https://github.com/apache/datafusion-site/pull/174 Fixes https://github.com/apache/datafusion-site/pull/173#issuecomment-4415043334 Followup to #172 ## What Change `giscus.json` origins from `https://datafusion.apache.org
Re: [PR] docs: add Ballista link to landing page (#17746) [datafusion]
Comet <https://datafusion.apache.org/comet/>`_ is an accelerator for Apache Spark based on DataFusion. +- `DataFusion Ballista <https://datafusion.apache.org/ballista/>`_ is a distributed compute platform built on + top of DataFusion for scalable execution. "Out of the
(datafusion-comet) branch asf-site updated: Publish built docs triggered by d81b383cb7fb81a3288a59220f47f56fe2b40723
DataFusion Comet, follow the [DataFusion Slack and Discord channels](https://datafusion.apache.org/contributor-guide/communication.html) to connect with other users, ask questions, and share your experiences with Comet. -Follow [Apache DataFusion Comet Overview](https://datafusion.apache.org/comet
Re: [I] Create Project Website (datafusion.apache.org) [datafusion]
alamb closed issue #10151: Create Project Website (datafusion.apache.org) URL: https://github.com/apache/datafusion/issues/10151 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment
Re: [D] outlier, time compare or frequency analysis operators in datafusion? [datafusion]
GitHub user alamb added a comment to the discussion: outlier, time compare or frequency analysis operators in datafusion? The window functions might also be relevant: https://datafusion.apache.org/user-guide/sql/window_functions.html GitHub link: https://github.com/apache/datafusion
Re: [D] why datafusion consume 2g of memory?? [datafusion]
GitHub user alamb closed the discussion with a comment: why datafusion consume 2g of memory?? The tuning guide may also offer some interesting ideas https://datafusion.apache.org/user-guide/configs.html#tuning-guide GitHub link: https://github.com/apache/datafusion/discussions/12386
[D] Writing Custom Table Providers in Apache DataFusion - Apache DataFusion Blog [datafusion-site]
GitHub user giscus[bot] created a discussion: Writing Custom Table Providers in Apache DataFusion - Apache DataFusion Blog # Writing Custom Table Providers in Apache DataFusion - Apache DataFusion Blog https://datafusion.apache.org/blog/2026/03/31/writing-table-providers/ GitHub link
Re: [I] 404 in repo Website: https://datafusion.apache.org/ballista [datafusion-ballista]
andygrove closed issue #1035: 404 in repo Website: https://datafusion.apache.org/ballista URL: https://github.com/apache/datafusion-ballista/issues/1035 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go
Re: [I] Redirect existing docs from https://arrow.apache.org/ to https://datafusion.apache.org/ [datafusion]
alamb closed issue #10194: Redirect existing docs from https://arrow.apache.org/ to https://datafusion.apache.org/ URL: https://github.com/apache/datafusion/issues/10194 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use
Re: [D] outlier, time compare or frequency analysis operators in datafusion? [datafusion]
GitHub user juju4 added a comment to the discussion: outlier, time compare or frequency analysis operators in datafusion? so best approaching that is currently available is standard deviation (stddev), correct? https://datafusion.apache.org/user-guide/sql/aggregate_functions.html#stddev
Re: [D] How can I use a case expression from Python? [datafusion]
GitHub user Jefffrey added a comment to the discussion: How can I use a case expression from Python? I believe the Python bindings now expose case: https://datafusion.apache.org/python/autoapi/datafusion/functions/index.html#datafusion.functions.case GitHub link: https://github.com/apache
[D] Implementing User Defined Types and Custom Metadata in DataFusion - Apache DataFusion Blog [datafusion-site]
GitHub user giscus[bot] created a discussion: Implementing User Defined Types and Custom Metadata in DataFusion - Apache DataFusion Blog # Implementing User Defined Types and Custom Metadata in DataFusion - Apache DataFusion Blog https://datafusion.apache.org/blog/2025/09/21/custom-types
Re: [D] DISCUSSION: DataFusion Meetup in Asia and China 2026 [datafusion]
GitHub user alamb added a comment to the discussion: DISCUSSION: DataFusion Meetup in Asia and China 2026 A bunch of people use discord as described in https://datafusion.apache.org/contributor-guide/communication.html#discord I don't know of a WeChat group (though there might b
Re: [PR] Update .asf.yaml to publish docs to datafusion.apache.org [datafusion]
homepage: https://arrow.apache.org/datafusion + homepage: https://datafusion.apache.org/ Review Comment: `https://datafusion.apache.org/` will give you:  -
Re: [PR] chore: add contributing in README.md [datafusion-comet]
viirya commented on code in PR #382: URL: https://github.com/apache/datafusion-comet/pull/382#discussion_r1590335386 ## README.md: ## @@ -70,3 +70,7 @@ Linux, Apple OSX (Intel and M1) ## Getting started See the [DataFusion Comet User Guide](https://datafusion.apache.org
Re: [I] no way to specify date range [datafusion]
functions? https://datafusion.apache.org/user-guide/sql/scalar_functions.html#generate-series https://datafusion.apache.org/user-guide/sql/scalar_functions.html#array-functions https://datafusion.apache.org/user-guide/sql/scalar_functions.html#time-and-date-functions -- This is an
(datafusion-comet) branch main updated: re-enable GitHub discussions (#1535)
..693b92cf0 100644 --- a/.asf.yaml +++ b/.asf.yaml @@ -24,6 +24,7 @@ notifications: commits: [email protected] issues: [email protected] pullrequests: [email protected] + discussions: [email protected] jira_options: link label worklog github
(datafusion) branch main updated: Re-enable github discussion (#15241)
f.yaml index 8e939c695d..5fe94dc04a 100644 --- a/.asf.yaml +++ b/.asf.yaml @@ -24,6 +24,7 @@ notifications: commits: [email protected] issues: [email protected] pullrequests: [email protected] + discussions: [email protected] jira_options: link
Re: [D] Is there a join type that can pushdown join filter to one side's scan? [datafusion]
GitHub user alexwilcoxson-rel added a comment to the discussion: Is there a join type that can pushdown join filter to one side's scan? https://datafusion.apache.org/blog/2025/09/10/dynamic-filters/ specifically the [section about hash joins](https://datafusion.apache.org/blog/2025/
Re: [PR] chore: Create a doap file [datafusion]
xmlns:foaf="http://xmlns.com/foaf/0.1/";> + + https://datafusion.apache.org";> +2024-04-17 +https://spdx.org/licenses/Apache-2.0"; /> +Apache DataFusion +https://datafusion.apache.org"; /> +https://datafusion.apache.org"; /> +Apache DataF
Re: [I] `https://datafusion.apache.org/blog/` routes to a directory listing [datafusion-site]
kevinjqliu commented on issue #181: URL: https://github.com/apache/datafusion-site/issues/181#issuecomment-4431361137 https://github.com/apache/datafusion-site/pull/182 we're back! https://datafusion.apache.org/blog/ -- This is an automated message from the Apache Git Servic
(datafusion-site) branch asf-site updated: Bump feed.xml to attempt to trigger infra to publish (#36)
deletions(-) diff --git a/feed.xml b/feed.xml index d3766e5..9b6bc1e 100644 --- a/feed.xml +++ b/feed.xml @@ -1,4 +1,4 @@ -http://www.w3.org/2005/Atom"; >https://jekyllrb.com/"; version="4.3.3">Jekyllhttps://datafusion.apache.org/blog/feed.xml"; rel="self&q
(datafusion-comet) branch asf-site updated: Publish built docs triggered by f51b51a6200c1846102d0fa6afa17db4ff71bd53
| 2 ++ 1 file changed, 2 insertions(+) diff --git a/.asf.yaml b/.asf.yaml index 2d2009110..693b92cf0 100644 --- a/.asf.yaml +++ b/.asf.yaml @@ -24,6 +24,7 @@ notifications: commits: [email protected] issues: [email protected] pullrequests: [email protected]
(datafusion) branch asf-site updated: Publish built docs triggered by 30863b9aeed640df6bf13601dabf7308e751c3c8
++ 1 file changed, 2 insertions(+) diff --git a/.asf.yaml b/.asf.yaml index 8e939c695d..5fe94dc04a 100644 --- a/.asf.yaml +++ b/.asf.yaml @@ -24,6 +24,7 @@ notifications: commits: [email protected] issues: [email protected] pullrequests: [email protected]
(datafusion-site) branch main updated: github: turn on discussion (#85)
(+) diff --git a/.asf.yaml b/.asf.yaml index 7ee5b83..7f6f7bc 100644 --- a/.asf.yaml +++ b/.asf.yaml @@ -24,6 +24,7 @@ notifications: commits: [email protected] issues: [email protected] pullrequests: [email protected] + discussions: git
Re: [PR] Add Table of content to past blogs [datafusion-site]
alamb commented on PR #112: URL: https://github.com/apache/datafusion-site/pull/112#issuecomment-3312352194 I spot checked a few and they now have a TOC! https://datafusion.apache.org/blog/2025/03/11/ordering-analysis/ https://github.com/user-attachments/assets/22c993e0-999a
Re: [I] Enable comments on datafusion-site via giscus [datafusion-site]
kevinjqliu commented on issue #80: URL: https://github.com/apache/datafusion-site/issues/80#issuecomment-4416405278 Not sure if its just me but the latest blog post (https://datafusion.apache.org/blog/output/2026/04/18/datafusion-comet-0.15.0/) still doesnt work... Im seeing https
Re: [I] Update the DataFusion in Python website [datafusion-python]
Michael-J-Ward commented on issue #687: URL: https://github.com/apache/datafusion-python/issues/687#issuecomment-2111455295 Thanks, @Weijun-H And I see the new logo on https://datafusion.apache.org/  or [nvl2](https://datafusion.apache.org/user
Re: [D] Is HashAggregation spilling enabled by default? [datafusion]
://datafusion.apache.org/comet/user-guide/tuning.html (i'm not using cometh though) GitHub link: https://github.com/apache/datafusion/discussions/15543#discussioncomment-12775706 This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: github-uns
Re: [I] Release DataFusion `46.0.0` [datafusion]
alamb commented on issue #14123: URL: https://github.com/apache/datafusion/issues/14123#issuecomment-2694820798 > [@alamb](https://github.com/alamb) My pleasure > > I sent the release email to [[email protected]](mailto:[email protected]), did you see it?
Re: [D] How does Comet compare to Gluten? Are there any plans to integrate with Gluten? [datafusion-comet]
GitHub user andygrove added a comment to the discussion: How does Comet compare to Gluten? Are there any plans to integrate with Gluten? We now have a guide comparing Comet and Gluten as part of our documentation: https://datafusion.apache.org/comet/user-guide/gluten_comparison.html GitHub
Re: [I] row-wise min and max [datafusion]
kosiew commented on issue #16366: URL: https://github.com/apache/datafusion/issues/16366#issuecomment-2968958912 hi @drtconway , pmin sounds a lot like https://datafusion.apache.org/user-guide/sql/scalar_functions.html#least and pmax like https://datafusion.apache.org
Re: [PR] Revert "fix: add `output: 'blog'` to publish workflow to fix `/output/` URL leak" [datafusion-site]
kevinjqliu commented on PR #184: URL: https://github.com/apache/datafusion-site/pull/184#issuecomment-4432184178 verified that https://datafusion.apache.org/blog/blog/ is gone https://datafusion.apache.org/blog/output/ still exists thanks again! -- This is an automated message
(datafusion) branch asf-site updated: Publish built docs triggered by c91dcfdb6a5814e87c796caa3bc7606f01425f00
in the [Extending SQL in DataFusion: from ->> +to TABLESAMPLE] blog. + +[extending sql in datafusion: from ->> to tablesample]: https://datafusion.apache.org/blog/2026/01/12/extending-sql + ## Architecture Overview When DataFusion processes a SQL query, it goes through these stages
(datafusion) branch asf-site updated: Publish built docs triggered by fedee070c86f5769088960fab351f1bc0ab30248
o:[email protected]), -[unsubscribe](mailto:[email protected]), -[archives](https://lists.apache.org/[email protected])). +## Mailing Lists -When emailing the dev list, please make sure to prefix the subject line with a -`[DataFusion]` tag
(datafusion-comet) branch main updated: fix: correct user guide URL in compatibility fallback messages (#4854)
ot;Guide (https://datafusion.apache.org/comet/user-guide/compatibility.html)" + "Guide (https://datafusion.apache.org/comet/user-guide/latest/compatibility/index.html)" private val TUNING_GUIDE = "For more information, refer to the Comet Tuning " + - "Gu
Re: [PR] docs: add Ballista link to landing page (#17746) [datafusion]
<https://datafusion.apache.org/comet/>`_ is an accelerator for Apache Spark based on DataFusion. +- `DataFusion Ballista <https://arrow.apache.org/ballista/>`_ is a distributed compute platform built on + top of DataFusion for scalable execution. "Out of the box,"
Re: [PR] chore: Create a doap file [datafusion]
-syntax-ns#"; + xmlns:asfext="http://projects.apache.org/ns/asfext#"; + xmlns:foaf="http://xmlns.com/foaf/0.1/";> + + https://datafusion.apache.org";> +2024-04-17 +https://spdx.org/licenses/Apache-2.0"; /> + Apache DataFusion +https://datafus
Re: [PR] chore: Create a doap file [datafusion]
-syntax-ns#"; + xmlns:asfext="http://projects.apache.org/ns/asfext#"; + xmlns:foaf="http://xmlns.com/foaf/0.1/";> + + https://datafusion.apache.org";> +2024-04-17 +https://spdx.org/licenses/Apache-2.0"; /> + Apache DataFusion +https://datafus
Re: [I] [EPIC] Tasks for a new Top Level Apache Project [datafusion]
alamb commented on issue #9691: URL: https://github.com/apache/datafusion/issues/9691#issuecomment-2070154517 Ok, the DNS issue has been resolved. We have the website up (needs some links fixed) https://datafusion.apache.org/ The mailing lists are working as well. For example
Re: [PR] Update .asf.yaml to publish docs to datafusion.apache.org [datafusion]
alamb commented on PR #10190: URL: https://github.com/apache/datafusion/pull/10190#issuecomment-2071981403 It appears to have worked! https://datafusion.apache.org/ now shows:  GitHub link: https://github.com/apache/datafusion/discussions/2980#discussioncomment-14482492 This is an automatically sent email for [email protected]. To
Re: [PR] consecutive repartitions blog post [datafusion-site]
alamb commented on PR #127: URL: https://github.com/apache/datafusion-site/pull/127#issuecomment-3677783962 Update -- this post now is showing up correctly on the main datatfusion blog site: https://datafusion.apache.org/blog/ Specifically the url is: https://datafusion.apache.org
Re: [D] How can I string-split a string field into a list field in Arrow Datafusion? [datafusion]
GitHub user Jefffrey closed the discussion with a comment: How can I string-split a string field into a list field in Arrow Datafusion? This is now possible with [`string_to_array`](https://datafusion.apache.org/user-guide/sql/scalar_functions.html#string-to-array) function Equivalent
Re: [PR] Use BooleanBufferBuilder rather than Vec in ArrowBytesViewMap [datafusion]
alamb commented on code in PR #20064: URL: https://github.com/apache/datafusion/pull/20064#discussion_r2742927075 ## CONTRIBUTING.md: ## @@ -17,4 +17,4 @@ under the License. --> -See the [Contributor Guide](https://datafusion.apache.org/contributor-guide/index.html) +
Re: [D] Tokio-Conf 2026. [datafusion]
GitHub user alamb added a comment to the discussion: Tokio-Conf 2026. Submitted! GitHub link: https://github.com/apache/datafusion/discussions/18260#discussioncomment-14779843 This is an automatically sent email for [email protected]. To unsubscribe, please send an email to
(datafusion) branch asf-site updated: Publish built docs triggered by e65c3e919855c9977cf4d80c0630ee26b7fd03ee
tafusion/latest/datafusion/> + Blog <https://datafusion.apache.org/blog/> Code of conduct <https://github.com/apache/datafusion/blob/main/CODE_OF_CONDUCT.md> Download diff --git a/contributor-guide/architecture.html b/contributor-guide/architecture.html index ececc
Re: [PR] Fix: deadlink in "Concepts, Reading, Events" page to DataFusion blog [datafusion]
. - **2026-04-04** [Video: Generalized Consensus & Native Top-K Joins in ParadeDB](https://www.youtube.com/watch?v=TeFsBVIYBis) -- **2026-03-31** [Blog: Writing Custom Table Providers in Apache DataFusion](https://datafusion.apache.org/blog/2026/03/31/custom-table-providers/) +- **2026-03-31** [
(datafusion) branch main updated: docs: add Ballista link to landing page (#17746) (#17775)
separate documentati queries. - `DataFusion Comet <https://datafusion.apache.org/comet/>`_ is an accelerator for Apache Spark based on DataFusion. +- `DataFusion Ballista <https://datafusion.apache.org/ballista/>`_ is distributed processing extension for DataFusion. &qu
Re: [PR] Update releases links with releases in 2025-2026 [datafusion]
. ## 📅 Release Notes & Updates -- **2025-03-24** [Apache DataFusion 46.0.0 Released](https://datafusion.apache.org/blog/2025/03/24/datafusion-46.0.0/) - -- **2024-09-14** [Apache DataFusion Python 43.1.0 Released](https://datafusion.apache.org/blog/2024/12/14/datafusion-python-43
Re: [D] Support Spark 3.3/JDK8 [datafusion-comet]
GitHub user xumingming added a comment to the discussion: Support Spark 3.3/JDK8 Thanks @mbutrovich and @andygrove ! GitHub link: https://github.com/apache/datafusion-comet/discussions/3043#discussioncomment-15439791 This is an automatically sent email for [email protected]
Re: [D] Google Summer of Code (GSoC) 2026 [datafusion]
GitHub user Yuvraj-cyborg added a comment to the discussion: Google Summer of Code (GSoC) 2026 fair enough GitHub link: https://github.com/apache/datafusion/discussions/20033#discussioncomment-15629394 This is an automatically sent email for [email protected]. To unsubscribe
Re: [D] DISCUSSION: DataFusion Meetup in Stockholm, Sweden [datafusion]
GitHub user xudong963 added a comment to the discussion: DISCUSSION: DataFusion Meetup in Stockholm, Sweden +1 GitHub link: https://github.com/apache/datafusion/discussions/18429#discussioncomment-15063626 This is an automatically sent email for [email protected]. To
Re: [D] starting [datafusion]
@datafusion.apache.org. To unsubscribe, please send an email to: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: github-h
Re: [D] DISCUSSION: Apache DataFusion Portland, OR Meetup [datafusion]
GitHub user alamb added a comment to the discussion: DISCUSSION: Apache DataFusion Portland, OR Meetup So good! GitHub link: https://github.com/apache/datafusion/discussions/19817#discussioncomment-16747664 This is an automatically sent email for [email protected]. To
Re: [ANNOUNCE] New DataFusion Committer: Huaxin Gao
your contributions! > > Liang-Chi > > - > To unsubscribe, e-mail: [email protected] > For additional commands, e-mail: [email protected] > > ----- To uns
Re: [PR] Publish DataFusion 40.0.0 post [datafusion-site]
alamb commented on code in PR #10: URL: https://github.com/apache/datafusion-site/pull/10#discussion_r1689542007 ## 2021/08/18/datafusion-5.0.0/index.html: ## @@ -10,17 +10,17 @@ -https://datafusion.apache.org/blog/2021/08/18/datafusion-5.0.0/"; />
Re: [PR] Docs: Formatting and Added Extra resources [datafusion]
https://datafusion.apache.org/blog/2025/03/21/parquet-pushdown https://datafusion.apache.org/blog/2025/03/20/parquet-pruning -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubsc
Re: [D] How does 'sort' interact with record batches? [datafusion]
.window(vec![row_number().alias(DATA_FUSION_ROW_NUMBER)]) .sort(vec![ident("userPrimarkyKey").sort(true, true)])? ``` You will also likely have to set [`datafusion.execution.target_partitions` config setting ](https://datafusion.apache.org/user-guide/configs.html)to 1 GitHub li
Re: [PR] Minor: add clearer link to the main website from intro paragraph. [datafusion]
://datafusion.apache.org/ +//! [DataFusion website]: https://datafusion.apache.org Review Comment: I realize it links to the same place twice, but I think that is ok -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the
Re: [PR] Use BooleanBufferBuilder rather than Vec in ArrowBytesViewMap [datafusion]
etk18 commented on code in PR #20064: URL: https://github.com/apache/datafusion/pull/20064#discussion_r2744638751 ## CONTRIBUTING.md: ## @@ -17,4 +17,4 @@ under the License. --> -See the [Contributor Guide](https://datafusion.apache.org/contributor-guide/index.html) +
(datafusion) 01/01: docs: Update Concepts, Readings, Events page (add Videos section, recent posts and releases) (#24221)
[Concepts, Readings, Events](https://datafusion.apache.org/user-guide/concepts-readings-events.html) page had not been updated since early April 2026. ## What changes are included in this PR? 1. Add recent release announcements prune older release entries in favor of
Re: [D] More thorough contribution guideline [datafusion]
for [email protected]. To unsubscribe, please send an email to: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: github-h
Re: [D] Search Pushdown (e.g. Vector Search) Into Table Providers [datafusion]
GitHub user niebayes added a comment to the discussion: Search Pushdown (e.g. Vector Search) Into Table Providers Cool GitHub link: https://github.com/apache/datafusion/discussions/16358#discussioncomment-13461933 This is an automatically sent email for [email protected]. To
Re: [D] Indexing Support in DataFusion? [datafusion]
[email protected]. To unsubscribe, please send an email to: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: git
Re: [D] How can I save partitioned Parquet ? [datafusion]
GitHub user Miyake-Diogo closed a discussion: How can I save partitioned Parquet ? How can I save partitioned parquet like apache spark? GitHub link: https://github.com/apache/datafusion/discussions/3737 This is an automatically sent email for [email protected]. To
Re: [D] are there a function works as generate_series()of postgresql in datafusion? [datafusion]
GitHub user l1t1 closed a discussion: are there a function works as generate_series()of postgresql in datafusion? thanks GitHub link: https://github.com/apache/datafusion/discussions/9315 This is an automatically sent email for [email protected]. To unsubscribe, please send
Re: [D] Join reordering [datafusion]
[email protected]. To unsubscribe, please send an email to: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: github-h
Re: [D] datafusion mascot when? [datafusion]
--- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected] - To unsubscribe, e-mail: [email protected] For ad
Re: [D] datafusion mascot when? [datafusion]
--- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected] - To unsubscribe, e-mail: [email protected] For ad
Re: [D] Google Summer of Code (GSoC) 2026 [datafusion]
@datafusion.apache.org. To unsubscribe, please send an email to: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [D] starting [datafusion]
@datafusion.apache.org. To unsubscribe, please send an email to: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [D] Indexing Support in DataFusion? [datafusion]
@datafusion.apache.org. To unsubscribe, please send an email to: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: github-h
Re: [D] Admin – Remote & Flexible Work Opportunity [datafusion]
s an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected] - To unsubscribe, e-mail: [email protected] For additi
Re: [D] Dynamic loading of plugins [datafusion]
GitHub user lixiaoyong12 closed a discussion: Dynamic loading of plugins Can you give a plug-in management module a dynamic record plug-in example? GitHub link: https://github.com/apache/datafusion/discussions/5447 This is an automatically sent email for [email protected]. To
