alamb commented on code in PR #4992:
URL: https://github.com/apache/arrow-datafusion/pull/4992#discussion_r1081668860
##
datafusion/common/src/error.rs:
##
@@ -359,84 +380,49 @@ impl DataFusionError {
///
/// This may be the same as `self`.
pub fn find_root(&self)
alamb opened a new pull request, #4992:
URL: https://github.com/apache/arrow-datafusion/pull/4992
# Which issue does this PR close?
Closes https://github.com/apache/arrow-datafusion/issues/4991
# Rationale for this change
In IOx (and in DataFusion) we often want to know w
pitrou commented on issue #15054:
URL: https://github.com/apache/arrow/issues/15054#issuecomment-1397431670
Note original problem: "there is a global static RegionResolver that has an
S3Client and that S3Client is being destroyed after S3 has already been
destroyed". So the static RegionRes
pitrou commented on issue #15054:
URL: https://github.com/apache/arrow/issues/15054#issuecomment-1397430555
Wouldn't the problem be basically the same? Depending on static destruction
order, some structures inside AWS SDK may already have been finalized?
--
This is an automated message fr
westonpace commented on issue #15054:
URL: https://github.com/apache/arrow/issues/15054#issuecomment-1397429004
Perhaps we can add another static storage object that calls EnsureFinalized?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on
zeroshade commented on code in PR #355:
URL: https://github.com/apache/arrow-adbc/pull/355#discussion_r1081663877
##
go/adbc/driver/flightsql/flightsql_adbc.go:
##
@@ -116,22 +122,32 @@ type database struct {
func (d *database) SetOptions(cnOptions map[string]string) error {
pitrou commented on issue #15054:
URL: https://github.com/apache/arrow/issues/15054#issuecomment-1397427907
Ah! No, a C `atexit` hook would probably not work. I'm talking about a
[Python `atexit` hook](https://docs.python.org/3/library/atexit.html). However,
there is the flipped issue that
zeroshade commented on code in PR #355:
URL: https://github.com/apache/arrow-adbc/pull/355#discussion_r1081661077
##
go/adbc/driver/flightsql/flightsql_adbc.go:
##
@@ -103,6 +103,12 @@ func (d Driver) NewDatabase(opts map[string]string)
(adbc.Database, error) {
zeroshade commented on code in PR #355:
URL: https://github.com/apache/arrow-adbc/pull/355#discussion_r1081658427
##
ci/scripts/go_build.sh:
##
@@ -42,6 +42,13 @@ main() {
make all
popd
+
+mkdir -p "${install_dir}/lib"
+if [[ $(go env GOOS) ==
westonpace commented on issue #15054:
URL: https://github.com/apache/arrow/issues/15054#issuecomment-1397422501
I agree that this isn't a good fix for users. I'm not sure an `atexit` hook
would work though because it [won't be called before the static state is
destroyed](https://en.cpprefe
assignUser commented on issue #33786:
URL: https://github.com/apache/arrow/issues/33786#issuecomment-1397421912
Ah yes this seems to be the case as 22.04 has xsimd 7.6.0 and we require
8.1.0:
`Unpacking libxsimd-dev:amd64 (7.6.0-2) `
--
This is an automated message from the Apache Git
assignUser commented on issue #33786:
URL: https://github.com/apache/arrow/issues/33786#issuecomment-1397414258
resolve_dependency clearly does not correctly detect the system install
(maybe discards it due to version?) and falls back on source build. So it is
ossible that `Findxsimd.cmkae`
nealrichardson commented on code in PR #33748:
URL: https://github.com/apache/arrow/pull/33748#discussion_r1081651053
##
r/NEWS.md:
##
@@ -19,6 +19,94 @@
# arrow 10.0.1.9000
+## Breaking changes
+
+* `map_batches()` is lazy by default; it now returns a `RecordBatchReader`
+
tustvold commented on issue #3568:
URL: https://github.com/apache/arrow-rs/issues/3568#issuecomment-1397408351
FWIW there is regex rewrite logic already in DataFusion that we could crib
from - https://github.com/apache/arrow-datafusion/pull/4646
Tbh I'm not sure if this is better hand
rok commented on PR #33776:
URL: https://github.com/apache/arrow/pull/33776#issuecomment-1397404547
> Well, why should I have a assignee but I cannot edit the description of
patch? Should someone be assignee or assign this task to me? ╮(￣▽￣"")╭
I've assigned it to you. Can you check i
wjones127 commented on code in PR #33660:
URL: https://github.com/apache/arrow/pull/33660#discussion_r1081643332
##
docs/source/developers/reviewing.rst:
##
@@ -255,3 +255,43 @@ Social aspects
* Like any communication, code reviews are governed by the Apache
`Code of Conduct
snmvaughan opened a new issue, #3568:
URL: https://github.com/apache/arrow-rs/issues/3568
**Is your feature request related to a problem or challenge? Please describe
what you are trying to do.**
Implement a Spark SQL `rlike`, which checks for specific fast paths in order
to avoid using
lidavidm merged PR #33768:
URL: https://github.com/apache/arrow/pull/33768
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscr...@arrow.apac
zeroshade commented on PR #14111:
URL: https://github.com/apache/arrow/pull/14111#issuecomment-1397400985
If there's no further comments before EOD today i'll merge this.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use
github-actions[bot] commented on PR #33793:
URL: https://github.com/apache/arrow/pull/33793#issuecomment-1397400817
:warning: GitHub issue #15054 **has been automatically assigned in GitHub**
to PR creator.
--
This is an automated message from the Apache Git Service.
To respond to the mes
github-actions[bot] commented on PR #33793:
URL: https://github.com/apache/arrow/pull/33793#issuecomment-1397400770
* Closes: #15054
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific c
westonpace opened a new pull request, #33793:
URL: https://github.com/apache/arrow/pull/33793
For some reason destroying an S3Client at shutdown can cause a crash in our
tests. It appears to be because S3's logging is already shut down. I wouldn't
think this would happen because I would t
pitrou commented on issue #15054:
URL: https://github.com/apache/arrow/issues/15054#issuecomment-1397398440
This may solve the problem in pytest, but will not solve it for users. We
may try an `atexit` hook...
--
This is an automated message from the Apache Git Service.
To respond to the
ursabot commented on PR #4988:
URL:
https://github.com/apache/arrow-datafusion/pull/4988#issuecomment-1397396643
Benchmark runs are scheduled for baseline =
dde23efed94704044822bcefe49c0af7f9260088 and contender =
5025aa58f3cbb2a949de5afb7a11b5dba869e724.
5025aa58f3cbb2a949de5afb7a11b5dba
github-actions[bot] commented on PR #33792:
URL: https://github.com/apache/arrow/pull/33792#issuecomment-1397394446
* Closes: #33789
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific c
lidavidm opened a new pull request, #33792:
URL: https://github.com/apache/arrow/pull/33792
### Rationale for this change
Add Err() to the RecordReader interface so we can report errors.
### Are these changes tested?
This is tested in the C Data Interface.
### Are
westonpace commented on issue #15054:
URL: https://github.com/apache/arrow/issues/15054#issuecomment-1397392367
Shall we try this:
https://github.com/apache/arrow/commit/59cc8cdf1be90da30086325c41d3e7d49d1483b9
?
`finalize_s3` will reset the region resolver before shutting down s3.
Dandandan commented on PR #4988:
URL:
https://github.com/apache/arrow-datafusion/pull/4988#issuecomment-1397387893
Thank you @jdye64
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific
Dandandan merged PR #4988:
URL: https://github.com/apache/arrow-datafusion/pull/4988
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscr...@
Dandandan closed issue #4987: Re-Export `substait` crate
URL: https://github.com/apache/arrow-datafusion/issues/4987
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscr
github-actions[bot] commented on PR #33791:
URL: https://github.com/apache/arrow/pull/33791#issuecomment-1397384518
:warning: GitHub issue #33782 **has been automatically assigned in GitHub**
to PR creator.
--
This is an automated message from the Apache Git Service.
To respond to the mes
github-actions[bot] commented on PR #33791:
URL: https://github.com/apache/arrow/pull/33791#issuecomment-1397384453
* Closes: #33782
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific c
tustvold closed issue #2832: Deprecate MutableArrayData
URL: https://github.com/apache/arrow-rs/issues/2832
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-ma
tustvold commented on issue #2832:
URL: https://github.com/apache/arrow-rs/issues/2832#issuecomment-1397384403
I think I have made peace with the existence of MutableArrayData
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub an
rok opened a new pull request, #33791:
URL: https://github.com/apache/arrow/pull/33791
### What changes are included in this PR?
Release RC vote email now gets issue number and verify release PR's url from
GitHub's GraphQL API.
### Are these changes tested?
Changes were
alamb commented on issue #3566:
URL: https://github.com/apache/arrow-rs/issues/3566#issuecomment-1397371990
Follow on ticket in datafusion:
https://github.com/apache/arrow-datafusion/issues/4991
--
This is an automated message from the Apache Git Service.
To respond to the message, please
alamb commented on code in PR #3567:
URL: https://github.com/apache/arrow-rs/pull/3567#discussion_r1081612923
##
arrow-flight/src/error.rs:
##
@@ -52,7 +54,15 @@ impl std::fmt::Display for FlightError {
}
}
-impl std::error::Error for FlightError {}
+impl Error for Fligh
nealrichardson commented on code in PR #33770:
URL: https://github.com/apache/arrow/pull/33770#discussion_r1081612013
##
cpp/src/arrow/dataset/scanner.cc:
##
@@ -135,20 +136,19 @@ Result>
GetProjectedSchemaFromExpression(
const std::shared_ptr& dataset_schema) {
// proc
alamb opened a new issue, #4991:
URL: https://github.com/apache/arrow-datafusion/issues/4991
**Is your feature request related to a problem or challenge? Please describe
what you are trying to do.**
In IOx (and in DataFusion) we often want to know what the root cause of an
error is (e.g
alamb commented on issue #3566:
URL: https://github.com/apache/arrow-rs/issues/3566#issuecomment-1397359936
>
I think we should replace the find_root method in DataFusion with this
mechanism as well and embrace the standard 💪
On it!
--
This is an automated message from the
crepererum commented on code in PR #3567:
URL: https://github.com/apache/arrow-rs/pull/3567#discussion_r1081604539
##
arrow-flight/src/error.rs:
##
@@ -52,7 +54,15 @@ impl std::fmt::Display for FlightError {
}
}
-impl std::error::Error for FlightError {}
+impl Error for
crepererum commented on issue #3566:
URL: https://github.com/apache/arrow-rs/issues/3566#issuecomment-1397355652
I think we should replace the `find_root` method in DataFusion with this
mechanism as well and embrace the standard :muscle:
--
This is an automated message from the Apache Gi
alamb commented on code in PR #3567:
URL: https://github.com/apache/arrow-rs/pull/3567#discussion_r1081602031
##
arrow-flight/src/error.rs:
##
@@ -52,7 +54,15 @@ impl std::fmt::Display for FlightError {
}
}
-impl std::error::Error for FlightError {}
+impl Error for Fligh
alamb opened a new pull request, #3567:
URL: https://github.com/apache/arrow-rs/pull/3567
# Which issue does this PR close?
Close https://github.com/apache/arrow-rs/issues/3566
# Rationale for this change
In IOx (and in DataFusion) we often want to know what the root cau
ozankabak commented on PR #4989:
URL:
https://github.com/apache/arrow-datafusion/pull/4989#issuecomment-1397344630
@alamb, I think you will like this. As I was reading the segment tree paper
from #4904, one of the remarks therein that stood out to me was that in RANGE
frames a simple linea
pitrou commented on issue #33765:
URL: https://github.com/apache/arrow/issues/33765#issuecomment-1397333607
This is a bit weird: all these classes and methods are generated by Cython
and we're not doing anything particularly advanced in that regard. Did you
build PyArrow yourself?
--
Thi
jorisvandenbossche commented on issue #33763:
URL: https://github.com/apache/arrow/issues/33763#issuecomment-1397332990
Actually, this seems to working fine for me with the latest pyarrow:
```
In [72]: map_type = pa.map_(
...: pa.field("key", pa.string(), nullable=False,
jorisvandenbossche commented on issue #33763:
URL: https://github.com/apache/arrow/issues/33763#issuecomment-1397332098
> I believe it's a bug in pyarrow. Specifically at this line: A new
field is created and used but without the metadata of the input field.
That line should only
alamb opened a new issue, #3566:
URL: https://github.com/apache/arrow-rs/issues/3566
**Is your feature request related to a problem or challenge? Please describe
what you are trying to do.**
In IOx (and in DataFusion) we often want to know what the root cause of an
error is (e.g was it a
pitrou commented on issue #15054:
URL: https://github.com/apache/arrow/issues/15054#issuecomment-1397326538
Yes, it's probably that. Though "S3 has already been destroyed" is a bit
vague (is it after DLL unload?).
--
This is an automated message from the Apache Git Service.
To respond to
westonpace commented on issue #15054:
URL: https://github.com/apache/arrow/issues/15054#issuecomment-1397323800
Looks like there is a global static `RegionResolver` that has an `S3Client`
and that `S3Client` is being destroyed after S3 has already been destroyed?
--
This is an automated m
jorisvandenbossche commented on issue #33765:
URL: https://github.com/apache/arrow/issues/33765#issuecomment-1397317927
cc @pitrou
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific co
tustvold commented on PR #3563:
URL: https://github.com/apache/arrow-rs/pull/3563#issuecomment-1397315398
> What's the benefit of this over including an append_all function?
https://github.com/apache/arrow-rs/pull/3563/files#diff-cb5b791e20e4536940eecb1466e034510c245d0d443fb89942b8ab9
askoa commented on PR #3563:
URL: https://github.com/apache/arrow-rs/pull/3563#issuecomment-1397308505
What's the benefit of this over including an `append_all` function?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use
zeroshade commented on issue #33789:
URL: https://github.com/apache/arrow/issues/33789#issuecomment-1397278591
At this point we might as well add the `Err() error` method to the
`array.RecordReader` interface, this would allow us to potentially bring the
`ipc.Reader` to be an `array.RecordR
alamb commented on code in PR #4958:
URL: https://github.com/apache/arrow-datafusion/pull/4958#discussion_r1081534824
##
datafusion/core/src/execution/context.rs:
##
@@ -1729,6 +1741,15 @@ impl SessionState {
query.statement_to_plan(statement)
}
+/// Creates
pitrou commented on issue #33762:
URL: https://github.com/apache/arrow/issues/33762#issuecomment-1397269438
A mere lazy consensus wouldn't be enough as it's a disruptive change. It
would need an actual PMC vote. Given the lack of reaction on the [previous ML
thread](https://lists.apache.org
alamb commented on issue #4990:
URL:
https://github.com/apache/arrow-datafusion/issues/4990#issuecomment-1397267641
THe kind of outline I was thinking was:
`Expr`
`LogicalPlan`
`PhysicalPlan`
`PhysicalExpr`
`Execution Model` (aka document the ExecutionPlan
lidavidm commented on PR #33768:
URL: https://github.com/apache/arrow/pull/33768#issuecomment-1397265982
I noticed the unit test doens't actually assert that err is nil (seems Go
doesn't complain about unused return values?) so I'll fix that
--
This is an automated message from the Apache
lidavidm commented on issue #33767:
URL: https://github.com/apache/arrow/issues/33767#issuecomment-1397265138
That's what I thought :)
(It was expecting it to be zero-initialized, because it would _call the
release callback if present_.)
--
This is an automated message from the Apa
alamb opened a new issue, #4990:
URL: https://github.com/apache/arrow-datafusion/issues/4990
**Is your feature request related to a problem or challenge? Please describe
what you are trying to do.**
I would like to continue to grow / scale the community of users and
contributors to D
westonpace commented on issue #33783:
URL: https://github.com/apache/arrow/issues/33783#issuecomment-1397261770
> I think we can upgrade the unit test projects to compile for both .NET
framework 6.0 and 7.0 but that is not normally done.
I take back what I said about "not normally don
westonpace commented on issue #33783:
URL: https://github.com/apache/arrow/issues/33783#issuecomment-1397257697
> I've found that if I install dotnet 7.0.102 via snap I get the above
segmentation fault but if I install it via the Microsoft debian repositories:
I also experienced this.
pitrou commented on issue #33767:
URL: https://github.com/apache/arrow/issues/33767#issuecomment-1397255508
The `out` parameter should be handled as an out-parameter, so it can't be
expected to be initialized (to what?).
--
This is an automated message from the Apache Git Service.
To resp
westonpace commented on issue #33783:
URL: https://github.com/apache/arrow/issues/33783#issuecomment-1397252779
The libraries are (should be) portable. Executables (unit tests in this
case) are not portable.
The .NET library projects are built to target .net standard and should be
c
raulcd commented on issue #33783:
URL: https://github.com/apache/arrow/issues/33783#issuecomment-1397240744
I've found that if I install dotnet 7.0.102 via snap I get the above
segmentation fault but if I install it via the Microsoft debian repositories:
```
$ wget
https://packages.mi
dependabot[bot] opened a new pull request, #143:
URL: https://github.com/apache/arrow-datafusion-python/pull/143
Bumps [uuid](https://github.com/uuid-rs/uuid) from 0.8.2 to 1.2.2.
Release notes
Sourced from https://github.com/uuid-rs/uuid/releases";>uuid's releases.
1.2.2
dependabot[bot] closed pull request #96: build(deps): bump uuid from 0.8.2 to
1.2.1
URL: https://github.com/apache/arrow-datafusion-python/pull/96
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the
dependabot[bot] commented on PR #96:
URL:
https://github.com/apache/arrow-datafusion-python/pull/96#issuecomment-1397240332
Superseded by #143.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to th
andygrove merged PR #141:
URL: https://github.com/apache/arrow-datafusion-python/pull/141
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubsc
pitrou commented on issue #15054:
URL: https://github.com/apache/arrow/issues/15054#issuecomment-1397236632
Judging by the reconstructed stack trace (thanks @lidavidm !), this has
nothing to do with OpenSSL but with calling a logging method:
```c++
CurlHandleContainer::~CurlHandleConta
paleolimbot commented on issue #15054:
URL: https://github.com/apache/arrow/issues/15054#issuecomment-1397230707
FIWIW this looks very similar/maybe is the same as #15189, which the R
package fixed by skipping on platforms with a very old SSL runtime (MacOS 10.13
was the culprit for us).
ursabot commented on PR #33656:
URL: https://github.com/apache/arrow/pull/33656#issuecomment-1397215055
Benchmark runs are scheduled for baseline =
444dcb6779755fc33f3f81d647c188cf31abd23c and contender =
c8d6110a26c41966e539e9fa2f5cb8c31dc2f0fe.
c8d6110a26c41966e539e9fa2f5cb8c31dc2f0fe is
westonpace commented on code in PR #15083:
URL: https://github.com/apache/arrow/pull/15083#discussion_r1081477937
##
python/pyarrow/_compute.pyx:
##
@@ -2202,12 +2202,18 @@ def _group_by(args, keys, aggregations):
_pack_compute_args(args, &c_args)
_pack_compute_args(ke
pitrou merged PR #33772:
URL: https://github.com/apache/arrow/pull/33772
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscr...@arrow.apache
mustafasrepo opened a new pull request, #4989:
URL: https://github.com/apache/arrow-datafusion/pull/4989
# Which issue does this PR close?
Closes #4979
# Rationale for this change
During range calculation for window frames, we can use linear search instead
of
thisisnic merged PR #33778:
URL: https://github.com/apache/arrow/pull/33778
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscr...@arrow.apa
thisisnic commented on code in PR #33748:
URL: https://github.com/apache/arrow/pull/33748#discussion_r1081448080
##
r/NEWS.md:
##
@@ -19,6 +19,94 @@
# arrow 10.0.1.9000
+## Breaking changes
+
+* `map_batches()` is lazy by default; it now returns a `RecordBatchReader`
+ ins
thisisnic commented on code in PR #33748:
URL: https://github.com/apache/arrow/pull/33748#discussion_r1081446799
##
r/NEWS.md:
##
@@ -19,6 +19,94 @@
# arrow 10.0.1.9000
+## Breaking changes
+
+* `map_batches()` is lazy by default; it now returns a `RecordBatchReader`
+ ins
andygrove commented on PR #141:
URL:
https://github.com/apache/arrow-datafusion-python/pull/141#issuecomment-1397166051
@Jimexist @francis-du @martin-g fyi
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above
jdye64 opened a new pull request, #4988:
URL: https://github.com/apache/arrow-datafusion/pull/4988
# Which issue does this PR close?
Closes #4987
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to
thisisnic commented on code in PR #33748:
URL: https://github.com/apache/arrow/pull/33748#discussion_r1081441163
##
r/NEWS.md:
##
@@ -19,6 +19,94 @@
# arrow 10.0.1.9000
+## Breaking changes
+
+* `map_batches()` is lazy by default; it now returns a `RecordBatchReader`
+ ins
jdye64 opened a new issue, #4987:
URL: https://github.com/apache/arrow-datafusion/issues/4987
**Is your feature request related to a problem or challenge? Please describe
what you are trying to do.**
We should re-export the `substrait` crate so that library consumers can
ensure they are
westonpace commented on code in PR #14867:
URL: https://github.com/apache/arrow/pull/14867#discussion_r1081433969
##
python/pyarrow/table.pxi:
##
@@ -5383,11 +5383,9 @@ list[tuple(str, str, FunctionOptions)]
for col_name, (aggr_name, _) in zip(columns, group_by_aggr
gruuya commented on code in PR #4958:
URL: https://github.com/apache/arrow-datafusion/pull/4958#discussion_r1081432997
##
datafusion/core/src/execution/context.rs:
##
@@ -1729,6 +1741,15 @@ impl SessionState {
query.statement_to_plan(statement)
}
+/// Creates
wjones127 commented on code in PR #33660:
URL: https://github.com/apache/arrow/pull/33660#discussion_r1081432513
##
docs/source/developers/reviewing.rst:
##
@@ -255,3 +255,43 @@ Social aspects
* Like any communication, code reviews are governed by the Apache
`Code of Conduct
andygrove opened a new issue, #142:
URL: https://github.com/apache/arrow-datafusion-python/issues/142
**Is your feature request related to a problem or challenge? Please describe
what you are trying to do.**
Add documentation about releasing to conda-forge
**Describe the solution y
andygrove opened a new pull request, #141:
URL: https://github.com/apache/arrow-datafusion-python/pull/141
# Which issue does this PR close?
Closes #.
# Rationale for this change
# What changes are included in this PR?
# Are there any user-facing c
nealrichardson commented on code in PR #33748:
URL: https://github.com/apache/arrow/pull/33748#discussion_r1081416116
##
r/NEWS.md:
##
@@ -19,6 +19,94 @@
# arrow 10.0.1.9000
+## Breaking changes
+
+* `map_batches()` is lazy by default; it now returns a `RecordBatchReader`
+
nealrichardson commented on code in PR #33748:
URL: https://github.com/apache/arrow/pull/33748#discussion_r1081414171
##
r/NEWS.md:
##
@@ -19,6 +19,94 @@
# arrow 10.0.1.9000
+## Breaking changes
+
+* `map_batches()` is lazy by default; it now returns a `RecordBatchReader`
+
nealrichardson commented on code in PR #33748:
URL: https://github.com/apache/arrow/pull/33748#discussion_r1081414171
##
r/NEWS.md:
##
@@ -19,6 +19,94 @@
# arrow 10.0.1.9000
+## Breaking changes
+
+* `map_batches()` is lazy by default; it now returns a `RecordBatchReader`
+
nealrichardson commented on code in PR #33748:
URL: https://github.com/apache/arrow/pull/33748#discussion_r1081413052
##
r/NEWS.md:
##
@@ -19,6 +19,94 @@
# arrow 10.0.1.9000
+## Breaking changes
+
+* `map_batches()` is lazy by default; it now returns a `RecordBatchReader`
+
nealrichardson commented on code in PR #33748:
URL: https://github.com/apache/arrow/pull/33748#discussion_r1081412618
##
r/NEWS.md:
##
@@ -19,6 +19,94 @@
# arrow 10.0.1.9000
+## Breaking changes
+
+* `map_batches()` is lazy by default; it now returns a `RecordBatchReader`
+
DataPsycho opened a new issue, #4986:
URL: https://github.com/apache/arrow-datafusion/issues/4986
Problem:
While trying to write a csv (any type) file, I am getting the following
exception if the file already exists:
```
Error: Execution("Could not create directory data/processed/di
nealrichardson commented on code in PR #33748:
URL: https://github.com/apache/arrow/pull/33748#discussion_r1081409996
##
r/NEWS.md:
##
@@ -19,6 +19,94 @@
# arrow 10.0.1.9000
+## Breaking changes
+
+* `map_batches()` is lazy by default; it now returns a `RecordBatchReader`
+
jorisvandenbossche commented on code in PR #15196:
URL: https://github.com/apache/arrow/pull/15196#discussion_r1081408579
##
python/pyarrow/_flight.pyx:
##
@@ -536,12 +545,7 @@ cdef class FlightDescriptor(_Weakrefable):
return self.descriptor.path
def __repr__(se
alamb merged PR #4975:
URL: https://github.com/apache/arrow-datafusion/pull/4975
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscr...@arro
jorisvandenbossche commented on code in PR #15196:
URL: https://github.com/apache/arrow/pull/15196#discussion_r1081404786
##
python/pyarrow/_flight.pyx:
##
@@ -536,12 +545,7 @@ cdef class FlightDescriptor(_Weakrefable):
return self.descriptor.path
def __repr__(se
alamb commented on PR #4975:
URL:
https://github.com/apache/arrow-datafusion/pull/4975#issuecomment-1397122516
> I filed https://github.com/apache/arrow-datafusion/issues/4985 for the
changelog issue. I will look at this when I have more time.
Maybe for this release we can make the c
andygrove commented on PR #4975:
URL:
https://github.com/apache/arrow-datafusion/pull/4975#issuecomment-1397111903
I filed https://github.com/apache/arrow-datafusion/issues/4985 for the
changelog issue. I will look at this when I have more time.
--
This is an automated message from the A
401 - 500 of 37841 matches
Mail list logo
