shaneknapp commented on issue #23447: [SPARK-26462][CORE] Use ConfigEntry for
hardcoded configs for execution categories
URL: https://github.com/apache/spark/pull/23447#issuecomment-454124180
test this please
This is an
AmplabJenkins commented on issue #22535: [SPARK-17636][SQL][WIP] Parquet
predicate pushdown in nested fields
URL: https://github.com/apache/spark/pull/22535#issuecomment-454127548
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
AmplabJenkins removed a comment on issue #23396: [SPARK-26397][SQL] Driver side
only metrics support
URL: https://github.com/apache/spark/pull/23396#issuecomment-454127224
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
SparkQA commented on issue #22535: [SPARK-17636][SQL][WIP] Parquet predicate
pushdown in nested fields
URL: https://github.com/apache/spark/pull/22535#issuecomment-454127523
**[Test build #101203 has
AmplabJenkins removed a comment on issue #23396: [SPARK-26397][SQL] Driver side
only metrics support
URL: https://github.com/apache/spark/pull/23396#issuecomment-454127220
Merged build finished. Test PASSed.
This is an
AmplabJenkins commented on issue #22535: [SPARK-17636][SQL][WIP] Parquet
predicate pushdown in nested fields
URL: https://github.com/apache/spark/pull/22535#issuecomment-454127543
Merged build finished. Test FAILed.
This is
AmplabJenkins commented on issue #22535: [SPARK-17636][SQL][WIP] Parquet
predicate pushdown in nested fields
URL: https://github.com/apache/spark/pull/22535#issuecomment-454134541
Merged build finished. Test PASSed.
This is
AmplabJenkins removed a comment on issue #22535: [SPARK-17636][SQL][WIP]
Parquet predicate pushdown in nested fields
URL: https://github.com/apache/spark/pull/22535#issuecomment-454134543
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
AmplabJenkins commented on issue #22535: [SPARK-17636][SQL][WIP] Parquet
predicate pushdown in nested fields
URL: https://github.com/apache/spark/pull/22535#issuecomment-454134543
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
srowen commented on issue #22807: [SPARK-25811][PySpark] Raise a proper error
when unsafe cast is detected by PyArrow
URL: https://github.com/apache/spark/pull/22807#issuecomment-454134268
Got it, makes sense to me, with a default config value that sets safe=False.
dan-blanchard commented on issue #18139: [SPARK-20787][PYTHON] PySpark can't
handle datetimes before 1900
URL: https://github.com/apache/spark/pull/18139#issuecomment-454141515
This is not fixed in Python 3. `time.mktime` cannot handle dates before 1900.
With Python 3.7:
```
dan-blanchard edited a comment on issue #18139: [SPARK-20787][PYTHON] PySpark
can't handle datetimes before 1900
URL: https://github.com/apache/spark/pull/18139#issuecomment-454141515
This is not fixed in Python 3. `time.mktime` cannot handle dates before 1900.
With Python 3.7:
dan-blanchard commented on issue #18139: [SPARK-20787][PYTHON] PySpark can't
handle datetimes before 1900
URL: https://github.com/apache/spark/pull/18139#issuecomment-454155032
A backward compatible fix would be to use the `tzlocal` library to get the
local timezone info:
```py
SparkQA commented on issue #23447: [SPARK-26462][CORE] Use ConfigEntry for
hardcoded configs for execution categories
URL: https://github.com/apache/spark/pull/23447#issuecomment-454087930
**[Test build #101193 has
rdblue commented on a change in pull request #21978: [SPARK-25006][SQL] Add
CatalogTableIdentifier.
URL: https://github.com/apache/spark/pull/21978#discussion_r247597895
##
File path:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/identifiers.scala
##
@@
AmplabJenkins removed a comment on issue #23521: [SPARK-26604][CORE] Clean up
channel registration for StreamManager
URL: https://github.com/apache/spark/pull/23521#issuecomment-454119351
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
shaneknapp commented on issue #23383: [SPARK-23817][SQL] Create file source V2
framework and migrate ORC read path
URL: https://github.com/apache/spark/pull/23383#issuecomment-454124398
test this please
This is an automated
shaneknapp commented on issue #23396: [SPARK-26397][SQL] Driver side only
metrics support
URL: https://github.com/apache/spark/pull/23396#issuecomment-454124493
test this please
This is an automated message from the Apache
shaneknapp commented on issue #23531: [SPARK-24497][SQL] Support recursive SQL
query
URL: https://github.com/apache/spark/pull/23531#issuecomment-454124304
test this please
This is an automated message from the Apache Git
AmplabJenkins removed a comment on issue #22573: [SPARK-25558][SQL] Pushdown
predicates for nested fields in DataSource Strategy
URL: https://github.com/apache/spark/pull/22573#issuecomment-454125866
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
AmplabJenkins removed a comment on issue #23396: [SPARK-26397][SQL] Driver side
only metrics support
URL: https://github.com/apache/spark/pull/23396#issuecomment-454125715
Merged build finished. Test PASSed.
This is an
AmplabJenkins removed a comment on issue #23521: [SPARK-26604][CORE] Clean up
channel registration for StreamManager
URL: https://github.com/apache/spark/pull/23521#issuecomment-454125725
Merged build finished. Test PASSed.
AmplabJenkins removed a comment on issue #23396: [SPARK-26397][SQL] Driver side
only metrics support
URL: https://github.com/apache/spark/pull/23396#issuecomment-454125722
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
AmplabJenkins removed a comment on issue #22573: [SPARK-25558][SQL] Pushdown
predicates for nested fields in DataSource Strategy
URL: https://github.com/apache/spark/pull/22573#issuecomment-454125861
Merged build finished. Test PASSed.
BryanCutler commented on issue #22807: [SPARK-25811][PySpark] Raise a proper
error when unsafe cast is detected by PyArrow
URL: https://github.com/apache/spark/pull/22807#issuecomment-454126221
>Can users directly set 'safe' if they want to?
No, there is no way for a user to set it.
AmplabJenkins removed a comment on issue #22535: [SPARK-17636][SQL][WIP]
Parquet predicate pushdown in nested fields
URL: https://github.com/apache/spark/pull/22535#issuecomment-454127884
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
rberenguel commented on issue #18139: [SPARK-20787][PYTHON] PySpark can't
handle datetimes before 1900
URL: https://github.com/apache/spark/pull/18139#issuecomment-454148595
Hi @dan-blanchard thanks for the pointers, I haven't delved much into Python
3.x time improvements (if any), if I
AmplabJenkins removed a comment on issue #23396: [SPARK-26397][SQL] Driver side
only metrics support
URL: https://github.com/apache/spark/pull/23396#issuecomment-454155800
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
gatorsmile commented on a change in pull request #23285: [SPARK-26224][SQL]
Warn and advice the user when creating many project on subsequent calls to
withColumn
URL: https://github.com/apache/spark/pull/23285#discussion_r247584595
##
File path:
AmplabJenkins removed a comment on issue #23447: [SPARK-26462][CORE] Use
ConfigEntry for hardcoded configs for execution categories
URL: https://github.com/apache/spark/pull/23447#issuecomment-454092375
Test PASSed.
Refer to this link for build results (access rights to CI server
inpefess commented on issue #20691: [SPARK-18161] [Python] Allow pickle to
serialize >4 GB objects when possible (Python 3.4+)
URL: https://github.com/apache/spark/pull/20691#issuecomment-454095559
> Looks the test failures related. In the current master, it all passes fine.
Yes, my
SparkQA removed a comment on issue #23538: [MINOR][BUILD] Remove binary
license/notice files in a source release for branch-2.4+ only
URL: https://github.com/apache/spark/pull/23538#issuecomment-454004784
**[Test build #101183 has
gatorsmile commented on issue #23496: [SPARK-26577][SQL] Add input optimizer
when reading Hive table by SparkSQL
URL: https://github.com/apache/spark/pull/23496#issuecomment-454100312
Let us close this one and will review the PR in the master branch.
shaneknapp commented on issue #23540: [SPARK-26615][Core] Fixing transport
server/client resource leaks in the core unittests
URL: https://github.com/apache/spark/pull/23540#issuecomment-454120522
test this please
This is an
shaneknapp commented on issue #23396: [SPARK-26397][SQL] Driver side only
metrics support
URL: https://github.com/apache/spark/pull/23396#issuecomment-454120396
test this please
This is an automated message from the Apache
AmplabJenkins removed a comment on issue #23396: [SPARK-26397][SQL] Driver side
only metrics support
URL: https://github.com/apache/spark/pull/23396#issuecomment-454119352
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
shaneknapp commented on issue #23383: [SPARK-23817][SQL] Create file source V2
framework and migrate ORC read path
URL: https://github.com/apache/spark/pull/23383#issuecomment-454120463
test this please
This is an automated
AmplabJenkins removed a comment on issue #23540: [SPARK-26615][Core] Fixing
transport server/client resource leaks in the core unittests
URL: https://github.com/apache/spark/pull/23540#issuecomment-454125126
Test PASSed.
Refer to this link for build results (access rights to CI server
AmplabJenkins removed a comment on issue #23540: [SPARK-26615][Core] Fixing
transport server/client resource leaks in the core unittests
URL: https://github.com/apache/spark/pull/23540#issuecomment-454125124
Merged build finished. Test PASSed.
AmplabJenkins commented on issue #23447: [SPARK-26462][CORE] Use ConfigEntry
for hardcoded configs for execution categories
URL: https://github.com/apache/spark/pull/23447#issuecomment-454125409
Merged build finished. Test PASSed.
SparkQA commented on issue #23540: [SPARK-26615][Core] Fixing transport
server/client resource leaks in the core unittests
URL: https://github.com/apache/spark/pull/23540#issuecomment-454125427
**[Test build #101196 has
AmplabJenkins commented on issue #23447: [SPARK-26462][CORE] Use ConfigEntry
for hardcoded configs for execution categories
URL: https://github.com/apache/spark/pull/23447#issuecomment-454125419
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
SparkQA commented on issue #22573: [SPARK-25558][SQL] Pushdown predicates for
nested fields in DataSource Strategy
URL: https://github.com/apache/spark/pull/22573#issuecomment-454125496
**[Test build #101202 has
SparkQA commented on issue #23521: [SPARK-26604][CORE] Clean up channel
registration for StreamManager
URL: https://github.com/apache/spark/pull/23521#issuecomment-454125453
**[Test build #101198 has
AmplabJenkins commented on issue #23383: [SPARK-23817][SQL] Create file source
V2 framework and migrate ORC read path
URL: https://github.com/apache/spark/pull/23383#issuecomment-454125437
Merged build finished. Test PASSed.
SparkQA commented on issue #23396: [SPARK-26397][SQL] Driver side only metrics
support
URL: https://github.com/apache/spark/pull/23396#issuecomment-454125484
**[Test build #101200 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/101200/testReport)**
for PR
AmplabJenkins commented on issue #23383: [SPARK-23817][SQL] Create file source
V2 framework and migrate ORC read path
URL: https://github.com/apache/spark/pull/23383#issuecomment-454125448
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
SparkQA commented on issue #23447: [SPARK-26462][CORE] Use ConfigEntry for
hardcoded configs for execution categories
URL: https://github.com/apache/spark/pull/23447#issuecomment-454125459
**[Test build #101199 has
pgandhi999 commented on a change in pull request #22806: [SPARK-25250][CORE] :
Late zombie task completions handled correctly even before new taskset launched
URL: https://github.com/apache/spark/pull/22806#discussion_r247648372
##
File path:
devaraj-kavali commented on a change in pull request #17726: [SPARK-17928]
[Mesos] No driver.memoryOverhead setting for mesos cluster mode
URL: https://github.com/apache/spark/pull/17726#discussion_r247592016
##
File path:
AmplabJenkins removed a comment on issue #23519: [SPARK-26601][SQL] Make
broadcast-exchange thread pool configurable
URL: https://github.com/apache/spark/pull/23519#issuecomment-454097320
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
SparkQA commented on issue #23538: [MINOR][BUILD] Remove binary license/notice
files in a source release for branch-2.4+ only
URL: https://github.com/apache/spark/pull/23538#issuecomment-454099747
**[Test build #101183 has
AmplabJenkins commented on issue #23539: [SPARK-26617][SQL] Cache manager locks
URL: https://github.com/apache/spark/pull/23539#issuecomment-454102763
Can one of the admins verify this patch?
This is an automated message from
AmplabJenkins removed a comment on issue #23539: [SPARK-26617][SQL] Cache
manager locks
URL: https://github.com/apache/spark/pull/23539#issuecomment-454102626
Can one of the admins verify this patch?
This is an automated
AmplabJenkins commented on issue #23539: [SPARK-26617][SQL] Cache manager locks
URL: https://github.com/apache/spark/pull/23539#issuecomment-454102626
Can one of the admins verify this patch?
This is an automated message from
BryanCutler commented on issue #22807: [SPARK-25811][PySpark] Raise a proper
error when unsafe cast is detected by PyArrow
URL: https://github.com/apache/spark/pull/22807#issuecomment-454117538
@srowen we discussed adding this flag a while ago when pyarrow 0.11.1 made
this option which
SparkQA commented on issue #23540: [SPARK-26615][Core] Fixing transport
server/client resource leaks in the core unittests
URL: https://github.com/apache/spark/pull/23540#issuecomment-454117662
**[Test build #101194 has
AmplabJenkins commented on issue #23540: [SPARK-26615][Core] Fixing transport
server/client resource leaks in the core unittests
URL: https://github.com/apache/spark/pull/23540#issuecomment-454117951
Merged build finished. Test PASSed.
AmplabJenkins commented on issue #23540: [SPARK-26615][Core] Fixing transport
server/client resource leaks in the core unittests
URL: https://github.com/apache/spark/pull/23540#issuecomment-454117960
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
AmplabJenkins removed a comment on issue #23540: [SPARK-26615][Core] Fixing
transport server/client resource leaks in the core unittests
URL: https://github.com/apache/spark/pull/23540#issuecomment-454119358
Test FAILed.
Refer to this link for build results (access rights to CI server
shaneknapp commented on issue #23521: [SPARK-26604][CORE] Clean up channel
registration for StreamManager
URL: https://github.com/apache/spark/pull/23521#issuecomment-454120871
test this please
This is an automated message
attilapiros commented on issue #23540: [SPARK-26615][Core] Fixing transport
server/client resource leaks in the core unittests
URL: https://github.com/apache/spark/pull/23540#issuecomment-454121204
As I see the tests was stopped as Jenkins is restarted.
shaneknapp commented on issue #23531: [SPARK-24497][SQL] Support recursive SQL
query
URL: https://github.com/apache/spark/pull/23531#issuecomment-454120587
test this please
This is an automated message from the Apache Git
AmplabJenkins removed a comment on issue #23531: [SPARK-24497][SQL] Support
recursive SQL query
URL: https://github.com/apache/spark/pull/23531#issuecomment-454119363
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
shaneknapp commented on issue #23447: [SPARK-26462][CORE] Use ConfigEntry for
hardcoded configs for execution categories
URL: https://github.com/apache/spark/pull/23447#issuecomment-454120737
test this please
This is an
AmplabJenkins removed a comment on issue #23447: [SPARK-26462][CORE] Use
ConfigEntry for hardcoded configs for execution categories
URL: https://github.com/apache/spark/pull/23447#issuecomment-454119339
Merged build finished. Test FAILed.
AmplabJenkins commented on issue #23531: [SPARK-24497][SQL] Support recursive
SQL query
URL: https://github.com/apache/spark/pull/23531#issuecomment-454124877
Merged build finished. Test PASSed.
This is an automated message
AmplabJenkins commented on issue #23540: [SPARK-26615][Core] Fixing transport
server/client resource leaks in the core unittests
URL: https://github.com/apache/spark/pull/23540#issuecomment-454125124
Merged build finished. Test PASSed.
AmplabJenkins removed a comment on issue #23531: [SPARK-24497][SQL] Support
recursive SQL query
URL: https://github.com/apache/spark/pull/23531#issuecomment-454124877
Merged build finished. Test PASSed.
This is an automated
srowen commented on issue #23499: [SPARK-26254][CORE] Extract Hive + Kafka
dependencies from Core.
URL: https://github.com/apache/spark/pull/23499#issuecomment-454125062
(Agree that shading is a big, important, but separate change to be
considered)
AmplabJenkins removed a comment on issue #23531: [SPARK-24497][SQL] Support
recursive SQL query
URL: https://github.com/apache/spark/pull/23531#issuecomment-454124898
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
AmplabJenkins commented on issue #23540: [SPARK-26615][Core] Fixing transport
server/client resource leaks in the core unittests
URL: https://github.com/apache/spark/pull/23540#issuecomment-454125126
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
AmplabJenkins commented on issue #23531: [SPARK-24497][SQL] Support recursive
SQL query
URL: https://github.com/apache/spark/pull/23531#issuecomment-454124898
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
srowen commented on issue #22807: [SPARK-25811][PySpark] Raise a proper error
when unsafe cast is detected by PyArrow
URL: https://github.com/apache/spark/pull/22807#issuecomment-454124856
Can users directly set 'safe' if they want to? is it an Arrow option that
users can access in
AmplabJenkins removed a comment on issue #22535: [SPARK-17636][SQL][WIP]
Parquet predicate pushdown in nested fields
URL: https://github.com/apache/spark/pull/22535#issuecomment-454127877
Merged build finished. Test PASSed.
AmplabJenkins commented on issue #22535: [SPARK-17636][SQL][WIP] Parquet
predicate pushdown in nested fields
URL: https://github.com/apache/spark/pull/22535#issuecomment-454127884
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
SparkQA removed a comment on issue #22535: [SPARK-17636][SQL][WIP] Parquet
predicate pushdown in nested fields
URL: https://github.com/apache/spark/pull/22535#issuecomment-454125500
**[Test build #101203 has
AmplabJenkins removed a comment on issue #22535: [SPARK-17636][SQL][WIP]
Parquet predicate pushdown in nested fields
URL: https://github.com/apache/spark/pull/22535#issuecomment-454127548
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
AmplabJenkins removed a comment on issue #22535: [SPARK-17636][SQL][WIP]
Parquet predicate pushdown in nested fields
URL: https://github.com/apache/spark/pull/22535#issuecomment-454127543
Merged build finished. Test FAILed.
AmplabJenkins commented on issue #22535: [SPARK-17636][SQL][WIP] Parquet
predicate pushdown in nested fields
URL: https://github.com/apache/spark/pull/22535#issuecomment-454127877
Merged build finished. Test PASSed.
This is
AmplabJenkins removed a comment on issue #22535: [SPARK-17636][SQL][WIP]
Parquet predicate pushdown in nested fields
URL: https://github.com/apache/spark/pull/22535#issuecomment-454134541
Merged build finished. Test PASSed.
SparkQA commented on issue #23396: [SPARK-26397][SQL] Driver side only metrics
support
URL: https://github.com/apache/spark/pull/23396#issuecomment-454155547
**[Test build #101200 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/101200/testReport)**
for PR
AmplabJenkins commented on issue #22535: [SPARK-17636][SQL][WIP] Parquet
predicate pushdown in nested fields
URL: https://github.com/apache/spark/pull/22535#issuecomment-454165320
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
AmplabJenkins removed a comment on issue #22535: [SPARK-17636][SQL][WIP]
Parquet predicate pushdown in nested fields
URL: https://github.com/apache/spark/pull/22535#issuecomment-454165316
Merged build finished. Test FAILed.
AmplabJenkins commented on issue #22535: [SPARK-17636][SQL][WIP] Parquet
predicate pushdown in nested fields
URL: https://github.com/apache/spark/pull/22535#issuecomment-454165316
Merged build finished. Test FAILed.
This is
tdas commented on issue #23301: [SPARK-26350][SS]Allow to override group id of
the Kafka consumer
URL: https://github.com/apache/spark/pull/23301#issuecomment-454166967
LGTM.
This is an automated message from the Apache Git
zsxwing commented on issue #23301: [SPARK-26350][SS]Allow to override group id
of the Kafka consumer
URL: https://github.com/apache/spark/pull/23301#issuecomment-454170780
Thanks! Merging to master.
This is an automated
dbtsai opened a new pull request #23542: [WIP] [SPARK-25603][SQL] Pushing Down
Nested Field projections
URL: https://github.com/apache/spark/pull/23542
## What changes were proposed in this pull request?
(Please fill in changes proposed in this fix)
## How was this patch
AmplabJenkins commented on issue #23542: [WIP] [SPARK-25603][SQL] Pushing Down
Nested Field projections
URL: https://github.com/apache/spark/pull/23542#issuecomment-454176379
Merged build finished. Test FAILed.
This is an
AmplabJenkins commented on issue #23542: [WIP] [SPARK-25603][SQL] Pushing Down
Nested Field projections
URL: https://github.com/apache/spark/pull/23542#issuecomment-454176367
Merged build finished. Test PASSed.
This is an
SparkQA removed a comment on issue #23542: [WIP] [SPARK-25603][SQL] Pushing
Down Nested Field projections
URL: https://github.com/apache/spark/pull/23542#issuecomment-454175819
**[Test build #101207 has
SparkQA commented on issue #23542: [WIP] [SPARK-25603][SQL] Pushing Down Nested
Field projections
URL: https://github.com/apache/spark/pull/23542#issuecomment-454176364
**[Test build #101207 has
SparkQA commented on issue #22573: [SPARK-25558][SQL] Pushdown predicates for
nested fields in DataSource Strategy
URL: https://github.com/apache/spark/pull/22573#issuecomment-454177923
**[Test build #101202 has
SparkQA removed a comment on issue #22573: [SPARK-25558][SQL] Pushdown
predicates for nested fields in DataSource Strategy
URL: https://github.com/apache/spark/pull/22573#issuecomment-454125496
**[Test build #101202 has
AmplabJenkins commented on issue #22573: [SPARK-25558][SQL] Pushdown predicates
for nested fields in DataSource Strategy
URL: https://github.com/apache/spark/pull/22573#issuecomment-454178237
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
AmplabJenkins removed a comment on issue #22573: [SPARK-25558][SQL] Pushdown
predicates for nested fields in DataSource Strategy
URL: https://github.com/apache/spark/pull/22573#issuecomment-454178233
Merged build finished. Test FAILed.
AmplabJenkins commented on issue #22573: [SPARK-25558][SQL] Pushdown predicates
for nested fields in DataSource Strategy
URL: https://github.com/apache/spark/pull/22573#issuecomment-454178233
Merged build finished. Test FAILed.
gatorsmile commented on a change in pull request #23506: [SPARK-26577][SQL] Add
input optimizer when reading Hive table by SparkSQL
URL: https://github.com/apache/spark/pull/23506#discussion_r247678113
##
File path:
pgandhi999 commented on issue #23536: [SPARK-26612]Fix speculation kill causing
finished stage recomputed
URL: https://github.com/apache/spark/pull/23536#issuecomment-454187241
It would also make sense to combine this PR with #23537
AmplabJenkins removed a comment on issue #23512: [SPARK-26593][SQL] Use
Proleptic Gregorian calendar in casting UTF8String to Date/TimestampType
URL: https://github.com/apache/spark/pull/23512#issuecomment-454187625
Merged build finished. Test PASSed.
201 - 300 of 1093 matches
Mail list logo
