[
https://issues.apache.org/jira/browse/SPARK-23715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16452790#comment-16452790
]
Bruce Robbins edited comment on SPARK-23715 at 4/25/18 10:00 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-23715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16452790#comment-16452790
]
Bruce Robbins commented on SPARK-23715:
---
[~cloud_fan]
I'll give separate answers for String input
[
https://issues.apache.org/jira/browse/SPARK-24043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16449352#comment-16449352
]
Bruce Robbins commented on SPARK-24043:
---
You're half-way there. When whole-stage codegen is off
[
https://issues.apache.org/jira/browse/SPARK-24043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16449281#comment-16449281
]
Bruce Robbins commented on SPARK-24043:
---
[~maropu]
> Do I miss any precondition?
For this bug to
Bruce Robbins created SPARK-24043:
-
Summary: InterpretedPredicate.eval fails if expression tree
contains Nondeterministic expressions
Key: SPARK-24043
URL: https://issues.apache.org/jira/browse/SPARK-24043
[
https://issues.apache.org/jira/browse/SPARK-23963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16441378#comment-16441378
]
Bruce Robbins commented on SPARK-23963:
---
[~Tagar] Yes, although I am a little fuzzy on the process
[
https://issues.apache.org/jira/browse/SPARK-23936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16437985#comment-16437985
]
Bruce Robbins commented on SPARK-23936:
---
I will have a WIP pull request tonight or tomorrow
[
https://issues.apache.org/jira/browse/SPARK-23936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16436133#comment-16436133
]
Bruce Robbins commented on SPARK-23936:
---
I would like to take this one, assuming no one has taken
[
https://issues.apache.org/jira/browse/SPARK-23715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431403#comment-16431403
]
Bruce Robbins edited comment on SPARK-23715 at 4/11/18 8:09 PM:
I've been
[
https://issues.apache.org/jira/browse/SPARK-23963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-23963:
--
Description:
TableReader gets disproportionately slower as the number of columns in the
query
[
https://issues.apache.org/jira/browse/SPARK-23963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-23963:
--
Description:
TableReader gets disproportionately slower as the number of columns in the
query
Bruce Robbins created SPARK-23963:
-
Summary: Queries on text-based Hive tables grow disproportionately
slower as the number of columns increase
Key: SPARK-23963
URL:
[
https://issues.apache.org/jira/browse/SPARK-23715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431403#comment-16431403
]
Bruce Robbins commented on SPARK-23715:
---
I've been convinced this is worth fixing, at least for
[
https://issues.apache.org/jira/browse/SPARK-23776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16411854#comment-16411854
]
Bruce Robbins commented on SPARK-23776:
---
As it turns out, the building-spark page does have maven
Bruce Robbins created SPARK-23776:
-
Summary: pyspark-sql tests should display build instructions when
components are missing
Key: SPARK-23776
URL: https://issues.apache.org/jira/browse/SPARK-23776
[
https://issues.apache.org/jira/browse/SPARK-23715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-23715:
--
Description:
This produces the expected answer:
{noformat}
[
https://issues.apache.org/jira/browse/SPARK-23715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16406836#comment-16406836
]
Bruce Robbins commented on SPARK-23715:
---
A fix to this requires some ugly hacking of the implicit
[
https://issues.apache.org/jira/browse/SPARK-23715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-23715:
--
Description:
This produces the expected answer:
{noformat}
[
https://issues.apache.org/jira/browse/SPARK-23715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-23715:
--
Description:
This produces the expected answer:
{noformat}
[
https://issues.apache.org/jira/browse/SPARK-23715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-23715:
--
Description:
This produces the expected answer:
{noformat}
[
https://issues.apache.org/jira/browse/SPARK-23560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-23560:
--
Summary: Group by on struct field can add extra shuffle (was: A joinWith
followed by groupBy
[
https://issues.apache.org/jira/browse/SPARK-23715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-23715:
--
Description:
This produces the expected answer:
{noformat}
[
https://issues.apache.org/jira/browse/SPARK-23715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-23715:
--
Description:
This produces the expected answer:
{noformat}
[
https://issues.apache.org/jira/browse/SPARK-23715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-23715:
--
Description:
This produces the expected answer:
{noformat}
[
https://issues.apache.org/jira/browse/SPARK-23715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16403183#comment-16403183
]
Bruce Robbins commented on SPARK-23715:
---
It almost seems like FromUTCTimestamp needs its own Cast
Bruce Robbins created SPARK-23715:
-
Summary: from_utc_timestamp returns incorrect results for some UTC
date/time values
Key: SPARK-23715
URL: https://issues.apache.org/jira/browse/SPARK-23715
[
https://issues.apache.org/jira/browse/SPARK-23560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16394369#comment-16394369
]
Bruce Robbins commented on SPARK-23560:
---
A simpler example that seems to reproduce this issue
Bruce Robbins created SPARK-23629:
-
Summary: Building streaming-kafka-0-8-assembly or
streaming-flume-assembly adds incompatible jline jar to assembly
Key: SPARK-23629
URL:
[
https://issues.apache.org/jira/browse/SPARK-23560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-23560:
--
Description:
Depending on the size of the input, a joinWith followed by a groupBy requires
[
https://issues.apache.org/jira/browse/SPARK-23560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390111#comment-16390111
]
Bruce Robbins commented on SPARK-23560:
---
The main issue is that an AttributeReference instance
Bruce Robbins created SPARK-23560:
-
Summary: A joinWith followed by groupBy requires extra shuffle
Key: SPARK-23560
URL: https://issues.apache.org/jira/browse/SPARK-23560
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-23417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16368031#comment-16368031
]
Bruce Robbins commented on SPARK-23417:
---
This does the trick:
{noformat}
build/sbt -Pkafka-0-8
[
https://issues.apache.org/jira/browse/SPARK-23410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364929#comment-16364929
]
Bruce Robbins edited comment on SPARK-23410 at 2/14/18 11:17 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-23410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364929#comment-16364929
]
Bruce Robbins commented on SPARK-23410:
---
bq. I am working on a fix, just in case
Oh, OK, this one
[
https://issues.apache.org/jira/browse/SPARK-23410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364916#comment-16364916
]
Bruce Robbins commented on SPARK-23410:
---
On Spark 2.2.1, I got the same result as you. But with
[
https://issues.apache.org/jira/browse/SPARK-23410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364866#comment-16364866
]
Bruce Robbins edited comment on SPARK-23410 at 2/14/18 10:21 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-23410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364866#comment-16364866
]
Bruce Robbins commented on SPARK-23410:
---
[~maxgekk]
My simple test input of
[{"field1": 10,
[
https://issues.apache.org/jira/browse/SPARK-23410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364788#comment-16364788
]
Bruce Robbins commented on SPARK-23410:
---
I am probably misunderstanding the issue, but I couldn't
[
https://issues.apache.org/jira/browse/SPARK-23240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16359568#comment-16359568
]
Bruce Robbins commented on SPARK-23240:
---
A little background. A Spark installation had a Python
[
https://issues.apache.org/jira/browse/SPARK-23251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346246#comment-16346246
]
Bruce Robbins edited comment on SPARK-23251 at 1/31/18 4:35 AM:
[~srowen]
[
https://issues.apache.org/jira/browse/SPARK-23251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346246#comment-16346246
]
Bruce Robbins commented on SPARK-23251:
---
[~srowen] This also occurs with compiled apps submitted
[
https://issues.apache.org/jira/browse/SPARK-23251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346050#comment-16346050
]
Bruce Robbins commented on SPARK-23251:
---
I commented out the following line in
[
https://issues.apache.org/jira/browse/SPARK-23240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16342688#comment-16342688
]
Bruce Robbins commented on SPARK-23240:
---
Hi [~hyukjin.kwon],
I am not sure this update covers the
Bruce Robbins created SPARK-23251:
-
Summary: ClassNotFoundException: scala.Any when there's a missing
implicit Map encoder
Key: SPARK-23251
URL: https://issues.apache.org/jira/browse/SPARK-23251
[
https://issues.apache.org/jira/browse/SPARK-23240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16341609#comment-16341609
]
Bruce Robbins commented on SPARK-23240:
---
I will be making a pull request.
> PythonWorkerFactory
Bruce Robbins created SPARK-23240:
-
Summary: PythonWorkerFactory issues unhelpful message when
pyspark.daemon produces bogus stdout
Key: SPARK-23240
URL: https://issues.apache.org/jira/browse/SPARK-23240
[
https://issues.apache.org/jira/browse/SPARK-22940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-22940:
--
Description:
On platforms that don't have wget installed (e.g., Mac OS X), test suite
Bruce Robbins created SPARK-22940:
-
Summary: Test suite HiveExternalCatalogVersionsSuite fails on
platforms that don't have wget installed
Key: SPARK-22940
URL: https://issues.apache.org/jira/browse/SPARK-22940
[
https://issues.apache.org/jira/browse/SPARK-22940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-22940:
--
Description:
On platforms that don't have wget installed (e.g., Mac OS X), test suite
401 - 449 of 449 matches
Mail list logo