[
https://issues.apache.org/jira/browse/SPARK-23801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16416835#comment-16416835
]
Kazuaki Ishizaki commented on SPARK-23801:
--
While we know it is time-consuming work to narrow
[
https://issues.apache.org/jira/browse/SPARK-22618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16416821#comment-16416821
]
Wenchen Fan commented on SPARK-22618:
-
Looks like we can apply the same fix to `Broadcast.unpersist`.
[
https://issues.apache.org/jira/browse/SPARK-23291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16416763#comment-16416763
]
Wenchen Fan commented on SPARK-23291:
-
shall we backport this bug fix to 2.3?
> SparkR : substr : In
[
https://issues.apache.org/jira/browse/SPARK-23699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bryan Cutler resolved SPARK-23699.
--
Resolution: Fixed
Fix Version/s: 2.4.0
Issue resolved by pull request 20839
[
https://issues.apache.org/jira/browse/SPARK-23699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bryan Cutler reassigned SPARK-23699:
Assignee: Bryan Cutler
> PySpark should raise same Error when Arrow fallback is disabled
[
https://issues.apache.org/jira/browse/SPARK-22618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16416309#comment-16416309
]
Thomas Graves commented on SPARK-22618:
---
thanks for fixing this, hitting it now in spark 2.2, I
[
https://issues.apache.org/jira/browse/SPARK-23096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tathagata Das resolved SPARK-23096.
---
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 20688
[
https://issues.apache.org/jira/browse/SPARK-23096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tathagata Das reassigned SPARK-23096:
-
Assignee: Saisai Shao
> Migrate rate source to v2
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-19964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16416239#comment-16416239
]
Apache Spark commented on SPARK-19964:
--
User 'vanzin' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-23804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-23804.
Resolution: Duplicate
Same root cause as SPARK-19964.
> Flaky test: SparkSubmitSuite
[
https://issues.apache.org/jira/browse/SPARK-19964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-19964:
Assignee: (was: Apache Spark)
> Flaky test: SparkSubmitSuite "includes jars passed in
[
https://issues.apache.org/jira/browse/SPARK-19964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-19964:
Assignee: Apache Spark
> Flaky test: SparkSubmitSuite "includes jars passed in through
[
https://issues.apache.org/jira/browse/SPARK-19964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16416141#comment-16416141
]
Marcelo Vanzin commented on SPARK-19964:
http://dl.bintray.com doesn't seem to be loading right
[
https://issues.apache.org/jira/browse/SPARK-23714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16416138#comment-16416138
]
Ted Yu commented on SPARK-23714:
[~tdas]:
What do you think ?
Thanks
> Add metrics for cached
[
https://issues.apache.org/jira/browse/SPARK-19964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16416091#comment-16416091
]
Marcelo Vanzin commented on SPARK-19964:
I ran into this failure in our internal jenkins also...
[
https://issues.apache.org/jira/browse/SPARK-9209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-9209:
-
Due Date: (was: 21/Jul/15)
> Using executor allocation, a executor is removed but it exists in
>
[
https://issues.apache.org/jira/browse/SPARK-23694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-23694:
--
Target Version/s: (was: 2.3.0)
> The staging directory should under hive.exec.stagingdir if we set
[
https://issues.apache.org/jira/browse/SPARK-22797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-22797:
--
Target Version/s: (was: 2.3.0)
> Add multiple column support to PySpark Bucketizer
>
[
https://issues.apache.org/jira/browse/SPARK-10473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-10473:
--
Due Date: (was: 7/Sep/15)
> EventLog will loss message in the long-running security application
>
[
https://issues.apache.org/jira/browse/SPARK-23425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-23425:
--
Due Date: (was: 15/Feb/18)
> load data for hdfs file path with wild card usage is not working
[
https://issues.apache.org/jira/browse/SPARK-22809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16416038#comment-16416038
]
holdenk commented on SPARK-22809:
-
This _should_ be resolved by SPARK-23169 but I'll double check when
[
https://issues.apache.org/jira/browse/SPARK-19964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin updated SPARK-19964:
---
Summary: Flaky test: SparkSubmitSuite "includes jars passed in through
--packages" (was:
Marcelo Vanzin created SPARK-23804:
--
Summary: Flaky test: SparkSubmitSuite "repositories"
Key: SPARK-23804
URL: https://issues.apache.org/jira/browse/SPARK-23804
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-19964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16416033#comment-16416033
]
Marcelo Vanzin commented on SPARK-19964:
Still flaky:
[
https://issues.apache.org/jira/browse/SPARK-23195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-23195:
--
Target Version/s: 2.3.1 (was: 2.3.0)
> Hint of cached data is lost
> ---
>
>
[
https://issues.apache.org/jira/browse/SPARK-22809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-22809:
--
Target Version/s: 2.3.1, 2.4.0 (was: 2.3.0, 2.4.0)
> pyspark is sensitive to imports with dots
>
[
https://issues.apache.org/jira/browse/SPARK-23292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-23292:
--
Target Version/s: (was: 2.3.0)
> python tests related to pandas are skipped with python 2
>
[
https://issues.apache.org/jira/browse/SPARK-23309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-23309:
--
Target Version/s: (was: 2.3.0)
> Spark 2.3 cached query performance 20-30% worse then spark 2.2
>
[
https://issues.apache.org/jira/browse/SPARK-17859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-17859:
--
Fix Version/s: (was: 2.2.1)
(was: 2.0.2)
> persist should not impede with
[
https://issues.apache.org/jira/browse/SPARK-23625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-23625:
--
Target Version/s: (was: 1.6.2)
Fix Version/s: (was: 1.6.2)
> spark sql long-running
[
https://issues.apache.org/jira/browse/SPARK-23657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-23657:
--
Fix Version/s: (was: 2.4.0)
> Document InternalRow and expose it as a stable interface
>
[
https://issues.apache.org/jira/browse/SPARK-22839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-22839:
--
Fix Version/s: (was: 2.4.0)
> Refactor Kubernetes code for configuring driver/executor pods to use
[
https://issues.apache.org/jira/browse/SPARK-23803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16415997#comment-16415997
]
Apache Spark commented on SPARK-23803:
--
User 'sabanas' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-23803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23803:
Assignee: Apache Spark
> Support bucket pruning to optimize filtering on a bucketed
[
https://issues.apache.org/jira/browse/SPARK-23803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23803:
Assignee: (was: Apache Spark)
> Support bucket pruning to optimize filtering on a
[
https://issues.apache.org/jira/browse/SPARK-5594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16415985#comment-16415985
]
imran shaik edited comment on SPARK-5594 at 3/27/18 5:48 PM:
-
[~NeoYE]
Thank
[
https://issues.apache.org/jira/browse/SPARK-5594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16415985#comment-16415985
]
imran shaik commented on SPARK-5594:
[~NeoYE]
Thank you for your awesome comment!!
It worked!!
[
https://issues.apache.org/jira/browse/SPARK-23803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asher Saban updated SPARK-23803:
Target Version/s: (was: 2.3.1)
> Support bucket pruning to optimize filtering on a bucketed
[
https://issues.apache.org/jira/browse/SPARK-23803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asher Saban updated SPARK-23803:
Fix Version/s: (was: 2.3.1)
> Support bucket pruning to optimize filtering on a bucketed
Asher Saban created SPARK-23803:
---
Summary: Support bucket pruning to optimize filtering on a
bucketed column
Key: SPARK-23803
URL: https://issues.apache.org/jira/browse/SPARK-23803
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-23801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16415911#comment-16415911
]
Marcelo Vanzin commented on SPARK-23801:
[~joshrosen] looks like the code you added to find
[
https://issues.apache.org/jira/browse/SPARK-23784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Joshua Howard updated SPARK-23784:
--
Description: I have code
[
https://issues.apache.org/jira/browse/SPARK-23784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Joshua Howard updated SPARK-23784:
--
Description: {{I have code
[
https://issues.apache.org/jira/browse/SPARK-23802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16415832#comment-16415832
]
Apache Spark commented on SPARK-23802:
--
User 'robert3005' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-23802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23802:
Assignee: (was: Apache Spark)
> PropagateEmptyRelation can leave query plan in
[
https://issues.apache.org/jira/browse/SPARK-15276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16415825#comment-16415825
]
Volodymyr Glushak edited comment on SPARK-15276 at 3/27/18 3:55 PM:
[
https://issues.apache.org/jira/browse/SPARK-23802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23802:
Assignee: Apache Spark
> PropagateEmptyRelation can leave query plan in unresolved state
Robert Kruszewski created SPARK-23802:
-
Summary: PropagateEmptyRelation can leave query plan in unresolved
state
Key: SPARK-23802
URL: https://issues.apache.org/jira/browse/SPARK-23802
Project:
[
https://issues.apache.org/jira/browse/SPARK-15276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16415825#comment-16415825
]
Volodymyr Glushak edited comment on SPARK-15276 at 3/27/18 3:51 PM:
[
https://issues.apache.org/jira/browse/SPARK-15276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16415825#comment-16415825
]
Volodymyr Glushak commented on SPARK-15276:
---
[~andrewor14],
HIVE is not adding EXTERNAL
[
https://issues.apache.org/jira/browse/SPARK-23801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nathan Kleyn updated SPARK-23801:
-
Description:
After upgrading to Spark v2.3.0 from Spark v2.1.1, we are seeing consistent
[
https://issues.apache.org/jira/browse/SPARK-23801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nathan Kleyn updated SPARK-23801:
-
Environment:
Mesos coarse grained executor
18 * r3.4xlarge (16 core boxes) with 105G of executor
[
https://issues.apache.org/jira/browse/SPARK-23801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nathan Kleyn updated SPARK-23801:
-
Environment: 18 * r3.4xlarge (16 core boxes) with 105G of executor memory
> Consistent SIGSEGV
Nathan Kleyn created SPARK-23801:
Summary: Consistent SIGSEGV after upgrading to Spark v2.3.0
Key: SPARK-23801
URL: https://issues.apache.org/jira/browse/SPARK-23801
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-23801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nathan Kleyn updated SPARK-23801:
-
Attachment: spark-executor-failure.coredump.log
> Consistent SIGSEGV after upgrading to Spark
[
https://issues.apache.org/jira/browse/SPARK-23799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Shtelma updated SPARK-23799:
Description:
Spark 2.2.1 and 2.3.0 can produce NumberFormatException (see below) during
[
https://issues.apache.org/jira/browse/SPARK-23799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Shtelma updated SPARK-23799:
Description:
Spark 2.2.1 and 2.3.0 can produce NumberFormatException (see below) during
[
https://issues.apache.org/jira/browse/SPARK-23800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Li Jin updated SPARK-23800:
---
Description:
Per discussion here:
[https://github.com/apache/spark/pull/20900#issuecomment-376195597]
>
Li Jin created SPARK-23800:
--
Summary: Support partial function and callable object with pandas
UDF
Key: SPARK-23800
URL: https://issues.apache.org/jira/browse/SPARK-23800
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-23800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Li Jin updated SPARK-23800:
---
Environment: (was: Per discussion here:
[
https://issues.apache.org/jira/browse/SPARK-23799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16415652#comment-16415652
]
Apache Spark commented on SPARK-23799:
--
User 'mshtelma' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-23799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23799:
Assignee: (was: Apache Spark)
> [CBO] FilterEstimation.evaluateInSet produces
[
https://issues.apache.org/jira/browse/SPARK-23799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23799:
Assignee: Apache Spark
> [CBO] FilterEstimation.evaluateInSet produces devision by zero
Michael Shtelma created SPARK-23799:
---
Summary: [CBO] FilterEstimation.evaluateInSet produces devision by
zero in a case of empty table with analyzed statistics
Key: SPARK-23799
URL:
[
https://issues.apache.org/jira/browse/SPARK-6162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16415600#comment-16415600
]
Barry Becker commented on SPARK-6162:
-
If we all agree that is is something that would be very nice to
Marek Novotny created SPARK-23798:
-
Summary: The CreateArray and ConcatArray should return the default
array type when no children provided
Key: SPARK-23798
URL: https://issues.apache.org/jira/browse/SPARK-23798
[
https://issues.apache.org/jira/browse/SPARK-23794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Herman van Hovell resolved SPARK-23794.
---
Resolution: Fixed
Assignee: Liang-Chi Hsieh
Fix Version/s: 2.4.0
>
[
https://issues.apache.org/jira/browse/SPARK-22513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16415320#comment-16415320
]
Steve Loughran commented on SPARK-22513:
bq. So I guess at the summary level Sean was correct
[
https://issues.apache.org/jira/browse/SPARK-23504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16415313#comment-16415313
]
Marek Novotny commented on SPARK-23504:
---
Experienced the [same
[
https://issues.apache.org/jira/browse/SPARK-23794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23794:
Assignee: (was: Apache Spark)
> UUID() should be stateful
> -
[
https://issues.apache.org/jira/browse/SPARK-23794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16415295#comment-16415295
]
Apache Spark commented on SPARK-23794:
--
User 'viirya' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-23794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23794:
Assignee: Apache Spark
> UUID() should be stateful
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-22968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jepson reopened SPARK-22968:
This issue is reappear.
> java.lang.IllegalStateException: No current assignment for partition kssh-2
>
[
https://issues.apache.org/jira/browse/SPARK-23191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16415194#comment-16415194
]
Sujith Jay Nair edited comment on SPARK-23191 at 3/27/18 8:10 AM:
--
This
[
https://issues.apache.org/jira/browse/SPARK-23191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16415194#comment-16415194
]
Sujith Jay Nair commented on SPARK-23191:
-
This is a known race condition, in which the
[
https://issues.apache.org/jira/browse/SPARK-23500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16415141#comment-16415141
]
Apache Spark commented on SPARK-23500:
--
User 'gatorsmile' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-23766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apeksha Agnihotri updated SPARK-23766:
--
Component/s: (was: Spark Core)
Structured Streaming
> Not able to
[
https://issues.apache.org/jira/browse/SPARK-23739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16415093#comment-16415093
]
Davide Isoardi commented on SPARK-23739:
We know that kafka client 0.8 has not this class, but
78 matches
Mail list logo