[
https://issues.apache.org/jira/browse/SPARK-23801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16416835#comment-16416835
]
Kazuaki Ishizaki commented on SPARK-23801:
--
While we know it is time-consuming w
[
https://issues.apache.org/jira/browse/SPARK-22618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16416821#comment-16416821
]
Wenchen Fan commented on SPARK-22618:
-
Looks like we can apply the same fix to `Broad
[
https://issues.apache.org/jira/browse/SPARK-23291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16416763#comment-16416763
]
Wenchen Fan commented on SPARK-23291:
-
shall we backport this bug fix to 2.3?
> Spar
[
https://issues.apache.org/jira/browse/SPARK-23699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bryan Cutler resolved SPARK-23699.
--
Resolution: Fixed
Fix Version/s: 2.4.0
Issue resolved by pull request 20839
[https://git
[
https://issues.apache.org/jira/browse/SPARK-23699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bryan Cutler reassigned SPARK-23699:
Assignee: Bryan Cutler
> PySpark should raise same Error when Arrow fallback is disabled
>
[
https://issues.apache.org/jira/browse/SPARK-22618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16416309#comment-16416309
]
Thomas Graves commented on SPARK-22618:
---
thanks for fixing this, hitting it now in
[
https://issues.apache.org/jira/browse/SPARK-23096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tathagata Das resolved SPARK-23096.
---
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 20688
[https://g
[
https://issues.apache.org/jira/browse/SPARK-23096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tathagata Das reassigned SPARK-23096:
-
Assignee: Saisai Shao
> Migrate rate source to v2
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-19964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16416239#comment-16416239
]
Apache Spark commented on SPARK-19964:
--
User 'vanzin' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-23804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-23804.
Resolution: Duplicate
Same root cause as SPARK-19964.
> Flaky test: SparkSubmitSuite "repo
[
https://issues.apache.org/jira/browse/SPARK-19964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-19964:
Assignee: (was: Apache Spark)
> Flaky test: SparkSubmitSuite "includes jars passed in
[
https://issues.apache.org/jira/browse/SPARK-19964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-19964:
Assignee: Apache Spark
> Flaky test: SparkSubmitSuite "includes jars passed in through --p
[
https://issues.apache.org/jira/browse/SPARK-19964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16416141#comment-16416141
]
Marcelo Vanzin commented on SPARK-19964:
http://dl.bintray.com doesn't seem to be
[
https://issues.apache.org/jira/browse/SPARK-23714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16416138#comment-16416138
]
Ted Yu commented on SPARK-23714:
[~tdas]:
What do you think ?
Thanks
> Add metrics for
[
https://issues.apache.org/jira/browse/SPARK-19964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16416091#comment-16416091
]
Marcelo Vanzin commented on SPARK-19964:
I ran into this failure in our internal
[
https://issues.apache.org/jira/browse/SPARK-9209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-9209:
-
Due Date: (was: 21/Jul/15)
> Using executor allocation, a executor is removed but it exists in
> Exec
[
https://issues.apache.org/jira/browse/SPARK-23694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-23694:
--
Target Version/s: (was: 2.3.0)
> The staging directory should under hive.exec.stagingdir if we set
>
[
https://issues.apache.org/jira/browse/SPARK-22797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-22797:
--
Target Version/s: (was: 2.3.0)
> Add multiple column support to PySpark Bucketizer
>
[
https://issues.apache.org/jira/browse/SPARK-10473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-10473:
--
Due Date: (was: 7/Sep/15)
> EventLog will loss message in the long-running security application
> -
[
https://issues.apache.org/jira/browse/SPARK-23425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-23425:
--
Due Date: (was: 15/Feb/18)
> load data for hdfs file path with wild card usage is not working prope
[
https://issues.apache.org/jira/browse/SPARK-22809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16416038#comment-16416038
]
holdenk commented on SPARK-22809:
-
This _should_ be resolved by SPARK-23169 but I'll doub
[
https://issues.apache.org/jira/browse/SPARK-19964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin updated SPARK-19964:
---
Summary: Flaky test: SparkSubmitSuite "includes jars passed in through
--packages" (was: Fla
Marcelo Vanzin created SPARK-23804:
--
Summary: Flaky test: SparkSubmitSuite "repositories"
Key: SPARK-23804
URL: https://issues.apache.org/jira/browse/SPARK-23804
Project: Spark
Issue Type: B
[
https://issues.apache.org/jira/browse/SPARK-19964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16416033#comment-16416033
]
Marcelo Vanzin commented on SPARK-19964:
Still flaky:
https://amplab.cs.berkeley.
[
https://issues.apache.org/jira/browse/SPARK-23195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-23195:
--
Target Version/s: 2.3.1 (was: 2.3.0)
> Hint of cached data is lost
> ---
>
>
[
https://issues.apache.org/jira/browse/SPARK-22809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-22809:
--
Target Version/s: 2.3.1, 2.4.0 (was: 2.3.0, 2.4.0)
> pyspark is sensitive to imports with dots
> -
[
https://issues.apache.org/jira/browse/SPARK-23292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-23292:
--
Target Version/s: (was: 2.3.0)
> python tests related to pandas are skipped with python 2
> -
[
https://issues.apache.org/jira/browse/SPARK-23309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-23309:
--
Target Version/s: (was: 2.3.0)
> Spark 2.3 cached query performance 20-30% worse then spark 2.2
> ---
[
https://issues.apache.org/jira/browse/SPARK-17859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-17859:
--
Fix Version/s: (was: 2.2.1)
(was: 2.0.2)
> persist should not impede with sp
[
https://issues.apache.org/jira/browse/SPARK-23625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-23625:
--
Target Version/s: (was: 1.6.2)
Fix Version/s: (was: 1.6.2)
> spark sql long-running missio
[
https://issues.apache.org/jira/browse/SPARK-23657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-23657:
--
Fix Version/s: (was: 2.4.0)
> Document InternalRow and expose it as a stable interface
> --
[
https://issues.apache.org/jira/browse/SPARK-22839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-22839:
--
Fix Version/s: (was: 2.4.0)
> Refactor Kubernetes code for configuring driver/executor pods to use
[
https://issues.apache.org/jira/browse/SPARK-23803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16415997#comment-16415997
]
Apache Spark commented on SPARK-23803:
--
User 'sabanas' has created a pull request fo
[
https://issues.apache.org/jira/browse/SPARK-23803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23803:
Assignee: Apache Spark
> Support bucket pruning to optimize filtering on a bucketed column
[
https://issues.apache.org/jira/browse/SPARK-23803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23803:
Assignee: (was: Apache Spark)
> Support bucket pruning to optimize filtering on a buck
[
https://issues.apache.org/jira/browse/SPARK-5594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16415985#comment-16415985
]
imran shaik edited comment on SPARK-5594 at 3/27/18 5:48 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-5594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16415985#comment-16415985
]
imran shaik commented on SPARK-5594:
[~NeoYE]
Thank you for your awesome comment!!
It
[
https://issues.apache.org/jira/browse/SPARK-23803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asher Saban updated SPARK-23803:
Target Version/s: (was: 2.3.1)
> Support bucket pruning to optimize filtering on a bucketed colum
[
https://issues.apache.org/jira/browse/SPARK-23803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asher Saban updated SPARK-23803:
Fix Version/s: (was: 2.3.1)
> Support bucket pruning to optimize filtering on a bucketed column
Asher Saban created SPARK-23803:
---
Summary: Support bucket pruning to optimize filtering on a
bucketed column
Key: SPARK-23803
URL: https://issues.apache.org/jira/browse/SPARK-23803
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-23801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16415911#comment-16415911
]
Marcelo Vanzin commented on SPARK-23801:
[~joshrosen] looks like the code you add
[
https://issues.apache.org/jira/browse/SPARK-23784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Joshua Howard updated SPARK-23784:
--
Description: I have code
[here|http://stackoverflow.com/questions/49440766/trouble-getting-spar
[
https://issues.apache.org/jira/browse/SPARK-23784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Joshua Howard updated SPARK-23784:
--
Description: {{I have code
[here|http://stackoverflow.com/questions/49440766/trouble-getting-sp
[
https://issues.apache.org/jira/browse/SPARK-23802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16415832#comment-16415832
]
Apache Spark commented on SPARK-23802:
--
User 'robert3005' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-15276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16415825#comment-16415825
]
Volodymyr Glushak edited comment on SPARK-15276 at 3/27/18 3:55 PM:
---
[
https://issues.apache.org/jira/browse/SPARK-23802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23802:
Assignee: Apache Spark
> PropagateEmptyRelation can leave query plan in unresolved state
>
[
https://issues.apache.org/jira/browse/SPARK-23802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23802:
Assignee: (was: Apache Spark)
> PropagateEmptyRelation can leave query plan in unresol
Robert Kruszewski created SPARK-23802:
-
Summary: PropagateEmptyRelation can leave query plan in unresolved
state
Key: SPARK-23802
URL: https://issues.apache.org/jira/browse/SPARK-23802
Project: Sp
[
https://issues.apache.org/jira/browse/SPARK-15276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16415825#comment-16415825
]
Volodymyr Glushak edited comment on SPARK-15276 at 3/27/18 3:51 PM:
---
[
https://issues.apache.org/jira/browse/SPARK-15276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16415825#comment-16415825
]
Volodymyr Glushak commented on SPARK-15276:
---
[~andrewor14],
HIVE is not adding
[
https://issues.apache.org/jira/browse/SPARK-23801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nathan Kleyn updated SPARK-23801:
-
Description:
After upgrading to Spark v2.3.0 from Spark v2.1.1, we are seeing consistent
segfaul
[
https://issues.apache.org/jira/browse/SPARK-23801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nathan Kleyn updated SPARK-23801:
-
Environment:
Mesos coarse grained executor
18 * r3.4xlarge (16 core boxes) with 105G of executor
[
https://issues.apache.org/jira/browse/SPARK-23801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nathan Kleyn updated SPARK-23801:
-
Environment: 18 * r3.4xlarge (16 core boxes) with 105G of executor memory
> Consistent SIGSEGV af
Nathan Kleyn created SPARK-23801:
Summary: Consistent SIGSEGV after upgrading to Spark v2.3.0
Key: SPARK-23801
URL: https://issues.apache.org/jira/browse/SPARK-23801
Project: Spark
Issue Type
[
https://issues.apache.org/jira/browse/SPARK-23801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nathan Kleyn updated SPARK-23801:
-
Attachment: spark-executor-failure.coredump.log
> Consistent SIGSEGV after upgrading to Spark v2.
[
https://issues.apache.org/jira/browse/SPARK-23799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Shtelma updated SPARK-23799:
Description:
Spark 2.2.1 and 2.3.0 can produce NumberFormatException (see below) during the
[
https://issues.apache.org/jira/browse/SPARK-23799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Shtelma updated SPARK-23799:
Description:
Spark 2.2.1 and 2.3.0 can produce NumberFormatException (see below) during the
[
https://issues.apache.org/jira/browse/SPARK-23800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Li Jin updated SPARK-23800:
---
Description:
Per discussion here:
[https://github.com/apache/spark/pull/20900#issuecomment-376195597]
>
Li Jin created SPARK-23800:
--
Summary: Support partial function and callable object with pandas
UDF
Key: SPARK-23800
URL: https://issues.apache.org/jira/browse/SPARK-23800
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-23800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Li Jin updated SPARK-23800:
---
Environment: (was: Per discussion here:
https://github.com/apache/spark/pull/20900#issuecomment-376195597
[
https://issues.apache.org/jira/browse/SPARK-23799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16415652#comment-16415652
]
Apache Spark commented on SPARK-23799:
--
User 'mshtelma' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-23799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23799:
Assignee: (was: Apache Spark)
> [CBO] FilterEstimation.evaluateInSet produces devision
[
https://issues.apache.org/jira/browse/SPARK-23799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23799:
Assignee: Apache Spark
> [CBO] FilterEstimation.evaluateInSet produces devision by zero in
Michael Shtelma created SPARK-23799:
---
Summary: [CBO] FilterEstimation.evaluateInSet produces devision by
zero in a case of empty table with analyzed statistics
Key: SPARK-23799
URL: https://issues.apache.org/jir
[
https://issues.apache.org/jira/browse/SPARK-6162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16415600#comment-16415600
]
Barry Becker commented on SPARK-6162:
-
If we all agree that is is something that would
Marek Novotny created SPARK-23798:
-
Summary: The CreateArray and ConcatArray should return the default
array type when no children provided
Key: SPARK-23798
URL: https://issues.apache.org/jira/browse/SPARK-23798
[
https://issues.apache.org/jira/browse/SPARK-23794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Herman van Hovell resolved SPARK-23794.
---
Resolution: Fixed
Assignee: Liang-Chi Hsieh
Fix Version/s: 2.4.0
> UU
[
https://issues.apache.org/jira/browse/SPARK-22513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16415320#comment-16415320
]
Steve Loughran commented on SPARK-22513:
bq. So I guess at the summary level Sean
[
https://issues.apache.org/jira/browse/SPARK-23504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16415313#comment-16415313
]
Marek Novotny commented on SPARK-23504:
---
Experienced the [same
problem|https://amp
[
https://issues.apache.org/jira/browse/SPARK-23794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23794:
Assignee: (was: Apache Spark)
> UUID() should be stateful
> -
[
https://issues.apache.org/jira/browse/SPARK-23794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16415295#comment-16415295
]
Apache Spark commented on SPARK-23794:
--
User 'viirya' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-23794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23794:
Assignee: Apache Spark
> UUID() should be stateful
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-22968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jepson reopened SPARK-22968:
This issue is reappear.
> java.lang.IllegalStateException: No current assignment for partition kssh-2
> --
[
https://issues.apache.org/jira/browse/SPARK-23191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16415194#comment-16415194
]
Sujith Jay Nair edited comment on SPARK-23191 at 3/27/18 8:10 AM:
-
[
https://issues.apache.org/jira/browse/SPARK-23191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16415194#comment-16415194
]
Sujith Jay Nair commented on SPARK-23191:
-
This is a known race condition, in whi
[
https://issues.apache.org/jira/browse/SPARK-23500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16415141#comment-16415141
]
Apache Spark commented on SPARK-23500:
--
User 'gatorsmile' has created a pull request
76 matches
Mail list logo