Hyukjin Kwon created SPARK-25673:
Summary: Remove Travis CI which enables Java lint check
Key: SPARK-25673
URL: https://issues.apache.org/jira/browse/SPARK-25673
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-25675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641345#comment-16641345
]
Apache Spark commented on SPARK-25675:
--
User 'shivusondur' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-25675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641344#comment-16641344
]
Apache Spark commented on SPARK-25675:
--
User 'shivusondur' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-25651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-25651.
--
Resolution: Not A Problem
> spark-shell gets wrong version of spark on windows
>
[
https://issues.apache.org/jira/browse/SPARK-25599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641373#comment-16641373
]
Hyukjin Kwon commented on SPARK-25599:
--
Are you proposong UDAF for Python side? Then it might be a
[
https://issues.apache.org/jira/browse/SPARK-25675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641340#comment-16641340
]
shivusondur commented on SPARK-25675:
-
I am working on this issue
> [Spark Job History] Job UI page
[
https://issues.apache.org/jira/browse/SPARK-25591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-25591:
-
Target Version/s: 2.4.0
Labels: data-loss (was: )
Priority: Critical
[
https://issues.apache.org/jira/browse/SPARK-25673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641284#comment-16641284
]
Apache Spark commented on SPARK-25673:
--
User 'HyukjinKwon' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-25673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641285#comment-16641285
]
Apache Spark commented on SPARK-25673:
--
User 'HyukjinKwon' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-25591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Abdeali Kothari updated SPARK-25591:
Description:
When having multiple Python UDFs - the last Python UDF's accumulator is the
[
https://issues.apache.org/jira/browse/SPARK-25580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-25580.
--
Resolution: Invalid
That looks an issue at MongoDB -
[
https://issues.apache.org/jira/browse/SPARK-25649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-25649.
--
Resolution: Invalid
> CatalystTypeConverter throws exception for ScalaesRow type when
[
https://issues.apache.org/jira/browse/SPARK-25649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641379#comment-16641379
]
Hyukjin Kwon commented on SPARK-25649:
--
[~mauliksoneji], have you tried ^? Let me leave this
ABHISHEK KUMAR GUPTA created SPARK-25675:
Summary: [Spark Job History] Job UI page does not show pagination
with one page
Key: SPARK-25675
URL: https://issues.apache.org/jira/browse/SPARK-25675
[
https://issues.apache.org/jira/browse/SPARK-25587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641371#comment-16641371
]
Michael Heuer commented on SPARK-25587:
---
[~hyukjin.kwon], I agree that this isn't a Spark SQL or
[
https://issues.apache.org/jira/browse/SPARK-25673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25673:
Assignee: (was: Apache Spark)
> Remove Travis CI which enables Java lint check
>
[
https://issues.apache.org/jira/browse/SPARK-25673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25673:
Assignee: Apache Spark
> Remove Travis CI which enables Java lint check
>
Yuming Wang created SPARK-25676:
---
Summary: Refactor BenchmarkWideTable to use main method
Key: SPARK-25676
URL: https://issues.apache.org/jira/browse/SPARK-25676
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-25552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nuno Azevedo updated SPARK-25552:
-
Description:
After upgrading from Spark 1.6.3 to 2.3.0 our jobs started to need about 50%
more
[
https://issues.apache.org/jira/browse/SPARK-19224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-19224.
--
Resolution: Duplicate
> [PYSPARK] Python tests organization
>
[
https://issues.apache.org/jira/browse/SPARK-25674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641295#comment-16641295
]
Apache Spark commented on SPARK-25674:
--
User '10110346' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-25344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641294#comment-16641294
]
Hyukjin Kwon commented on SPARK-25344:
--
[~irashid], would you mind if I try to take a look for this
[
https://issues.apache.org/jira/browse/SPARK-25674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25674:
Assignee: (was: Apache Spark)
> If the records are incremented by more than 1 at a
[
https://issues.apache.org/jira/browse/SPARK-25674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25674:
Assignee: Apache Spark
> If the records are incremented by more than 1 at a time,the
[
https://issues.apache.org/jira/browse/SPARK-25675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25675:
Assignee: (was: Apache Spark)
> [Spark Job History] Job UI page does not show
[
https://issues.apache.org/jira/browse/SPARK-25675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25675:
Assignee: Apache Spark
> [Spark Job History] Job UI page does not show pagination with
[
https://issues.apache.org/jira/browse/SPARK-25651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641372#comment-16641372
]
Hyukjin Kwon commented on SPARK-25651:
--
You should set {{SPARK_HOME}} correctly. {{`set
liuxian created SPARK-25674:
---
Summary: If the records are incremented by more than 1 at a
time,the number of bytes might rarely ever get updated
Key: SPARK-25674
URL: https://issues.apache.org/jira/browse/SPARK-25674
[
https://issues.apache.org/jira/browse/SPARK-25652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641369#comment-16641369
]
Hyukjin Kwon commented on SPARK-25652:
--
Mind describing what's expected output and why it's wrong?
[
https://issues.apache.org/jira/browse/SPARK-24630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641258#comment-16641258
]
Jackey Lee commented on SPARK-24630:
SQLStreaming is another interfaces for StructStreaming. Those,
[
https://issues.apache.org/jira/browse/SPARK-25625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641308#comment-16641308
]
Apache Spark commented on SPARK-25625:
--
User 'shahidki31' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-25625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25625:
Assignee: (was: Apache Spark)
> LogisticRegressionSuite.binary logistic regression
[
https://issues.apache.org/jira/browse/SPARK-25625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641307#comment-16641307
]
Apache Spark commented on SPARK-25625:
--
User 'shahidki31' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-25625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25625:
Assignee: Apache Spark
> LogisticRegressionSuite.binary logistic regression with
[
https://issues.apache.org/jira/browse/SPARK-25624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641306#comment-16641306
]
Apache Spark commented on SPARK-25624:
--
User 'shahidki31' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-24630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641327#comment-16641327
]
Jungtaek Lim commented on SPARK-24630:
--
[~Jackey Lee]
For DDL it would be better to participate
[
https://issues.apache.org/jira/browse/SPARK-25587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641366#comment-16641366
]
Hyukjin Kwon commented on SPARK-25587:
--
[~heuermh], mind fixing the JIRA accordingly?
> NPE in
[
https://issues.apache.org/jira/browse/SPARK-25648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641377#comment-16641377
]
Hyukjin Kwon commented on SPARK-25648:
--
{quote}
There is some results lost with the parameter
[
https://issues.apache.org/jira/browse/SPARK-25677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641376#comment-16641376
]
shivusondur commented on SPARK-25677:
-
i am working on this issue
> [Spark Compression]
ABHISHEK KUMAR GUPTA created SPARK-25677:
Summary: [Spark Compression] spark.io.compression.codec =
org.apache.spark.io.ZstdCompressionCodec throwing IllegalArgumentException
Exception
Key: SPARK-25677
[
https://issues.apache.org/jira/browse/SPARK-25466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maxim Gekk updated SPARK-25466:
---
Summary: Documentation does not specify how to set Kafka consumer cache
capacity for SS (was:
[
https://issues.apache.org/jira/browse/SPARK-25664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641000#comment-16641000
]
Apache Spark commented on SPARK-25664:
--
User 'wangyum' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-25664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25664:
Assignee: (was: Apache Spark)
> Refactor JoinBenchmark to use main method
>
[
https://issues.apache.org/jira/browse/SPARK-25664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25664:
Assignee: Apache Spark
> Refactor JoinBenchmark to use main method
>
[
https://issues.apache.org/jira/browse/SPARK-25664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16640999#comment-16640999
]
Apache Spark commented on SPARK-25664:
--
User 'wangyum' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-25627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25627:
Assignee: (was: Apache Spark)
> ContinuousStressSuite - 8 mins 13 sec
>
[
https://issues.apache.org/jira/browse/SPARK-25627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641003#comment-16641003
]
Apache Spark commented on SPARK-25627:
--
User 'viirya' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-25627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25627:
Assignee: Apache Spark
> ContinuousStressSuite - 8 mins 13 sec
>
[
https://issues.apache.org/jira/browse/SPARK-25490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641063#comment-16641063
]
Apache Spark commented on SPARK-25490:
--
User 'gengliangwang' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-25490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25490:
Assignee: Apache Spark
> Refactor KryoBenchmark
> --
>
>
[
https://issues.apache.org/jira/browse/SPARK-25490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25490:
Assignee: (was: Apache Spark)
> Refactor KryoBenchmark
> --
>
>
[
https://issues.apache.org/jira/browse/SPARK-25490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641057#comment-16641057
]
Apache Spark commented on SPARK-25490:
--
User 'gengliangwang' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-25539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen reassigned SPARK-25539:
-
Assignee: Yuming Wang
> Update lz4-java to get speed improvement
>
[
https://issues.apache.org/jira/browse/SPARK-25662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641093#comment-16641093
]
Apache Spark commented on SPARK-25662:
--
User 'peter-toth' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-25662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25662:
Assignee: Apache Spark
> Refactor DataSourceReadBenchmark to use main method
>
[
https://issues.apache.org/jira/browse/SPARK-25662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25662:
Assignee: (was: Apache Spark)
> Refactor DataSourceReadBenchmark to use main method
[
https://issues.apache.org/jira/browse/SPARK-25490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641044#comment-16641044
]
Gengliang Wang commented on SPARK-25490:
I am working on this.
> Refactor KryoBenchmark
>
[
https://issues.apache.org/jira/browse/SPARK-20415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641054#comment-16641054
]
Yan Zhitao commented on SPARK-20415:
I have similar issue but the thread dump has minor difference.
[
https://issues.apache.org/jira/browse/SPARK-25539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-25539:
--
Priority: Minor (was: Major)
> Update lz4-java to get speed improvement
>
[
https://issues.apache.org/jira/browse/SPARK-25539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-25539.
---
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 22551
[
https://issues.apache.org/jira/browse/SPARK-25658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-25658.
---
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 22652
[
https://issues.apache.org/jira/browse/SPARK-25461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-25461.
--
Resolution: Fixed
Fix Version/s: 3.0.0
Fixed in
[
https://issues.apache.org/jira/browse/SPARK-25461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-25461:
Assignee: Liang-Chi Hsieh
> PySpark Pandas UDF outputs incorrect results when input
[
https://issues.apache.org/jira/browse/SPARK-25062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-25062:
--
Attachment: petertoth.png
> Clean up BlockLocations in FileStatus objects
>
[
https://issues.apache.org/jira/browse/SPARK-25062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641131#comment-16641131
]
Dongjoon Hyun commented on SPARK-25062:
---
This is done by [~petertoth], but currently, I'm hitting
[
https://issues.apache.org/jira/browse/SPARK-25658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-25658:
-
Assignee: Yuming Wang
> Refactor HashByteArrayBenchmark to use main method
>
[
https://issues.apache.org/jira/browse/SPARK-25657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-25657:
-
Assignee: Yuming Wang
> Refactor HashBenchmark to use main method
>
[
https://issues.apache.org/jira/browse/SPARK-25657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-25657.
---
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 22651
[
https://issues.apache.org/jira/browse/SPARK-14681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641138#comment-16641138
]
Dongjoon Hyun commented on SPARK-14681:
---
This is reverted on `master` branch, too.
> Provide
[
https://issues.apache.org/jira/browse/SPARK-25062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641146#comment-16641146
]
Peter Toth commented on SPARK-25062:
[~dongjoon], do I need to set anything in my profile to be able
[
https://issues.apache.org/jira/browse/SPARK-25062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641150#comment-16641150
]
Dongjoon Hyun commented on SPARK-25062:
---
Finally, I added you to Spark Contributor role group. As
[
https://issues.apache.org/jira/browse/SPARK-25062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-25062:
-
Assignee: Peter Toth
> Clean up BlockLocations in FileStatus objects
>
[
https://issues.apache.org/jira/browse/SPARK-25576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-25576:
-
Assignee: Sam Davarnia
> Fix lint failure in 2.2
> ---
>
>
[
https://issues.apache.org/jira/browse/SPARK-25576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641151#comment-16641151
]
Dongjoon Hyun commented on SPARK-25576:
---
[~samdvr] .I added you as Spark Contributor role. As you
[
https://issues.apache.org/jira/browse/SPARK-25062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641152#comment-16641152
]
Peter Toth commented on SPARK-25062:
Thanks [~dongjoon]. :)
> Clean up BlockLocations in FileStatus
Maxim Gekk created SPARK-25672:
--
Summary: Inferring schema from CSV string literal
Key: SPARK-25672
URL: https://issues.apache.org/jira/browse/SPARK-25672
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-25672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641201#comment-16641201
]
Apache Spark commented on SPARK-25672:
--
User 'MaxGekk' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-25672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641200#comment-16641200
]
Apache Spark commented on SPARK-25672:
--
User 'MaxGekk' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-25672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25672:
Assignee: (was: Apache Spark)
> Inferring schema from CSV string literal
>
[
https://issues.apache.org/jira/browse/SPARK-25672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25672:
Assignee: Apache Spark
> Inferring schema from CSV string literal
>
[
https://issues.apache.org/jira/browse/SPARK-25663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-25663:
Summary: Refactor BuiltInDataSourceWriteBenchmark and
DataSourceWriteBenchmark to use main method
[
https://issues.apache.org/jira/browse/SPARK-25663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-25663:
Summary: Refactor and DataSourceWriteBenchmark to use main method (was:
Refactor
[
https://issues.apache.org/jira/browse/SPARK-25661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-25661:
Summary: Refactor BuiltInDataSourceWriteBenchmark and AvroWriteBenchmark to
use main method
[
https://issues.apache.org/jira/browse/SPARK-25663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-25663:
Summary: Refactor BuiltInDataSourceWriteBenchmark and
DataSourceWriteBenchmark to use main method
[
https://issues.apache.org/jira/browse/SPARK-25661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-25661:
Summary: Refactor AvroWriteBenchmark to use main method (was: Refactor
85 matches
Mail list logo