[jira] [Commented] (SPARK-23382) Spark Streaming ui about the contents of the form need to have hidden and show features, when the table records very much.

[ https://issues.apache.org/jira/browse/SPARK-23382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16359720#comment-16359720 ] Apache Spark commented on SPARK-23382: -- User 'guoxiaolongzte' has created a pull request for this

[jira] [Assigned] (SPARK-23382) Spark Streaming ui about the contents of the form need to have hidden and show features, when the table records very much.

[ https://issues.apache.org/jira/browse/SPARK-23382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23382: Assignee: (was: Apache Spark) > Spark Streaming ui about the contents of the form

[jira] [Assigned] (SPARK-23382) Spark Streaming ui about the contents of the form need to have hidden and show features, when the table records very much.

[ https://issues.apache.org/jira/browse/SPARK-23382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23382: Assignee: Apache Spark > Spark Streaming ui about the contents of the form need to have

[jira] [Comment Edited] (SPARK-10912) Improve Spark metrics executor.filesystem

[ https://issues.apache.org/jira/browse/SPARK-10912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16359810#comment-16359810 ] Harel Ben Attia edited comment on SPARK-10912 at 2/11/18 6:25 AM: -- We

[jira] [Commented] (SPARK-10912) Improve Spark metrics executor.filesystem

[ https://issues.apache.org/jira/browse/SPARK-10912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16359810#comment-16359810 ] Harel Ben Attia commented on SPARK-10912: - We would really be glad to see this happening as well,

[jira] [Created] (SPARK-23382) Spark Streaming ui about the contents of the form need to have hidden and show features, when the table records very much.

guoxiaolongzte created SPARK-23382: -- Summary: Spark Streaming ui about the contents of the form need to have hidden and show features, when the table records very much. Key: SPARK-23382 URL:

[jira] [Updated] (SPARK-23383) Make a distribution should exit with usage while detecting wrong options

[ https://issues.apache.org/jira/browse/SPARK-23383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-23383: - Description: {code:java} ./dev/make-distribution.sh --name ne-1.0.0-SNAPSHOT xyz --tgz -Phadoop-2.7

[jira] [Updated] (SPARK-23340) Update ORC to 1.4.3

[ https://issues.apache.org/jira/browse/SPARK-23340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-23340: -- Description: This issue updates Apache ORC dependencies to 1.4.3 released on February 9th.

[jira] [Created] (SPARK-23385) Allow SparkUITab to be customized adding in SparkConf and loaded when creating SparkUI

Lantao Jin created SPARK-23385: -- Summary: Allow SparkUITab to be customized adding in SparkConf and loaded when creating SparkUI Key: SPARK-23385 URL: https://issues.apache.org/jira/browse/SPARK-23385

[jira] [Assigned] (SPARK-23385) Allow SparkUITab to be customized adding in SparkConf and loaded when creating SparkUI

[ https://issues.apache.org/jira/browse/SPARK-23385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23385: Assignee: (was: Apache Spark) > Allow SparkUITab to be customized adding in SparkConf

[jira] [Commented] (SPARK-23385) Allow SparkUITab to be customized adding in SparkConf and loaded when creating SparkUI

[ https://issues.apache.org/jira/browse/SPARK-23385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16359825#comment-16359825 ] Apache Spark commented on SPARK-23385: -- User 'LantaoJin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23385) Allow SparkUITab to be customized adding in SparkConf and loaded when creating SparkUI

[ https://issues.apache.org/jira/browse/SPARK-23385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23385: Assignee: Apache Spark > Allow SparkUITab to be customized adding in SparkConf and loaded

[jira] [Assigned] (SPARK-23386) Enable direct application links before replay

[ https://issues.apache.org/jira/browse/SPARK-23386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23386: Assignee: Apache Spark > Enable direct application links before replay >

[jira] [Assigned] (SPARK-23386) Enable direct application links before replay

[ https://issues.apache.org/jira/browse/SPARK-23386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23386: Assignee: (was: Apache Spark) > Enable direct application links before replay >

[jira] [Commented] (SPARK-23386) Enable direct application links before replay

[ https://issues.apache.org/jira/browse/SPARK-23386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16359831#comment-16359831 ] Apache Spark commented on SPARK-23386: -- User 'gerashegalov' has created a pull request for this

[jira] [Commented] (SPARK-23381) Murmur3 hash generates a different value from other implementations

[ https://issues.apache.org/jira/browse/SPARK-23381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16359690#comment-16359690 ] Shintaro Murakami commented on SPARK-23381: --- FeatureHasher in MLLib uses Murmur3 in hashing

[jira] [Commented] (SPARK-23383) Make a distribution should exit with usage while detecting wrong options

[ https://issues.apache.org/jira/browse/SPARK-23383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16359763#comment-16359763 ] Apache Spark commented on SPARK-23383: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23383) Make a distribution should exit with usage while detecting wrong options

[ https://issues.apache.org/jira/browse/SPARK-23383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23383: Assignee: Apache Spark > Make a distribution should exit with usage while detecting wrong

[jira] [Assigned] (SPARK-23383) Make a distribution should exit with usage while detecting wrong options

[ https://issues.apache.org/jira/browse/SPARK-23383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23383: Assignee: (was: Apache Spark) > Make a distribution should exit with usage while

[jira] [Updated] (SPARK-23340) Update ORC to 1.4.3

[ https://issues.apache.org/jira/browse/SPARK-23340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-23340: -- Summary: Update ORC to 1.4.3 (was: Update ORC to 1.4.2) > Update ORC to 1.4.3 >

[jira] [Created] (SPARK-23386) Enable direct application links before replay

Gera Shegalov created SPARK-23386: - Summary: Enable direct application links before replay Key: SPARK-23386 URL: https://issues.apache.org/jira/browse/SPARK-23386 Project: Spark Issue Type:

[jira] [Created] (SPARK-23383) Make a distribution should exit with usage while detecting wrong options

Kent Yao created SPARK-23383: Summary: Make a distribution should exit with usage while detecting wrong options Key: SPARK-23383 URL: https://issues.apache.org/jira/browse/SPARK-23383 Project: Spark

[jira] [Assigned] (SPARK-17147) Spark Streaming Kafka 0.10 Consumer Can't Handle Non-consecutive Offsets (i.e. Log Compaction)

[ https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17147: Assignee: Apache Spark > Spark Streaming Kafka 0.10 Consumer Can't Handle Non-consecutive

[jira] [Commented] (SPARK-17147) Spark Streaming Kafka 0.10 Consumer Can't Handle Non-consecutive Offsets (i.e. Log Compaction)

[ https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16359786#comment-16359786 ] Apache Spark commented on SPARK-17147: -- User 'koeninger' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17147) Spark Streaming Kafka 0.10 Consumer Can't Handle Non-consecutive Offsets (i.e. Log Compaction)

[ https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17147: Assignee: (was: Apache Spark) > Spark Streaming Kafka 0.10 Consumer Can't Handle

[jira] [Commented] (SPARK-23370) Spark receives a size of 0 for an Oracle Number field and defaults the field type to be BigDecimal(30,10) instead of the actual precision and scale

[ https://issues.apache.org/jira/browse/SPARK-23370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16359788#comment-16359788 ] Harleen Singh Mann commented on SPARK-23370: This goes as far as I understand:  * JDBC

[jira] [Commented] (SPARK-10697) Lift Calculation in Association Rule mining

[ https://issues.apache.org/jira/browse/SPARK-10697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16359639#comment-16359639 ] Sean Owen commented on SPARK-10697: --- Yes, I think it's OK to add. Go ahead and propose a PR. Lift is

[jira] [Created] (SPARK-23384) When it has no incomplete(completed) applications found, the last updated time is not formatted and client local time zone is not show in history server web ui.

guoxiaolongzte created SPARK-23384: -- Summary: When it has no incomplete(completed) applications found, the last updated time is not formatted and client local time zone is not show in history server web ui. Key: SPARK-23384

[jira] [Updated] (SPARK-23384) When it has no incomplete(completed) applications found, the last updated time is not formatted and client local time zone is not show in history server web ui.

[ https://issues.apache.org/jira/browse/SPARK-23384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guoxiaolongzte updated SPARK-23384: --- Attachment: 2.png 1.png > When it has no incomplete(completed) applications

[jira] [Updated] (SPARK-23384) When it has no incomplete(completed) applications found, the last updated time is not formatted and client local time zone is not show in history server web ui.

[ https://issues.apache.org/jira/browse/SPARK-23384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guoxiaolongzte updated SPARK-23384: --- Description: When it has no incomplete(completed) applications found, the last updated time

[jira] [Assigned] (SPARK-23384) When it has no incomplete(completed) applications found, the last updated time is not formatted and client local time zone is not show in history server web ui.

[ https://issues.apache.org/jira/browse/SPARK-23384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23384: Assignee: Apache Spark > When it has no incomplete(completed) applications found, the

[jira] [Commented] (SPARK-23384) When it has no incomplete(completed) applications found, the last updated time is not formatted and client local time zone is not show in history server web ui.

[ https://issues.apache.org/jira/browse/SPARK-23384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16359820#comment-16359820 ] Apache Spark commented on SPARK-23384: -- User 'guoxiaolongzte' has created a pull request for this

[jira] [Assigned] (SPARK-23384) When it has no incomplete(completed) applications found, the last updated time is not formatted and client local time zone is not show in history server web ui.

[ https://issues.apache.org/jira/browse/SPARK-23384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23384: Assignee: (was: Apache Spark) > When it has no incomplete(completed) applications

[jira] [Created] (SPARK-23380) Make toPandas fall back to Arrow optimization disabled when schema is mismatched

Hyukjin Kwon created SPARK-23380: Summary: Make toPandas fall back to Arrow optimization disabled when schema is mismatched Key: SPARK-23380 URL: https://issues.apache.org/jira/browse/SPARK-23380

[jira] [Assigned] (SPARK-23380) Make toPandas fall back to Arrow optimization disabled when schema is not supported in the Arrow optimization

[ https://issues.apache.org/jira/browse/SPARK-23380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23380: Assignee: Apache Spark > Make toPandas fall back to Arrow optimization disabled when

[jira] [Updated] (SPARK-23380) Make toPandas fall back to Arrow optimization disabled when schema is not supported in the Arrow optimization

[ https://issues.apache.org/jira/browse/SPARK-23380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-23380: - Summary: Make toPandas fall back to Arrow optimization disabled when schema is not supported in

[jira] [Assigned] (SPARK-23377) Bucketizer with multiple columns persistence bug

[ https://issues.apache.org/jira/browse/SPARK-23377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23377: Assignee: Apache Spark > Bucketizer with multiple columns persistence bug >

[jira] [Commented] (SPARK-23377) Bucketizer with multiple columns persistence bug

[ https://issues.apache.org/jira/browse/SPARK-23377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16359340#comment-16359340 ] Apache Spark commented on SPARK-23377: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23377) Bucketizer with multiple columns persistence bug

[ https://issues.apache.org/jira/browse/SPARK-23377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23377: Assignee: (was: Apache Spark) > Bucketizer with multiple columns persistence bug >

[jira] [Assigned] (SPARK-23380) Make toPandas fall back to Arrow optimization disabled when schema is not supported in the Arrow optimization

[ https://issues.apache.org/jira/browse/SPARK-23380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23380: Assignee: (was: Apache Spark) > Make toPandas fall back to Arrow optimization

[jira] [Commented] (SPARK-23380) Make toPandas fall back to Arrow optimization disabled when schema is not supported in the Arrow optimization

[ https://issues.apache.org/jira/browse/SPARK-23380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16359349#comment-16359349 ] Apache Spark commented on SPARK-23380: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-23310) Perf regression introduced by SPARK-21113

[ https://issues.apache.org/jira/browse/SPARK-23310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16359429#comment-16359429 ] Kazuaki Ishizaki commented on SPARK-23310: -- got it, thanks > Perf regression introduced by

[jira] [Updated] (SPARK-23381) Murmur3 hash generates a different value from other implementations

[ https://issues.apache.org/jira/browse/SPARK-23381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shintaro Murakami updated SPARK-23381: -- Summary: Murmur3 hash generates a different value from other implementations (was:

[jira] [Created] (SPARK-23381) Murmur3 hash generates a different value

Shintaro Murakami created SPARK-23381: - Summary: Murmur3 hash generates a different value Key: SPARK-23381 URL: https://issues.apache.org/jira/browse/SPARK-23381 Project: Spark Issue

[jira] [Assigned] (SPARK-23381) Murmur3 hash generates a different value from other implementations

[ https://issues.apache.org/jira/browse/SPARK-23381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23381: Assignee: (was: Apache Spark) > Murmur3 hash generates a different value from other

[jira] [Assigned] (SPARK-23381) Murmur3 hash generates a different value from other implementations

[ https://issues.apache.org/jira/browse/SPARK-23381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23381: Assignee: Apache Spark > Murmur3 hash generates a different value from other

[jira] [Commented] (SPARK-23381) Murmur3 hash generates a different value from other implementations

[ https://issues.apache.org/jira/browse/SPARK-23381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16359445#comment-16359445 ] Apache Spark commented on SPARK-23381: -- User 'mrkm4ntr' has created a pull request for this issue:

[jira] [Commented] (SPARK-23240) PythonWorkerFactory issues unhelpful message when pyspark.daemon produces bogus stdout

[ https://issues.apache.org/jira/browse/SPARK-23240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16359568#comment-16359568 ] Bruce Robbins commented on SPARK-23240: --- A little background. A Spark installation had a Python

[jira] [Commented] (SPARK-22105) Dataframe has poor performance when computing on many columns with codegen

[ https://issues.apache.org/jira/browse/SPARK-22105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16359420#comment-16359420 ] Marco Gaido commented on SPARK-22105: - [~WeichenXu123] which is the number of rows for the dataset

[jira] [Resolved] (SPARK-23374) Checkstyle/Scalastyle only work from top level build

[ https://issues.apache.org/jira/browse/SPARK-23374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-23374. --- Resolution: Not A Problem Agree, that's the right way to invoke a target on one module in a

[jira] [Commented] (SPARK-23381) Murmur3 hash generates a different value from other implementations

[ https://issues.apache.org/jira/browse/SPARK-23381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16359501#comment-16359501 ] Sean Owen commented on SPARK-23381: --- ... what problem does this cause? > Murmur3 hash generates a

[jira] [Resolved] (SPARK-23344) Add KMeans distanceMeasure param to PySpark

[ https://issues.apache.org/jira/browse/SPARK-23344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-23344. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 20520

[jira] [Assigned] (SPARK-23344) Add KMeans distanceMeasure param to PySpark

[ https://issues.apache.org/jira/browse/SPARK-23344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-23344: - Assignee: Marco Gaido > Add KMeans distanceMeasure param to PySpark >

[jira] [Resolved] (SPARK-23360) SparkSession.createDataFrame timestamps can be incorrect with non-Arrow codepath

[ https://issues.apache.org/jira/browse/SPARK-23360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-23360. -- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 20559

[jira] [Assigned] (SPARK-23360) SparkSession.createDataFrame timestamps can be incorrect with non-Arrow codepath

[ https://issues.apache.org/jira/browse/SPARK-23360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-23360: Assignee: Takuya Ueshin > SparkSession.createDataFrame timestamps can be incorrect with

[jira] [Commented] (SPARK-23370) Spark receives a size of 0 for an Oracle Number field and defaults the field type to be BigDecimal(30,10) instead of the actual precision and scale

[ https://issues.apache.org/jira/browse/SPARK-23370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16359500#comment-16359500 ] Sean Owen commented on SPARK-23370: --- Overhead for the applications that will use Oracle from Spark.

[jira] [Commented] (SPARK-10697) Lift Calculation in Association Rule mining

[ https://issues.apache.org/jira/browse/SPARK-10697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16359623#comment-16359623 ] Tristan Stevens commented on SPARK-10697: - [~srowen] a big +1 from me to implementing this.