[jira] [Commented] (SPARK-22666) Spark reader source for image format

2018-02-11 Thread xubo245 (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16360402#comment-16360402 ] xubo245 commented on SPARK-22666: - Did it finished? or TODO > Spark reader source for image format >

[jira] [Updated] (SPARK-23230) When hive.default.fileformat is other kinds of file types, create textfile table cause a serde error

2018-02-11 Thread dzcxzl (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dzcxzl updated SPARK-23230: --- Description: When hive.default.fileformat is other kinds of file types, create textfile table cause a serde

[jira] [Updated] (SPARK-23230) When hive.default.fileformat is other kinds of file types, create textfile table cause a serde error

2018-02-11 Thread dzcxzl (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dzcxzl updated SPARK-23230: --- Description: When hive.default.fileformat is other kinds of file types, create textfile table cause a serde

[jira] [Updated] (SPARK-23230) When hive.default.fileformat is other kinds of file types, create textfile table cause a serde error

2018-02-11 Thread dzcxzl (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dzcxzl updated SPARK-23230: --- Description: When hive.default.fileformat is other kinds of file types, create textfile table cause a serde

[jira] [Commented] (SPARK-23386) Enable direct application links before replay

2018-02-11 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16360371#comment-16360371 ] Marcelo Vanzin commented on SPARK-23386: The umbrella you refer to is closed and only covered

[jira] [Assigned] (SPARK-23390) Flaky Test Suite: FileBasedDataSourceSuite in Spark 2.3/hadoop 2.7

2018-02-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23390: Assignee: Apache Spark > Flaky Test Suite: FileBasedDataSourceSuite in Spark 2.3/hadoop

[jira] [Commented] (SPARK-23390) Flaky Test Suite: FileBasedDataSourceSuite in Spark 2.3/hadoop 2.7

2018-02-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16360304#comment-16360304 ] Apache Spark commented on SPARK-23390: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23390) Flaky Test Suite: FileBasedDataSourceSuite in Spark 2.3/hadoop 2.7

2018-02-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23390: Assignee: (was: Apache Spark) > Flaky Test Suite: FileBasedDataSourceSuite in Spark

[jira] [Created] (SPARK-23393) Path is error when run test in local machine

2018-02-11 Thread xubo245 (JIRA)
xubo245 created SPARK-23393: --- Summary: Path is error when run test in local machine Key: SPARK-23393 URL: https://issues.apache.org/jira/browse/SPARK-23393 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-23392) Add some test case for images feature

2018-02-11 Thread xubo245 (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16360284#comment-16360284 ] xubo245 commented on SPARK-23392: - Sorry, OK.[~hyukjin.kwon] > Add some test case for images feature >

[jira] [Assigned] (SPARK-23392) Add some test case for images feature

2018-02-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23392: Assignee: Apache Spark > Add some test case for images feature >

[jira] [Assigned] (SPARK-23392) Add some test case for images feature

2018-02-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23392: Assignee: (was: Apache Spark) > Add some test case for images feature >

[jira] [Commented] (SPARK-23392) Add some test case for images feature

2018-02-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16360279#comment-16360279 ] Apache Spark commented on SPARK-23392: -- User 'xubo245' has created a pull request for this issue:

[jira] [Updated] (SPARK-23392) Add some test case for images feature

2018-02-11 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-23392: - Fix Version/s: (was: 2.4.0) > Add some test case for images feature >

[jira] [Updated] (SPARK-23392) Add some test case for images feature

2018-02-11 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-23392: - Component/s: (was: MLlib) ML > Add some test case for images feature >

[jira] [Commented] (SPARK-23392) Add some test case for images feature

2018-02-11 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16360275#comment-16360275 ] Hyukjin Kwon commented on SPARK-23392: -- Let's don't set the target version which is usually reserved

[jira] [Updated] (SPARK-23392) Add some test case for images feature

2018-02-11 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-23392: - Target Version/s: (was: 2.4.0) > Add some test case for images feature >

[jira] [Updated] (SPARK-23391) It may lead to overflow for some integer multiplication

2018-02-11 Thread liuxian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuxian updated SPARK-23391: Priority: Minor (was: Major) > It may lead to overflow for some integer multiplication >

[jira] [Created] (SPARK-23392) Add some test case for images feature

2018-02-11 Thread xubo245 (JIRA)
xubo245 created SPARK-23392: --- Summary: Add some test case for images feature Key: SPARK-23392 URL: https://issues.apache.org/jira/browse/SPARK-23392 Project: Spark Issue Type: Test

[jira] [Commented] (SPARK-23391) It may lead to overflow for some integer multiplication

2018-02-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16360263#comment-16360263 ] Apache Spark commented on SPARK-23391: -- User '10110346' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23391) It may lead to overflow for some integer multiplication

2018-02-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23391: Assignee: (was: Apache Spark) > It may lead to overflow for some integer

[jira] [Assigned] (SPARK-23391) It may lead to overflow for some integer multiplication

2018-02-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23391: Assignee: Apache Spark > It may lead to overflow for some integer multiplication >

[jira] [Updated] (SPARK-23391) It may lead to overflow for some integer multiplication

2018-02-11 Thread liuxian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuxian updated SPARK-23391: Description: In the {{getBlockData}},{{blockId.reduceId}} is the {{Int}} type, when it is greater than

[jira] [Updated] (SPARK-23391) It may lead to overflow for some integer multiplication

2018-02-11 Thread liuxian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuxian updated SPARK-23391: Description: In the {{getBlockData}},{{blockId.reduceId}} is the {{Int}} type, when it is greater than

[jira] [Created] (SPARK-23391) It may lead to overflow for some integer multiplication

2018-02-11 Thread liuxian (JIRA)
liuxian created SPARK-23391: --- Summary: It may lead to overflow for some integer multiplication Key: SPARK-23391 URL: https://issues.apache.org/jira/browse/SPARK-23391 Project: Spark Issue Type:

[jira] [Commented] (SPARK-23370) Spark receives a size of 0 for an Oracle Number field and defaults the field type to be BigDecimal(30,10) instead of the actual precision and scale

2018-02-11 Thread Harleen Singh Mann (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16360257#comment-16360257 ] Harleen Singh Mann commented on SPARK-23370: # Yes, querying the table would mean non-trivial

[jira] [Commented] (SPARK-23372) Writing empty struct in parquet fails during execution. It should fail earlier during analysis.

2018-02-11 Thread Harleen Singh Mann (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16360252#comment-16360252 ] Harleen Singh Mann commented on SPARK-23372: Perhaps a dumb question: Why are you editionĀ 

[jira] [Resolved] (SPARK-23376) creating UnsafeKVExternalSorter with BytesToBytesMap may fail

2018-02-11 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-23376. - Resolution: Fixed Fix Version/s: 2.3.0 2.2.2 Issue resolved by pull

[jira] [Comment Edited] (SPARK-23390) Flaky Test Suite: FileBasedDataSourceSuite in Spark 2.3/hadoop 2.7

2018-02-11 Thread Sameer Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16360225#comment-16360225 ] Sameer Agarwal edited comment on SPARK-23390 at 2/12/18 2:41 AM: - I ran

[jira] [Commented] (SPARK-23390) Flaky Test Suite: FileBasedDataSourceSuite in Spark 2.3/hadoop 2.7

2018-02-11 Thread Sameer Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16360225#comment-16360225 ] Sameer Agarwal commented on SPARK-23390: I ran this test locally 50 times and it passed every

[jira] [Created] (SPARK-23390) Flaky Test Suite: FileBasedDataSourceSuite in Spark 2.3/hadoop 2.7

2018-02-11 Thread Sameer Agarwal (JIRA)
Sameer Agarwal created SPARK-23390: -- Summary: Flaky Test Suite: FileBasedDataSourceSuite in Spark 2.3/hadoop 2.7 Key: SPARK-23390 URL: https://issues.apache.org/jira/browse/SPARK-23390 Project:

[jira] [Commented] (SPARK-23358) When the number of partitions is greater than 2^28, it will result in an error result

2018-02-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16360211#comment-16360211 ] Apache Spark commented on SPARK-23358: -- User '10110346' has created a pull request for this issue:

[jira] [Commented] (SPARK-23382) Spark Streaming ui about the contents of the form need to have hidden and show features, when the table records very much.

2018-02-11 Thread guoxiaolongzte (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16360209#comment-16360209 ] guoxiaolongzte commented on SPARK-23382: Before jira, modify the job page, stage page, task page,

[jira] [Commented] (SPARK-23389) When the shuffle dependency specifies aggregation ,and `dependency.mapSideCombine=false`, we should be able to use serialized sorting.

2018-02-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16360208#comment-16360208 ] Apache Spark commented on SPARK-23389: -- User '10110346' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23389) When the shuffle dependency specifies aggregation ,and `dependency.mapSideCombine=false`, we should be able to use serialized sorting.

2018-02-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23389: Assignee: Apache Spark > When the shuffle dependency specifies aggregation ,and >

[jira] [Assigned] (SPARK-23389) When the shuffle dependency specifies aggregation ,and `dependency.mapSideCombine=false`, we should be able to use serialized sorting.

2018-02-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23389: Assignee: (was: Apache Spark) > When the shuffle dependency specifies aggregation

[jira] [Created] (SPARK-23389) When the shuffle dependency specifies aggregation ,and `dependency.mapSideCombine=false`, we should be able to use serialized sorting.

2018-02-11 Thread liuxian (JIRA)
liuxian created SPARK-23389: --- Summary: When the shuffle dependency specifies aggregation ,and `dependency.mapSideCombine=false`, we should be able to use serialized sorting. Key: SPARK-23389 URL:

[jira] [Updated] (SPARK-23372) Writing empty struct in parquet fails during execution. It should fail earlier during analysis.

2018-02-11 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dilip Biswal updated SPARK-23372: - Description: *Running*

[jira] [Assigned] (SPARK-23388) Support for Parquet Binary DecimalType in VectorizedColumnReader

2018-02-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23388: Assignee: (was: Apache Spark) > Support for Parquet Binary DecimalType in

[jira] [Commented] (SPARK-23388) Support for Parquet Binary DecimalType in VectorizedColumnReader

2018-02-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16360160#comment-16360160 ] Apache Spark commented on SPARK-23388: -- User 'jamesthomp' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23388) Support for Parquet Binary DecimalType in VectorizedColumnReader

2018-02-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23388: Assignee: Apache Spark > Support for Parquet Binary DecimalType in VectorizedColumnReader

[jira] [Commented] (SPARK-23372) Writing empty struct in parquet fails during execution. It should fail earlier during analysis.

2018-02-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16360158#comment-16360158 ] Apache Spark commented on SPARK-23372: -- User 'dilipbiswal' has created a pull request for this

[jira] [Assigned] (SPARK-23372) Writing empty struct in parquet fails during execution. It should fail earlier during analysis.

2018-02-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23372: Assignee: Apache Spark > Writing empty struct in parquet fails during execution. It

[jira] [Assigned] (SPARK-23372) Writing empty struct in parquet fails during execution. It should fail earlier during analysis.

2018-02-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23372: Assignee: (was: Apache Spark) > Writing empty struct in parquet fails during

[jira] [Created] (SPARK-23388) Support for Parquet Binary DecimalType in VectorizedColumnReader

2018-02-11 Thread James Thompson (JIRA)
James Thompson created SPARK-23388: -- Summary: Support for Parquet Binary DecimalType in VectorizedColumnReader Key: SPARK-23388 URL: https://issues.apache.org/jira/browse/SPARK-23388 Project: Spark

[jira] [Commented] (SPARK-23318) FP-growth: WARN FPGrowth: Input data is not cached

2018-02-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16359969#comment-16359969 ] Apache Spark commented on SPARK-23318: -- User 'tashoyan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23318) FP-growth: WARN FPGrowth: Input data is not cached

2018-02-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23318: Assignee: Apache Spark > FP-growth: WARN FPGrowth: Input data is not cached >

[jira] [Assigned] (SPARK-23318) FP-growth: WARN FPGrowth: Input data is not cached

2018-02-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23318: Assignee: (was: Apache Spark) > FP-growth: WARN FPGrowth: Input data is not cached >

[jira] [Resolved] (SPARK-23371) Parquet Footer data is wrong on window in parquet format partition table

2018-02-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-23371. --- Resolution: Not A Problem > Parquet Footer data is wrong on window in parquet format partition table

[jira] [Updated] (SPARK-23382) Spark Streaming ui about the contents of the form need to have hidden and show features, when the table records very much.

2018-02-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-23382: -- Affects Version/s: (was: 2.4.0) 2.3.0 I think I get what this is about but:

[jira] [Commented] (SPARK-23385) Allow SparkUITab to be customized adding in SparkConf and loaded when creating SparkUI

2018-02-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16359960#comment-16359960 ] Sean Owen commented on SPARK-23385: --- I'm not sure about this. See PR. > Allow SparkUITab to be

[jira] [Updated] (SPARK-23386) Enable direct application links before replay

2018-02-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-23386: -- Priority: Minor (was: Major) Seems related to [~vanzin]'s over-arching SHS improvements. Should it be

[jira] [Updated] (SPARK-23384) When it has no incomplete(completed) applications found, the last updated time is not formatted and client local time zone is not show in history server web ui.

2018-02-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-23384: -- Affects Version/s: (was: 2.4.0) 2.3.0 Yes, seems like a clean fix for a

[jira] [Commented] (SPARK-23370) Spark receives a size of 0 for an Oracle Number field and defaults the field type to be BigDecimal(30,10) instead of the actual precision and scale

2018-02-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16359957#comment-16359957 ] Sean Owen commented on SPARK-23370: --- I don't think that answers the question, which is probably one

[jira] [Updated] (SPARK-23383) Make a distribution should exit with usage while detecting wrong options

2018-02-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-23383: -- Description: {code:java} ./dev/make-distribution.sh --name ne-1.0.0-SNAPSHOT xyz --tgz -Phadoop-2.7

[jira] [Commented] (SPARK-23381) Murmur3 hash generates a different value from other implementations

2018-02-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16359956#comment-16359956 ] Sean Owen commented on SPARK-23381: --- I don't think that behavior is guaranteed anyway, but I can see

[jira] [Updated] (SPARK-23381) Murmur3 hash generates a different value from other implementations

2018-02-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-23381: -- Priority: Minor (was: Major) Issue Type: Improvement (was: Bug) > Murmur3 hash generates a

[jira] [Comment Edited] (SPARK-6772) spark sql error when running code on large number of records

2018-02-11 Thread Nayef F.R (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16359939#comment-16359939 ] Nayef F.R edited comment on SPARK-6772 at 2/11/18 1:33 PM: --- I have the same

[jira] [Comment Edited] (SPARK-6772) spark sql error when running code on large number of records

2018-02-11 Thread Nayef F.R (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16359939#comment-16359939 ] Nayef F.R edited comment on SPARK-6772 at 2/11/18 1:19 PM: --- I have the same

[jira] [Resolved] (SPARK-23387) Backport assertPandasEqual to branch-2.3.

2018-02-11 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-23387. -- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 20577

[jira] [Commented] (SPARK-6772) spark sql error when running code on large number of records

2018-02-11 Thread Nayef F.R (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16359939#comment-16359939 ] Nayef F.R commented on SPARK-6772: -- I have the same problem with Scala spark. Can I know if anyone solved

[jira] [Assigned] (SPARK-23387) Backport assertPandasEqual to branch-2.3.

2018-02-11 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-23387: Assignee: Takuya Ueshin > Backport assertPandasEqual to branch-2.3. >

[jira] [Assigned] (SPARK-23387) Backport assertPandasEqual to branch-2.3.

2018-02-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23387: Assignee: Apache Spark > Backport assertPandasEqual to branch-2.3. >

[jira] [Assigned] (SPARK-23387) Backport assertPandasEqual to branch-2.3.

2018-02-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23387: Assignee: (was: Apache Spark) > Backport assertPandasEqual to branch-2.3. >

[jira] [Commented] (SPARK-23387) Backport assertPandasEqual to branch-2.3.

2018-02-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16359930#comment-16359930 ] Apache Spark commented on SPARK-23387: -- User 'ueshin' has created a pull request for this issue:

[jira] [Created] (SPARK-23387) Backport assertPandasEqual to branch-2.3.

2018-02-11 Thread Takuya Ueshin (JIRA)
Takuya Ueshin created SPARK-23387: - Summary: Backport assertPandasEqual to branch-2.3. Key: SPARK-23387 URL: https://issues.apache.org/jira/browse/SPARK-23387 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-22624) Expose range partitioning shuffle introduced by SPARK-22614

2018-02-11 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-22624: Assignee: xubo245 > Expose range partitioning shuffle introduced by SPARK-22614 >

[jira] [Resolved] (SPARK-22624) Expose range partitioning shuffle introduced by SPARK-22614

2018-02-11 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-22624. -- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 20456

[jira] [Resolved] (SPARK-23084) Add unboundedPreceding(), unboundedFollowing() and currentRow() to PySpark

2018-02-11 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-23084. -- Resolution: Fixed Fix Version/s: 2.4.0 > Add unboundedPreceding(), unboundedFollowing()

[jira] [Commented] (SPARK-23084) Add unboundedPreceding(), unboundedFollowing() and currentRow() to PySpark

2018-02-11 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16359870#comment-16359870 ] Hyukjin Kwon commented on SPARK-23084: -- Fixed in https://github.com/apache/spark/pull/20400 > Add

[jira] [Assigned] (SPARK-23084) Add unboundedPreceding(), unboundedFollowing() and currentRow() to PySpark

2018-02-11 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-23084: Assignee: Huaxin Gao > Add unboundedPreceding(), unboundedFollowing() and currentRow() to

[jira] [Updated] (SPARK-23314) Pandas grouped udf on dataset with timestamp column error

2018-02-11 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-23314: - Fix Version/s: (was: 2.3.1) 2.3.0 > Pandas grouped udf on dataset with

[jira] [Resolved] (SPARK-23314) Pandas grouped udf on dataset with timestamp column error

2018-02-11 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-23314. -- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 20537

[jira] [Assigned] (SPARK-23314) Pandas grouped udf on dataset with timestamp column error

2018-02-11 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-23314: Assignee: Li Jin > Pandas grouped udf on dataset with timestamp column error >

[jira] [Updated] (SPARK-23314) Pandas grouped udf on dataset with timestamp column error

2018-02-11 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-23314: - Fix Version/s: (was: 2.3.0) 2.3.1 > Pandas grouped udf on dataset with