[jira] [Created] (SPARK-20391) Properly rename the memory related fields in ExecutorSummary REST API

2017-04-19 Thread Saisai Shao (JIRA)
Saisai Shao created SPARK-20391: --- Summary: Properly rename the memory related fields in ExecutorSummary REST API Key: SPARK-20391 URL: https://issues.apache.org/jira/browse/SPARK-20391 Project: Spark

[jira] [Assigned] (SPARK-20390) Non-deterministic expressions could exist in grouping keys

2017-04-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20390: Assignee: (was: Apache Spark) > Non-deterministic expressions could exist in grouping

[jira] [Assigned] (SPARK-20390) Non-deterministic expressions could exist in grouping keys

2017-04-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20390: Assignee: Apache Spark > Non-deterministic expressions could exist in grouping keys >

[jira] [Commented] (SPARK-20390) Non-deterministic expressions could exist in grouping keys

2017-04-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15974664#comment-15974664 ] Apache Spark commented on SPARK-20390: -- User 'maropu' has created a pull request for this issue:

[jira] [Created] (SPARK-20390) Non-deterministic expressions could exist in grouping keys

2017-04-19 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-20390: Summary: Non-deterministic expressions could exist in grouping keys Key: SPARK-20390 URL: https://issues.apache.org/jira/browse/SPARK-20390 Project: Spark

[jira] [Commented] (SPARK-20389) Upgrade kryo to fix NegativeArraySizeException

2017-04-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15974639#comment-15974639 ] Sean Owen commented on SPARK-20389: --- Kryo 3.0.3 you mean? The problem is that Kryo 4 is a breaking

[jira] [Created] (SPARK-20389) Upgrade kryo to fix NegativeArraySizeException

2017-04-19 Thread Georg Heiler (JIRA)
Georg Heiler created SPARK-20389: Summary: Upgrade kryo to fix NegativeArraySizeException Key: SPARK-20389 URL: https://issues.apache.org/jira/browse/SPARK-20389 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-20341) Support BigIngeger values > 19 precision

2017-04-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20341: Assignee: Apache Spark > Support BigIngeger values > 19 precision >

[jira] [Assigned] (SPARK-20341) Support BigIngeger values > 19 precision

2017-04-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20341: Assignee: (was: Apache Spark) > Support BigIngeger values > 19 precision >

[jira] [Commented] (SPARK-20341) Support BigIngeger values > 19 precision

2017-04-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15974589#comment-15974589 ] Apache Spark commented on SPARK-20341: -- User 'kiszk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-20386) The log info "Added %s in memory on %s (size: %s, free: %s)" in function "org.apache.spark.storage.BlockManagerInfo.updateBlockInfo" is not accurate if the block exist

2017-04-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20386: Assignee: Apache Spark > The log info "Added %s in memory on %s (size: %s, free: %s)" in

[jira] [Assigned] (SPARK-20386) The log info "Added %s in memory on %s (size: %s, free: %s)" in function "org.apache.spark.storage.BlockManagerInfo.updateBlockInfo" is not accurate if the block exist

2017-04-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20386: Assignee: (was: Apache Spark) > The log info "Added %s in memory on %s (size: %s,

[jira] [Commented] (SPARK-20386) The log info "Added %s in memory on %s (size: %s, free: %s)" in function "org.apache.spark.storage.BlockManagerInfo.updateBlockInfo" is not accurate if the block exis

2017-04-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15974430#comment-15974430 ] Apache Spark commented on SPARK-20386: -- User 'eatoncys' has created a pull request for this issue:

[jira] [Updated] (SPARK-20384) supporting value classes over primitives in DataSets

2017-04-19 Thread Daniel Davis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Davis updated SPARK-20384: - Description: As a spark user who uses value classes in scala for modelling domain objects, I

[jira] [Commented] (SPARK-20384) supporting value classes over primitives in DataSets

2017-04-19 Thread Daniel Davis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15974404#comment-15974404 ] Daniel Davis commented on SPARK-20384: -- The bugs SPARK-19741 and SPARK-17368 are about specific

[jira] [Updated] (SPARK-20384) supporting value classes over primitives in DataSets

2017-04-19 Thread Daniel Davis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Davis updated SPARK-20384: - Summary: supporting value classes over primitives in DataSets (was: value classes on primitives

[jira] [Updated] (SPARK-20384) value classes on primitives in DataSets

2017-04-19 Thread Daniel Davis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Davis updated SPARK-20384: - Description: As a spark user who uses value classes in scala for modelling domain objects, I

[jira] [Commented] (SPARK-20338) Spaces in spark.eventLog.dir are not correctly handled

2017-04-19 Thread zuotingbing (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15974395#comment-15974395 ] zuotingbing commented on SPARK-20338: - cc [~srowen] > Spaces in spark.eventLog.dir are not correctly

[jira] [Resolved] (SPARK-20388) problem loading data from mongoDB 3.0.5 to apache spark

2017-04-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20388. --- Resolution: Invalid This isn't a Spark issue -- look at the stack trace. > problem loading data

[jira] [Created] (SPARK-20388) problem loading data from mongoDB 3.0.5 to apache spark

2017-04-19 Thread Maher Hattabi (JIRA)
Maher Hattabi created SPARK-20388: - Summary: problem loading data from mongoDB 3.0.5 to apache spark Key: SPARK-20388 URL: https://issues.apache.org/jira/browse/SPARK-20388 Project: Spark

[jira] [Updated] (SPARK-20387) Permissive mode is not replacing corrupt record with null

2017-04-19 Thread Navya Krishnappa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navya Krishnappa updated SPARK-20387: - Description: When reading the below mentioned time value by specifying "mode" as

[jira] [Comment Edited] (SPARK-20208) Document R fpGrowth support in vignettes, programming guide and code example

2017-04-19 Thread Maciej Szymkiewicz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15974374#comment-15974374 ] Maciej Szymkiewicz edited comment on SPARK-20208 at 4/19/17 9:27 AM: -

[jira] [Commented] (SPARK-20208) Document R fpGrowth support in vignettes, programming guide and code example

2017-04-19 Thread Maciej Szymkiewicz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15974374#comment-15974374 ] Maciej Szymkiewicz commented on SPARK-20208: [~felixcheung] There is active PR

[jira] [Created] (SPARK-20387) Permissive mode is not replacing corrupt record with null

2017-04-19 Thread Navya Krishnappa (JIRA)
Navya Krishnappa created SPARK-20387: Summary: Permissive mode is not replacing corrupt record with null Key: SPARK-20387 URL: https://issues.apache.org/jira/browse/SPARK-20387 Project: Spark

[jira] [Updated] (SPARK-20386) The log info "Added %s in memory on %s (size: %s, free: %s)" in function "org.apache.spark.storage.BlockManagerInfo.updateBlockInfo" is not accurate if the block exists

2017-04-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-20386: -- Priority: Trivial (was: Major) > The log info "Added %s in memory on %s (size: %s, free: %s)" in

[jira] [Created] (SPARK-20386) The log info "Added %s in memory on %s (size: %s, free: %s)" in function "org.apache.spark.storage.BlockManagerInfo.updateBlockInfo" is not accurate if the block exists

2017-04-19 Thread eaton (JIRA)
eaton created SPARK-20386: - Summary: The log info "Added %s in memory on %s (size: %s, free: %s)" in function "org.apache.spark.storage.BlockManagerInfo.updateBlockInfo" is not accurate if the block exists on the slave already Key:

[jira] [Updated] (SPARK-20385) 'Submitted Time' field, the date format needs to be formatted, in running Drivers table or Completed Drivers table in master web ui

2017-04-19 Thread guoxiaolongzte (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guoxiaolongzte updated SPARK-20385: --- Attachment: before_fix.png after_fix.png > 'Submitted Time' field, the date

[jira] [Commented] (SPARK-20385) 'Submitted Time' field, the date format needs to be formatted, in running Drivers table or Completed Drivers table in master web ui

2017-04-19 Thread guoxiaolongzte (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15974312#comment-15974312 ] guoxiaolongzte commented on SPARK-20385: Please see the PR,Thank you > 'Submitted Time' field,

[jira] [Commented] (SPARK-20385) 'Submitted Time' field, the date format needs to be formatted, in running Drivers table or Completed Drivers table in master web ui

2017-04-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15974308#comment-15974308 ] Apache Spark commented on SPARK-20385: -- User 'guoxiaolongzte' has created a pull request for this

[jira] [Assigned] (SPARK-20385) 'Submitted Time' field, the date format needs to be formatted, in running Drivers table or Completed Drivers table in master web ui

2017-04-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20385: Assignee: (was: Apache Spark) > 'Submitted Time' field, the date format needs to be

[jira] [Assigned] (SPARK-20385) 'Submitted Time' field, the date format needs to be formatted, in running Drivers table or Completed Drivers table in master web ui

2017-04-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20385: Assignee: Apache Spark > 'Submitted Time' field, the date format needs to be formatted,

[jira] [Commented] (SPARK-20192) SparkR 2.2.0 release note

2017-04-19 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15974309#comment-15974309 ] Felix Cheung commented on SPARK-20192: --

[jira] [Commented] (SPARK-20192) SparkR 2.2.0 release note

2017-04-19 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15974311#comment-15974311 ] Felix Cheung commented on SPARK-20192: --

[jira] [Commented] (SPARK-20192) SparkR 2.2.0 release note

2017-04-19 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15974307#comment-15974307 ] Felix Cheung commented on SPARK-20192: --

[jira] [Commented] (SPARK-20384) value classes on primitives in DataSets

2017-04-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15974301#comment-15974301 ] Sean Owen commented on SPARK-20384: --- Can you make the title more descriptive? an example of what

[jira] [Commented] (SPARK-20385) 'Submitted Time' field, the date format needs to be formatted, in running Drivers table or Completed Drivers table in master web ui

2017-04-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15974296#comment-15974296 ] Sean Owen commented on SPARK-20385: --- What's the problem here? (Use code blocks for format your code) >

[jira] [Created] (SPARK-20385) 'Submitted Time' field, the date format needs to be formatted, in running Drivers table or Completed Drivers table in master web ui

2017-04-19 Thread guoxiaolongzte (JIRA)
guoxiaolongzte created SPARK-20385: -- Summary: 'Submitted Time' field, the date format needs to be formatted, in running Drivers table or Completed Drivers table in master web ui Key: SPARK-20385 URL:

[jira] [Created] (SPARK-20384) value classes on primitives in DataSets

2017-04-19 Thread Daniel Waeber (JIRA)
Daniel Waeber created SPARK-20384: - Summary: value classes on primitives in DataSets Key: SPARK-20384 URL: https://issues.apache.org/jira/browse/SPARK-20384 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-20356) Spark sql group by returns incorrect results after join + distinct transformations

2017-04-19 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-20356. - Resolution: Fixed Fix Version/s: 2.3.0 2.2.0 > Spark sql group by

[jira] [Assigned] (SPARK-20356) Spark sql group by returns incorrect results after join + distinct transformations

2017-04-19 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-20356: --- Assignee: Liang-Chi Hsieh > Spark sql group by returns incorrect results after join +

[jira] [Resolved] (SPARK-20359) Catalyst EliminateOuterJoin optimization can cause NPE

2017-04-19 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-20359. - Resolution: Fixed > Catalyst EliminateOuterJoin optimization can cause NPE >

[jira] [Assigned] (SPARK-20359) Catalyst EliminateOuterJoin optimization can cause NPE

2017-04-19 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-20359: --- Assignee: Koert Kuipers > Catalyst EliminateOuterJoin optimization can cause NPE >

[jira] [Updated] (SPARK-20359) Catalyst EliminateOuterJoin optimization can cause NPE

2017-04-19 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-20359: Fix Version/s: 2.3.0 2.1.1 > Catalyst EliminateOuterJoin optimization can cause

[jira] [Assigned] (SPARK-20383) SparkSQL unsupports to create function with key word 'if not exists'

2017-04-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20383: Assignee: (was: Apache Spark) > SparkSQL unsupports to create function with key word

[jira] [Commented] (SPARK-20383) SparkSQL unsupports to create function with key word 'if not exists'

2017-04-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15974262#comment-15974262 ] Apache Spark commented on SPARK-20383: -- User 'ouyangxiaochen' has created a pull request for this

[jira] [Assigned] (SPARK-20383) SparkSQL unsupports to create function with key word 'if not exists'

2017-04-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20383: Assignee: Apache Spark > SparkSQL unsupports to create function with key word 'if not

[jira] [Created] (SPARK-20383) SparkSQL unsupports to create function with key word 'if not exists'

2017-04-19 Thread Xiaochen Ouyang (JIRA)
Xiaochen Ouyang created SPARK-20383: --- Summary: SparkSQL unsupports to create function with key word 'if not exists' Key: SPARK-20383 URL: https://issues.apache.org/jira/browse/SPARK-20383 Project:

[jira] [Assigned] (SPARK-20364) Parquet predicate pushdown on columns with dots return empty results

2017-04-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20364: Assignee: (was: Apache Spark) > Parquet predicate pushdown on columns with dots

[jira] [Commented] (SPARK-20364) Parquet predicate pushdown on columns with dots return empty results

2017-04-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15974215#comment-15974215 ] Apache Spark commented on SPARK-20364: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-20364) Parquet predicate pushdown on columns with dots return empty results

2017-04-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20364: Assignee: Apache Spark > Parquet predicate pushdown on columns with dots return empty

[jira] [Commented] (SPARK-20364) Parquet predicate pushdown on columns with dots return empty results

2017-04-19 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15974214#comment-15974214 ] Hyukjin Kwon commented on SPARK-20364: -- Probably, let me open a PR first at least to show/check if

[jira] [Commented] (SPARK-19282) RandomForestRegressionModel summary should expose getMaxDepth

2017-04-19 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15974188#comment-15974188 ] Xin Ren commented on SPARK-19282: - sorry [~bryanc] I'm just back from vacation... and sure I'd love to

[jira] [Updated] (SPARK-20382) fileSystem.closed when run load data on spark beeline

2017-04-19 Thread QQShu1 (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] QQShu1 updated SPARK-20382: --- Summary: fileSystem.closed when run load data on spark beeline (was: fileSystem.closed when run load

[jira] [Commented] (SPARK-19282) RandomForestRegressionModel summary should expose getMaxDepth

2017-04-19 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15974186#comment-15974186 ] Xin Ren commented on SPARK-19282: - yes, for R side, both parameters are exposed >

[jira] [Commented] (SPARK-20382) fileSystem.closed when run load data on beeline

2017-04-19 Thread QQShu1 (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15974183#comment-15974183 ] QQShu1 commented on SPARK-20382: @Umesh Chaudhary this beeline is spark beeline, not the hive . >

[jira] [Commented] (SPARK-20382) fileSystem.closed when run load data on beeline

2017-04-19 Thread Umesh Chaudhary (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15974173#comment-15974173 ] Umesh Chaudhary commented on SPARK-20382: - [~QQShu1], I am unable to get any spark issue here.

<    1   2