[jira] [Commented] (SPARK-12757) Use reference counting to prevent blocks from being evicted during reads

2017-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15810913#comment-15810913 ] Apache Spark commented on SPARK-12757: -- User 'felixcheung' has created a pull request for this

[jira] [Updated] (SPARK-19102) Accuracy error of spark SQL results

2017-01-08 Thread XiaodongCui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiaodongCui updated SPARK-19102: Description: the problem is cube6's second column named sumprice is 1 times bigger than the

[jira] [Assigned] (SPARK-19133) glm Gamma family results in error

2017-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19133: Assignee: (was: Apache Spark) > glm Gamma family results in error >

[jira] [Assigned] (SPARK-19133) glm Gamma family results in error

2017-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19133: Assignee: Apache Spark > glm Gamma family results in error >

[jira] [Commented] (SPARK-19133) glm Gamma family results in error

2017-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15810862#comment-15810862 ] Apache Spark commented on SPARK-19133: -- User 'felixcheung' has created a pull request for this

[jira] [Updated] (SPARK-19133) glm Gamma family results in error

2017-01-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-19133: - Description: > glm(y~1,family=Gamma, data = dy) 17/01/09 06:10:47 ERROR RBackendHandler: fit on

[jira] [Commented] (SPARK-15237) SparkR corr function documentation

2017-01-08 Thread Shaul (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15810850#comment-15810850 ] Shaul commented on SPARK-15237: --- Great, looks good cheers! > SparkR corr function documentation >

[jira] [Comment Edited] (SPARK-7768) Make user-defined type (UDT) API public

2017-01-08 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15807248#comment-15807248 ] Liang-Chi Hsieh edited comment on SPARK-7768 at 1/9/17 6:42 AM: Hi

[jira] [Created] (SPARK-19133) glm Gamma family results in error

2017-01-08 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-19133: Summary: glm Gamma family results in error Key: SPARK-19133 URL: https://issues.apache.org/jira/browse/SPARK-19133 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-19131) Support "alter table drop partition [if exists]"

2017-01-08 Thread lichenglin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15810768#comment-15810768 ] lichenglin commented on SPARK-19131: Yes > Support "alter table drop partition [if exists]" >

[jira] [Commented] (SPARK-18075) UDF doesn't work on non-local spark

2017-01-08 Thread Dan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15810766#comment-15810766 ] Dan commented on SPARK-18075: - I would gladly fix it, however I am a spark user, not a developer so I doubt I

[jira] [Commented] (SPARK-13610) Create a Transformer to disassemble vectors in DataFrames

2017-01-08 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15810767#comment-15810767 ] Joseph K. Bradley commented on SPARK-13610: --- This sounds like a reasonable use case, but I'm

[jira] [Commented] (SPARK-15237) SparkR corr function documentation

2017-01-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15810760#comment-15810760 ] Felix Cheung commented on SPARK-15237: -- I think this is better now? Shall we resolve this JIRA? >

[jira] [Commented] (SPARK-14692) Error While Setting the path for R front end

2017-01-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15810754#comment-15810754 ] Felix Cheung commented on SPARK-14692: -- closing. let us know if this is still an issue. thanks >

[jira] [Resolved] (SPARK-14692) Error While Setting the path for R front end

2017-01-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-14692. -- Resolution: Cannot Reproduce Assignee: Felix Cheung > Error While Setting the path for R

[jira] [Commented] (SPARK-18335) Add a numSlices parameter to SparkR's createDataFrame

2017-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15810748#comment-15810748 ] Apache Spark commented on SPARK-18335: -- User 'felixcheung' has created a pull request for this

[jira] [Assigned] (SPARK-18335) Add a numSlices parameter to SparkR's createDataFrame

2017-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18335: Assignee: (was: Apache Spark) > Add a numSlices parameter to SparkR's createDataFrame

[jira] [Assigned] (SPARK-18335) Add a numSlices parameter to SparkR's createDataFrame

2017-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18335: Assignee: Apache Spark > Add a numSlices parameter to SparkR's createDataFrame >

[jira] [Commented] (SPARK-19131) Support "alter table drop partition [if exists]"

2017-01-08 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15810740#comment-15810740 ] Dongjoon Hyun commented on SPARK-19131: --- Maybe, do you mean the following Hive syntax ? {code}

[jira] [Created] (SPARK-19132) Add test cases for row size estimation

2017-01-08 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-19132: --- Summary: Add test cases for row size estimation Key: SPARK-19132 URL: https://issues.apache.org/jira/browse/SPARK-19132 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-17077) Cardinality estimation of project operator

2017-01-08 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-17077. - Resolution: Fixed Assignee: Zhenhua Wang Fix Version/s: 2.2.0 > Cardinality

[jira] [Created] (SPARK-19131) Support "alter table drop partition [if exists]"

2017-01-08 Thread lichenglin (JIRA)
lichenglin created SPARK-19131: -- Summary: Support "alter table drop partition [if exists]" Key: SPARK-19131 URL: https://issues.apache.org/jira/browse/SPARK-19131 Project: Spark Issue Type: New

[jira] [Resolved] (SPARK-19126) Join Documentation Improvements

2017-01-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-19126. -- Resolution: Fixed Assignee: Bill Chambers Fix Version/s: 2.2.0

[jira] [Commented] (SPARK-18011) SparkR serialize "NA" throws exception

2017-01-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15810660#comment-15810660 ] Felix Cheung commented on SPARK-18011: -- [~wangmiao1981]do you remember this one? I thought at one

[jira] [Commented] (SPARK-19130) SparkR should support setting and adding new column with singular value implicitly

2017-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15810639#comment-15810639 ] Apache Spark commented on SPARK-19130: -- User 'felixcheung' has created a pull request for this

[jira] [Assigned] (SPARK-19130) SparkR should support setting and adding new column with singular value implicitly

2017-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19130: Assignee: Apache Spark > SparkR should support setting and adding new column with

[jira] [Created] (SPARK-19130) SparkR should support setting and adding new column with singular value implicitly

2017-01-08 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-19130: Summary: SparkR should support setting and adding new column with singular value implicitly Key: SPARK-19130 URL: https://issues.apache.org/jira/browse/SPARK-19130

[jira] [Commented] (SPARK-18823) Assignation by column name variable not available or bug?

2017-01-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15810634#comment-15810634 ] Felix Cheung commented on SPARK-18823: -- I think to Shivaram, this is a bit tricky since we are

[jira] [Commented] (SPARK-19042) Remove query string from jar url for executor

2017-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15810580#comment-15810580 ] Apache Spark commented on SPARK-19042: -- User 'hustfxj' has created a pull request for this issue:

[jira] [Assigned] (SPARK-18806) driverwrapper and executor doesn't exit when worker killed

2017-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18806: Assignee: (was: Apache Spark) > driverwrapper and executor doesn't exit when worker

[jira] [Commented] (SPARK-18806) driverwrapper and executor doesn't exit when worker killed

2017-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15810543#comment-15810543 ] Apache Spark commented on SPARK-18806: -- User 'liujianhuiouc' has created a pull request for this

[jira] [Assigned] (SPARK-18806) driverwrapper and executor doesn't exit when worker killed

2017-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18806: Assignee: Apache Spark > driverwrapper and executor doesn't exit when worker killed >

[jira] [Commented] (SPARK-19115) SparkSQL unsupported the command " create external table if not exist new_tbl like old_tbl"

2017-01-08 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15810534#comment-15810534 ] Xiao Li commented on SPARK-19115: - Nope. When you using CREATE TABLE LIKE to create a table, it will be a

[jira] [Commented] (SPARK-19129) alter table table_name drop partition with a empty string will drop the whole table

2017-01-08 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15810529#comment-15810529 ] Xiao Li commented on SPARK-19129: - Let me take a look. > alter table table_name drop partition with a

[jira] [Comment Edited] (SPARK-18806) driverwrapper and executor doesn't exit when worker killed

2017-01-08 Thread liujianhui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15810519#comment-15810519 ] liujianhui edited comment on SPARK-18806 at 1/9/17 3:15 AM: Hi, Sean Owen, I

[jira] [Commented] (SPARK-18806) driverwrapper and executor doesn't exit when worker killed

2017-01-08 Thread liujianhui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15810519#comment-15810519 ] liujianhui commented on SPARK-18806: Hi, Sean Owen, I found the root cause, when start the

[jira] [Commented] (SPARK-18570) Consider supporting other R formula operators

2017-01-08 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15810510#comment-15810510 ] Yanbo Liang commented on SPARK-18570: - [~KrishnaKalyan3] You can also refer the initial design

[jira] [Created] (SPARK-19129) alter table table_name drop partition with a empty string will drop the whole table

2017-01-08 Thread lichenglin (JIRA)
lichenglin created SPARK-19129: -- Summary: alter table table_name drop partition with a empty string will drop the whole table Key: SPARK-19129 URL: https://issues.apache.org/jira/browse/SPARK-19129

[jira] [Commented] (SPARK-19115) SparkSQL unsupported the command " create external table if not exist new_tbl like old_tbl"

2017-01-08 Thread Xiaochen Ouyang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15810441#comment-15810441 ] Xiaochen Ouyang commented on SPARK-19115: - May I ask you whether Spark2.0.1 supports the

[jira] [Resolved] (SPARK-19127) Inconsistencies in dense_rank and rank documentation

2017-01-08 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-19127. - Resolution: Fixed Assignee: Bill Chambers Fix Version/s: 2.2.0

[jira] [Commented] (SPARK-19103) In web ui,URL's host name should be a specific IP address.

2017-01-08 Thread guoxiaolong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15810312#comment-15810312 ] guoxiaolong commented on SPARK-19103: - Yes,if is not a ip,browser opens this address 404.Please see

[jira] [Updated] (SPARK-19103) In web ui,URL's host name should be a specific IP address.

2017-01-08 Thread guoxiaolong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guoxiaolong updated SPARK-19103: Attachment: 3.png > In web ui,URL's host name should be a specific IP address. >

[jira] [Commented] (SPARK-18903) uiWebUrl is not accessible to SparkR

2017-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15810290#comment-15810290 ] Apache Spark commented on SPARK-18903: -- User 'felixcheung' has created a pull request for this

[jira] [Commented] (SPARK-18903) uiWebUrl is not accessible to SparkR

2017-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15810281#comment-15810281 ] Apache Spark commented on SPARK-18903: -- User 'felixcheung' has created a pull request for this

[jira] [Commented] (SPARK-18570) Consider supporting other R formula operators

2017-01-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15810250#comment-15810250 ] Felix Cheung commented on SPARK-18570: -- Hi - the code is here:

[jira] [Commented] (SPARK-18075) UDF doesn't work on non-local spark

2017-01-08 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15810132#comment-15810132 ] Herman van Hovell commented on SPARK-18075: --- I am happy to reopen it, if you are willing to fix

[jira] [Resolved] (SPARK-19093) Cached tables are not used in SubqueryExpression

2017-01-08 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-19093. --- Resolution: Fixed Assignee: Dilip Biswal Fix Version/s: 2.2.0 >

[jira] [Commented] (SPARK-18075) UDF doesn't work on non-local spark

2017-01-08 Thread Dan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15809990#comment-15809990 ] Dan commented on SPARK-18075: - Can you please reopen this issue? It is very common to run Spark applications

[jira] [Commented] (SPARK-10078) Vector-free L-BFGS

2017-01-08 Thread Debasish Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15809876#comment-15809876 ] Debasish Das commented on SPARK-10078: -- I looked into the code and I see we are replicating Breeze

[jira] [Updated] (SPARK-19128) Refresh Metadata Cache After DDL Changes

2017-01-08 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-19128: Labels: correctness (was: ) > Refresh Metadata Cache After DDL Changes >

[jira] [Created] (SPARK-19128) Refresh Metadata Cache After DDL Changes

2017-01-08 Thread Xiao Li (JIRA)
Xiao Li created SPARK-19128: --- Summary: Refresh Metadata Cache After DDL Changes Key: SPARK-19128 URL: https://issues.apache.org/jira/browse/SPARK-19128 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-19111) S3 Mesos history upload fails silently if too large

2017-01-08 Thread Charles Allen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15809837#comment-15809837 ] Charles Allen commented on SPARK-19111: --- So to clarify, I agree this ticket is not actionable as

[jira] [Commented] (SPARK-11968) ALS recommend all methods spend most of time in GC

2017-01-08 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15809805#comment-15809805 ] Joseph K. Bradley commented on SPARK-11968: --- I disagree; this is a problem but is non-trivial

[jira] [Commented] (SPARK-19127) Inconsistencies in dense_rank and rank documentation

2017-01-08 Thread Bill Chambers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15809726#comment-15809726 ] Bill Chambers commented on SPARK-19127: --- https://github.com/apache/spark/pull/16505 >

[jira] [Assigned] (SPARK-19127) Inconsistencies in dense_rank and rank documentation

2017-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19127: Assignee: (was: Apache Spark) > Inconsistencies in dense_rank and rank documentation

[jira] [Commented] (SPARK-19127) Inconsistencies in dense_rank and rank documentation

2017-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15809714#comment-15809714 ] Apache Spark commented on SPARK-19127: -- User 'anabranch' has created a pull request for this issue:

[jira] [Updated] (SPARK-19126) Join Documentation Improvements

2017-01-08 Thread Bill Chambers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Chambers updated SPARK-19126: -- Priority: Minor (was: Major) > Join Documentation Improvements >

[jira] [Assigned] (SPARK-19127) Inconsistencies in dense_rank and rank documentation

2017-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19127: Assignee: Apache Spark > Inconsistencies in dense_rank and rank documentation >

[jira] [Updated] (SPARK-19127) Inconsistencies in dense_rank and rank documentation

2017-01-08 Thread Bill Chambers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Chambers updated SPARK-19127: -- Priority: Minor (was: Major) > Inconsistencies in dense_rank and rank documentation >

[jira] [Updated] (SPARK-19127) Inconsistencies in dense_rank and rank documentation

2017-01-08 Thread Bill Chambers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Chambers updated SPARK-19127: -- Summary: Inconsistencies in dense_rank and rank documentation (was: Errors in Window

[jira] [Assigned] (SPARK-19126) Join Documentation Improvements

2017-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19126: Assignee: Apache Spark > Join Documentation Improvements >

[jira] [Assigned] (SPARK-19126) Join Documentation Improvements

2017-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19126: Assignee: (was: Apache Spark) > Join Documentation Improvements >

[jira] [Commented] (SPARK-19126) Join Documentation Improvements

2017-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15809711#comment-15809711 ] Apache Spark commented on SPARK-19126: -- User 'anabranch' has created a pull request for this issue:

[jira] [Created] (SPARK-19127) Errors in Window Functions Documentation

2017-01-08 Thread Bill Chambers (JIRA)
Bill Chambers created SPARK-19127: - Summary: Errors in Window Functions Documentation Key: SPARK-19127 URL: https://issues.apache.org/jira/browse/SPARK-19127 Project: Spark Issue Type:

[jira] [Commented] (SPARK-19127) Errors in Window Functions Documentation

2017-01-08 Thread Bill Chambers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15809697#comment-15809697 ] Bill Chambers commented on SPARK-19127: --- PR coming > Errors in Window Functions Documentation >

[jira] [Commented] (SPARK-19126) Join Documentation Improvements

2017-01-08 Thread Bill Chambers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15809690#comment-15809690 ] Bill Chambers commented on SPARK-19126: --- PR Ready: https://github.com/apache/spark/pull/16504 >

[jira] [Updated] (SPARK-19126) Join Documentation Improvements

2017-01-08 Thread Bill Chambers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Chambers updated SPARK-19126: -- Description: - Some join types are missing (no mention of anti join) - Joins are labelled

[jira] [Updated] (SPARK-19126) Join Documentation Improvements

2017-01-08 Thread Bill Chambers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Chambers updated SPARK-19126: -- Description: - Some join types are missing (no mention of anti join) - Joins are labelled

[jira] [Updated] (SPARK-19126) Join Documentation Improvements

2017-01-08 Thread Bill Chambers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Chambers updated SPARK-19126: -- Description: - Some join types are missing or inconsistent (no mention of anti join) Pull

[jira] [Created] (SPARK-19126) Join Documentation Incomplete

2017-01-08 Thread Bill Chambers (JIRA)
Bill Chambers created SPARK-19126: - Summary: Join Documentation Incomplete Key: SPARK-19126 URL: https://issues.apache.org/jira/browse/SPARK-19126 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-18113) Sending AskPermissionToCommitOutput failed, driver enter into task deadloop

2017-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18113: Assignee: Apache Spark > Sending AskPermissionToCommitOutput failed, driver enter into

[jira] [Assigned] (SPARK-18113) Sending AskPermissionToCommitOutput failed, driver enter into task deadloop

2017-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18113: Assignee: (was: Apache Spark) > Sending AskPermissionToCommitOutput failed, driver

[jira] [Commented] (SPARK-18113) Sending AskPermissionToCommitOutput failed, driver enter into task deadloop

2017-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15809638#comment-15809638 ] Apache Spark commented on SPARK-18113: -- User 'jinxing64' has created a pull request for this issue:

[jira] [Commented] (SPARK-14194) spark csv reader not working properly if CSV content contains CRLF character (newline) in the intermediate cell

2017-01-08 Thread Gergely Szecsenyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15809619#comment-15809619 ] Gergely Szecsenyi commented on SPARK-14194: --- R can handle it. It would be useful for free text

[jira] [Commented] (SPARK-19125) Streaming Duration by Count

2017-01-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15809449#comment-15809449 ] Sean Owen commented on SPARK-19125: --- That's so at odds with the architecture that I don't think that

[jira] [Resolved] (SPARK-19124) GraphX PageRank execution time

2017-01-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-19124. --- Resolution: Invalid Questions should go to the mailing list. Read

[jira] [Created] (SPARK-19125) Streaming Duration by Count

2017-01-08 Thread JIRA
Paulo Cândido created SPARK-19125: - Summary: Streaming Duration by Count Key: SPARK-19125 URL: https://issues.apache.org/jira/browse/SPARK-19125 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-19124) GraphX PageRank execution time

2017-01-08 Thread Elias Bassani (JIRA)
Elias Bassani created SPARK-19124: -- Summary: GraphX PageRank execution time Key: SPARK-19124 URL: https://issues.apache.org/jira/browse/SPARK-19124 Project: Spark Issue Type: Question

[jira] [Resolved] (SPARK-18862) Split SparkR mllib.R into multiple files

2017-01-08 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang resolved SPARK-18862. - Resolution: Fixed Assignee: Yanbo Liang Fix Version/s: 2.2.0 Target

[jira] [Assigned] (SPARK-19117) script transformation does not work on Windows due to fixed bash executable location

2017-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19117: Assignee: (was: Apache Spark) > script transformation does not work on Windows due to

[jira] [Assigned] (SPARK-19117) script transformation does not work on Windows due to fixed bash executable location

2017-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19117: Assignee: Apache Spark > script transformation does not work on Windows due to fixed bash

[jira] [Commented] (SPARK-19117) script transformation does not work on Windows due to fixed bash executable location

2017-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15809268#comment-15809268 ] Apache Spark commented on SPARK-19117: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-18570) Consider supporting other R formula operators

2017-01-08 Thread Krishna Kalyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15809259#comment-15809259 ] Krishna Kalyan commented on SPARK-18570: [~felixcheung] I would like to work on this, Could you

[jira] [Commented] (SPARK-18890) Do all task serialization in CoarseGrainedExecutorBackend thread (rather than TaskSchedulerImpl)

2017-01-08 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15809212#comment-15809212 ] Guoqiang Li commented on SPARK-18890: - OK, I see. In fact, the most difficult to deal with the

[jira] [Commented] (SPARK-19123) KeyProviderException when reading Azure Blobs from Apache Spark

2017-01-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15809096#comment-15809096 ] Sean Owen commented on SPARK-19123: --- This doesn't look like a Spark issue per se. >

[jira] [Resolved] (SPARK-19026) local directories cannot be cleanuped when create directory of "executor-***" throws IOException such as there is no more free disk space to create it etc.

2017-01-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-19026. --- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 16439

[jira] [Updated] (SPARK-19026) local directories cannot be cleanuped when create directory of "executor-***" throws IOException such as there is no more free disk space to create it etc.

2017-01-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-19026: -- Assignee: zuotingbing Priority: Minor (was: Major) Issue Type: Improvement (was: Bug) >