[jira] [Updated] (SPARK-21159) Cluster mode, driver throws connection refused exception submitted by SparkLauncher

2017-06-23 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-21159: Fix Version/s: (was: 2.3.0) 2.2.0 2.1.2 > Cluster mode,

[jira] [Resolved] (SPARK-21159) Cluster mode, driver throws connection refused exception submitted by SparkLauncher

2017-06-23 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-21159. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 18397

[jira] [Assigned] (SPARK-21159) Cluster mode, driver throws connection refused exception submitted by SparkLauncher

2017-06-23 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-21159: --- Assignee: Marcelo Vanzin > Cluster mode, driver throws connection refused exception

[jira] [Comment Edited] (SPARK-19726) Faild to insert null timestamp value to mysql using spark jdbc

2017-06-23 Thread Chang chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16060739#comment-16060739 ] Chang chen edited comment on SPARK-19726 at 6/24/17 5:17 AM: - @srowen, As we

[jira] [Assigned] (SPARK-20555) Incorrect handling of Oracle's decimal types via JDBC

2017-06-23 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-20555: --- Assignee: Gabor Feher > Incorrect handling of Oracle's decimal types via JDBC >

[jira] [Resolved] (SPARK-20555) Incorrect handling of Oracle's decimal types via JDBC

2017-06-23 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-20555. - Resolution: Fixed Fix Version/s: 2.2.0 2.1.2 > Incorrect handling of Oracle's

[jira] [Assigned] (SPARK-21203) Wrong results of insertion of Array of Struct

2017-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21203: Assignee: Apache Spark (was: Xiao Li) > Wrong results of insertion of Array of Struct >

[jira] [Commented] (SPARK-21203) Wrong results of insertion of Array of Struct

2017-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16061775#comment-16061775 ] Apache Spark commented on SPARK-21203: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21203) Wrong results of insertion of Array of Struct

2017-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21203: Assignee: Xiao Li (was: Apache Spark) > Wrong results of insertion of Array of Struct >

[jira] [Updated] (SPARK-21203) Wrong results of insertion of Array of Struct

2017-06-23 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-21203: Target Version/s: 2.2.0 > Wrong results of insertion of Array of Struct >

[jira] [Updated] (SPARK-21203) Wrong results of insertion of Array of Struct

2017-06-23 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-21203: Summary: Wrong results of insertion of Array of Struct (was: Wrong results are inserted by Array of

[jira] [Updated] (SPARK-21203) Wrong results are inserted by Array of Struct

2017-06-23 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-21203: Summary: Wrong results are inserted by Array of Struct (was: Wrong result are inserted by Array of

[jira] [Created] (SPARK-21203) Wrong result are inserted by Array of Struct

2017-06-23 Thread Xiao Li (JIRA)
Xiao Li created SPARK-21203: --- Summary: Wrong result are inserted by Array of Struct Key: SPARK-21203 URL: https://issues.apache.org/jira/browse/SPARK-21203 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-18004) DataFrame filter Predicate push-down fails for Oracle Timestamp type columns

2017-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16061770#comment-16061770 ] Apache Spark commented on SPARK-18004: -- User 'SharpRay' has created a pull request for this issue:

[jira] [Commented] (SPARK-21156) Spark cannot handle multiple KMS server configuration

2017-06-23 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16061768#comment-16061768 ] Harsh J commented on SPARK-21156: - Could you confirm if the hadoop libraries version used by your Spark

[jira] [Updated] (SPARK-21202) Assignment operator ==== working, But equalTo is throw with error

2017-06-23 Thread saravanan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] saravanan updated SPARK-21202: -- Description: I raised question in

[jira] [Created] (SPARK-21202) Assignment operator ==== working, But equalTo is throw with error

2017-06-23 Thread saravanan (JIRA)
saravanan created SPARK-21202: - Summary: Assignment operator working, But equalTo is throw with error Key: SPARK-21202 URL: https://issues.apache.org/jira/browse/SPARK-21202 Project: Spark

[jira] [Commented] (SPARK-21152) Use level 3 BLAS operations in LogisticAggregator

2017-06-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16061762#comment-16061762 ] Yanbo Liang commented on SPARK-21152: - [~sethah] I'm a little pessimistic on this. From the

[jira] [Commented] (SPARK-21200) Spark REST API is not working or Spark documentation is wrong.

2017-06-23 Thread guoxiaolongzte (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16061737#comment-16061737 ] guoxiaolongzte commented on SPARK-21200: Please give an example, such as which specific REST api.

[jira] [Created] (SPARK-21201) SparkSQL Load data inpath into table tableName, file is moved

2017-06-23 Thread shining (JIRA)
shining created SPARK-21201: --- Summary: SparkSQL Load data inpath into table tableName, file is moved Key: SPARK-21201 URL: https://issues.apache.org/jira/browse/SPARK-21201 Project: Spark Issue

[jira] [Closed] (SPARK-21139) java.util.concurrent.RejectedExecutionException: rejected from java.util.concurrent.ThreadPoolExecutor@46477dd0[Terminated, pool size = 0, active threads = 0, queued task

2017-06-23 Thread shining (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shining closed SPARK-21139. --- Maybe HiveHBaseInputFormat use the old API of HBase. It is not spark's issue >

[jira] [Created] (SPARK-21200) Spark REST API is not working or Spark documentation is wrong.

2017-06-23 Thread Srinivasarao Daruna (JIRA)
Srinivasarao Daruna created SPARK-21200: --- Summary: Spark REST API is not working or Spark documentation is wrong. Key: SPARK-21200 URL: https://issues.apache.org/jira/browse/SPARK-21200

[jira] [Updated] (SPARK-21199) Its not possible to impute Vector types

2017-06-23 Thread Franklyn Dsouza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Franklyn Dsouza updated SPARK-21199: Description: There are cases where nulls end up in vector columns in dataframes. Currently

[jira] [Created] (SPARK-21199) Its not possible to impute Vector types

2017-06-23 Thread Franklyn Dsouza (JIRA)
Franklyn Dsouza created SPARK-21199: --- Summary: Its not possible to impute Vector types Key: SPARK-21199 URL: https://issues.apache.org/jira/browse/SPARK-21199 Project: Spark Issue Type:

[jira] [Commented] (SPARK-12806) Support SQL expressions extracting values from VectorUDT

2017-06-23 Thread Franklyn Dsouza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16061718#comment-16061718 ] Franklyn Dsouza commented on SPARK-12806: - [~mengxr] can we get this fixed ? > Support SQL

[jira] [Updated] (SPARK-21190) SPIP: Vectorized UDFs in Python

2017-06-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-21190: Attachment: SPIPVectorizedUDFsforPython (1).pdf > SPIP: Vectorized UDFs in Python >

[jira] [Updated] (SPARK-21198) SparkSession catalog is terribly slow

2017-06-23 Thread Saif Addin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saif Addin updated SPARK-21198: --- Description: We have a considerably large Hive metastore and a Spark program that goes through Hive

[jira] [Updated] (SPARK-21198) SparkSession catalog is terribly slow

2017-06-23 Thread Saif Addin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saif Addin updated SPARK-21198: --- Description: We have a considerably large Hive metastore and a Spark program that goes through Hive

[jira] [Updated] (SPARK-21198) SparkSession catalog is terribly slow

2017-06-23 Thread Saif Addin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saif Addin updated SPARK-21198: --- Description: We have a considerably large Hive metastore and a Spark program that goes through Hive

[jira] [Created] (SPARK-21198) SparkSession catalog is terribly slow

2017-06-23 Thread Saif Addin (JIRA)
Saif Addin created SPARK-21198: -- Summary: SparkSession catalog is terribly slow Key: SPARK-21198 URL: https://issues.apache.org/jira/browse/SPARK-21198 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-21197) Tricky use case makes dead application struggle for a long duration

2017-06-23 Thread Nan Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nan Zhu updated SPARK-21197: Summary: Tricky use case makes dead application struggle for a long duration (was: Tricky use cases makes

[jira] [Created] (SPARK-21197) Tricky use cases makes dead application struggle for a long duration

2017-06-23 Thread Nan Zhu (JIRA)
Nan Zhu created SPARK-21197: --- Summary: Tricky use cases makes dead application struggle for a long duration Key: SPARK-21197 URL: https://issues.apache.org/jira/browse/SPARK-21197 Project: Spark

[jira] [Assigned] (SPARK-20971) Purge the metadata log for FileStreamSource

2017-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20971: Assignee: (was: Apache Spark) > Purge the metadata log for FileStreamSource >

[jira] [Assigned] (SPARK-20971) Purge the metadata log for FileStreamSource

2017-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20971: Assignee: Apache Spark > Purge the metadata log for FileStreamSource >

[jira] [Commented] (SPARK-20971) Purge the metadata log for FileStreamSource

2017-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16061596#comment-16061596 ] Apache Spark commented on SPARK-20971: -- User 'CodingCat' has created a pull request for this issue:

[jira] [Commented] (SPARK-21157) Report Total Memory Used by Spark Executors

2017-06-23 Thread Jose Soltren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16061582#comment-16061582 ] Jose Soltren commented on SPARK-21157: -- Hello Marcelo - It's true, the design doc doesn't discuss

[jira] [Resolved] (SPARK-21164) Remove isTableSample from Sample and isGenerated from Alias and AttributeReference

2017-06-23 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-21164. - Resolution: Fixed Fix Version/s: 2.3.0 > Remove isTableSample from Sample and isGenerated from

[jira] [Commented] (SPARK-20307) SparkR: pass on setHandleInvalid to spark.mllib functions that use StringIndexer

2017-06-23 Thread Joseph Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16061532#comment-16061532 ] Joseph Wang commented on SPARK-20307: - Thanks a lot. Let me know if you have done that. This will

[jira] [Commented] (SPARK-20307) SparkR: pass on setHandleInvalid to spark.mllib functions that use StringIndexer

2017-06-23 Thread Miao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16061525#comment-16061525 ] Miao Wang commented on SPARK-20307: --- [~Monday0927!] I am working on it now. Thanks! Miao cc

[jira] [Updated] (SPARK-21190) SPIP: Vectorized UDFs in Python

2017-06-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-21190: Description: *Background and Motivation* Python is one of the most popular programming languages

[jira] [Closed] (SPARK-20817) Benchmark.getProcessorName() returns "Unknown processor" on ppc and 390 platforms

2017-06-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-20817. --- Resolution: Won't Fix See github discussions. > Benchmark.getProcessorName() returns "Unknown

[jira] [Updated] (SPARK-21190) SPIP: Vectorized UDFs in Python

2017-06-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-21190: Description: *Background and Motivation* Python is one of the most popular programming languages

[jira] [Updated] (SPARK-21137) Spark reads many small files slowly

2017-06-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-21137: -- Affects Version/s: (was: 2.2.1) 2.1.1 Priority: Minor (was:

[jira] [Reopened] (SPARK-21137) Spark reads many small files slowly

2017-06-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-21137: --- > Spark reads many small files slowly > --- > > Key:

[jira] [Commented] (SPARK-21110) Structs should be usable in inequality filters

2017-06-23 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16061398#comment-16061398 ] Michael Armbrust commented on SPARK-21110: -- It seems if you can call {{min}} and {{max}} on

[jira] [Updated] (SPARK-21110) Structs should be usable in inequality filters

2017-06-23 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-21110: - Target Version/s: 2.3.0 > Structs should be usable in inequality filters >

[jira] [Assigned] (SPARK-21196) Split codegen info of query plan into sequence

2017-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21196: Assignee: Apache Spark > Split codegen info of query plan into sequence >

[jira] [Commented] (SPARK-21196) Split codegen info of query plan into sequence

2017-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16061364#comment-16061364 ] Apache Spark commented on SPARK-21196: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-21196) Split codegen info of query plan into sequence

2017-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21196: Assignee: (was: Apache Spark) > Split codegen info of query plan into sequence >

[jira] [Created] (SPARK-21196) Split codegen info of query plan into sequence

2017-06-23 Thread Gengliang Wang (JIRA)
Gengliang Wang created SPARK-21196: -- Summary: Split codegen info of query plan into sequence Key: SPARK-21196 URL: https://issues.apache.org/jira/browse/SPARK-21196 Project: Spark Issue

[jira] [Resolved] (SPARK-20417) Move error reporting for subquery from Analyzer to CheckAnalysis

2017-06-23 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-20417. - Resolution: Fixed Assignee: Dilip Biswal Fix Version/s: 2.3.0 > Move error reporting for

[jira] [Commented] (SPARK-20555) Incorrect handling of Oracle's decimal types via JDBC

2017-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16061304#comment-16061304 ] Apache Spark commented on SPARK-20555: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Resolved] (SPARK-21192) Preserve State Store provider class configuration across StreamingQuery restarts

2017-06-23 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-21192. -- Resolution: Fixed Assignee: Tathagata Das (was: Apache Spark) Fix Version/s:

[jira] [Resolved] (SPARK-21181) Suppress memory leak errors reported by netty

2017-06-23 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-21181. Resolution: Fixed Assignee: Dhruve Ashar Fix Version/s: 2.3.0

[jira] [Resolved] (SPARK-21180) Remove conf from stats functions since now we have conf in LogicalPlan

2017-06-23 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-21180. - Resolution: Fixed Assignee: Zhenhua Wang Fix Version/s: 2.3.0 > Remove conf from stats

[jira] [Commented] (SPARK-21155) Add (? running tasks) into Spark UI progress

2017-06-23 Thread Eric Vandenberg (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16061225#comment-16061225 ] Eric Vandenberg commented on SPARK-21155: - Added screen shot with skipped tasks for reference. >

[jira] [Resolved] (SPARK-21149) Add job description API for R

2017-06-23 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-21149. -- Resolution: Fixed Assignee: Hyukjin Kwon Fix Version/s: 2.3.0

[jira] [Updated] (SPARK-21164) Remove isTableSample from Sample and isGenerated from Alias and AttributeReference

2017-06-23 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-21164: Description: isTableSample and isGenerated were introduced for SQL Generation respectively by PR 11148

[jira] [Updated] (SPARK-21164) Remove isTableSample from Sample and isGenerated from Alias and AttributeReference

2017-06-23 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-21164: Description: isTableSample and isGenerated were introduced for SQL Generation respectively by #11148 and

[jira] [Updated] (SPARK-21164) Remove isTableSample from Sample and isGenerated from Alias and AttributeReference

2017-06-23 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-21164: Summary: Remove isTableSample from Sample and isGenerated from Alias and AttributeReference (was: Remove

[jira] [Resolved] (SPARK-21144) Unexpected results when the data schema and partition schema have the duplicate columns

2017-06-23 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-21144. - Resolution: Fixed Assignee: Takeshi Yamamuro Fix Version/s: 2.2.0 > Unexpected results

[jira] [Commented] (SPARK-20307) SparkR: pass on setHandleInvalid to spark.mllib functions that use StringIndexer

2017-06-23 Thread Joseph Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16061161#comment-16061161 ] Joseph Wang commented on SPARK-20307: - Hi Felix, the problem for me is how to get into the backend

[jira] [Commented] (SPARK-20307) SparkR: pass on setHandleInvalid to spark.mllib functions that use StringIndexer

2017-06-23 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16061159#comment-16061159 ] Felix Cheung commented on SPARK-20307: -- Not much update as far as I know. Would you like to

[jira] [Commented] (SPARK-21152) Use level 3 BLAS operations in LogisticAggregator

2017-06-23 Thread Seth Hendrickson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16061158#comment-16061158 ] Seth Hendrickson commented on SPARK-21152: -- [~yanboliang] I can do performance testing and post

[jira] [Commented] (SPARK-20307) SparkR: pass on setHandleInvalid to spark.mllib functions that use StringIndexer

2017-06-23 Thread Joseph Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16060982#comment-16060982 ] Joseph Wang commented on SPARK-20307: - Hello, I am new to the discussion. I come across the same

[jira] [Commented] (SPARK-20952) ParquetFileFormat should forward TaskContext to its forkjoinpool

2017-06-23 Thread Robert Kruszewski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16060972#comment-16060972 ] Robert Kruszewski commented on SPARK-20952: --- [~zsxwing] updated the issue title and pr with

[jira] [Updated] (SPARK-20952) ParquetFileFormat should forward TaskContext to its forkjoinpool

2017-06-23 Thread Robert Kruszewski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kruszewski updated SPARK-20952: -- Summary: ParquetFileFormat should forward TaskContext to its forkjoinpool (was:

[jira] [Commented] (SPARK-21181) Suppress memory leak errors reported by netty

2017-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16060970#comment-16060970 ] Apache Spark commented on SPARK-21181: -- User 'dhruve' has created a pull request for this issue:

[jira] [Commented] (SPARK-18004) DataFrame filter Predicate push-down fails for Oracle Timestamp type columns

2017-06-23 Thread Rui Zha (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16060963#comment-16060963 ] Rui Zha commented on SPARK-18004: - The PR 18404 is closed. I will resend the PR later. > DataFrame

[jira] [Assigned] (SPARK-21195) MetricSystem should pick up dynamically registered metrics in sources

2017-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21195: Assignee: (was: Apache Spark) > MetricSystem should pick up dynamically registered

[jira] [Assigned] (SPARK-21195) MetricSystem should pick up dynamically registered metrics in sources

2017-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21195: Assignee: Apache Spark > MetricSystem should pick up dynamically registered metrics in

[jira] [Commented] (SPARK-21195) MetricSystem should pick up dynamically registered metrics in sources

2017-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16060939#comment-16060939 ] Apache Spark commented on SPARK-21195: -- User 'robert3005' has created a pull request for this issue:

[jira] [Created] (SPARK-21195) MetricSystem should pick up dynamically registered metrics in sources

2017-06-23 Thread Robert Kruszewski (JIRA)
Robert Kruszewski created SPARK-21195: - Summary: MetricSystem should pick up dynamically registered metrics in sources Key: SPARK-21195 URL: https://issues.apache.org/jira/browse/SPARK-21195

[jira] [Resolved] (SPARK-21193) Specify Pandas version in setup.py

2017-06-23 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-21193. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 18403

[jira] [Assigned] (SPARK-21193) Specify Pandas version in setup.py

2017-06-23 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-21193: --- Assignee: Hyukjin Kwon > Specify Pandas version in setup.py >

[jira] [Assigned] (SPARK-21194) Fail the putNullmethod when containsNull=false.

2017-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21194: Assignee: (was: Apache Spark) > Fail the putNullmethod when containsNull=false. >

[jira] [Commented] (SPARK-21194) Fail the putNullmethod when containsNull=false.

2017-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16060919#comment-16060919 ] Apache Spark commented on SPARK-21194: -- User 'jinxing64' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21194) Fail the putNullmethod when containsNull=false.

2017-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21194: Assignee: Apache Spark > Fail the putNullmethod when containsNull=false. >

[jira] [Created] (SPARK-21194) Fail the putNullmethod when containsNull=false.

2017-06-23 Thread jin xing (JIRA)
jin xing created SPARK-21194: Summary: Fail the putNullmethod when containsNull=false. Key: SPARK-21194 URL: https://issues.apache.org/jira/browse/SPARK-21194 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-21115) If the cores left is less than the coresPerExecutor,the cores left will not be allocated, so it should not to check in every schedule

2017-06-23 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-21115: --- Assignee: eaton > If the cores left is less than the coresPerExecutor,the cores left will

[jira] [Resolved] (SPARK-21115) If the cores left is less than the coresPerExecutor,the cores left will not be allocated, so it should not to check in every schedule

2017-06-23 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-21115. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 18322

[jira] [Resolved] (SPARK-21165) Fail to write into partitioned hive table due to attribute reference not working with cast on partition column

2017-06-23 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-21165. - Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 18386

[jira] [Assigned] (SPARK-21047) Add test suites for complicated cases in ColumnarBatchSuite

2017-06-23 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-21047: --- Assignee: jin xing > Add test suites for complicated cases in ColumnarBatchSuite >

[jira] [Resolved] (SPARK-21047) Add test suites for complicated cases in ColumnarBatchSuite

2017-06-23 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-21047. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 18327

[jira] [Assigned] (SPARK-18004) DataFrame filter Predicate push-down fails for Oracle Timestamp type columns

2017-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18004: Assignee: Apache Spark > DataFrame filter Predicate push-down fails for Oracle Timestamp

[jira] [Commented] (SPARK-18004) DataFrame filter Predicate push-down fails for Oracle Timestamp type columns

2017-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16060795#comment-16060795 ] Apache Spark commented on SPARK-18004: -- User 'SharpRay' has created a pull request for this issue:

[jira] [Assigned] (SPARK-18004) DataFrame filter Predicate push-down fails for Oracle Timestamp type columns

2017-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18004: Assignee: (was: Apache Spark) > DataFrame filter Predicate push-down fails for Oracle

[jira] [Commented] (SPARK-21184) QuantileSummaries implementation is wrong and QuantileSummariesSuite fails with larger n

2017-06-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16060741#comment-16060741 ] Sean Owen commented on SPARK-21184: --- [~timhunter] [~clockfly] do you have opinions on this? Probably

[jira] [Commented] (SPARK-19726) Faild to insert null timestamp value to mysql using spark jdbc

2017-06-23 Thread Chang chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16060739#comment-16060739 ] Chang chen commented on SPARK-19726: @srowen, As we investigated, Spark translate null to 0 in case

[jira] [Resolved] (SPARK-21191) DataFrame Row StructType check duplicate name

2017-06-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21191. --- Resolution: Duplicate > DataFrame Row StructType check duplicate name >

[jira] [Commented] (SPARK-21191) DataFrame Row StructType check duplicate name

2017-06-23 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16060724#comment-16060724 ] Takeshi Yamamuro commented on SPARK-21191: -- I think this is a design:

[jira] [Assigned] (SPARK-21193) Specify Pandas version in setup.py

2017-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21193: Assignee: (was: Apache Spark) > Specify Pandas version in setup.py >

[jira] [Assigned] (SPARK-21193) Specify Pandas version in setup.py

2017-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21193: Assignee: Apache Spark > Specify Pandas version in setup.py >

[jira] [Commented] (SPARK-21193) Specify Pandas version in setup.py

2017-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16060719#comment-16060719 ] Apache Spark commented on SPARK-21193: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Created] (SPARK-21193) Specify Pandas version in setup.py

2017-06-23 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-21193: Summary: Specify Pandas version in setup.py Key: SPARK-21193 URL: https://issues.apache.org/jira/browse/SPARK-21193 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-21192) Preserve State Store provider class configuration across StreamingQuery restarts

2017-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21192: Assignee: Apache Spark (was: Tathagata Das) > Preserve State Store provider class

[jira] [Commented] (SPARK-21192) Preserve State Store provider class configuration across StreamingQuery restarts

2017-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16060699#comment-16060699 ] Apache Spark commented on SPARK-21192: -- User 'tdas' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21192) Preserve State Store provider class configuration across StreamingQuery restarts

2017-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21192: Assignee: Tathagata Das (was: Apache Spark) > Preserve State Store provider class

[jira] [Assigned] (SPARK-21192) Preserve State Store provider class configuration across StreamingQuery restarts

2017-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21192: Assignee: Apache Spark (was: Tathagata Das) > Preserve State Store provider class

[jira] [Updated] (SPARK-21192) Preserve State Store provider class configuration across StreamingQuery restarts

2017-06-23 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-21192: -- Summary: Preserve State Store provider class configuration across StreamingQuery restarts

  1   2   >