[jira] [Commented] (SPARK-7980) Support SQLContext.range(end)

2015-06-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570487#comment-14570487 ] Apache Spark commented on SPARK-7980: - User 'animeshbaranawal' has created a pull

[jira] [Updated] (SPARK-8071) Run PySpark dataframe.rollup/cube test failed

2015-06-03 Thread Weizhong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weizhong updated SPARK-8071: Description: I run test for Spark, and failed on PySpark, details are: File

[jira] [Assigned] (SPARK-8074) Parquet should throw AnalysisException during setup for data type/name related failures

2015-06-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8074: --- Assignee: Reynold Xin (was: Apache Spark) Parquet should throw AnalysisException during

[jira] [Commented] (SPARK-8074) Parquet should throw AnalysisException during setup for data type/name related failures

2015-06-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570485#comment-14570485 ] Apache Spark commented on SPARK-8074: - User 'rxin' has created a pull request for this

[jira] [Assigned] (SPARK-8074) Parquet should throw AnalysisException during setup for data type/name related failures

2015-06-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8074: --- Assignee: Apache Spark (was: Reynold Xin) Parquet should throw AnalysisException during

[jira] [Created] (SPARK-8076) spark sql udtf error

2015-06-03 Thread ant_nebula (JIRA)
ant_nebula created SPARK-8076: - Summary: spark sql udtf error Key: SPARK-8076 URL: https://issues.apache.org/jira/browse/SPARK-8076 Project: Spark Issue Type: Question Reporter:

[jira] [Updated] (SPARK-8043) update NaiveBayes and SVM examples in doc

2015-06-03 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8043: - Assignee: yuhao yang update NaiveBayes and SVM examples in doc

[jira] [Updated] (SPARK-8043) update NaiveBayes and SVM examples in doc

2015-06-03 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8043: - Target Version/s: 1.3.2, 1.4.1, 1.5.0 Affects Version/s: 1.3.1 update NaiveBayes and SVM

[jira] [Updated] (SPARK-8043) update NaiveBayes and SVM examples in doc

2015-06-03 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8043: - Affects Version/s: (was: 1.3.1) update NaiveBayes and SVM examples in doc

[jira] [Updated] (SPARK-8032) Make NumPy version checking in mllib/__init__.py

2015-06-03 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8032: - Assignee: Manoj Kumar Make NumPy version checking in mllib/__init__.py

[jira] [Updated] (SPARK-7961) Redesign SQLConf for better error message reporting

2015-06-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7961: --- Priority: Critical (was: Blocker) Redesign SQLConf for better error message reporting

[jira] [Created] (SPARK-8075) apply type checking interface to more expressions

2015-06-03 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-8075: -- Summary: apply type checking interface to more expressions Key: SPARK-8075 URL: https://issues.apache.org/jira/browse/SPARK-8075 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-8032) Make NumPy version checking in mllib/__init__.py

2015-06-03 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-8032. -- Resolution: Fixed Fix Version/s: 1.4.0 1.0.3 1.6.0

[jira] [Resolved] (SPARK-7562) Improve error reporting for expression data type mismatch

2015-06-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-7562. Resolution: Fixed Fix Version/s: 1.5.0 Assignee: Wenchen Fan Improve error

[jira] [Resolved] (SPARK-6444) SQL functions (either built-in or UDF) should check for data types of their arguments

2015-06-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-6444. Resolution: Fixed Fix Version/s: 1.5.0 Assignee: Wenchen Fan SQL functions (either

[jira] [Created] (SPARK-8073) Directory traversal vulnerability

2015-06-03 Thread 0keeTeam (JIRA)
0keeTeam created SPARK-8073: --- Summary: Directory traversal vulnerability Key: SPARK-8073 URL: https://issues.apache.org/jira/browse/SPARK-8073 Project: Spark Issue Type: Bug Components:

[jira] [Updated] (SPARK-7743) Upgrade Parquet to 1.7

2015-06-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7743: --- Issue Type: Sub-task (was: Bug) Parent: SPARK-5463 Upgrade Parquet to 1.7

[jira] [Updated] (SPARK-7743) Upgrade Parquet to 1.7

2015-06-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7743: --- Summary: Upgrade Parquet to 1.7 (was: Upgrade parquet dependency) Upgrade Parquet to 1.7

[jira] [Updated] (SPARK-8075) apply type checking interface to more expressions

2015-06-03 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-8075: --- Description: As https://github.com/apache/spark/pull/6405 has been merged, we need to apply the type

[jira] [Updated] (SPARK-8071) Run PySpark dataframe.rollup/cube test failed

2015-06-03 Thread Weizhong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weizhong updated SPARK-8071: Description: I run test for Spark, and failed on PySpark, details are: File

[jira] [Updated] (SPARK-8068) Add confusionMatrix method at class MulticlassMetrics in pyspark/mllib

2015-06-03 Thread Ai He (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ai He updated SPARK-8068: - Component/s: PySpark Add confusionMatrix method at class MulticlassMetrics in pyspark/mllib

[jira] [Created] (SPARK-8068) Add confusionMatrix method at class MulticlassMetrics in pyspark/mllib

2015-06-03 Thread Ai He (JIRA)
Ai He created SPARK-8068: Summary: Add confusionMatrix method at class MulticlassMetrics in pyspark/mllib Key: SPARK-8068 URL: https://issues.apache.org/jira/browse/SPARK-8068 Project: Spark Issue

[jira] [Resolved] (SPARK-8043) update NaiveBayes and SVM examples in doc

2015-06-03 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-8043. -- Resolution: Fixed Fix Version/s: 1.4.1 1.5.0 Issue resolved by pull

[jira] [Issue Comment Deleted] (SPARK-7980) Support SQLContext.range(end)

2015-06-03 Thread Animesh Baranawal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Animesh Baranawal updated SPARK-7980: - Comment: was deleted (was: Regarding the python support for range, I am unable to check

[jira] [Commented] (SPARK-7993) Improve DataFrame.show() output

2015-06-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570358#comment-14570358 ] Reynold Xin commented on SPARK-7993: that sounds good. Improve DataFrame.show()

[jira] [Commented] (SPARK-8062) NullPointerException in SparkHadoopUtil.getFileSystemThreadStatistics

2015-06-03 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570388#comment-14570388 ] Sandy Ryza commented on SPARK-8062: --- [~joshrosen] nothing sticks out to me past what

[jira] [Created] (SPARK-8069) Add support for cutoff to RandomForestClassifier

2015-06-03 Thread holdenk (JIRA)
holdenk created SPARK-8069: -- Summary: Add support for cutoff to RandomForestClassifier Key: SPARK-8069 URL: https://issues.apache.org/jira/browse/SPARK-8069 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-8070) Improve createDataFrame in Python

2015-06-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8070: --- Assignee: Apache Spark (was: Davies Liu) Improve createDataFrame in Python

[jira] [Commented] (SPARK-8070) Improve createDataFrame in Python

2015-06-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570409#comment-14570409 ] Apache Spark commented on SPARK-8070: - User 'davies' has created a pull request for

[jira] [Assigned] (SPARK-8070) Improve createDataFrame in Python

2015-06-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8070: --- Assignee: Davies Liu (was: Apache Spark) Improve createDataFrame in Python

[jira] [Created] (SPARK-8072) Better AnalysisException for writing DataFrame with identically named columns

2015-06-03 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-8072: -- Summary: Better AnalysisException for writing DataFrame with identically named columns Key: SPARK-8072 URL: https://issues.apache.org/jira/browse/SPARK-8072 Project:

[jira] [Updated] (SPARK-5463) Improve Parquet support (reliability, performance, and error messages)

2015-06-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-5463: --- Summary: Improve Parquet support (reliability, performance, and error messages) (was: Fix Parquet

[jira] [Resolved] (SPARK-7983) Add require for one-based indices in loadLibSVMFile

2015-06-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7983. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6538

[jira] [Updated] (SPARK-7983) Add require for one-based indices in loadLibSVMFile

2015-06-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7983: - Labels: (was: MLlib,) Add require for one-based indices in loadLibSVMFile

[jira] [Updated] (SPARK-7983) Add require for one-based indices in loadLibSVMFile

2015-06-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7983: - Assignee: yuhao yang Add require for one-based indices in loadLibSVMFile

[jira] [Assigned] (SPARK-8079) NPE when HadoopFsRelation.prepareForWriteJob throws exception

2015-06-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8079: --- Assignee: Cheng Lian (was: Apache Spark) NPE when HadoopFsRelation.prepareForWriteJob

[jira] [Assigned] (SPARK-7334) Implement RandomProjection for Dimensionality Reduction

2015-06-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7334: --- Assignee: Apache Spark Implement RandomProjection for Dimensionality Reduction

[jira] [Updated] (SPARK-8079) NPE when HadoopFsRelation.prepareForWriteJob throws exception

2015-06-03 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-8079: -- Description: Take {{ParquetRelation2}} as an example, the following Spark shell code may cause an

[jira] [Comment Edited] (SPARK-7122) KafkaUtils.createDirectStream - unreasonable processing time in absence of load

2015-06-03 Thread Nicolas PHUNG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570847#comment-14570847 ] Nicolas PHUNG edited comment on SPARK-7122 at 6/3/15 1:53 PM: --

[jira] [Created] (SPARK-8079) NPE when HadoopFsRelation.prepareForWriteJob throws exception

2015-06-03 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-8079: - Summary: NPE when HadoopFsRelation.prepareForWriteJob throws exception Key: SPARK-8079 URL: https://issues.apache.org/jira/browse/SPARK-8079 Project: Spark Issue

[jira] [Updated] (SPARK-8080) Custom Receiver.store with Iterator type do not give correct count at Spark UI

2015-06-03 Thread Dibyendu Bhattacharya (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dibyendu Bhattacharya updated SPARK-8080: - Attachment: screenshot.png Custom Receiver.store with Iterator type do not give

[jira] [Comment Edited] (SPARK-3185) SPARK launch on Hadoop 2 in EC2 throws Tachyon exception when Formatting JOURNAL_FOLDER

2015-06-03 Thread Grzegorz Dubicki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570794#comment-14570794 ] Grzegorz Dubicki edited comment on SPARK-3185 at 6/3/15 2:32 PM:

[jira] [Commented] (SPARK-8080) Custom Receiver.store with Iterator type do not give correct count at Spark UI

2015-06-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570949#comment-14570949 ] Apache Spark commented on SPARK-8080: - User 'dibbhatt' has created a pull request for

[jira] [Assigned] (SPARK-8080) Custom Receiver.store with Iterator type do not give correct count at Spark UI

2015-06-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8080: --- Assignee: (was: Apache Spark) Custom Receiver.store with Iterator type do not give

[jira] [Commented] (SPARK-8078) Spark MLlib Decision Trees Improvement

2015-06-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570828#comment-14570828 ] Apache Spark commented on SPARK-8078: - User 'yang1young' has created a pull request

[jira] [Assigned] (SPARK-8078) Spark MLlib Decision Trees Improvement

2015-06-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8078: --- Assignee: Apache Spark Spark MLlib Decision Trees Improvement

[jira] [Commented] (SPARK-3185) SPARK launch on Hadoop 2 in EC2 throws Tachyon exception when Formatting JOURNAL_FOLDER

2015-06-03 Thread Grzegorz Dubicki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570794#comment-14570794 ] Grzegorz Dubicki commented on SPARK-3185: - Why was this issue closed? It IS a

[jira] [Created] (SPARK-8078) Spark MLlib Decision Trees Improvement

2015-06-03 Thread yangqiao (JIRA)
yangqiao created SPARK-8078: --- Summary: Spark MLlib Decision Trees Improvement Key: SPARK-8078 URL: https://issues.apache.org/jira/browse/SPARK-8078 Project: Spark Issue Type: Improvement

[jira] [Comment Edited] (SPARK-7122) KafkaUtils.createDirectStream - unreasonable processing time in absence of load

2015-06-03 Thread Platon Potapov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570974#comment-14570974 ] Platon Potapov edited comment on SPARK-7122 at 6/3/15 3:10 PM:

[jira] [Created] (SPARK-8081) Problems with Optimized Logical Plan Generation

2015-06-03 Thread Ihor Bobak (JIRA)
Ihor Bobak created SPARK-8081: - Summary: Problems with Optimized Logical Plan Generation Key: SPARK-8081 URL: https://issues.apache.org/jira/browse/SPARK-8081 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-7122) KafkaUtils.createDirectStream - unreasonable processing time in absence of load

2015-06-03 Thread Platon Potapov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570974#comment-14570974 ] Platon Potapov commented on SPARK-7122: --- Nicolas, in your scenario, it appears that

[jira] [Commented] (SPARK-8064) Upgrade Hive to 1.2

2015-06-03 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571228#comment-14571228 ] Yin Huai commented on SPARK-8064: - Seems we do not want to put it under Refactor

[jira] [Commented] (SPARK-7857) IDF w/ minDocFreq on SparseVectors results in literal zeros

2015-06-03 Thread Karl Higley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571220#comment-14571220 ] Karl Higley commented on SPARK-7857: Agreed. numNonZeros works for my use case, but I

[jira] [Commented] (SPARK-4520) SparkSQL exception when reading certain columns from a parquet file

2015-06-03 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571248#comment-14571248 ] Cheng Lian commented on SPARK-4520: --- This issue is related to Parquet backwards

[jira] [Resolved] (SPARK-7973) Increase the timeout of CliSuite's Commands using SerDe provided in --jars and Single command with -e

2015-06-03 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-7973. - Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 6525

[jira] [Commented] (SPARK-8064) Upgrade Hive to 1.2

2015-06-03 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571276#comment-14571276 ] Yin Huai commented on SPARK-8064: - Also, we need to update the built-in metastore client

[jira] [Updated] (SPARK-8094) Calling take on ExecutedCommand and OneRowRelation should not trigger job execution

2015-06-03 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-8094: Summary: Calling take on ExecutedCommand and OneRowRelation should not trigger job execution (was:

[jira] [Resolved] (SPARK-8094) ExecutedCommand and OneRowRelation should not trigger job execution

2015-06-03 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-8094. - Resolution: Duplicate My bad. I was somehow confused. The real problem is described by

[jira] [Created] (SPARK-8095) Spark package dependencies not resolved when package is in local-ivy-cache

2015-06-03 Thread Eron Wright (JIRA)
Eron Wright created SPARK-8095: --- Summary: Spark package dependencies not resolved when package is in local-ivy-cache Key: SPARK-8095 URL: https://issues.apache.org/jira/browse/SPARK-8095 Project:

[jira] [Closed] (SPARK-8078) Spark MLlib Decision Trees Improvement

2015-06-03 Thread yangqiao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yangqiao closed SPARK-8078. --- Resolution: Won't Fix Spark MLlib Decision Trees Improvement --

[jira] [Commented] (SPARK-8095) Spark package dependencies not resolved when package is in local-ivy-cache

2015-06-03 Thread Eron Wright (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14572120#comment-14572120 ] Eron Wright commented on SPARK-8095: - Note that IBiblioResolver::setUsepoms is not

[jira] [Updated] (SPARK-8071) Run PySpark dataframe.rollup/cube test failed

2015-06-03 Thread Weizhong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weizhong updated SPARK-8071: Description: I run test for Spark, and failed on PySpark, details are: File

[jira] [Updated] (SPARK-8092) OneVsRest doesn't allow flexibility in label/ feature column renaming

2015-06-03 Thread Ram Sriharsha (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ram Sriharsha updated SPARK-8092: - Fix Version/s: 1.4.1 OneVsRest doesn't allow flexibility in label/ feature column renaming

[jira] [Created] (SPARK-8094) ExecutedCommand and OneRowRelation should use LocalRelation LocalTableScan

2015-06-03 Thread Yin Huai (JIRA)
Yin Huai created SPARK-8094: --- Summary: ExecutedCommand and OneRowRelation should use LocalRelation LocalTableScan Key: SPARK-8094 URL: https://issues.apache.org/jira/browse/SPARK-8094 Project: Spark

[jira] [Commented] (SPARK-8095) Spark package dependencies not resolved when package is in local-ivy-cache

2015-06-03 Thread Eron Wright (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14572179#comment-14572179 ] Eron Wright commented on SPARK-8095: - Tested with 1.4.0RC4. When package is in

[jira] [Updated] (SPARK-8094) ExecutedCommand and OneRowRelation should not trigger job execution

2015-06-03 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-8094: Description: ExecutedCommand and OneRowRelation are used to store a very small set of rows. We do not need

[jira] [Commented] (SPARK-7205) Support local ivy cache in --packages

2015-06-03 Thread Eron Wright (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14572123#comment-14572123 ] Eron Wright commented on SPARK-7205: - I see a potential issue here and filed

[jira] [Commented] (SPARK-2973) Use LocalRelation for all ExecutedCommands, avoid job for take/collect()

2015-06-03 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14572047#comment-14572047 ] Yin Huai commented on SPARK-2973: - Also, {{sqlContext.tables().select(...).collect}}

[jira] [Closed] (SPARK-7558) Log test name when starting and finishing each test

2015-06-03 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-7558. Resolution: Fixed Fix Version/s: 1.4.1 Log test name when starting and finishing each test

[jira] [Commented] (SPARK-7122) KafkaUtils.createDirectStream - unreasonable processing time in absence of load

2015-06-03 Thread Cody Koeninger (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14572059#comment-14572059 ] Cody Koeninger commented on SPARK-7122: --- If you can try out this patch

[jira] [Commented] (SPARK-8078) Spark MLlib Decision Trees Improvement

2015-06-03 Thread yangqiao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14572115#comment-14572115 ] yangqiao commented on SPARK-8078: - Because this is my first to submit my thoughts to

[jira] [Commented] (SPARK-7942) Receiver's life cycle is inconsistent with streaming job.

2015-06-03 Thread SaintBacchus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14572212#comment-14572212 ] SaintBacchus commented on SPARK-7942: - [~tdas] Now I'm not clear about how to deal

[jira] [Updated] (SPARK-8092) OneVsRest doesn't allow flexibility in label/ feature column renaming

2015-06-03 Thread Ram Sriharsha (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ram Sriharsha updated SPARK-8092: - Component/s: ML OneVsRest doesn't allow flexibility in label/ feature column renaming

[jira] [Assigned] (SPARK-8091) SerializationDebugger does not handle classes with writeObject method

2015-06-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8091: --- Assignee: Tathagata Das (was: Apache Spark) SerializationDebugger does not handle classes

[jira] [Assigned] (SPARK-8091) SerializationDebugger does not handle classes with writeObject method

2015-06-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8091: --- Assignee: Apache Spark (was: Tathagata Das) SerializationDebugger does not handle classes

[jira] [Commented] (SPARK-8091) SerializationDebugger does not handle classes with writeObject method

2015-06-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571965#comment-14571965 ] Apache Spark commented on SPARK-8091: - User 'tdas' has created a pull request for this

[jira] [Updated] (SPARK-8091) SerializationDebugger does not handle classes with writeObject method

2015-06-03 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-8091: - Summary: SerializationDebugger does not handle classes with writeObject method (was:

[jira] [Commented] (SPARK-8095) Spark package dependencies not resolved when package is in local-ivy-cache

2015-06-03 Thread Burak Yavuz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14572128#comment-14572128 ] Burak Yavuz commented on SPARK-8095: In the local ivy cache, it should use the

[jira] [Commented] (SPARK-8078) Spark MLlib Decision Trees Improvement

2015-06-03 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14572130#comment-14572130 ] Joseph K. Bradley commented on SPARK-8078: -- No worries, please do keep

[jira] [Commented] (SPARK-5784) Add StatsDSink to MetricsSystem

2015-06-03 Thread Vidhya Arvind (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14572206#comment-14572206 ] Vidhya Arvind commented on SPARK-5784: -- [~rdub] I tried to add this as package, it's

[jira] [Updated] (SPARK-7819) Isolated Hive Client Loader appears to cause Native Library libMapRClient.4.0.2-mapr.so already loaded in another classloader error

2015-06-03 Thread Fi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fi updated SPARK-7819: -- Attachment: invalidClassException.log Isolated Hive Client Loader appears to cause Native Library

[jira] [Commented] (SPARK-7819) Isolated Hive Client Loader appears to cause Native Library libMapRClient.4.0.2-mapr.so already loaded in another classloader error

2015-06-03 Thread Fi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14572205#comment-14572205 ] Fi commented on SPARK-7819: --- Hello, sorry for not responding sooner, been quite hectic at work.

[jira] [Updated] (SPARK-6776) Implement backwards-compatibility rules in Catalyst converters (which convert Parquet record to rows)

2015-06-03 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6776: -- Summary: Implement backwards-compatibility rules in Catalyst converters (which convert Parquet record

[jira] [Commented] (SPARK-7122) KafkaUtils.createDirectStream - unreasonable processing time in absence of load

2015-06-03 Thread Cody Koeninger (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571454#comment-14571454 ] Cody Koeninger commented on SPARK-7122: --- Nicolas, do you have an actual compilable

[jira] [Updated] (SPARK-6777) Implement backwards-compatibility rules in Parquet schema converters

2015-06-03 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6777: -- Description: When converting Parquet schemas to/from Spark SQL schemas, we should recognize commonly

[jira] [Created] (SPARK-8083) Fix return to drivers link in Mesos driver page

2015-06-03 Thread Timothy Chen (JIRA)
Timothy Chen created SPARK-8083: --- Summary: Fix return to drivers link in Mesos driver page Key: SPARK-8083 URL: https://issues.apache.org/jira/browse/SPARK-8083 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-8083) Fix return to drivers link in Mesos driver page

2015-06-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8083: --- Assignee: Apache Spark Fix return to drivers link in Mesos driver page

[jira] [Updated] (SPARK-6777) Implement backwards-compatibility rules in Parquet schema converters

2015-06-03 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6777: -- Affects Version/s: 1.4.0 Implement backwards-compatibility rules in Parquet schema converters

[jira] [Commented] (SPARK-7900) Reduce number of tagging calls in spark-ec2

2015-06-03 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571460#comment-14571460 ] Nicholas Chammas commented on SPARK-7900: - I'm marking this as a duplicate of

[jira] [Resolved] (SPARK-7900) Reduce number of tagging calls in spark-ec2

2015-06-03 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas resolved SPARK-7900. - Resolution: Duplicate Reduce number of tagging calls in spark-ec2

[jira] [Commented] (SPARK-4983) Add sleep() before tagging EC2 instances to allow instance metadata to propagate

2015-06-03 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571467#comment-14571467 ] Nicholas Chammas commented on SPARK-4983: - Per the discussion on [SPARK-7900], I

[jira] [Commented] (SPARK-7029) Unable to use hive built-in functions in sparkSQL

2015-06-03 Thread Neil Best (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571470#comment-14571470 ] Neil Best commented on SPARK-7029: -- Aditya, did you find a resolution for this? I am

[jira] [Commented] (SPARK-7990) Add methods to facilitate equi-join on multiple join keys

2015-06-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571475#comment-14571475 ] Apache Spark commented on SPARK-7990: - User 'viirya' has created a pull request for

[jira] [Assigned] (SPARK-7990) Add methods to facilitate equi-join on multiple join keys

2015-06-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7990: --- Assignee: (was: Apache Spark) Add methods to facilitate equi-join on multiple join keys

[jira] [Updated] (SPARK-7161) Provide REST api to download event logs from History Server

2015-06-03 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-7161: Assignee: Hari Shreedharan (was: Imran Rashid) Provide REST api to download event logs from

[jira] [Assigned] (SPARK-7990) Add methods to facilitate equi-join on multiple join keys

2015-06-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7990: --- Assignee: Apache Spark Add methods to facilitate equi-join on multiple join keys

[jira] [Closed] (SPARK-7161) Provide REST api to download event logs from History Server

2015-06-03 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid closed SPARK-7161. --- Resolution: Fixed Provide REST api to download event logs from History Server

[jira] [Assigned] (SPARK-7161) Provide REST api to download event logs from History Server

2015-06-03 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid reassigned SPARK-7161: --- Assignee: Imran Rashid Provide REST api to download event logs from History Server

[jira] [Updated] (SPARK-7161) Provide REST api to download event logs from History Server

2015-06-03 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-7161: Fix Version/s: 1.5.0 Provide REST api to download event logs from History Server

[jira] [Updated] (SPARK-8094) ExecutedCommand and OneRowRelation should not trigger job execution

2015-06-03 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-8094: Summary: ExecutedCommand and OneRowRelation should not trigger job execution (was: ExecutedCommand and

<    1   2   3   >