[jira] [Created] (SPARK-18001) Broke link to R DataFrame In sql-programming-guide

2016-10-18 Thread Tommy Yu (JIRA)
Tommy Yu created SPARK-18001: Summary: Broke link to R DataFrame In sql-programming-guide Key: SPARK-18001 URL: https://issues.apache.org/jira/browse/SPARK-18001 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-17982) Spark 2.0.0 CREATE VIEW statement fails :: java.lang.RuntimeException: Failed to analyze the canonicalized SQL. It is possible there is a bug in Spark.

2016-10-18 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587579#comment-15587579 ] Dongjoon Hyun commented on SPARK-17982: --- Hi, [~jiangxb]. I think Spark supports that like MySQL

[jira] [Updated] (SPARK-18001) Broke link to R DataFrame In sql-programming-guide

2016-10-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18001: Assignee: Tommy Yu > Broke link to R DataFrame In sql-programming-guide >

[jira] [Resolved] (SPARK-18001) Broke link to R DataFrame In sql-programming-guide

2016-10-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-18001. - Resolution: Fixed Fix Version/s: 2.1.0 2.0.2 > Broke link to R

[jira] [Commented] (SPARK-16559) Got java.lang.ArithmeticException when Num of Buckets is Set to Zero

2016-10-18 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587711#comment-15587711 ] Dongjoon Hyun commented on SPARK-16559: --- Hi, [~smilegator]. It seems to be resolved in your PR,

[jira] [Assigned] (SPARK-17999) Add getPreferredLocations for KafkaSourceRDD

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17999: Assignee: (was: Apache Spark) > Add getPreferredLocations for KafkaSourceRDD >

[jira] [Assigned] (SPARK-17997) Aggregation function for counting distinct values for multiple intervals

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17997: Assignee: (was: Apache Spark) > Aggregation function for counting distinct values for

[jira] [Assigned] (SPARK-17999) Add getPreferredLocations for KafkaSourceRDD

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17999: Assignee: Apache Spark > Add getPreferredLocations for KafkaSourceRDD >

[jira] [Commented] (SPARK-17892) Query in CTAS is Optimized Twice (branch-2.0)

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587567#comment-15587567 ] Apache Spark commented on SPARK-17892: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Comment Edited] (SPARK-9487) Use the same num. worker threads in Scala/Python unit tests

2016-10-18 Thread Saikat Kanjilal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587627#comment-15587627 ] Saikat Kanjilal edited comment on SPARK-9487 at 10/19/16 4:24 AM: --

[jira] [Comment Edited] (SPARK-9487) Use the same num. worker threads in Scala/Python unit tests

2016-10-18 Thread Saikat Kanjilal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587627#comment-15587627 ] Saikat Kanjilal edited comment on SPARK-9487 at 10/19/16 4:24 AM: --

[jira] [Commented] (SPARK-9487) Use the same num. worker threads in Scala/Python unit tests

2016-10-18 Thread Saikat Kanjilal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587627#comment-15587627 ] Saikat Kanjilal commented on SPARK-9487: [~holdenk] finally getting time to look at this, so I am

[jira] [Created] (SPARK-18003) RDD zipWithIndex generate wrong result when one partition contains more than 2147483647 records.

2016-10-18 Thread Weichen Xu (JIRA)
Weichen Xu created SPARK-18003: -- Summary: RDD zipWithIndex generate wrong result when one partition contains more than 2147483647 records. Key: SPARK-18003 URL: https://issues.apache.org/jira/browse/SPARK-18003

[jira] [Commented] (SPARK-17982) Spark 2.0.0 CREATE VIEW statement fails :: java.lang.RuntimeException: Failed to analyze the canonicalized SQL. It is possible there is a bug in Spark.

2016-10-18 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587583#comment-15587583 ] Dongjoon Hyun commented on SPARK-17982: --- Hi, [~tafra...@gmail.com]. I made a PR for you. It handles

[jira] [Commented] (SPARK-17630) jvm-exit-on-fatal-error handler for spark.rpc.netty like there is available for akka

2016-10-18 Thread Mario Briggs (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587664#comment-15587664 ] Mario Briggs commented on SPARK-17630: -- [~zsxwing] thanks much. any pointers on how/where to add

[jira] [Assigned] (SPARK-18003) RDD zipWithIndex generate wrong result when one partition contains more than 2147483647 records.

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18003: Assignee: Apache Spark > RDD zipWithIndex generate wrong result when one partition

[jira] [Assigned] (SPARK-18003) RDD zipWithIndex generate wrong result when one partition contains more than 2147483647 records.

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18003: Assignee: (was: Apache Spark) > RDD zipWithIndex generate wrong result when one

[jira] [Updated] (SPARK-17074) generate histogram information for column

2016-10-18 Thread Zhenhua Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenhua Wang updated SPARK-17074: - Description: We support two kinds of histograms: - Equi-width histogram: We have a fixed

[jira] [Assigned] (SPARK-18002) Prune unnecessary IsNotNull predicates from Filter

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18002: Assignee: Apache Spark > Prune unnecessary IsNotNull predicates from Filter >

[jira] [Assigned] (SPARK-18002) Prune unnecessary IsNotNull predicates from Filter

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18002: Assignee: (was: Apache Spark) > Prune unnecessary IsNotNull predicates from Filter >

[jira] [Commented] (SPARK-17985) Bump commons-lang3 version to 3.5.

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587625#comment-15587625 ] Apache Spark commented on SPARK-17985: -- User 'ueshin' has created a pull request for this issue:

[jira] [Commented] (SPARK-18002) Prune unnecessary IsNotNull predicates from Filter

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587624#comment-15587624 ] Apache Spark commented on SPARK-18002: -- User 'viirya' has created a pull request for this issue:

[jira] [Updated] (SPARK-9487) Use the same num. worker threads in Scala/Python unit tests

2016-10-18 Thread Saikat Kanjilal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saikat Kanjilal updated SPARK-9487: --- Attachment: ContextCleanerSuiteResults > Use the same num. worker threads in Scala/Python

[jira] [Commented] (SPARK-18003) RDD zipWithIndex generate wrong result when one partition contains more than 2147483647 records.

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587706#comment-15587706 ] Apache Spark commented on SPARK-18003: -- User 'WeichenXu123' has created a pull request for this

[jira] [Updated] (SPARK-18003) RDD zipWithIndex generate wrong result when one partition contains more than 2147483647 records.

2016-10-18 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-18003: --- Component/s: Spark Core > RDD zipWithIndex generate wrong result when one partition contains more

[jira] [Assigned] (SPARK-17982) Spark 2.0.0 CREATE VIEW statement fails :: java.lang.RuntimeException: Failed to analyze the canonicalized SQL. It is possible there is a bug in Spark.

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17982: Assignee: Apache Spark > Spark 2.0.0 CREATE VIEW statement fails ::

[jira] [Commented] (SPARK-17892) Query in CTAS is Optimized Twice (branch-2.0)

2016-10-18 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587574#comment-15587574 ] Dongjoon Hyun commented on SPARK-17892: --- Sorry. It's my mistake. > Query in CTAS is Optimized

[jira] [Commented] (SPARK-17982) Spark 2.0.0 CREATE VIEW statement fails :: java.lang.RuntimeException: Failed to analyze the canonicalized SQL. It is possible there is a bug in Spark.

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587573#comment-15587573 ] Apache Spark commented on SPARK-17982: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-17982) Spark 2.0.0 CREATE VIEW statement fails :: java.lang.RuntimeException: Failed to analyze the canonicalized SQL. It is possible there is a bug in Spark.

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17982: Assignee: (was: Apache Spark) > Spark 2.0.0 CREATE VIEW statement fails ::

[jira] [Updated] (SPARK-9487) Use the same num. worker threads in Scala/Python unit tests

2016-10-18 Thread Saikat Kanjilal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saikat Kanjilal updated SPARK-9487: --- Attachment: HeartbeatReceiverSuiteResults > Use the same num. worker threads in Scala/Python

[jira] [Assigned] (SPARK-16559) Got java.lang.ArithmeticException when Num of Buckets is Set to Zero

2016-10-18 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-16559: --- Assignee: Xiao Li > Got java.lang.ArithmeticException when Num of Buckets is Set to Zero >

[jira] [Updated] (SPARK-18003) RDD zipWithIndex generate wrong result when one partition contains more than 2147483647 records.

2016-10-18 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-18003: --- Description: RDD zipWithIndex generate wrong result when one partition contains more than

[jira] [Resolved] (SPARK-16559) Got java.lang.ArithmeticException when Num of Buckets is Set to Zero

2016-10-18 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-16559. - Resolution: Fixed > Got java.lang.ArithmeticException when Num of Buckets is Set to Zero >

[jira] [Commented] (SPARK-16559) Got java.lang.ArithmeticException when Num of Buckets is Set to Zero

2016-10-18 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587713#comment-15587713 ] Xiao Li commented on SPARK-16559: - Yeah, resolved. > Got java.lang.ArithmeticException when Num of

[jira] [Updated] (SPARK-17873) ALTER TABLE ... RENAME TO ... should allow users to specify database in destination table name

2016-10-18 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-17873: - Assignee: Wenchen Fan (was: Apache Spark) > ALTER TABLE ... RENAME TO ... should allow users to specify

[jira] [Resolved] (SPARK-17873) ALTER TABLE ... RENAME TO ... should allow users to specify database in destination table name

2016-10-18 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-17873. -- Resolution: Fixed Fix Version/s: 2.1.0 This issue has been resolved by

[jira] [Commented] (SPARK-17987) ML Evaluator fails to handle null values in the dataset

2016-10-18 Thread bo song (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587530#comment-15587530 ] bo song commented on SPARK-17987: - There is a common case in cross validation, suppose f1 is a

[jira] [Assigned] (SPARK-17997) Aggregation function for counting distinct values for multiple intervals

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17997: Assignee: Apache Spark > Aggregation function for counting distinct values for multiple

[jira] [Commented] (SPARK-17997) Aggregation function for counting distinct values for multiple intervals

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587548#comment-15587548 ] Apache Spark commented on SPARK-17997: -- User 'wzhfy' has created a pull request for this issue:

[jira] [Created] (SPARK-18002) Prune unnecessary IsNotNull predicates from Filter

2016-10-18 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-18002: --- Summary: Prune unnecessary IsNotNull predicates from Filter Key: SPARK-18002 URL: https://issues.apache.org/jira/browse/SPARK-18002 Project: Spark

[jira] [Commented] (SPARK-17982) Spark 2.0.0 CREATE VIEW statement fails :: java.lang.RuntimeException: Failed to analyze the canonicalized SQL. It is possible there is a bug in Spark.

2016-10-18 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587659#comment-15587659 ] Jiang Xingbo commented on SPARK-17982: -- You are right, just made a mistake. Sorry for that! > Spark

[jira] [Assigned] (SPARK-18001) Broke link to R DataFrame In sql-programming-guide

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18001: Assignee: (was: Apache Spark) > Broke link to R DataFrame In sql-programming-guide >

[jira] [Commented] (SPARK-18001) Broke link to R DataFrame In sql-programming-guide

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587539#comment-15587539 ] Apache Spark commented on SPARK-18001: -- User 'Wenpei' has created a pull request for this issue:

[jira] [Assigned] (SPARK-18001) Broke link to R DataFrame In sql-programming-guide

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18001: Assignee: Apache Spark > Broke link to R DataFrame In sql-programming-guide >

[jira] [Commented] (SPARK-14393) monotonicallyIncreasingId not monotonically increasing with downstream coalesce

2016-10-18 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15584761#comment-15584761 ] Xiangrui Meng commented on SPARK-14393: --- This is a bigger issue. It would happen with

[jira] [Updated] (SPARK-17988) How could I run includePackage in sparkR

2016-10-18 Thread cobb xia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cobb xia updated SPARK-17988: - Description: includePackage not included in /pkg/NAMESPACE ,so it could not be seen in sparkR,when

[jira] [Resolved] (SPARK-17988) How could I run includePackage in sparkR

2016-10-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17988. --- Resolution: Invalid See https://cwiki.apache.org/confluence/display/SPARK/Contributing+to+Spark and

[jira] [Commented] (SPARK-17731) Metrics for Structured Streaming

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15584815#comment-15584815 ] Apache Spark commented on SPARK-17731: -- User 'tdas' has created a pull request for this issue:

[jira] [Closed] (SPARK-14938) Use Datasets.as to improve internal implementation

2016-10-18 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng closed SPARK-14938. Resolution: Not A Problem > Use Datasets.as to improve internal implementation >

[jira] [Issue Comment Deleted] (SPARK-11115) Host verification is not correct for IPv6

2016-10-18 Thread Tao Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Meng updated SPARK-5: - Comment: was deleted (was: Yes. Maybe the method name is not very accurate. It is better to change

[jira] [Issue Comment Deleted] (SPARK-17987) ML Evaluator fails to handle null values in the dataset

2016-10-18 Thread bo song (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bo song updated SPARK-17987: Comment: was deleted (was: Thanks for your comments. When evaluation involves in cross validation, there

[jira] [Commented] (SPARK-17987) ML Evaluator fails to handle null values in the dataset

2016-10-18 Thread bo song (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15585016#comment-15585016 ] bo song commented on SPARK-17987: - Thanks for your comments. When evaluation involves in cross

[jira] [Commented] (SPARK-14767) Codegen "no constructor found" errors with Maps inside case classes in Datasets

2016-10-18 Thread Juri Paern (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15584782#comment-15584782 ] Juri Paern commented on SPARK-14767: We updated to spark 2.0.1 and face now this issue. Any idea when

[jira] [Commented] (SPARK-5925) YARN - Spark progress bar stucks at 10% but after finishing shows 100%

2016-10-18 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15584969#comment-15584969 ] Steve Loughran commented on SPARK-5925: --- looking at this, I'm confused about what I'd written

[jira] [Commented] (SPARK-17984) Add support for numa aware feature

2016-10-18 Thread quanfuwang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15584968#comment-15584968 ] quanfuwang commented on SPARK-17984: NUMA is a model for cores and memory. For modern CPU there are

[jira] [Comment Edited] (SPARK-17982) Spark 2.0.0 CREATE VIEW statement fails when select statement contains limit clause

2016-10-18 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15585061#comment-15585061 ] Jiang Xingbo edited comment on SPARK-17982 at 10/18/16 10:16 AM: - Hi,

[jira] [Commented] (SPARK-17910) Allow users to update the comment of a column

2016-10-18 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15585121#comment-15585121 ] Jiang Xingbo commented on SPARK-17910: -- Hi, If no one is working on this, I'd like to have a try.

[jira] [Created] (SPARK-17988) How could I run includePackage in sparkR

2016-10-18 Thread cobb xia (JIRA)
cobb xia created SPARK-17988: Summary: How could I run includePackage in sparkR Key: SPARK-17988 URL: https://issues.apache.org/jira/browse/SPARK-17988 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-17984) Add support for numa aware feature

2016-10-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15584975#comment-15584975 ] Sean Owen commented on SPARK-17984: --- Hm, it sounds like you mean it is on by default but not supported

[jira] [Resolved] (SPARK-9931) Flaky test: mllib/tests.py StreamingLogisticRegressionWithSGDTests. test_training_and_prediction

2016-10-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9931. -- Resolution: Cannot Reproduce > Flaky test: mllib/tests.py StreamingLogisticRegressionWithSGDTests. >

[jira] [Commented] (SPARK-17987) ML Evaluator fails to handle null values in the dataset

2016-10-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15584956#comment-15584956 ] Sean Owen commented on SPARK-17987: --- I think this is on purpose. There's no meaningful way to handle a

[jira] [Commented] (SPARK-17982) Spark 2.0.0 CREATE VIEW statement fails when select statement contains limit clause

2016-10-18 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15585061#comment-15585061 ] Jiang Xingbo commented on SPARK-17982: -- Thank you for reporting! I'll look at this issue. > Spark

[jira] [Resolved] (SPARK-17973) is there any way to split Dataset into 2 or more based on the given condition

2016-10-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17973. --- Resolution: Not A Problem Questions should go on the mailing list:

[jira] [Updated] (SPARK-17862) Feature flag SPARK-16980

2016-10-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-17862: -- Assignee: Eric Liang Priority: Trivial (was: Major) > Feature flag SPARK-16980 >

[jira] [Comment Edited] (SPARK-14393) monotonicallyIncreasingId not monotonically increasing with downstream coalesce

2016-10-18 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15584761#comment-15584761 ] Xiangrui Meng edited comment on SPARK-14393 at 10/18/16 7:43 AM: - This is

[jira] [Commented] (SPARK-14938) Use Datasets.as to improve internal implementation

2016-10-18 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15584871#comment-15584871 ] zhengruifeng commented on SPARK-14938: -- This jira is out of date. I think it's time to close it. >

[jira] [Commented] (SPARK-17987) ML Evaluator fails to handle null values in the dataset

2016-10-18 Thread bo song (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15585019#comment-15585019 ] bo song commented on SPARK-17987: - Thanks for your comments. When evaluation involves in cross

[jira] [Updated] (SPARK-17984) Add support for numa aware feature

2016-10-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-17984: -- Target Version/s: (was: 2.0.1) Fix Version/s: (was: 2.0.1) > Add support for numa aware

[jira] [Commented] (SPARK-15708) Tasks table in Detailed Stage page shows ip instead of hostname under Executor ID/Host

2016-10-18 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15585451#comment-15585451 ] Thomas Graves commented on SPARK-15708: --- [~ajbozarth] It was closed because we weren't able to

[jira] [Commented] (SPARK-10872) Derby error (XSDB6) when creating new HiveContext after restarting SparkContext

2016-10-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15584938#comment-15584938 ] Sean Owen commented on SPARK-10872: --- If you see a place where the DB or metastore can obviously be

[jira] [Commented] (SPARK-17987) ML Evaluator fails to handle null values in the dataset

2016-10-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15585082#comment-15585082 ] Sean Owen commented on SPARK-17987: --- This amounts to assuming that any row that has no prediction

[jira] [Commented] (SPARK-17989) Check ascendingOrder type in sort_array function ahead

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15585855#comment-15585855 ] Apache Spark commented on SPARK-17989: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-17989) Check ascendingOrder type in sort_array function ahead

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17989: Assignee: Apache Spark > Check ascendingOrder type in sort_array function ahead >

[jira] [Assigned] (SPARK-17989) Check ascendingOrder type in sort_array function ahead

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17989: Assignee: (was: Apache Spark) > Check ascendingOrder type in sort_array function

[jira] [Commented] (SPARK-15769) Add Encoder for input type to Aggregator

2016-10-18 Thread koert kuipers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15585931#comment-15585931 ] koert kuipers commented on SPARK-15769: --- worth pointing out: * adding an encoder to the input type

[jira] [Created] (SPARK-17989) Check ascendingOrder type in sort_array function ahead

2016-10-18 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-17989: Summary: Check ascendingOrder type in sort_array function ahead Key: SPARK-17989 URL: https://issues.apache.org/jira/browse/SPARK-17989 Project: Spark Issue

[jira] [Updated] (SPARK-17891) SQL-based three column join loses first column

2016-10-18 Thread Eli Miller (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Miller updated SPARK-17891: --- Issue Type: Bug (was: Question) > SQL-based three column join loses first column >

[jira] [Commented] (SPARK-17979) Remove deprecated support for config SPARK_YARN_USER_ENV

2016-10-18 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15585664#comment-15585664 ] Thomas Graves commented on SPARK-17979: --- We already had a jira to remove all the deprecated

[jira] [Commented] (SPARK-17983) Can't filter over mixed case parquet columns of converted Hive tables

2016-10-18 Thread Michael Allman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586116#comment-15586116 ] Michael Allman commented on SPARK-17983: Speaking strictly from the POV of parquet predicate

[jira] [Commented] (SPARK-10915) Add support for UDAFs in Python

2016-10-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586172#comment-15586172 ] Reynold Xin commented on SPARK-10915: - Hm I don't think [~mgummelt] knows SQL at all. Not sure how

[jira] [Commented] (SPARK-17862) Feature flag SPARK-16980

2016-10-18 Thread Eric Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586210#comment-15586210 ] Eric Liang commented on SPARK-17862: Yes, this is the flag: {code} val

[jira] [Updated] (SPARK-17751) Remove spark.sql.eagerAnalysis

2016-10-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-17751: Fix Version/s: 2.0.2 > Remove spark.sql.eagerAnalysis > -- > >

[jira] [Updated] (SPARK-17219) QuantileDiscretizer does strange things with NaN values

2016-10-18 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-17219: -- Fix Version/s: (was: 2.1.0) > QuantileDiscretizer does strange things with NaN

[jira] [Updated] (SPARK-17219) QuantileDiscretizer does strange things with NaN values

2016-10-18 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-17219: -- Affects Version/s: 2.1.0 2.0.1 > QuantileDiscretizer does

[jira] [Reopened] (SPARK-17219) QuantileDiscretizer does strange things with NaN values

2016-10-18 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley reopened SPARK-17219: --- > QuantileDiscretizer does strange things with NaN values >

[jira] [Commented] (SPARK-10915) Add support for UDAFs in Python

2016-10-18 Thread Tobi Bosede (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586159#comment-15586159 ] Tobi Bosede commented on SPARK-10915: - Ah ok. Well maybe we can implement an interquartile (IQR)

[jira] [Created] (SPARK-17990) ALTER TABLE ... ADD PARTITION does not play nice with mixed-case partition column names

2016-10-18 Thread Michael Allman (JIRA)
Michael Allman created SPARK-17990: -- Summary: ALTER TABLE ... ADD PARTITION does not play nice with mixed-case partition column names Key: SPARK-17990 URL: https://issues.apache.org/jira/browse/SPARK-17990

[jira] [Resolved] (SPARK-17862) Feature flag SPARK-16980

2016-10-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17862. --- Resolution: Done > Feature flag SPARK-16980 > > > Key:

[jira] [Commented] (SPARK-17974) Refactor FileCatalog classes to simplify the inheritance tree

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586229#comment-15586229 ] Apache Spark commented on SPARK-17974: -- User 'ericl' has created a pull request for this issue:

[jira] [Comment Edited] (SPARK-17983) Can't filter over mixed case parquet columns of converted Hive tables

2016-10-18 Thread Michael Allman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586018#comment-15586018 ] Michael Allman edited comment on SPARK-17983 at 10/18/16 5:23 PM: -- cc

[jira] [Commented] (SPARK-17983) Can't filter over mixed case parquet columns of converted Hive tables

2016-10-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586069#comment-15586069 ] Reynold Xin commented on SPARK-17983: - [~michael] [~ekhliang] can we put all the tickets related to

[jira] [Updated] (SPARK-17219) QuantileDiscretizer should handle NaN values gracefully

2016-10-18 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-17219: -- Summary: QuantileDiscretizer should handle NaN values gracefully (was:

[jira] [Updated] (SPARK-17219) QuantileDiscretizer should handle NaN values gracefully

2016-10-18 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-17219: -- Affects Version/s: (was: 2.0.1) (was: 2.1.0)

[jira] [Commented] (SPARK-17983) Can't filter over mixed case parquet columns of converted Hive tables

2016-10-18 Thread Michael Allman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586018#comment-15586018 ] Michael Allman commented on SPARK-17983: cc [~rxin] I had a feeling there might be some fallout

[jira] [Updated] (SPARK-17983) Can't filter over mixed case parquet columns of converted Hive tables

2016-10-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-17983: Issue Type: Sub-task (was: Bug) Parent: SPARK-17861 > Can't filter over mixed case

[jira] [Commented] (SPARK-17983) Can't filter over mixed case parquet columns of converted Hive tables

2016-10-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586090#comment-15586090 ] Reynold Xin commented on SPARK-17983: - I'm really tempted to say everything in Spark SQL for the time

[jira] [Commented] (SPARK-17983) Can't filter over mixed case parquet columns of converted Hive tables

2016-10-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586121#comment-15586121 ] Reynold Xin commented on SPARK-17983: - We can update Parquet to make it case insensitive too. >

[jira] [Commented] (SPARK-17983) Can't filter over mixed case parquet columns of converted Hive tables

2016-10-18 Thread Michael Allman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586133#comment-15586133 ] Michael Allman commented on SPARK-17983: Hmmm... not sure what you mean. You talking about

[jira] [Comment Edited] (SPARK-17983) Can't filter over mixed case parquet columns of converted Hive tables

2016-10-18 Thread Michael Allman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586133#comment-15586133 ] Michael Allman edited comment on SPARK-17983 at 10/18/16 5:49 PM: --

[jira] [Updated] (SPARK-17219) QuantileDiscretizer should handle NaN values gracefully

2016-10-18 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-17219: -- Shepherd: Joseph K. Bradley > QuantileDiscretizer should handle NaN values gracefully

  1   2   3   >