[jira] [Commented] (SPARK-25695) Spark history server event log store problem

2018-10-10 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644503#comment-16644503 ] shahid commented on SPARK-25695: Hi, This error seems, eventLog directory doesn't exist in your

[jira] [Updated] (SPARK-25566) [Spark Job History] SQL UI Page does not support Pagination

2018-10-06 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-25566: --- Description: 1. configure spark.sql.ui.retainedExecutions = 5 ( In Job History Spark-default.conf ) 2.

[jira] [Updated] (SPARK-25566) [Spark Job History] SQL UI Page does not support Pagination

2018-10-06 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-25566: --- Attachment: Screenshot from 2018-10-06 09-46-11.png > [Spark Job History] SQL UI Page does not support

[jira] [Updated] (SPARK-25583) Add newly added History server related configurations in the documentation

2018-10-01 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-25583: --- Priority: Minor (was: Trivial) > Add newly added History server related configurations in the

[jira] [Created] (SPARK-25583) Add newly added History server related configurations in the documentation

2018-10-01 Thread shahid (JIRA)
shahid created SPARK-25583: -- Summary: Add newly added History server related configurations in the documentation Key: SPARK-25583 URL: https://issues.apache.org/jira/browse/SPARK-25583 Project: Spark

[jira] [Updated] (SPARK-25575) SQL tab in the spark UI doesn't have option of hiding tables, eventhough other UI tabs has.

2018-09-29 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-25575: --- Attachment: Screenshot from 2018-09-29 23-26-57.png > SQL tab in the spark UI doesn't have option of

[jira] [Updated] (SPARK-25575) SQL tab in the spark UI doesn't have option of hiding tables, eventhough other UI tabs has.

2018-09-29 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-25575: --- Description: Test tests: 1) bin/spark-shell {code:java} sql("create table a (id int)") for(i <- 1 to 100)

[jira] [Updated] (SPARK-25575) SQL tab in the spark UI doesn't have option of hiding tables, eventhough other UI tabs has.

2018-09-29 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-25575: --- Attachment: Screenshot from 2018-09-29 23-26-45.png > SQL tab in the spark UI doesn't have option of

[jira] [Commented] (SPARK-25575) SQL tab in the spark UI doesn't have option of hiding tables, eventhough other UI tabs has.

2018-09-29 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16633082#comment-16633082 ] shahid commented on SPARK-25575: I will raise a PR > SQL tab in the spark UI doesn't have option of

[jira] [Created] (SPARK-25575) SQL tab in the spark UI doesn't have option of hiding tables, eventhough other UI tabs has.

2018-09-29 Thread shahid (JIRA)
shahid created SPARK-25575: -- Summary: SQL tab in the spark UI doesn't have option of hiding tables, eventhough other UI tabs has. Key: SPARK-25575 URL: https://issues.apache.org/jira/browse/SPARK-25575

[jira] [Commented] (SPARK-25567) [Spark Job History] Table listing in SQL Tab not display Sort Icon

2018-09-28 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16631711#comment-16631711 ] shahid commented on SPARK-25567: Thanks. I will raise a PR > [Spark Job History] Table listing in SQL

[jira] [Commented] (SPARK-25566) [Spark Job History] SQL UI Page does not support Pagination

2018-09-28 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16631703#comment-16631703 ] shahid commented on SPARK-25566: Thanks for reporting. I am working on it. > [Spark Job History] SQL UI

[jira] [Commented] (SPARK-25502) [Spark Job History] Empty Page when page number exceeds the reatinedTask size

2018-09-26 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16628588#comment-16628588 ] shahid commented on SPARK-25502: [~toopt4] No. please refer the PR, to see the fix > [Spark Job

[jira] [Comment Edited] (SPARK-25536) executorSource.METRIC read wrong record in Executor.scala Line444

2018-09-26 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16628267#comment-16628267 ] shahid edited comment on SPARK-25536 at 9/26/18 7:18 AM: - Thanks. I will raise a

[jira] [Commented] (SPARK-25536) executorSource.METRIC read wrong record in Executor.scala Line444

2018-09-25 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16628267#comment-16628267 ] shahid commented on SPARK-25536: I will raise a pr > executorSource.METRIC read wrong record in

[jira] [Updated] (SPARK-25533) Inconsistent message for Completed Jobs in the JobUI, when there are failed jobs, compared to spark2.2

2018-09-25 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-25533: --- Description: Test steps:  1) bin/spark-shell {code:java} sc.parallelize(1 to 5, 5).collect()

[jira] [Updated] (SPARK-25533) Inconsistent message for Completed Jobs in the JobUI, when there are failed jobs, compared to spark2.2

2018-09-25 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-25533: --- Summary: Inconsistent message for Completed Jobs in the JobUI, when there are failed jobs, compared to

[jira] [Updated] (SPARK-25533) Inconsistent message of Completed Jobs in the JobUI, when there are failed jobs, compared to spark2.2

2018-09-25 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-25533: --- Attachment: (was: Screenshot from 2018-09-26 00-42-00.png) > Inconsistent message of Completed Jobs in

[jira] [Updated] (SPARK-25533) Inconsistent message of Completed Jobs in the JobUI, when there are failed jobs, compared to spark2.2

2018-09-25 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-25533: --- Description: Test steps:  1) bin/spark-shell {code:java} sc.parallelize(1 to 5, 5).collect()

[jira] [Updated] (SPARK-25533) Inconsistent message of Completed Jobs in the JobUI, when there are failed jobs, compared to spark2.2

2018-09-25 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-25533: --- Attachment: Screenshot from 2018-09-26 00-46-35.png > Inconsistent message of Completed Jobs in the JobUI,

[jira] [Updated] (SPARK-25533) Inconsistent message of Completed Jobs in the JobUI, when there are failed jobs, compared to spark2.2

2018-09-25 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-25533: --- Attachment: Screenshot from 2018-09-26 00-42-00.png > Inconsistent message of Completed Jobs in the JobUI,

[jira] [Commented] (SPARK-25533) Inconsistent message of Completed Jobs in the JobUI, when there are failed jobs, compared to spark2.2

2018-09-25 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16627823#comment-16627823 ] shahid commented on SPARK-25533: I am working on it. > Inconsistent message of Completed Jobs in the

[jira] [Updated] (SPARK-25533) Inconsistent message of Completed Jobs in the JobUI, when there are failed jobs, compared to spark2.2

2018-09-25 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-25533: --- Attachment: Screenshot from 2018-09-26 00-42-00.png > Inconsistent message of Completed Jobs in the JobUI,

[jira] [Created] (SPARK-25533) Inconsistent message of Completed Jobs in the JobUI, when there are failed jobs, compared to spark2.2

2018-09-25 Thread shahid (JIRA)
shahid created SPARK-25533: -- Summary: Inconsistent message of Completed Jobs in the JobUI, when there are failed jobs, compared to spark2.2 Key: SPARK-25533 URL: https://issues.apache.org/jira/browse/SPARK-25533

[jira] [Commented] (SPARK-25502) [Spark Job History] Empty Page when page number exceeds the reatinedTask size

2018-09-24 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626628#comment-16626628 ] shahid commented on SPARK-25502: Hi [~vanzin], Could you please change the Assignee to my name, as

[jira] [Comment Edited] (SPARK-25502) [Spark Job History] Empty Page when page number exceeds the reatinedTask size

2018-09-23 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16624695#comment-16624695 ] shahid edited comment on SPARK-25502 at 9/23/18 1:00 PM: - I have raised PR

[jira] [Comment Edited] (SPARK-25448) [Spark Job History] Job Staged page shows 1000 Jobs only

2018-09-23 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625093#comment-16625093 ] shahid edited comment on SPARK-25448 at 9/23/18 12:51 PM: -- I am not able to

[jira] [Issue Comment Deleted] (SPARK-25504) [Spark Job History]If the number of tasks exceeds spark.ui.retainedTask value, then stage page of UI should display upto the value set in the retainedTask.

2018-09-23 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-25504: --- Comment: was deleted (was: I am analyzing the issue. Will raise a PR soon.) > [Spark Job History]If the

[jira] [Commented] (SPARK-25504) [Spark Job History]If the number of tasks exceeds spark.ui.retainedTask value, then stage page of UI should display upto the value set in the retainedTask.

2018-09-23 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625095#comment-16625095 ] shahid commented on SPARK-25504: According to the code in the AppStatusListener.scala,

[jira] [Updated] (SPARK-25504) [Spark Job History]If the number of tasks exceeds spark.ui.retainedTask value, then stage page of UI should display upto the value set in the retainedTask.

2018-09-23 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-25504: --- Attachment: AppStatusListener.png > [Spark Job History]If the number of tasks exceeds spark.ui.retainedTask

[jira] [Commented] (SPARK-25448) [Spark Job History] Job Staged page shows 1000 Jobs only

2018-09-23 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625093#comment-16625093 ] shahid commented on SPARK-25448: I am not able to reproduce the issue with spark2.3.1 Test steps: 1)

[jira] [Updated] (SPARK-25448) [Spark Job History] Job Staged page shows 1000 Jobs only

2018-09-23 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-25448: --- Attachment: (was: historyJobs.jpg) > [Spark Job History] Job Staged page shows 1000 Jobs only >

[jira] [Updated] (SPARK-25448) [Spark Job History] Job Staged page shows 1000 Jobs only

2018-09-23 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-25448: --- Attachment: image-2018-09-23-18-01-35-554.png > [Spark Job History] Job Staged page shows 1000 Jobs only >

[jira] [Updated] (SPARK-25448) [Spark Job History] Job Staged page shows 1000 Jobs only

2018-09-23 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-25448: --- Attachment: historyJobs.jpg > [Spark Job History] Job Staged page shows 1000 Jobs only >

[jira] [Updated] (SPARK-25448) [Spark Job History] Job Staged page shows 1000 Jobs only

2018-09-23 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-25448: --- Attachment: (was: jobpage.png) > [Spark Job History] Job Staged page shows 1000 Jobs only >

[jira] [Issue Comment Deleted] (SPARK-25448) [Spark Job History] Job Staged page shows 1000 Jobs only

2018-09-23 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-25448: --- Comment: was deleted (was: I am not able to reproduce the issue with the below steps 1) bin/spark-shell

[jira] [Commented] (SPARK-25448) [Spark Job History] Job Staged page shows 1000 Jobs only

2018-09-23 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625075#comment-16625075 ] shahid commented on SPARK-25448: I am not able to reproduce the issue with the below steps 1)

[jira] [Updated] (SPARK-25448) [Spark Job History] Job Staged page shows 1000 Jobs only

2018-09-23 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-25448: --- Attachment: jobpage.png > [Spark Job History] Job Staged page shows 1000 Jobs only >

[jira] [Commented] (SPARK-25502) [Spark Job History] Empty Page when page number exceeds the reatinedTask size

2018-09-22 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16624695#comment-16624695 ] shahid commented on SPARK-25502: I have raised PR https://github.com/apache/spark/pull/22502 > [Spark

[jira] [Commented] (SPARK-25503) [Spark Job History] Total task message in stage page is ambiguous

2018-09-22 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16624683#comment-16624683 ] shahid commented on SPARK-25503: I have raised the PR https://github.com/apache/spark/pull/22525 >

[jira] [Commented] (SPARK-25504) [Spark Job History]If the number of tasks exceeds spark.ui.retainedTask value, then stage page of UI should display upto the value set in the retainedTask.

2018-09-21 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623391#comment-16623391 ] shahid commented on SPARK-25504: I am analyzing the issue. Will raise a PR soon. > [Spark Job

[jira] [Commented] (SPARK-25503) [Spark Job History] Total task message in stage page is ambiguous

2018-09-21 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623364#comment-16623364 ] shahid commented on SPARK-25503: I am working on it. will raise a PR soon > [Spark Job History] Total

[jira] [Commented] (SPARK-25502) [Spark Job History] Empty Page when page number exceeds the reatinedTask size

2018-09-21 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623350#comment-16623350 ] shahid commented on SPARK-25502: I am working on it. Will raise a PR. > [Spark Job History] Empty Page

[jira] [Comment Edited] (SPARK-25246) When the spark.eventLog.compress is enabled, the Application is not showing in the History server UI ('incomplete application' page), initially.

2018-09-20 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622588#comment-16622588 ] shahid edited comment on SPARK-25246 at 9/20/18 7:36 PM: - [~devaraj.k], Ideally

[jira] [Comment Edited] (SPARK-25246) When the spark.eventLog.compress is enabled, the Application is not showing in the History server UI ('incomplete application' page), initially.

2018-09-20 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622588#comment-16622588 ] shahid edited comment on SPARK-25246 at 9/20/18 7:35 PM: - [~devaraj.k], Ideally

[jira] [Commented] (SPARK-25246) When the spark.eventLog.compress is enabled, the Application is not showing in the History server UI ('incomplete application' page), initially.

2018-09-20 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622588#comment-16622588 ] shahid commented on SPARK-25246: [~devaraj.k], Ideally when the application start, it should display in

[jira] [Commented] (SPARK-25474) Size in bytes of the query is coming in EB in case of parquet datasource

2018-09-20 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622065#comment-16622065 ] shahid commented on SPARK-25474: Thanks [~Ayush007], [~sandeep.katta2007], I am working on it. I will

[jira] [Commented] (SPARK-25246) When the spark.eventLog.compress is enabled, the Application is not showing in the History server UI ('incomplete application' page), initially.

2018-08-30 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16597142#comment-16597142 ] shahid commented on SPARK-25246: cc [~vanzin] > When the spark.eventLog.compress is enabled, the

[jira] [Issue Comment Deleted] (SPARK-25246) When the spark.eventLog.compress is enabled, the Application is not showing in the History server UI ('incomplete application' page), initially.

2018-08-29 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-25246: --- Comment: was deleted (was: I am working on it :)) > When the spark.eventLog.compress is enabled, the

[jira] [Commented] (SPARK-25246) When the spark.eventLog.compress is enabled, the Application is not showing in the History server UI ('incomplete application' page), initially.

2018-08-26 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16593040#comment-16593040 ] shahid commented on SPARK-25246: I am working on it :) > When the spark.eventLog.compress is enabled,

[jira] [Created] (SPARK-25246) When the spark.eventLog.compress is enabled, the Application is not showing in the History server UI ('incomplete application' page), initially.

2018-08-26 Thread shahid (JIRA)
shahid created SPARK-25246: -- Summary: When the spark.eventLog.compress is enabled, the Application is not showing in the History server UI ('incomplete application' page), initially. Key: SPARK-25246 URL:

[jira] [Updated] (SPARK-18230) MatrixFactorizationModel.recommendProducts throws NoSuchElement exception when the user does not exist

2018-07-09 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-18230: --- Fix Version/s: 2.4.0 > MatrixFactorizationModel.recommendProducts throws NoSuchElement exception > when

[jira] [Commented] (SPARK-24484) Power Iteration Clustering is giving incorrect clustering results when there are mutiple leading eigen values.

2018-06-24 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16521847#comment-16521847 ] shahid commented on SPARK-24484: I have raised a PR, https://github.com/apache/spark/pull/21627 > Power

[jira] [Updated] (SPARK-24484) Power Iteration Clustering is giving incorrect clustering results when there are mutiple leading eigen values.

2018-06-11 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-24484: --- Priority: Major (was: Minor) > Power Iteration Clustering is giving incorrect clustering results when

[jira] [Resolved] (SPARK-24213) Power Iteration Clustering in the SparkML throws exception, when the ID is IntType

2018-06-08 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid resolved SPARK-24213. Resolution: Fixed > Power Iteration Clustering in the SparkML throws exception, when the ID is > IntType

[jira] [Resolved] (SPARK-24217) Power Iteration Clustering is not displaying cluster indices corresponding to some vertices.

2018-06-08 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid resolved SPARK-24217. Resolution: Fixed > Power Iteration Clustering is not displaying cluster indices corresponding to > some

[jira] [Created] (SPARK-24489) No check for invalid input type of weight data in ml.PowerIterationClustering

2018-06-07 Thread shahid (JIRA)
shahid created SPARK-24489: -- Summary: No check for invalid input type of weight data in ml.PowerIterationClustering Key: SPARK-24489 URL: https://issues.apache.org/jira/browse/SPARK-24489 Project: Spark

[jira] [Updated] (SPARK-24484) Power Iteration Clustering is giving incorrect clustering results when there are mutiple leading eigen values.

2018-06-07 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-24484: --- Summary: Power Iteration Clustering is giving incorrect clustering results when there are mutiple leading

[jira] [Created] (SPARK-24484) Power Iteration Clustering is giving incorrect clustering results when mutiple leading eigen values.

2018-06-07 Thread shahid (JIRA)
shahid created SPARK-24484: -- Summary: Power Iteration Clustering is giving incorrect clustering results when mutiple leading eigen values. Key: SPARK-24484 URL: https://issues.apache.org/jira/browse/SPARK-24484

[jira] [Commented] (SPARK-15784) Add Power Iteration Clustering to spark.ml

2018-05-11 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16471545#comment-16471545 ] shahid commented on SPARK-15784: Hi [~josephkb] , I can work on it. > Add Power Iteration Clustering to

[jira] [Issue Comment Deleted] (SPARK-24217) Power Iteration Clustering is not displaying cluster indices corresponding to some vertices.

2018-05-10 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-24217: --- Comment: was deleted (was: Thanks for the clarification Joseph K. Bradley Is it really required to append

[jira] [Comment Edited] (SPARK-24217) Power Iteration Clustering is not displaying cluster indices corresponding to some vertices.

2018-05-10 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16471128#comment-16471128 ] shahid edited comment on SPARK-24217 at 5/10/18 9:28 PM: - Thanks for the

[jira] [Comment Edited] (SPARK-24217) Power Iteration Clustering is not displaying cluster indices corresponding to some vertices.

2018-05-10 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16471128#comment-16471128 ] shahid edited comment on SPARK-24217 at 5/10/18 9:26 PM: - Thanks for the

[jira] [Comment Edited] (SPARK-24217) Power Iteration Clustering is not displaying cluster indices corresponding to some vertices.

2018-05-10 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16471128#comment-16471128 ] shahid edited comment on SPARK-24217 at 5/10/18 9:23 PM: - Thanks for the

[jira] [Comment Edited] (SPARK-24217) Power Iteration Clustering is not displaying cluster indices corresponding to some vertices.

2018-05-10 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16471128#comment-16471128 ] shahid edited comment on SPARK-24217 at 5/10/18 9:19 PM: - Thanks for the

[jira] [Issue Comment Deleted] (SPARK-24217) Power Iteration Clustering is not displaying cluster indices corresponding to some vertices.

2018-05-10 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-24217: --- Comment: was deleted (was: Thanks for the clarification.  Is it really required to append the result with

[jira] [Commented] (SPARK-24217) Power Iteration Clustering is not displaying cluster indices corresponding to some vertices.

2018-05-10 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16471128#comment-16471128 ] shahid commented on SPARK-24217: Thanks for the clarification Joseph K. Bradley Is it really required

[jira] [Comment Edited] (SPARK-24217) Power Iteration Clustering is not displaying cluster indices corresponding to some vertices.

2018-05-10 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16471040#comment-16471040 ] shahid edited comment on SPARK-24217 at 5/10/18 9:15 PM: - Thanks for the

[jira] [Comment Edited] (SPARK-24217) Power Iteration Clustering is not displaying cluster indices corresponding to some vertices.

2018-05-10 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16471040#comment-16471040 ] shahid edited comment on SPARK-24217 at 5/10/18 9:11 PM: - Thanks for the

[jira] [Comment Edited] (SPARK-22192) An RDD of nested POJO objects cannot be converted into a DataFrame using SQLContext.createDataFrame API

2017-10-09 Thread Asif Hussain Shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16191526#comment-16191526 ] Asif Hussain Shahid edited comment on SPARK-22192 at 10/10/17 5:46 AM:

[jira] [Commented] (SPARK-22192) An RDD of nested POJO objects cannot be converted into a DataFrame using SQLContext.createDataFrame API

2017-10-04 Thread Asif Hussain Shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16191526#comment-16191526 ] Asif Hussain Shahid commented on SPARK-22192: - The PR opened for this bug is

[jira] [Commented] (SPARK-22192) An RDD of nested POJO objects cannot be converted into a DataFrame using SQLContext.createDataFrame API

2017-10-03 Thread Asif Hussain Shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16190852#comment-16190852 ] Asif Hussain Shahid commented on SPARK-22192: - Not at all. I have added a bug test in

[jira] [Created] (SPARK-22192) An RDD of nested POJO objects cannot be converted into a DataFrame using SQLContext.createDataFrame API

2017-10-03 Thread Asif Hussain Shahid (JIRA)
Asif Hussain Shahid created SPARK-22192: --- Summary: An RDD of nested POJO objects cannot be converted into a DataFrame using SQLContext.createDataFrame API Key: SPARK-22192 URL:

[jira] [Updated] (SPARK-13116) TungstenAggregate though it is supposedly capable of all processing unsafe & safe rows, fails if the input is safe rows

2016-02-05 Thread Asif Hussain Shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asif Hussain Shahid updated SPARK-13116: Attachment: SPARK_13116_Test.scala A test which reproduces the issue. Pls note

[jira] [Commented] (SPARK-13116) TungstenAggregate though it is supposedly capable of all processing unsafe & safe rows, fails if the input is safe rows

2016-02-05 Thread Asif Hussain Shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15134988#comment-15134988 ] Asif Hussain Shahid commented on SPARK-13116: - It will show up if you throw an exception in

[jira] [Commented] (SPARK-13116) TungstenAggregate though it is supposedly capable of all processing unsafe & safe rows, fails if the input is safe rows

2016-02-05 Thread Asif Hussain Shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15134929#comment-15134929 ] Asif Hussain Shahid commented on SPARK-13116: - I further debugged the issue & found the

[jira] [Commented] (SPARK-13116) TungstenAggregate though it is supposedly capable of all processing unsafe & safe rows, fails if the input is safe rows

2016-02-05 Thread Asif Hussain Shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15134968#comment-15134968 ] Asif Hussain Shahid commented on SPARK-13116: - No, the unary expression was our code , not of

[jira] [Commented] (SPARK-13116) TungstenAggregate though it is supposedly capable of all processing unsafe & safe rows, fails if the input is safe rows

2016-02-05 Thread Asif Hussain Shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15134969#comment-15134969 ] Asif Hussain Shahid commented on SPARK-13116: - Now the unary expression was our code , not of

[jira] [Commented] (SPARK-13116) TungstenAggregate though it is supposedly capable of all processing unsafe & safe rows, fails if the input is safe rows

2016-02-04 Thread Asif Hussain Shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15133061#comment-15133061 ] Asif Hussain Shahid commented on SPARK-13116: - It seems our code of using relation provider

[jira] [Commented] (SPARK-13116) TungstenAggregate though it is supposedly capable of all processing unsafe & safe rows, fails if the input is safe rows

2016-02-03 Thread Asif Hussain Shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15131175#comment-15131175 ] Asif Hussain Shahid commented on SPARK-13116: - I will check if my tests encounter issue with

[jira] [Created] (SPARK-13116) TungstenAggregate though it is supposedly capable of all processing unsafe & safe rows, fails if the input is safe rows

2016-02-01 Thread Asif Hussain Shahid (JIRA)
Asif Hussain Shahid created SPARK-13116: --- Summary: TungstenAggregate though it is supposedly capable of all processing unsafe & safe rows, fails if the input is safe rows Key: SPARK-13116 URL:

[jira] [Commented] (SPARK-13116) TungstenAggregate though it is supposedly capable of all processing unsafe & safe rows, fails if the input is safe rows

2016-02-01 Thread Asif Hussain Shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15126947#comment-15126947 ] Asif Hussain Shahid commented on SPARK-13116: - This issue surfaces when the TungstenAggregate

<    1   2   3