[
https://issues.apache.org/jira/browse/SPARK-25695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644503#comment-16644503
]
shahid commented on SPARK-25695:
Hi, This error seems, eventLog directory doesn't exist in your
[
https://issues.apache.org/jira/browse/SPARK-25566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
shahid updated SPARK-25566:
---
Description:
1. configure spark.sql.ui.retainedExecutions = 5 ( In Job History
Spark-default.conf )
2.
[
https://issues.apache.org/jira/browse/SPARK-25566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
shahid updated SPARK-25566:
---
Attachment: Screenshot from 2018-10-06 09-46-11.png
> [Spark Job History] SQL UI Page does not support
[
https://issues.apache.org/jira/browse/SPARK-25583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
shahid updated SPARK-25583:
---
Priority: Minor (was: Trivial)
> Add newly added History server related configurations in the
shahid created SPARK-25583:
--
Summary: Add newly added History server related configurations in
the documentation
Key: SPARK-25583
URL: https://issues.apache.org/jira/browse/SPARK-25583
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-25575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
shahid updated SPARK-25575:
---
Attachment: Screenshot from 2018-09-29 23-26-57.png
> SQL tab in the spark UI doesn't have option of
[
https://issues.apache.org/jira/browse/SPARK-25575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
shahid updated SPARK-25575:
---
Description:
Test tests:
1) bin/spark-shell
{code:java}
sql("create table a (id int)")
for(i <- 1 to 100)
[
https://issues.apache.org/jira/browse/SPARK-25575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
shahid updated SPARK-25575:
---
Attachment: Screenshot from 2018-09-29 23-26-45.png
> SQL tab in the spark UI doesn't have option of
[
https://issues.apache.org/jira/browse/SPARK-25575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16633082#comment-16633082
]
shahid commented on SPARK-25575:
I will raise a PR
> SQL tab in the spark UI doesn't have option of
shahid created SPARK-25575:
--
Summary: SQL tab in the spark UI doesn't have option of hiding
tables, eventhough other UI tabs has.
Key: SPARK-25575
URL: https://issues.apache.org/jira/browse/SPARK-25575
[
https://issues.apache.org/jira/browse/SPARK-25567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16631711#comment-16631711
]
shahid commented on SPARK-25567:
Thanks. I will raise a PR
> [Spark Job History] Table listing in SQL
[
https://issues.apache.org/jira/browse/SPARK-25566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16631703#comment-16631703
]
shahid commented on SPARK-25566:
Thanks for reporting. I am working on it.
> [Spark Job History] SQL UI
[
https://issues.apache.org/jira/browse/SPARK-25502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16628588#comment-16628588
]
shahid commented on SPARK-25502:
[~toopt4] No. please refer the PR, to see the fix
> [Spark Job
[
https://issues.apache.org/jira/browse/SPARK-25536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16628267#comment-16628267
]
shahid edited comment on SPARK-25536 at 9/26/18 7:18 AM:
-
Thanks. I will raise a
[
https://issues.apache.org/jira/browse/SPARK-25536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16628267#comment-16628267
]
shahid commented on SPARK-25536:
I will raise a pr
> executorSource.METRIC read wrong record in
[
https://issues.apache.org/jira/browse/SPARK-25533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
shahid updated SPARK-25533:
---
Description:
Test steps:
1) bin/spark-shell
{code:java}
sc.parallelize(1 to 5, 5).collect()
[
https://issues.apache.org/jira/browse/SPARK-25533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
shahid updated SPARK-25533:
---
Summary: Inconsistent message for Completed Jobs in the JobUI, when there
are failed jobs, compared to
[
https://issues.apache.org/jira/browse/SPARK-25533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
shahid updated SPARK-25533:
---
Attachment: (was: Screenshot from 2018-09-26 00-42-00.png)
> Inconsistent message of Completed Jobs in
[
https://issues.apache.org/jira/browse/SPARK-25533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
shahid updated SPARK-25533:
---
Description:
Test steps:
1) bin/spark-shell
{code:java}
sc.parallelize(1 to 5, 5).collect()
[
https://issues.apache.org/jira/browse/SPARK-25533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
shahid updated SPARK-25533:
---
Attachment: Screenshot from 2018-09-26 00-46-35.png
> Inconsistent message of Completed Jobs in the JobUI,
[
https://issues.apache.org/jira/browse/SPARK-25533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
shahid updated SPARK-25533:
---
Attachment: Screenshot from 2018-09-26 00-42-00.png
> Inconsistent message of Completed Jobs in the JobUI,
[
https://issues.apache.org/jira/browse/SPARK-25533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16627823#comment-16627823
]
shahid commented on SPARK-25533:
I am working on it.
> Inconsistent message of Completed Jobs in the
[
https://issues.apache.org/jira/browse/SPARK-25533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
shahid updated SPARK-25533:
---
Attachment: Screenshot from 2018-09-26 00-42-00.png
> Inconsistent message of Completed Jobs in the JobUI,
shahid created SPARK-25533:
--
Summary: Inconsistent message of Completed Jobs in the JobUI,
when there are failed jobs, compared to spark2.2
Key: SPARK-25533
URL: https://issues.apache.org/jira/browse/SPARK-25533
[
https://issues.apache.org/jira/browse/SPARK-25502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626628#comment-16626628
]
shahid commented on SPARK-25502:
Hi [~vanzin], Could you please change the Assignee to my name, as
[
https://issues.apache.org/jira/browse/SPARK-25502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16624695#comment-16624695
]
shahid edited comment on SPARK-25502 at 9/23/18 1:00 PM:
-
I have raised PR
[
https://issues.apache.org/jira/browse/SPARK-25448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625093#comment-16625093
]
shahid edited comment on SPARK-25448 at 9/23/18 12:51 PM:
--
I am not able to
[
https://issues.apache.org/jira/browse/SPARK-25504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
shahid updated SPARK-25504:
---
Comment: was deleted
(was: I am analyzing the issue. Will raise a PR soon.)
> [Spark Job History]If the
[
https://issues.apache.org/jira/browse/SPARK-25504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625095#comment-16625095
]
shahid commented on SPARK-25504:
According to the code in the AppStatusListener.scala,
[
https://issues.apache.org/jira/browse/SPARK-25504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
shahid updated SPARK-25504:
---
Attachment: AppStatusListener.png
> [Spark Job History]If the number of tasks exceeds spark.ui.retainedTask
[
https://issues.apache.org/jira/browse/SPARK-25448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625093#comment-16625093
]
shahid commented on SPARK-25448:
I am not able to reproduce the issue with spark2.3.1
Test steps:
1)
[
https://issues.apache.org/jira/browse/SPARK-25448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
shahid updated SPARK-25448:
---
Attachment: (was: historyJobs.jpg)
> [Spark Job History] Job Staged page shows 1000 Jobs only
>
[
https://issues.apache.org/jira/browse/SPARK-25448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
shahid updated SPARK-25448:
---
Attachment: image-2018-09-23-18-01-35-554.png
> [Spark Job History] Job Staged page shows 1000 Jobs only
>
[
https://issues.apache.org/jira/browse/SPARK-25448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
shahid updated SPARK-25448:
---
Attachment: historyJobs.jpg
> [Spark Job History] Job Staged page shows 1000 Jobs only
>
[
https://issues.apache.org/jira/browse/SPARK-25448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
shahid updated SPARK-25448:
---
Attachment: (was: jobpage.png)
> [Spark Job History] Job Staged page shows 1000 Jobs only
>
[
https://issues.apache.org/jira/browse/SPARK-25448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
shahid updated SPARK-25448:
---
Comment: was deleted
(was: I am not able to reproduce the issue with the below steps
1) bin/spark-shell
[
https://issues.apache.org/jira/browse/SPARK-25448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625075#comment-16625075
]
shahid commented on SPARK-25448:
I am not able to reproduce the issue with the below steps
1)
[
https://issues.apache.org/jira/browse/SPARK-25448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
shahid updated SPARK-25448:
---
Attachment: jobpage.png
> [Spark Job History] Job Staged page shows 1000 Jobs only
>
[
https://issues.apache.org/jira/browse/SPARK-25502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16624695#comment-16624695
]
shahid commented on SPARK-25502:
I have raised PR https://github.com/apache/spark/pull/22502
> [Spark
[
https://issues.apache.org/jira/browse/SPARK-25503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16624683#comment-16624683
]
shahid commented on SPARK-25503:
I have raised the PR https://github.com/apache/spark/pull/22525
>
[
https://issues.apache.org/jira/browse/SPARK-25504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623391#comment-16623391
]
shahid commented on SPARK-25504:
I am analyzing the issue. Will raise a PR soon.
> [Spark Job
[
https://issues.apache.org/jira/browse/SPARK-25503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623364#comment-16623364
]
shahid commented on SPARK-25503:
I am working on it. will raise a PR soon
> [Spark Job History] Total
[
https://issues.apache.org/jira/browse/SPARK-25502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623350#comment-16623350
]
shahid commented on SPARK-25502:
I am working on it. Will raise a PR.
> [Spark Job History] Empty Page
[
https://issues.apache.org/jira/browse/SPARK-25246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622588#comment-16622588
]
shahid edited comment on SPARK-25246 at 9/20/18 7:36 PM:
-
[~devaraj.k], Ideally
[
https://issues.apache.org/jira/browse/SPARK-25246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622588#comment-16622588
]
shahid edited comment on SPARK-25246 at 9/20/18 7:35 PM:
-
[~devaraj.k], Ideally
[
https://issues.apache.org/jira/browse/SPARK-25246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622588#comment-16622588
]
shahid commented on SPARK-25246:
[~devaraj.k], Ideally when the application start, it should display in
[
https://issues.apache.org/jira/browse/SPARK-25474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622065#comment-16622065
]
shahid commented on SPARK-25474:
Thanks [~Ayush007], [~sandeep.katta2007], I am working on it. I will
[
https://issues.apache.org/jira/browse/SPARK-25246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16597142#comment-16597142
]
shahid commented on SPARK-25246:
cc [~vanzin]
> When the spark.eventLog.compress is enabled, the
[
https://issues.apache.org/jira/browse/SPARK-25246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
shahid updated SPARK-25246:
---
Comment: was deleted
(was: I am working on it :))
> When the spark.eventLog.compress is enabled, the
[
https://issues.apache.org/jira/browse/SPARK-25246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16593040#comment-16593040
]
shahid commented on SPARK-25246:
I am working on it :)
> When the spark.eventLog.compress is enabled,
shahid created SPARK-25246:
--
Summary: When the spark.eventLog.compress is enabled, the
Application is not showing in the History server UI ('incomplete application'
page), initially.
Key: SPARK-25246
URL:
[
https://issues.apache.org/jira/browse/SPARK-18230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
shahid updated SPARK-18230:
---
Fix Version/s: 2.4.0
> MatrixFactorizationModel.recommendProducts throws NoSuchElement exception
> when
[
https://issues.apache.org/jira/browse/SPARK-24484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16521847#comment-16521847
]
shahid commented on SPARK-24484:
I have raised a PR, https://github.com/apache/spark/pull/21627
> Power
[
https://issues.apache.org/jira/browse/SPARK-24484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
shahid updated SPARK-24484:
---
Priority: Major (was: Minor)
> Power Iteration Clustering is giving incorrect clustering results when
[
https://issues.apache.org/jira/browse/SPARK-24213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
shahid resolved SPARK-24213.
Resolution: Fixed
> Power Iteration Clustering in the SparkML throws exception, when the ID is
> IntType
[
https://issues.apache.org/jira/browse/SPARK-24217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
shahid resolved SPARK-24217.
Resolution: Fixed
> Power Iteration Clustering is not displaying cluster indices corresponding to
> some
shahid created SPARK-24489:
--
Summary: No check for invalid input type of weight data in
ml.PowerIterationClustering
Key: SPARK-24489
URL: https://issues.apache.org/jira/browse/SPARK-24489
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-24484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
shahid updated SPARK-24484:
---
Summary: Power Iteration Clustering is giving incorrect clustering results
when there are mutiple leading
shahid created SPARK-24484:
--
Summary: Power Iteration Clustering is giving incorrect clustering
results when mutiple leading eigen values.
Key: SPARK-24484
URL: https://issues.apache.org/jira/browse/SPARK-24484
[
https://issues.apache.org/jira/browse/SPARK-15784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16471545#comment-16471545
]
shahid commented on SPARK-15784:
Hi [~josephkb] , I can work on it.
> Add Power Iteration Clustering to
[
https://issues.apache.org/jira/browse/SPARK-24217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
shahid updated SPARK-24217:
---
Comment: was deleted
(was: Thanks for the clarification Joseph K. Bradley
Is it really required to append
[
https://issues.apache.org/jira/browse/SPARK-24217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16471128#comment-16471128
]
shahid edited comment on SPARK-24217 at 5/10/18 9:28 PM:
-
Thanks for the
[
https://issues.apache.org/jira/browse/SPARK-24217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16471128#comment-16471128
]
shahid edited comment on SPARK-24217 at 5/10/18 9:26 PM:
-
Thanks for the
[
https://issues.apache.org/jira/browse/SPARK-24217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16471128#comment-16471128
]
shahid edited comment on SPARK-24217 at 5/10/18 9:23 PM:
-
Thanks for the
[
https://issues.apache.org/jira/browse/SPARK-24217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16471128#comment-16471128
]
shahid edited comment on SPARK-24217 at 5/10/18 9:19 PM:
-
Thanks for the
[
https://issues.apache.org/jira/browse/SPARK-24217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
shahid updated SPARK-24217:
---
Comment: was deleted
(was: Thanks for the clarification.
Is it really required to append the result with
[
https://issues.apache.org/jira/browse/SPARK-24217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16471128#comment-16471128
]
shahid commented on SPARK-24217:
Thanks for the clarification Joseph K. Bradley
Is it really required
[
https://issues.apache.org/jira/browse/SPARK-24217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16471040#comment-16471040
]
shahid edited comment on SPARK-24217 at 5/10/18 9:15 PM:
-
Thanks for the
[
https://issues.apache.org/jira/browse/SPARK-24217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16471040#comment-16471040
]
shahid edited comment on SPARK-24217 at 5/10/18 9:11 PM:
-
Thanks for the
[
https://issues.apache.org/jira/browse/SPARK-22192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16191526#comment-16191526
]
Asif Hussain Shahid edited comment on SPARK-22192 at 10/10/17 5:46 AM:
[
https://issues.apache.org/jira/browse/SPARK-22192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16191526#comment-16191526
]
Asif Hussain Shahid commented on SPARK-22192:
-
The PR opened for this bug is
[
https://issues.apache.org/jira/browse/SPARK-22192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16190852#comment-16190852
]
Asif Hussain Shahid commented on SPARK-22192:
-
Not at all. I have added a bug test in
Asif Hussain Shahid created SPARK-22192:
---
Summary: An RDD of nested POJO objects cannot be converted into a
DataFrame using SQLContext.createDataFrame API
Key: SPARK-22192
URL:
[
https://issues.apache.org/jira/browse/SPARK-13116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif Hussain Shahid updated SPARK-13116:
Attachment: SPARK_13116_Test.scala
A test which reproduces the issue.
Pls note
[
https://issues.apache.org/jira/browse/SPARK-13116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15134988#comment-15134988
]
Asif Hussain Shahid commented on SPARK-13116:
-
It will show up if you throw an exception in
[
https://issues.apache.org/jira/browse/SPARK-13116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15134929#comment-15134929
]
Asif Hussain Shahid commented on SPARK-13116:
-
I further debugged the issue & found the
[
https://issues.apache.org/jira/browse/SPARK-13116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15134968#comment-15134968
]
Asif Hussain Shahid commented on SPARK-13116:
-
No, the unary expression was our code , not of
[
https://issues.apache.org/jira/browse/SPARK-13116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15134969#comment-15134969
]
Asif Hussain Shahid commented on SPARK-13116:
-
Now the unary expression was our code , not of
[
https://issues.apache.org/jira/browse/SPARK-13116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15133061#comment-15133061
]
Asif Hussain Shahid commented on SPARK-13116:
-
It seems our code of using relation provider
[
https://issues.apache.org/jira/browse/SPARK-13116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15131175#comment-15131175
]
Asif Hussain Shahid commented on SPARK-13116:
-
I will check if my tests encounter issue with
Asif Hussain Shahid created SPARK-13116:
---
Summary: TungstenAggregate though it is supposedly capable of all
processing unsafe & safe rows, fails if the input is safe rows
Key: SPARK-13116
URL:
[
https://issues.apache.org/jira/browse/SPARK-13116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15126947#comment-15126947
]
Asif Hussain Shahid commented on SPARK-13116:
-
This issue surfaces when the TungstenAggregate
201 - 282 of 282 matches
Mail list logo