[jira] [Closed] (SPARK-10798) JsonMappingException with Spark Context Parallelize

[ https://issues.apache.org/jira/browse/SPARK-10798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dev Lakhani closed SPARK-10798. --- Resolution: Cannot Reproduce > JsonMappingException with Spark Context Parallelize >

[jira] [Commented] (SPARK-10798) JsonMappingException with Spark Context Parallelize

[ https://issues.apache.org/jira/browse/SPARK-10798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15055130#comment-15055130 ] Dev Lakhani commented on SPARK-10798: - byte[] data= Kryo.serialize(List) This is just shorthand for

[jira] [Commented] (SPARK-10798) JsonMappingException with Spark Context Parallelize

[ https://issues.apache.org/jira/browse/SPARK-10798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14942651#comment-14942651 ] Dev Lakhani commented on SPARK-10798: - Hi Miao I will create a github project/fork for this to give

[jira] [Updated] (SPARK-10798) JsonMappingException with Spark Context Parallelize

[ https://issues.apache.org/jira/browse/SPARK-10798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dev Lakhani updated SPARK-10798: Environment: Linux, Java 1.8.45 (was: Linux, Java 1.8.40) > JsonMappingException with Spark

[jira] [Updated] (SPARK-10798) JsonMappingException with Spark Context Parallelize

[ https://issues.apache.org/jira/browse/SPARK-10798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dev Lakhani updated SPARK-10798: Description: When trying to create an RDD of Rows using a Java Spark Context and if I serialize

[jira] [Updated] (SPARK-10798) JsonMappingException with Spark Context Parallelize

[ https://issues.apache.org/jira/browse/SPARK-10798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dev Lakhani updated SPARK-10798: Description: When trying to create an RDD of Rows using a Java Spark Context: List rows= new

[jira] [Created] (SPARK-10798) JsonMappingException with Spark Context Parallelize

Dev Lakhani created SPARK-10798: --- Summary: JsonMappingException with Spark Context Parallelize Key: SPARK-10798 URL: https://issues.apache.org/jira/browse/SPARK-10798 Project: Spark Issue

[jira] [Updated] (SPARK-10700) Spark R Documentation not available

[ https://issues.apache.org/jira/browse/SPARK-10700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dev Lakhani updated SPARK-10700: Description: Documentation https://spark.apache.org/docs/latest/api/R/glm.html refered to in

[jira] [Created] (SPARK-10700) Spark R Documentation not available

Dev Lakhani created SPARK-10700: --- Summary: Spark R Documentation not available Key: SPARK-10700 URL: https://issues.apache.org/jira/browse/SPARK-10700 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-1867) Spark Documentation Error causes java.lang.IllegalStateException: unread block data

[ https://issues.apache.org/jira/browse/SPARK-1867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14602669#comment-14602669 ] Dev Lakhani commented on SPARK-1867: [~marcreichman] , [~meiyoula], [~srowen], [~sam]

[jira] [Created] (SPARK-8395) spark-submit documentation is incorrect

Dev Lakhani created SPARK-8395: -- Summary: spark-submit documentation is incorrect Key: SPARK-8395 URL: https://issues.apache.org/jira/browse/SPARK-8395 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-8143) Spark application history cannot be found even for finished jobs

[ https://issues.apache.org/jira/browse/SPARK-8143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dev Lakhani resolved SPARK-8143. Resolution: Fixed Fix Version/s: 1.4.0 Verified, history for killed jobs are now available

[jira] [Commented] (SPARK-8142) Spark Job Fails with ResultTask ClassCastException

[ https://issues.apache.org/jira/browse/SPARK-8142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14580689#comment-14580689 ] Dev Lakhani commented on SPARK-8142: To clarify [~srowen] 1) I meant the other way

[jira] [Commented] (SPARK-8142) Spark Job Fails with ResultTask ClassCastException

[ https://issues.apache.org/jira/browse/SPARK-8142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14580730#comment-14580730 ] Dev Lakhani commented on SPARK-8142: Hi [~vanzin] bq. if you want to use the

[jira] [Commented] (SPARK-1867) Spark Documentation Error causes java.lang.IllegalStateException: unread block data

[ https://issues.apache.org/jira/browse/SPARK-1867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14581130#comment-14581130 ] Dev Lakhani commented on SPARK-1867: Worth a new JIRA to suggest this? Spark

[jira] [Commented] (SPARK-8142) Spark Job Fails with ResultTask ClassCastException

[ https://issues.apache.org/jira/browse/SPARK-8142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14580632#comment-14580632 ] Dev Lakhani commented on SPARK-8142: [~vanzin] [~srowen] since this has been verified

[jira] [Commented] (SPARK-1867) Spark Documentation Error causes java.lang.IllegalStateException: unread block data

[ https://issues.apache.org/jira/browse/SPARK-1867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14578745#comment-14578745 ] Dev Lakhani commented on SPARK-1867: Although this has been marked with not an issue,

[jira] [Commented] (SPARK-8142) Spark Job Fails with ResultTask ClassCastException

[ https://issues.apache.org/jira/browse/SPARK-8142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14578916#comment-14578916 ] Dev Lakhani commented on SPARK-8142: Any suggestion on this? To summarise, Spark and

[jira] [Commented] (SPARK-8142) Spark Job Fails with ResultTask ClassCastException

[ https://issues.apache.org/jira/browse/SPARK-8142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14576816#comment-14576816 ] Dev Lakhani commented on SPARK-8142: Also I can confirm, without the user

[jira] [Commented] (SPARK-8142) Spark Job Fails with ResultTask ClassCastException

[ https://issues.apache.org/jira/browse/SPARK-8142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14577230#comment-14577230 ] Dev Lakhani commented on SPARK-8142: I thought it was only spark deps but I've now

[jira] [Commented] (SPARK-8142) Spark Job Fails with ResultTask ClassCastException

[ https://issues.apache.org/jira/browse/SPARK-8142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14577262#comment-14577262 ] Dev Lakhani commented on SPARK-8142: HBase kept, Hadoop and Spark removed. Now I get:

[jira] [Commented] (SPARK-8142) Spark Job Fails with ResultTask ClassCastException

[ https://issues.apache.org/jira/browse/SPARK-8142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14577265#comment-14577265 ] Dev Lakhani commented on SPARK-8142: To be specific when I say removed I mean marked

[jira] [Commented] (SPARK-8142) Spark Job Fails with ResultTask ClassCastException

[ https://issues.apache.org/jira/browse/SPARK-8142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14577108#comment-14577108 ] Dev Lakhani commented on SPARK-8142: I am not bundling spark, again, I have pre-built

[jira] [Commented] (SPARK-8143) Spark application history cannot be found even for finished jobs

[ https://issues.apache.org/jira/browse/SPARK-8143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14577130#comment-14577130 ] Dev Lakhani commented on SPARK-8143: I cannot try it against master because we are

[jira] [Commented] (SPARK-8142) Spark Job Fails with ResultTask ClassCastException

[ https://issues.apache.org/jira/browse/SPARK-8142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14577155#comment-14577155 ] Dev Lakhani commented on SPARK-8142: spark-core and spark-sql marked as provided, same

[jira] [Commented] (SPARK-8142) Spark Job Fails with ResultTask ClassCastException

[ https://issues.apache.org/jira/browse/SPARK-8142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14577371#comment-14577371 ] Dev Lakhani commented on SPARK-8142: Update: having resolved some dependencies issues

[jira] [Updated] (SPARK-8142) Spark Job Fails with ResultTask Class Cast Exception

[ https://issues.apache.org/jira/browse/SPARK-8142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dev Lakhani updated SPARK-8142: --- Summary: Spark Job Fails with ResultTask Class Cast Exception (was: Spark Job Fails with ResultTask

[jira] [Created] (SPARK-8142) Spark Job Fails with ResultTask Class Exception

Dev Lakhani created SPARK-8142: -- Summary: Spark Job Fails with ResultTask Class Exception Key: SPARK-8142 URL: https://issues.apache.org/jira/browse/SPARK-8142 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-8143) Spark application history cannot be found even for finished jobs

Dev Lakhani created SPARK-8143: -- Summary: Spark application history cannot be found even for finished jobs Key: SPARK-8143 URL: https://issues.apache.org/jira/browse/SPARK-8143 Project: Spark

[jira] [Commented] (SPARK-8142) Spark Job Fails with ResultTask ClassCastException

[ https://issues.apache.org/jira/browse/SPARK-8142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575958#comment-14575958 ] Dev Lakhani commented on SPARK-8142: I'm using pre-compiled binaries for spark 1.3.1

[jira] [Commented] (SPARK-8143) Spark application history cannot be found even for finished jobs

[ https://issues.apache.org/jira/browse/SPARK-8143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575959#comment-14575959 ] Dev Lakhani commented on SPARK-8143: Ok will wait for the official 1.4 release and

[jira] [Updated] (SPARK-8142) Spark Job Fails with ResultTask Class Cast Exception

[ https://issues.apache.org/jira/browse/SPARK-8142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dev Lakhani updated SPARK-8142: --- Description: When running a Spark Job, I get no failures in the application code whatsoever but a

[jira] [Updated] (SPARK-8142) Spark Job Fails with ResultTask ClassCastException

[ https://issues.apache.org/jira/browse/SPARK-8142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dev Lakhani updated SPARK-8142: --- Summary: Spark Job Fails with ResultTask ClassCastException (was: Spark Job Fails with ResultTask

[jira] [Updated] (SPARK-8142) Spark Job Fails with ResultTask ClassCastException

[ https://issues.apache.org/jira/browse/SPARK-8142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dev Lakhani updated SPARK-8142: --- Description: When running a Spark Job, I get no failures in the application code whatsoever but a

[jira] [Commented] (SPARK-6846) Stage kill URL easy to accidentally trigger and possibility for security issue.

[ https://issues.apache.org/jira/browse/SPARK-6846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14543970#comment-14543970 ] Dev Lakhani commented on SPARK-6846: As a more complex solution would it be possible

[jira] [Commented] (SPARK-6846) Stage kill URL easy to accidentally trigger and possibility for security issue.

[ https://issues.apache.org/jira/browse/SPARK-6846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494012#comment-14494012 ] Dev Lakhani commented on SPARK-6846: [~srowen] please go ahead, I wont have time for

[jira] [Updated] (SPARK-5273) Improve documentation examples for LinearRegression

[ https://issues.apache.org/jira/browse/SPARK-5273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dev Lakhani updated SPARK-5273: --- Affects Version/s: (was: 1.2.0) Improve documentation examples for LinearRegression

[jira] [Updated] (SPARK-5273) Improve documentation examples for LinearRegression

[ https://issues.apache.org/jira/browse/SPARK-5273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dev Lakhani updated SPARK-5273: --- Affects Version/s: 1.2.0 Improve documentation examples for LinearRegression

[jira] [Created] (SPARK-5273) Improve documentation examples for LinearRegression

Dev Lakhani created SPARK-5273: -- Summary: Improve documentation examples for LinearRegression Key: SPARK-5273 URL: https://issues.apache.org/jira/browse/SPARK-5273 Project: Spark Issue Type:

[jira] [Commented] (SPARK-576) Design and develop a more precise progress estimator

[ https://issues.apache.org/jira/browse/SPARK-576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14175023#comment-14175023 ] Dev Lakhani commented on SPARK-576: --- I've created a PR for this:

[jira] [Commented] (SPARK-2321) Design a proper progress reporting event listener API

[ https://issues.apache.org/jira/browse/SPARK-2321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14173619#comment-14173619 ] Dev Lakhani commented on SPARK-2321: There are some issues and bugs under the webui

[jira] [Commented] (SPARK-3957) Broadcast variable memory usage not reflected in UI

[ https://issues.apache.org/jira/browse/SPARK-3957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14173926#comment-14173926 ] Dev Lakhani commented on SPARK-3957: Here is my thoughts on a possible approach. Hi

[jira] [Commented] (SPARK-3957) Broadcast variable memory usage not reflected in UI

[ https://issues.apache.org/jira/browse/SPARK-3957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14174107#comment-14174107 ] Dev Lakhani commented on SPARK-3957: Hi For now I am happy for [~CodingCat] to take

[jira] [Commented] (SPARK-3644) REST API for Spark application info (jobs / stages / tasks / storage info)

[ https://issues.apache.org/jira/browse/SPARK-3644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14165293#comment-14165293 ] Dev Lakhani commented on SPARK-3644: Hi I am doing some work on the REST/JSON aspects