[jira] [Commented] (SPARK-46762) Spark Connect 3.5 Classloading issue with external jar

[ https://issues.apache.org/jira/browse/SPARK-46762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829258#comment-17829258 ] nirav patel commented on SPARK-46762: - [~zhenli] any updates on this? > Spark Connect 3.5

[jira] [Commented] (SPARK-46762) Spark Connect 3.5 Classloading issue with external jar

[ https://issues.apache.org/jira/browse/SPARK-46762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17822653#comment-17822653 ] nirav patel commented on SPARK-46762: - just realized I added spark-connect 3.4 example start up

[jira] [Updated] (SPARK-46762) Spark Connect 3.5 Classloading issue with external jar

[ https://issues.apache.org/jira/browse/SPARK-46762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nirav patel updated SPARK-46762: Description: We are having following `java.lang.ClassCastException` error in spark Executors

[jira] [Updated] (SPARK-46762) Spark Connect 3.5 Classloading issue with external jar

[ https://issues.apache.org/jira/browse/SPARK-46762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nirav patel updated SPARK-46762: Description: We are having following `java.lang.ClassCastException` error in spark Executors

[jira] [Commented] (SPARK-46762) Spark Connect 3.5 Classloading issue with external jar

[ https://issues.apache.org/jira/browse/SPARK-46762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17822302#comment-17822302 ] nirav patel commented on SPARK-46762: - Hi [~zhenli] I added some high level steps to reproduce that

[jira] [Updated] (SPARK-46762) Spark Connect 3.5 Classloading issue with external jar

[ https://issues.apache.org/jira/browse/SPARK-46762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nirav patel updated SPARK-46762: Description: We are having following `java.lang.ClassCastException` error in spark Executors

[jira] [Updated] (SPARK-46762) Spark Connect 3.5 Classloading issue with external jar

[ https://issues.apache.org/jira/browse/SPARK-46762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nirav patel updated SPARK-46762: Description: We are having following `java.lang.ClassCastException` error in spark Executors

[jira] [Commented] (SPARK-46762) Spark Connect 3.5 Classloading issue with external jar

[ https://issues.apache.org/jira/browse/SPARK-46762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17821911#comment-17821911 ] nirav patel commented on SPARK-46762: - [~zhenli]  is this related to following?   

[jira] [Comment Edited] (SPARK-46762) Spark Connect 3.5 Classloading issue with external jar

[ https://issues.apache.org/jira/browse/SPARK-46762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819830#comment-17819830 ] nirav patel edited comment on SPARK-46762 at 2/22/24 10:13 PM: --- I did some

[jira] [Comment Edited] (SPARK-46762) Spark Connect 3.5 Classloading issue with external jar

[ https://issues.apache.org/jira/browse/SPARK-46762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819830#comment-17819830 ] nirav patel edited comment on SPARK-46762 at 2/22/24 10:11 PM: --- I did some

[jira] [Updated] (SPARK-46762) Spark Connect 3.5 Classloading issue with external jar

[ https://issues.apache.org/jira/browse/SPARK-46762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nirav patel updated SPARK-46762: Attachment: Screenshot 2024-02-22 at 2.04.49 PM.png Screenshot 2024-02-22 at

[jira] [Commented] (SPARK-46762) Spark Connect 3.5 Classloading issue with external jar

[ https://issues.apache.org/jira/browse/SPARK-46762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819830#comment-17819830 ] nirav patel commented on SPARK-46762: - I did some more digging into executor classloading and heap

[jira] [Updated] (SPARK-46762) Spark Connect 3.5 Classloading issue with external jar

[ https://issues.apache.org/jira/browse/SPARK-46762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nirav patel updated SPARK-46762: Summary: Spark Connect 3.5 Classloading issue with external jar (was: Spark Connect 3.5

[jira] [Updated] (SPARK-46762) Spark Connect 3.5 Classloading issue

[ https://issues.apache.org/jira/browse/SPARK-46762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nirav patel updated SPARK-46762: Description: We are having following `java.lang.ClassCastException` error in spark Executors

[jira] [Updated] (SPARK-46762) Spark Connect 3.5 Classloading issue

[ https://issues.apache.org/jira/browse/SPARK-46762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nirav patel updated SPARK-46762: Description: We are having following `java.lang.ClassCastException` error in spark Executors

[jira] [Updated] (SPARK-46762) Spark Connect 3.5 Classloading issue

[ https://issues.apache.org/jira/browse/SPARK-46762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nirav patel updated SPARK-46762: Description: We are having following `java.lang.ClassCastException` error in spark Executors

[jira] [Updated] (SPARK-46762) Spark Connect 3.5 Classloading issue

[ https://issues.apache.org/jira/browse/SPARK-46762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nirav patel updated SPARK-46762: Description: *Affected version:* spark 3.5 and spark-connect_2.12:3.5.0   *Not affected

[jira] [Created] (SPARK-46762) Spark Connect 3.5 Classloading issue

nirav patel created SPARK-46762: --- Summary: Spark Connect 3.5 Classloading issue Key: SPARK-46762 URL: https://issues.apache.org/jira/browse/SPARK-46762 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-46762) Spark Connect 3.5 Classloading issue

[ https://issues.apache.org/jira/browse/SPARK-46762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nirav patel updated SPARK-46762: Description: *Affected version:* spark 3.5 and spark-connect_2.12:3.5.0   *Not affected

[jira] [Updated] (SPARK-44991) Spark json schema inference and fromJson api having inconsistent behavior

[ https://issues.apache.org/jira/browse/SPARK-44991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nirav patel updated SPARK-44991: Description: Spark json reader can infer datatype of a fields. I am ingesting millions of

[jira] [Updated] (SPARK-44991) Spark json schema inference and fromJson api having inconsistent behavior

[ https://issues.apache.org/jira/browse/SPARK-44991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nirav patel updated SPARK-44991: Summary: Spark json schema inference and fromJson api having inconsistent behavior (was: Spark

[jira] [Updated] (SPARK-44991) Spark json datasource reader and fromJson api having inconsistent behavior

[ https://issues.apache.org/jira/browse/SPARK-44991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nirav patel updated SPARK-44991: Description: Spark json reader can infer datatype of a fields. I am ingesting millions of

[jira] [Created] (SPARK-44991) Spark json datasource reader and fromJson api having inconsistent behavior

nirav patel created SPARK-44991: --- Summary: Spark json datasource reader and fromJson api having inconsistent behavior Key: SPARK-44991 URL: https://issues.apache.org/jira/browse/SPARK-44991 Project:

[jira] [Commented] (SPARK-6305) Add support for log4j 2.x to Spark

[ https://issues.apache.org/jira/browse/SPARK-6305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087908#comment-17087908 ] nirav patel commented on SPARK-6305: I think spark should decouple logging and allow application

[jira] [Created] (SPARK-28630) Union fails when column order is different

nirav patel created SPARK-28630: --- Summary: Union fails when column order is different Key: SPARK-28630 URL: https://issues.apache.org/jira/browse/SPARK-28630 Project: Spark Issue Type:

[jira] [Commented] (SPARK-26844) Parquet Reader exception - ArrayIndexOutOfBound should give more information to user

[ https://issues.apache.org/jira/browse/SPARK-26844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795382#comment-16795382 ] nirav patel commented on SPARK-26844: - [~hyukjin.kwon] Yes, Paruqet file is corrupt. It has newline 

[jira] [Updated] (SPARK-26844) Parquet Reader exception - ArrayIndexOutOfBound should give more information to user

[ https://issues.apache.org/jira/browse/SPARK-26844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nirav patel updated SPARK-26844: Description: I get following error while reading parquet file which has primitive datatypes

[jira] [Comment Edited] (SPARK-5997) Increase partition count without performing a shuffle

[ https://issues.apache.org/jira/browse/SPARK-5997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16792964#comment-16792964 ] nirav patel edited comment on SPARK-5997 at 3/14/19 6:56 PM: - Adding another

[jira] [Commented] (SPARK-5997) Increase partition count without performing a shuffle

[ https://issues.apache.org/jira/browse/SPARK-5997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16792964#comment-16792964 ] nirav patel commented on SPARK-5997: Adding another possible use case for this ask - I am hitting 

[jira] [Created] (SPARK-26844) Parquet Reader exception - ArrayIndexOutOfBound should give more information to user

nirav patel created SPARK-26844: --- Summary: Parquet Reader exception - ArrayIndexOutOfBound should give more information to user Key: SPARK-26844 URL: https://issues.apache.org/jira/browse/SPARK-26844

[jira] [Commented] (SPARK-26388) No support for "alter table .. replace columns" to drop columns

[ https://issues.apache.org/jira/browse/SPARK-26388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16725244#comment-16725244 ] nirav patel commented on SPARK-26388: - updated description with requested detail and a sample. > No

[jira] [Updated] (SPARK-26388) No support for "alter table .. replace columns" to drop columns

[ https://issues.apache.org/jira/browse/SPARK-26388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nirav patel updated SPARK-26388: Description: Looks like hive {{replace columns}} is not working with spark 2.2.1 and 2.3.1  

[jira] [Updated] (SPARK-26388) No support for "alter table .. replace columns" to drop columns

[ https://issues.apache.org/jira/browse/SPARK-26388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nirav patel updated SPARK-26388: Affects Version/s: 2.3.2 > No support for "alter table .. replace columns" to drop columns >

[jira] [Created] (SPARK-26388) No support for "alter table .. replace columns" to drop columns

nirav patel created SPARK-26388: --- Summary: No support for "alter table .. replace columns" to drop columns Key: SPARK-26388 URL: https://issues.apache.org/jira/browse/SPARK-26388 Project: Spark

[jira] [Commented] (SPARK-19261) Support `ALTER TABLE table_name ADD COLUMNS(..)` statement

[ https://issues.apache.org/jira/browse/SPARK-19261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16723382#comment-16723382 ] nirav patel commented on SPARK-19261: - It happens for `Replace columns` as well `Exception in

[jira] [Commented] (SPARK-14989) Upgrade to Jackson 2.7.3

[ https://issues.apache.org/jira/browse/SPARK-14989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662668#comment-16662668 ] nirav patel commented on SPARK-14989: - Any updates on this? Spark 2.2 still uses Jackson 1.9.13!

[jira] [Commented] (SPARK-17861) Store data source partitions in metastore and push partition pruning into metastore

[ https://issues.apache.org/jira/browse/SPARK-17861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16565749#comment-16565749 ] nirav patel commented on SPARK-17861: - [~rxin] can this also be supported via dataframe? so

[jira] [Commented] (SPARK-6459) Warn when Column API is constructing trivially true equality

[ https://issues.apache.org/jira/browse/SPARK-6459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16550024#comment-16550024 ] nirav patel commented on SPARK-6459: [~zero323] why the example you gave should generate cartesian

[jira] [Created] (SPARK-24853) Support Column type for withColumn and withColumnRenamed apis

nirav patel created SPARK-24853: --- Summary: Support Column type for withColumn and withColumnRenamed apis Key: SPARK-24853 URL: https://issues.apache.org/jira/browse/SPARK-24853 Project: Spark

[jira] [Commented] (SPARK-23822) Improve error message for Parquet schema mismatches

[ https://issues.apache.org/jira/browse/SPARK-23822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16537405#comment-16537405 ] nirav patel commented on SPARK-23822: - Does the fix pinpoint what column it fails to merge schema?

[jira] [Commented] (SPARK-14922) Alter Table Drop Partition Using Predicate-based Partition Spec

[ https://issues.apache.org/jira/browse/SPARK-14922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520715#comment-16520715 ] nirav patel commented on SPARK-14922: - Hi Any updates on this? Is there any workaround meanwhile? Is

[jira] [Commented] (SPARK-18579) spark-csv strips whitespace (pyspark)

[ https://issues.apache.org/jira/browse/SPARK-18579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15923338#comment-15923338 ] nirav patel commented on SPARK-18579: - I am having same issue. Created SPARK-19942. It seems like

[jira] [Created] (SPARK-19942) DataFrameWriter - CSV options "ignoreLeadingWhiteSpace" and "ignoreTrailingWhiteSpace" Not working

nirav patel created SPARK-19942: --- Summary: DataFrameWriter - CSV options "ignoreLeadingWhiteSpace" and "ignoreTrailingWhiteSpace" Not working Key: SPARK-19942 URL: https://issues.apache.org/jira/browse/SPARK-19942

[jira] [Commented] (SPARK-19090) Dynamic Resource Allocation not respecting spark.executor.cores

[ https://issues.apache.org/jira/browse/SPARK-19090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15818716#comment-15818716 ] nirav patel commented on SPARK-19090: - [~q79969786] As I mentioned in previous comment it does work

[jira] [Commented] (SPARK-19090) Dynamic Resource Allocation not respecting spark.executor.cores

[ https://issues.apache.org/jira/browse/SPARK-19090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15815580#comment-15815580 ] nirav patel commented on SPARK-19090: - I tried passing spark parameters via oozie directly using

[jira] [Commented] (SPARK-19090) Dynamic Resource Allocation not respecting spark.executor.cores

[ https://issues.apache.org/jira/browse/SPARK-19090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15815510#comment-15815510 ] nirav patel commented on SPARK-19090: - Yes, I am setting it from a Main application class. It works

[jira] [Comment Edited] (SPARK-19090) Dynamic Resource Allocation not respecting spark.executor.cores

[ https://issues.apache.org/jira/browse/SPARK-19090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813962#comment-15813962 ] nirav patel edited comment on SPARK-19090 at 1/10/17 5:39 AM: -- Oh right, I

[jira] [Comment Edited] (SPARK-19090) Dynamic Resource Allocation not respecting spark.executor.cores

[ https://issues.apache.org/jira/browse/SPARK-19090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813962#comment-15813962 ] nirav patel edited comment on SPARK-19090 at 1/10/17 5:38 AM: -- Oh right, I

[jira] [Commented] (SPARK-19090) Dynamic Resource Allocation not respecting spark.executor.cores

[ https://issues.apache.org/jira/browse/SPARK-19090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813969#comment-15813969 ] nirav patel commented on SPARK-19090: - Also you are just invoking spark-shell here and not submitting

[jira] [Commented] (SPARK-19090) Dynamic Resource Allocation not respecting spark.executor.cores

[ https://issues.apache.org/jira/browse/SPARK-19090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813962#comment-15813962 ] nirav patel commented on SPARK-19090: - Oh right, I have that set exclusively. I corrected my comment.

[jira] [Comment Edited] (SPARK-19090) Dynamic Resource Allocation not respecting spark.executor.cores

[ https://issues.apache.org/jira/browse/SPARK-19090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813689#comment-15813689 ] nirav patel edited comment on SPARK-19090 at 1/10/17 5:33 AM: -- [~jerryshao]

[jira] [Commented] (SPARK-19090) Dynamic Resource Allocation not respecting spark.executor.cores

[ https://issues.apache.org/jira/browse/SPARK-19090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813918#comment-15813918 ] nirav patel commented on SPARK-19090: - I am using oozie spark-action to submit job. I set all spark

[jira] [Commented] (SPARK-19090) Dynamic Resource Allocation not respecting spark.executor.cores

[ https://issues.apache.org/jira/browse/SPARK-19090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813723#comment-15813723 ] nirav patel commented on SPARK-19090: - 1.5.2 > Dynamic Resource Allocation not respecting

[jira] [Commented] (SPARK-15034) Use the value of spark.sql.warehouse.dir as the warehouse location instead of using hive.metastore.warehouse.dir

[ https://issues.apache.org/jira/browse/SPARK-15034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813703#comment-15813703 ] nirav patel commented on SPARK-15034: - Is this documented on spark 2.x documents? I don't see it

[jira] [Comment Edited] (SPARK-19090) Dynamic Resource Allocation not respecting spark.executor.cores

[ https://issues.apache.org/jira/browse/SPARK-19090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813689#comment-15813689 ] nirav patel edited comment on SPARK-19090 at 1/10/17 3:15 AM: -- [~jerryshao]

[jira] [Comment Edited] (SPARK-19090) Dynamic Resource Allocation not respecting spark.executor.cores

[ https://issues.apache.org/jira/browse/SPARK-19090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813689#comment-15813689 ] nirav patel edited comment on SPARK-19090 at 1/10/17 3:14 AM: -- [~jerryshao]

[jira] [Commented] (SPARK-19090) Dynamic Resource Allocation not respecting spark.executor.cores

[ https://issues.apache.org/jira/browse/SPARK-19090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813689#comment-15813689 ] nirav patel commented on SPARK-19090: - [~jerryshao] "spark.executor.cores" is to tell spark AM to

[jira] [Created] (SPARK-19090) Dynamic Resource Allocation not respecting spark.executor.cores

nirav patel created SPARK-19090: --- Summary: Dynamic Resource Allocation not respecting spark.executor.cores Key: SPARK-19090 URL: https://issues.apache.org/jira/browse/SPARK-19090 Project: Spark

[jira] [Updated] (SPARK-18374) Incorrect words in StopWords/english.txt

[ https://issues.apache.org/jira/browse/SPARK-18374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nirav patel updated SPARK-18374: Description: I was just double checking english.txt for list of stopwords as I felt it was taking

[jira] [Commented] (SPARK-18374) Incorrect words in StopWords/english.txt

[ https://issues.apache.org/jira/browse/SPARK-18374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15651793#comment-15651793 ] nirav patel commented on SPARK-18374: - [~srowen] Do you mean how to tokenize words in language

[jira] [Created] (SPARK-18374) Incorrect words in StopWords/english.txt

nirav patel created SPARK-18374: --- Summary: Incorrect words in StopWords/english.txt Key: SPARK-18374 URL: https://issues.apache.org/jira/browse/SPARK-18374 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-18205) Spark ML Estimators and Models needs documentation

[ https://issues.apache.org/jira/browse/SPARK-18205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nirav patel updated SPARK-18205: Description: I see that most of the Algorithms are missing documentation. It's really hard to

[jira] [Updated] (SPARK-18205) Spark ML Estimators and Models needs documentation

[ https://issues.apache.org/jira/browse/SPARK-18205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nirav patel updated SPARK-18205: Summary: Spark ML Estimators and Models needs documentation (was: Spark ML Algorithms needs

[jira] [Created] (SPARK-18205) Spark ML Algorithms needs documentation

nirav patel created SPARK-18205: --- Summary: Spark ML Algorithms needs documentation Key: SPARK-18205 URL: https://issues.apache.org/jira/browse/SPARK-18205 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15589825#comment-15589825 ] nirav patel commented on SPARK-4105: I hit this error as well but I also noticed lot of

[jira] [Updated] (SPARK-15845) Expose metrics for sub-stage transformations and action

[ https://issues.apache.org/jira/browse/SPARK-15845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nirav patel updated SPARK-15845: Description: Spark optimizes DAG processing by efficiently selecting stage boundaries. This

[jira] [Updated] (SPARK-15845) Expose metrics for sub-task transformations and action

[ https://issues.apache.org/jira/browse/SPARK-15845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nirav patel updated SPARK-15845: Summary: Expose metrics for sub-task transformations and action (was: Expose metrics for

[jira] [Created] (SPARK-15845) Expose metrics for sub-task steps

nirav patel created SPARK-15845: --- Summary: Expose metrics for sub-task steps Key: SPARK-15845 URL: https://issues.apache.org/jira/browse/SPARK-15845 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-15845) Expose metrics for sub-stage transformations and action

[ https://issues.apache.org/jira/browse/SPARK-15845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nirav patel updated SPARK-15845: Summary: Expose metrics for sub-stage transformations and action (was: Expose metrics for

[jira] [Commented] (SPARK-15772) Improve Scala API docs

[ https://issues.apache.org/jira/browse/SPARK-15772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15322709#comment-15322709 ] nirav patel commented on SPARK-15772: - I can't point you to every individual functions which needs

[jira] [Created] (SPARK-15772) Improve Scala API docs

nirav patel created SPARK-15772: --- Summary: Improve Scala API docs Key: SPARK-15772 URL: https://issues.apache.org/jira/browse/SPARK-15772 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-2365) Add IndexedRDD, an efficient updatable key-value store

[ https://issues.apache.org/jira/browse/SPARK-2365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955489#comment-14955489 ] nirav patel commented on SPARK-2365: Can it also have a capability to do a "scan" over ordered rdd?

[jira] [Comment Edited] (SPARK-2365) Add IndexedRDD, an efficient updatable key-value store

[ https://issues.apache.org/jira/browse/SPARK-2365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955489#comment-14955489 ] nirav patel edited comment on SPARK-2365 at 10/13/15 7:12 PM: -- Can it also

[jira] [Comment Edited] (SPARK-2365) Add IndexedRDD, an efficient updatable key-value store

[ https://issues.apache.org/jira/browse/SPARK-2365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955489#comment-14955489 ] nirav patel edited comment on SPARK-2365 at 10/13/15 9:46 PM: -- Is it possible

[jira] [Created] (SPARK-9802) spark configuration page should mention spark.executor.cores yarn property

nirav patel created SPARK-9802: -- Summary: spark configuration page should mention spark.executor.cores yarn property Key: SPARK-9802 URL: https://issues.apache.org/jira/browse/SPARK-9802 Project: Spark

[jira] [Commented] (SPARK-9515) Creating JavaSparkContext with yarn-cluster mode throws NPE

[ https://issues.apache.org/jira/browse/SPARK-9515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660286#comment-14660286 ] nirav patel commented on SPARK-9515: [~srowen] I just gave a reason why I can't use

[jira] [Updated] (SPARK-9515) Creating JavaSparkContext with yarn-cluster mode throws NPE

[ https://issues.apache.org/jira/browse/SPARK-9515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nirav patel updated SPARK-9515: --- Summary: Creating JavaSparkContext with yarn-cluster mode throws NPE (was: Creating JavaSparkContext

[jira] [Updated] (SPARK-9515) Creating JavaSparkContext throws NPE

[ https://issues.apache.org/jira/browse/SPARK-9515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nirav patel updated SPARK-9515: --- Description: I have spark application that runs agains YARN cluster. I run spark application as part

[jira] [Updated] (SPARK-9515) Creating JavaSparkContext with yarn-cluster mode throws NPE

[ https://issues.apache.org/jira/browse/SPARK-9515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nirav patel updated SPARK-9515: --- Description: I have spark application that runs agains YARN cluster. I run spark application as part

[jira] [Commented] (SPARK-9515) Creating JavaSparkContext with yarn-cluster mode throws NPE

[ https://issues.apache.org/jira/browse/SPARK-9515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14659191#comment-14659191 ] nirav patel commented on SPARK-9515: Please check EDIT. thanks Creating

[jira] [Reopened] (SPARK-9515) Creating JavaSparkContext with yarn-cluster mode throws NPE

[ https://issues.apache.org/jira/browse/SPARK-9515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nirav patel reopened SPARK-9515: Please check EDIT section Creating JavaSparkContext with yarn-cluster mode throws NPE

[jira] [Comment Edited] (SPARK-9515) Creating JavaSparkContext with yarn-cluster mode throws NPE

[ https://issues.apache.org/jira/browse/SPARK-9515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14659192#comment-14659192 ] nirav patel edited comment on SPARK-9515 at 8/5/15 11:34 PM: -

[jira] [Created] (SPARK-9515) Creating JavaSparkContext throws NPE

nirav patel created SPARK-9515: -- Summary: Creating JavaSparkContext throws NPE Key: SPARK-9515 URL: https://issues.apache.org/jira/browse/SPARK-9515 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-9441) NoSuchMethodError: Com.typesafe.config.Config.getDuration

[ https://issues.apache.org/jira/browse/SPARK-9441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nirav patel updated SPARK-9441: --- Description: I recently migrated my spark based rest service from 1.0.2 to 1.3.1 15/07/29 10:31:12

[jira] [Updated] (SPARK-9441) NoSuchMethodError: Com.typesafe.config.Config.getDuration

[ https://issues.apache.org/jira/browse/SPARK-9441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nirav patel updated SPARK-9441: --- Description: I recently migrated my spark based rest service from 1.0.2 to 1.3.1 15/07/29 10:31:12

[jira] [Created] (SPARK-9441) NoSuchMethodError: Com.typesafe.config.Config.getDuration

nirav patel created SPARK-9441: -- Summary: NoSuchMethodError: Com.typesafe.config.Config.getDuration Key: SPARK-9441 URL: https://issues.apache.org/jira/browse/SPARK-9441 Project: Spark Issue

[jira] [Commented] (SPARK-4492) Exception when following SimpleApp tutorial java.lang.ClassNotFoundException: org.apache.spark.deploy.yarn.YarnSparkHadoopUtil

[ https://issues.apache.org/jira/browse/SPARK-4492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645258#comment-14645258 ] nirav patel commented on SPARK-4492: There are many reasons users don't want to use

[jira] [Created] (SPARK-9423) Why do every other spark comiter keep suggesting to use spark-submit script

nirav patel created SPARK-9423: -- Summary: Why do every other spark comiter keep suggesting to use spark-submit script Key: SPARK-9423 URL: https://issues.apache.org/jira/browse/SPARK-9423 Project: Spark

[jira] [Issue Comment Deleted] (SPARK-4492) Exception when following SimpleApp tutorial java.lang.ClassNotFoundException: org.apache.spark.deploy.yarn.YarnSparkHadoopUtil

[ https://issues.apache.org/jira/browse/SPARK-4492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nirav patel updated SPARK-4492: --- Comment: was deleted (was: There are many reasons users don't want to use 'spark-submit' script so