[jira] [Updated] (SPARK-4346) YarnClientSchedulerBack.asyncMonitorApplication should be common with Client.monitorApplication

[ https://issues.apache.org/jira/browse/SPARK-4346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4346: - Component/s: YARN > YarnClientSchedulerBack.asyncMonitorApplication should be common with > Client.monito

[jira] [Updated] (SPARK-4941) Yarn cluster mode does not upload all needed jars to driver node (Spark 1.2.0)

[ https://issues.apache.org/jira/browse/SPARK-4941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4941: - Component/s: YARN > Yarn cluster mode does not upload all needed jars to driver node (Spark 1.2.0) > -

[jira] [Updated] (SPARK-2765) While running Spark through YARN Control Containers logging.

[ https://issues.apache.org/jira/browse/SPARK-2765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-2765: - Component/s: YARN > While running Spark through YARN Control Containers logging. > ---

[jira] [Updated] (SPARK-1200) Make it possible to use unmanaged AM in yarn-client mode

[ https://issues.apache.org/jira/browse/SPARK-1200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-1200: - Component/s: YARN > Make it possible to use unmanaged AM in yarn-client mode > ---

[jira] [Resolved] (SPARK-5525) [SPARK][SQL]

[ https://issues.apache.org/jira/browse/SPARK-5525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5525. -- Resolution: Invalid > [SPARK][SQL] > > > Key: SPARK-5525 >

[jira] [Updated] (SPARK-5427) Add support for floor function in Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-5427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5427: - Component/s: SQL > Add support for floor function in Spark SQL > -

[jira] [Updated] (SPARK-5314) java.lang.OutOfMemoryError in SparkSQL with GROUP BY

[ https://issues.apache.org/jira/browse/SPARK-5314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5314: - Component/s: SQL > java.lang.OutOfMemoryError in SparkSQL with GROUP BY >

[jira] [Updated] (SPARK-4854) Custom UDTF with Lateral View throws ClassNotFound exception in Spark SQL CLI

[ https://issues.apache.org/jira/browse/SPARK-4854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4854: - Component/s: SQL > Custom UDTF with Lateral View throws ClassNotFound exception in Spark SQL CLI > ---

[jira] [Updated] (SPARK-5060) Spark driver main thread hanging after SQL insert in Parquet file

[ https://issues.apache.org/jira/browse/SPARK-5060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5060: - Component/s: SQL > Spark driver main thread hanging after SQL insert in Parquet file > ---

[jira] [Updated] (SPARK-5525) [SPARK][SQL]

[ https://issues.apache.org/jira/browse/SPARK-5525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5525: - Component/s: SQL > [SPARK][SQL] > > > Key: SPARK-5525 > URL:

[jira] [Updated] (SPARK-5111) HiveContext and Thriftserver cannot work in secure cluster beyond hadoop2.5

[ https://issues.apache.org/jira/browse/SPARK-5111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5111: - Component/s: SQL > HiveContext and Thriftserver cannot work in secure cluster beyond hadoop2.5 > -

[jira] [Updated] (SPARK-5371) SparkSQL Fails to parse Query with UNION ALL in subquery

[ https://issues.apache.org/jira/browse/SPARK-5371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5371: - Component/s: SQL > SparkSQL Fails to parse Query with UNION ALL in subquery >

[jira] [Updated] (SPARK-5129) make SqlContext support "select date +/- XX DAYS from table"

[ https://issues.apache.org/jira/browse/SPARK-5129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5129: - Component/s: SQL > make SqlContext support "select date +/- XX DAYS from table" > --

[jira] [Updated] (SPARK-5633) pyspark saveAsTextFile support for compression codec

[ https://issues.apache.org/jira/browse/SPARK-5633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-5633: -- Assignee: Vladimir Vladimirov > pyspark saveAsTextFile support for compression codec > -

[jira] [Resolved] (SPARK-5633) pyspark saveAsTextFile support for compression codec

[ https://issues.apache.org/jira/browse/SPARK-5633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-5633. --- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4403 [https://github.com/

[jira] [Commented] (SPARK-1799) Add init script to the debian packaging

[ https://issues.apache.org/jira/browse/SPARK-1799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14310002#comment-14310002 ] Sean Owen commented on SPARK-1799: -- This adds a load more stuff to the build for the Debi

[jira] [Commented] (SPARK-540) Add API to customize in-memory representation of RDDs

[ https://issues.apache.org/jira/browse/SPARK-540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1430#comment-1430 ] Reynold Xin commented on SPARK-540: --- Yes it is. > Add API to customize in-memory represe

[jira] [Commented] (SPARK-4900) MLlib SingularValueDecomposition ARPACK IllegalStateException

[ https://issues.apache.org/jira/browse/SPARK-4900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14309981#comment-14309981 ] Sean Owen commented on SPARK-4900: -- Do you have any more info, like how to reproduce this

[jira] [Commented] (SPARK-3454) Expose JSON representation of data shown in WebUI

[ https://issues.apache.org/jira/browse/SPARK-3454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14309969#comment-14309969 ] Apache Spark commented on SPARK-3454: - User 'squito' has created a pull request for th

[jira] [Updated] (SPARK-4983) Add sleep() before tagging EC2 instances to allow instance metadata to propagate

[ https://issues.apache.org/jira/browse/SPARK-4983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-4983: -- Assignee: Gen TANG > Add sleep() before tagging EC2 instances to allow instance metadata to > propagate

[jira] [Updated] (SPARK-4983) Add sleep() before tagging EC2 instances to allow instance metadata to propagate

[ https://issues.apache.org/jira/browse/SPARK-4983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-4983: -- Summary: Add sleep() before tagging EC2 instances to allow instance metadata to propagate (was: Tag EC2

[jira] [Resolved] (SPARK-4983) Tag EC2 instances in the same call that launches them

[ https://issues.apache.org/jira/browse/SPARK-4983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-4983. --- Resolution: Fixed Fix Version/s: 1.2.2 1.3.0 Issue resolved by pull request

[jira] [Closed] (SPARK-706) Failures in block manager put leads to task hanging

[ https://issues.apache.org/jira/browse/SPARK-706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-706. - Resolution: Cannot Reproduce > Failures in block manager put leads to task hanging > --

[jira] [Commented] (SPARK-5531) Spark download .tgz file does not get unpacked

[ https://issues.apache.org/jira/browse/SPARK-5531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14309948#comment-14309948 ] Sean Owen commented on SPARK-5531: -- They don't. Look at the page again. > Spark download

[jira] [Resolved] (SPARK-5586) Automatically provide sqlContext in Spark shell

[ https://issues.apache.org/jira/browse/SPARK-5586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-5586. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4387 [https:/

[jira] [Commented] (SPARK-5531) Spark download .tgz file does not get unpacked

[ https://issues.apache.org/jira/browse/SPARK-5531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14309938#comment-14309938 ] DeepakVohra commented on SPARK-5531: Why two options, Direct Download and Select Apach

[jira] [Commented] (SPARK-5625) Spark binaries do not incude Spark Core

[ https://issues.apache.org/jira/browse/SPARK-5625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14309935#comment-14309935 ] DeepakVohra commented on SPARK-5625: Not clear if the assembly jar is to be extracted.

[jira] [Resolved] (SPARK-5278) check ambiguous reference to fields in Spark SQL is incompleted

[ https://issues.apache.org/jira/browse/SPARK-5278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-5278. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4068 [https:/

[jira] [Resolved] (SPARK-5603) Preinsert casting and renaming rule is needed in the Analyzer

[ https://issues.apache.org/jira/browse/SPARK-5603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-5603. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4373 [https:/

[jira] [Resolved] (SPARK-5595) In memory data cache should be invalidated after insert into/overwrite

[ https://issues.apache.org/jira/browse/SPARK-5595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-5595. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4373 [https:/

[jira] [Commented] (SPARK-5657) Add PySpark Avro Output Format example

[ https://issues.apache.org/jira/browse/SPARK-5657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14309856#comment-14309856 ] Apache Spark commented on SPARK-5657: - User 'staslos' has created a pull request for t

[jira] [Resolved] (SPARK-5324) Results of describe can't be queried

[ https://issues.apache.org/jira/browse/SPARK-5324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-5324. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4249 [https:/

[jira] [Updated] (SPARK-5628) Add option to return spark-ec2 version

[ https://issues.apache.org/jira/browse/SPARK-5628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5628: Labels: backport-needed (was: ) > Add option to return spark-ec2 version >

[jira] [Updated] (SPARK-5628) Add option to return spark-ec2 version

[ https://issues.apache.org/jira/browse/SPARK-5628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5628: Fix Version/s: 1.2.2 > Add option to return spark-ec2 version >

[jira] [Updated] (SPARK-5657) Add PySpark Avro Output Format example

[ https://issues.apache.org/jira/browse/SPARK-5657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stanislav Los updated SPARK-5657: - Component/s: PySpark Examples Affects Version/s: 1.2.0 > Add PySp

[jira] [Created] (SPARK-5657) Add PySpark Avro Output Format example

Stanislav Los created SPARK-5657: Summary: Add PySpark Avro Output Format example Key: SPARK-5657 URL: https://issues.apache.org/jira/browse/SPARK-5657 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-5619) Support 'show roles' in HiveContext

[ https://issues.apache.org/jira/browse/SPARK-5619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-5619. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4397 [https:/

[jira] [Commented] (SPARK-5388) Provide a stable application submission gateway in standalone cluster mode

[ https://issues.apache.org/jira/browse/SPARK-5388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14309825#comment-14309825 ] Patrick Wendell commented on SPARK-5388: One the boolean and numeric values. I don

[jira] [Resolved] (SPARK-5640) org.apache.spark.sql.catalyst.ScalaReflection is not thread safe

[ https://issues.apache.org/jira/browse/SPARK-5640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-5640. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4431 [https:/

[jira] [Resolved] (SPARK-5650) Optional 'FROM' clause in HiveQl

[ https://issues.apache.org/jira/browse/SPARK-5650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-5650. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4426 [https:/

[jira] [Updated] (SPARK-5628) Add option to return spark-ec2 version

[ https://issues.apache.org/jira/browse/SPARK-5628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-5628: -- Fix Version/s: 1.4.0 1.3.0 > Add option to return spark-ec2 version > ---

[jira] [Updated] (SPARK-5628) Add option to return spark-ec2 version

[ https://issues.apache.org/jira/browse/SPARK-5628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-5628: -- Assignee: Nicholas Chammas > Add option to return spark-ec2 version > --

[jira] [Commented] (SPARK-5388) Provide a stable application submission gateway in standalone cluster mode

[ https://issues.apache.org/jira/browse/SPARK-5388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14309784#comment-14309784 ] Patrick Wendell commented on SPARK-5388: On DELETE, I'll defer to you guys, have z

[jira] [Commented] (SPARK-5654) Integrate SparkR into Apache Spark

[ https://issues.apache.org/jira/browse/SPARK-5654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14309782#comment-14309782 ] Matei Zaharia commented on SPARK-5654: -- Yup, there's a tradeoff, but given that this

[jira] [Updated] (SPARK-4705) Driver retries in yarn-cluster mode always fail if event logging is enabled

[ https://issues.apache.org/jira/browse/SPARK-4705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4705: - Target Version/s: 1.4.0 > Driver retries in yarn-cluster mode always fail if event logging is enabled > --

[jira] [Closed] (SPARK-2945) Allow specifying num of executors in the context configuration

[ https://issues.apache.org/jira/browse/SPARK-2945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-2945. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: WangTaoTheTonic Target Version/

[jira] [Updated] (SPARK-3956) Python API for Distributed Matrix

[ https://issues.apache.org/jira/browse/SPARK-3956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-3956: Component/s: PySpark > Python API for Distributed Matrix > -

[jira] [Updated] (SPARK-3600) RDD[Double] doesn't use primitive arrays for caching

[ https://issues.apache.org/jira/browse/SPARK-3600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-3600: Component/s: Spark Core > RDD[Double] doesn't use primitive arrays for caching > ---

[jira] [Updated] (SPARK-4024) Remember user preferences for metrics to show in the UI

[ https://issues.apache.org/jira/browse/SPARK-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-4024: Component/s: Web UI > Remember user preferences for metrics to show in the UI >

[jira] [Updated] (SPARK-3246) Support weighted SVMWithSGD for classification of unbalanced dataset

[ https://issues.apache.org/jira/browse/SPARK-3246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-3246: Component/s: MLlib > Support weighted SVMWithSGD for classification of unbalanced dataset >

[jira] [Commented] (SPARK-5654) Integrate SparkR into Apache Spark

[ https://issues.apache.org/jira/browse/SPARK-5654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14309759#comment-14309759 ] Patrick Wendell commented on SPARK-5654: It's a fair point to ask about something

[jira] [Updated] (SPARK-2064) web ui should not remove executors if they are dead

[ https://issues.apache.org/jira/browse/SPARK-2064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-2064: Component/s: Web UI > web ui should not remove executors if they are dead >

[jira] [Updated] (SPARK-2654) Leveled logging in PySpark

[ https://issues.apache.org/jira/browse/SPARK-2654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-2654: Component/s: PySpark > Leveled logging in PySpark > -- > >

[jira] [Updated] (SPARK-1346) Backport SPARK-1210 into 0.9 branch

[ https://issues.apache.org/jira/browse/SPARK-1346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-1346: Labels: backport-needed (was: ) > Backport SPARK-1210 into 0.9 branch > ---

[jira] [Updated] (SPARK-1927) Implicits declared in companion objects not found in Spark shell

[ https://issues.apache.org/jira/browse/SPARK-1927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-1927: Component/s: Spark Shell > Implicits declared in companion objects not found in Spark shell

[jira] [Commented] (SPARK-1927) Implicits declared in companion objects not found in Spark shell

[ https://issues.apache.org/jira/browse/SPARK-1927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14309755#comment-14309755 ] Nicholas Chammas commented on SPARK-1927: - cc [~tobias.schlatter] > Implicits dec

[jira] [Updated] (SPARK-729) Closures not always serialized at capture time

[ https://issues.apache.org/jira/browse/SPARK-729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-729: --- Component/s: Spark Core > Closures not always serialized at capture time >

[jira] [Commented] (SPARK-1799) Add init script to the debian packaging

[ https://issues.apache.org/jira/browse/SPARK-1799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14309753#comment-14309753 ] Nicholas Chammas commented on SPARK-1799: - cc [~markhamstra], [~srowen], [~pwendel

[jira] [Updated] (SPARK-2326) DiskBlockManager could add DiskChecker function for kicking off bad directories

[ https://issues.apache.org/jira/browse/SPARK-2326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-2326: Component/s: Block Manager > DiskBlockManager could add DiskChecker function for kicking off

[jira] [Updated] (SPARK-1425) PySpark can crash Executors if worker.py fails while serializing data

[ https://issues.apache.org/jira/browse/SPARK-1425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-1425: Component/s: PySpark > PySpark can crash Executors if worker.py fails while serializing data

[jira] [Commented] (SPARK-761) Print a nicer error message when incompatible Spark binaries try to talk

[ https://issues.apache.org/jira/browse/SPARK-761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14309741#comment-14309741 ] Nicholas Chammas commented on SPARK-761: Not sure what component this falls under,

[jira] [Commented] (SPARK-706) Failures in block manager put leads to task hanging

[ https://issues.apache.org/jira/browse/SPARK-706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14309733#comment-14309733 ] Nicholas Chammas commented on SPARK-706: [~rxin] Is this issue still valid? > Fail

[jira] [Updated] (SPARK-706) Failures in block manager put leads to task hanging

[ https://issues.apache.org/jira/browse/SPARK-706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-706: --- Component/s: Block Manager > Failures in block manager put leads to task hanging >

[jira] [Commented] (SPARK-540) Add API to customize in-memory representation of RDDs

[ https://issues.apache.org/jira/browse/SPARK-540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14309728#comment-14309728 ] Nicholas Chammas commented on SPARK-540: [~matei], [~rxin]: Is this issue still val

[jira] [Updated] (SPARK-540) Add API to customize in-memory representation of RDDs

[ https://issues.apache.org/jira/browse/SPARK-540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-540: --- Component/s: Spark Core > Add API to customize in-memory representation of RDDs > -

[jira] [Closed] (SPARK-560) Specialize RDDs / iterators

[ https://issues.apache.org/jira/browse/SPARK-560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-560. - Resolution: Won't Fix > Specialize RDDs / iterators > --- > > Key:

[jira] [Commented] (SPARK-560) Specialize RDDs / iterators

[ https://issues.apache.org/jira/browse/SPARK-560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14309723#comment-14309723 ] Reynold Xin commented on SPARK-560: --- We should close this one. It is much easier to do wi

[jira] [Commented] (SPARK-560) Specialize RDDs / iterators

[ https://issues.apache.org/jira/browse/SPARK-560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14309709#comment-14309709 ] Nicholas Chammas commented on SPARK-560: [~matei], [~pwendell], [~rxin]: Is this is

[jira] [Updated] (SPARK-560) Specialize RDDs / iterators

[ https://issues.apache.org/jira/browse/SPARK-560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-560: --- Component/s: Spark Core > Specialize RDDs / iterators > --- > >

[jira] [Resolved] (SPARK-5652) Use broadcasted weights in LogisticRegressionModel and fix compilation error

[ https://issues.apache.org/jira/browse/SPARK-5652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-5652. -- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4429 [https://githu

[jira] [Commented] (SPARK-5656) NegativeArraySizeException in EigenValueDecomposition.symmetricEigs for large n and/or large k

[ https://issues.apache.org/jira/browse/SPARK-5656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14309684#comment-14309684 ] Apache Spark commented on SPARK-5656: - User 'mbittmann' has created a pull request for

[jira] [Resolved] (SPARK-5555) Enable UISeleniumSuite tests

[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-. --- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4334 [https://github.com/

[jira] [Commented] (SPARK-5654) Integrate SparkR into Apache Spark

[ https://issues.apache.org/jira/browse/SPARK-5654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14309681#comment-14309681 ] Shivaram Venkataraman commented on SPARK-5654: -- Thanks [~srowen] for your com

[jira] [Closed] (SPARK-5618) Optimise utility code.

[ https://issues.apache.org/jira/browse/SPARK-5618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5618. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Makoto Fukuhara Target Version/

[jira] [Resolved] (SPARK-2450) Provide link to YARN executor logs on UI

[ https://issues.apache.org/jira/browse/SPARK-2450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-2450. --- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 3486 [https://github.com/

[jira] [Updated] (SPARK-5656) NegativeArraySizeException in EigenValueDecomposition.symmetricEigs for large n and/or large k

[ https://issues.apache.org/jira/browse/SPARK-5656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Bittmann updated SPARK-5656: - Description: Large values of n or k in EigenValueDecomposition.symmetricEigs will fail with a Neg

[jira] [Updated] (SPARK-5613) YarnClientSchedulerBackend fails to get application report when yarn restarts

[ https://issues.apache.org/jira/browse/SPARK-5613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5613: - Target Version/s: 1.2.2, 1.4.0 (was: 1.2.0, 1.2.1, 1.2.2, 1.4.0) > YarnClientSchedulerBackend fails to ge

[jira] [Commented] (SPARK-4877) userClassPathFirst doesn't handle user classes inheriting from parent

[ https://issues.apache.org/jira/browse/SPARK-4877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14309666#comment-14309666 ] Josh Rosen commented on SPARK-4877: --- I've gone ahead and committed this PR because it fi

[jira] [Updated] (SPARK-4877) userClassPathFirst doesn't handle user classes inheriting from parent

[ https://issues.apache.org/jira/browse/SPARK-4877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-4877: -- Assignee: Stephen Haberman > userClassPathFirst doesn't handle user classes inheriting from parent > ---

[jira] [Resolved] (SPARK-4877) userClassPathFirst doesn't handle user classes inheriting from parent

[ https://issues.apache.org/jira/browse/SPARK-4877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-4877. --- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 3725 [https://github.com/

[jira] [Commented] (SPARK-5625) Spark binaries do not incude Spark Core

[ https://issues.apache.org/jira/browse/SPARK-5625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14309655#comment-14309655 ] Sean Owen commented on SPARK-5625: -- These are in the assembly. The idea is that it is one

[jira] [Created] (SPARK-5656) NegativeArraySizeException in EigenValueDecomposition.symmetricEigs for large n and/or large k

Mark Bittmann created SPARK-5656: Summary: NegativeArraySizeException in EigenValueDecomposition.symmetricEigs for large n and/or large k Key: SPARK-5656 URL: https://issues.apache.org/jira/browse/SPARK-5656

[jira] [Commented] (SPARK-4983) Tag EC2 instances in the same call that launches them

[ https://issues.apache.org/jira/browse/SPARK-4983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14309649#comment-14309649 ] Nicholas Chammas commented on SPARK-4983: - To summarize the discussion we had in [

[jira] [Updated] (SPARK-5396) Syntax error in spark scripts on windows.

[ https://issues.apache.org/jira/browse/SPARK-5396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5396: - Affects Version/s: (was: 1.2.0) 1.3.0 > Syntax error in spark scripts on window

[jira] [Updated] (SPARK-5396) Syntax error in spark scripts on windows.

[ https://issues.apache.org/jira/browse/SPARK-5396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5396: - Priority: Critical (was: Major) > Syntax error in spark scripts on windows. > ---

[jira] [Closed] (SPARK-5396) Syntax error in spark scripts on windows.

[ https://issues.apache.org/jira/browse/SPARK-5396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5396. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Masayoshi TSUZUKI Target Versio

[jira] [Commented] (SPARK-5625) Spark binaries do not incude Spark Core

[ https://issues.apache.org/jira/browse/SPARK-5625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14309636#comment-14309636 ] DeepakVohra commented on SPARK-5625: Thanks for the clarification. Would be better if

[jira] [Updated] (SPARK-5655) YARN Auxiliary Shuffle service can't access shuffle files on Hadoop cluster configured in secure mode

[ https://issues.apache.org/jira/browse/SPARK-5655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Rowson updated SPARK-5655: - Description: When running a Spark job on a YARN cluster which doesn't run containers under the sa

[jira] [Updated] (SPARK-5655) YARN Auxiliary Shuffle service can't access shuffle files on Hadoop cluster configured in secure mode

[ https://issues.apache.org/jira/browse/SPARK-5655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Rowson updated SPARK-5655: - Description: When running a Spark job on a YARN cluster which doesn't run containers under the sa

[jira] [Closed] (SPARK-4337) Add ability to cancel pending requests to YARN

[ https://issues.apache.org/jira/browse/SPARK-4337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4337. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Sandy Ryza Target Version/s: 1.

[jira] [Updated] (SPARK-5655) YARN Auxiliary Shuffle service can't access shuffle files on Hadoop cluster configured in secure mode

[ https://issues.apache.org/jira/browse/SPARK-5655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Rowson updated SPARK-5655: - Description: When running a Spark job on a YARN cluster which doesn't run containers under the sa

[jira] [Closed] (SPARK-5636) Lower dynamic allocation add interval

[ https://issues.apache.org/jira/browse/SPARK-5636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5636. Resolution: Fixed Fix Version/s: 1.3.0 > Lower dynamic allocation add interval >

[jira] [Updated] (SPARK-5655) YARN Auxiliary Shuffle service can't access shuffle files on Hadoop cluster configured in secure mode

[ https://issues.apache.org/jira/browse/SPARK-5655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Rowson updated SPARK-5655: - Description: When running a Spark job on a YARN cluster which doesn't run containers under the sa

[jira] [Updated] (SPARK-5416) Initialize Executor.threadPool before ExecutorSource

[ https://issues.apache.org/jira/browse/SPARK-5416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-5416: -- Fix Version/s: 1.3.0 > Initialize Executor.threadPool before ExecutorSource > --

[jira] [Closed] (SPARK-5593) Replace BlockManager listener with Executor listener in ExecutorAllocationListener

[ https://issues.apache.org/jira/browse/SPARK-5593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5593. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Lianhui Wang Target Version/s:

[jira] [Updated] (SPARK-5593) Replace BlockManager listener with Executor listener in ExecutorAllocationListener

[ https://issues.apache.org/jira/browse/SPARK-5593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5593: - Component/s: Spark Core > Replace BlockManager listener with Executor listener in > ExecutorAllocationLis

[jira] [Updated] (SPARK-5593) Replace BlockManager listener with Executor listener in ExecutorAllocationListener

[ https://issues.apache.org/jira/browse/SPARK-5593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5593: - Affects Version/s: 1.2.0 > Replace BlockManager listener with Executor listener in > ExecutorAllocationLi

[jira] [Updated] (SPARK-5653) in ApplicationMaster rename isDriver to isClusterMode

[ https://issues.apache.org/jira/browse/SPARK-5653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5653: - Affects Version/s: 1.2.0 > in ApplicationMaster rename isDriver to isClusterMode > ---

[jira] [Updated] (SPARK-5470) use defaultClassLoader of Serializer to load classes of classesToRegister in KryoSerializer

[ https://issues.apache.org/jira/browse/SPARK-5470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-5470: -- Fix Version/s: 1.3.0 > use defaultClassLoader of Serializer to load classes of classesToRegister in > K

[jira] [Updated] (SPARK-5653) in ApplicationMaster rename isDriver to isClusterMode

[ https://issues.apache.org/jira/browse/SPARK-5653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5653: - Affects Version/s: (was: 1.2.0) 1.0.0 > in ApplicationMaster rename isDriver to

<    1   2   3   >