[jira] [Commented] (SPARK-7280) Add a method for dropping a column in Java/Scala

[ https://issues.apache.org/jira/browse/SPARK-7280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14536866#comment-14536866 ] Shivaram Venkataraman commented on SPARK-7280: -- FWIW the R API already

[jira] [Assigned] (SPARK-7512) SparkR RDD show method doesn't work after transformations

[ https://issues.apache.org/jira/browse/SPARK-7512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7512: --- Assignee: Apache Spark (was: Shivaram Venkataraman) SparkR RDD show method doesn't work

[jira] [Updated] (SPARK-6101) Create a SparkSQL DataSource API implementation for DynamoDB

[ https://issues.apache.org/jira/browse/SPARK-6101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Fregly updated SPARK-6101: Fix Version/s: (was: 1.4.0) 1.5.0 Create a SparkSQL DataSource API

[jira] [Comment Edited] (SPARK-3630) Identify cause of Kryo+Snappy PARSING_ERROR

[ https://issues.apache.org/jira/browse/SPARK-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14536867#comment-14536867 ] Allan Douglas R. de Oliveira edited comment on SPARK-3630 at 5/9/15 8:34 PM:

[jira] [Commented] (SPARK-7331) Create HiveConf per application instead of per query in HiveQl.scala

[ https://issues.apache.org/jira/browse/SPARK-7331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14537027#comment-14537027 ] Apache Spark commented on SPARK-7331: - User 'nitin2goyal' has created a pull request

[jira] [Comment Edited] (SPARK-3630) Identify cause of Kryo+Snappy PARSING_ERROR

[ https://issues.apache.org/jira/browse/SPARK-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14536867#comment-14536867 ] Allan Douglas R. de Oliveira edited comment on SPARK-3630 at 5/9/15 8:36 PM:

[jira] [Comment Edited] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14536880#comment-14536880 ] Allan Douglas R. de Oliveira edited comment on SPARK-4105 at 5/9/15 8:36 PM:

[jira] [Assigned] (SPARK-7475) adjust ldaExample for online LDA

[ https://issues.apache.org/jira/browse/SPARK-7475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley reassigned SPARK-7475: Assignee: Joseph K. Bradley adjust ldaExample for online LDA

[jira] [Updated] (SPARK-7475) adjust ldaExample for online LDA

[ https://issues.apache.org/jira/browse/SPARK-7475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7475: - Assignee: yuhao yang (was: Joseph K. Bradley) adjust ldaExample for online LDA

[jira] [Resolved] (SPARK-7475) adjust ldaExample for online LDA

[ https://issues.apache.org/jira/browse/SPARK-7475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-7475. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 6000

[jira] [Commented] (SPARK-7512) SparkR RDD show method doesn't work after transformations

[ https://issues.apache.org/jira/browse/SPARK-7512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14536960#comment-14536960 ] Apache Spark commented on SPARK-7512: - User 'shivaram' has created a pull request for

[jira] [Assigned] (SPARK-7512) SparkR RDD show method doesn't work after transformations

[ https://issues.apache.org/jira/browse/SPARK-7512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7512: --- Assignee: Shivaram Venkataraman (was: Apache Spark) SparkR RDD show method doesn't work

[jira] [Comment Edited] (SPARK-3630) Identify cause of Kryo+Snappy PARSING_ERROR

[ https://issues.apache.org/jira/browse/SPARK-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14536867#comment-14536867 ] Allan Douglas R. de Oliveira edited comment on SPARK-3630 at 5/9/15 8:25 PM:

[jira] [Comment Edited] (SPARK-3630) Identify cause of Kryo+Snappy PARSING_ERROR

[ https://issues.apache.org/jira/browse/SPARK-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14536867#comment-14536867 ] Allan Douglas R. de Oliveira edited comment on SPARK-3630 at 5/9/15 8:24 PM:

[jira] [Commented] (SPARK-3630) Identify cause of Kryo+Snappy PARSING_ERROR

[ https://issues.apache.org/jira/browse/SPARK-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14536867#comment-14536867 ] Allan Douglas R. de Oliveira commented on SPARK-3630: - Got something

[jira] [Commented] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14536880#comment-14536880 ] Allan Douglas R. de Oliveira commented on SPARK-4105: - Got something

[jira] [Commented] (SPARK-7280) Add a method for dropping a column in Java/Scala

[ https://issues.apache.org/jira/browse/SPARK-7280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14536885#comment-14536885 ] Nicholas Chammas commented on SPARK-7280: - OK, good to know. Add a method for

[jira] [Created] (SPARK-7512) SparkR RDD show method doesn't work after transformations

Shivaram Venkataraman created SPARK-7512: Summary: SparkR RDD show method doesn't work after transformations Key: SPARK-7512 URL: https://issues.apache.org/jira/browse/SPARK-7512 Project:

[jira] [Commented] (SPARK-7331) Create HiveConf per application instead of per query in HiveQl.scala

[ https://issues.apache.org/jira/browse/SPARK-7331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14537039#comment-14537039 ] Apache Spark commented on SPARK-7331: - User 'nitin2goyal' has created a pull request

[jira] [Resolved] (SPARK-7438) Validation Error while running countApproxDistinct with relative accuracy = 0.38

[ https://issues.apache.org/jira/browse/SPARK-7438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7438. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5974

[jira] [Updated] (SPARK-7438) Validation Error while running countApproxDistinct with relative accuracy = 0.38

[ https://issues.apache.org/jira/browse/SPARK-7438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7438: - Assignee: Vinod KC Validation Error while running countApproxDistinct with relative accuracy = 0.38

[jira] [Assigned] (SPARK-7503) Resources in .sparkStaging directory can't be cleaned up on error

[ https://issues.apache.org/jira/browse/SPARK-7503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7503: --- Assignee: Apache Spark Resources in .sparkStaging directory can't be cleaned up on error

[jira] [Resolved] (SPARK-7403) Link URL in objects on Timeline View is wrong in case of running on YARN

[ https://issues.apache.org/jira/browse/SPARK-7403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7403. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5947

[jira] [Resolved] (SPARK-7451) Spark on Yarn : Preemption of executors is counted as failure causing Spark job to fail

[ https://issues.apache.org/jira/browse/SPARK-7451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7451. -- Resolution: Fixed Fix Version/s: 1.4.0 Spark on Yarn : Preemption of executors is counted as

[jira] [Updated] (SPARK-7451) Spark on Yarn : Preemption of executors is counted as failure causing Spark job to fail

[ https://issues.apache.org/jira/browse/SPARK-7451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7451: - Assignee: Ashwin Shankar Spark on Yarn : Preemption of executors is counted as failure causing Spark

[jira] [Updated] (SPARK-7403) Link URL in objects on Timeline View is wrong in case of running on YARN

[ https://issues.apache.org/jira/browse/SPARK-7403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7403: - Assignee: Kousuke Saruta Link URL in objects on Timeline View is wrong in case of running on YARN

[jira] [Updated] (SPARK-5074) Flaky test: o.a.s.scheduler.DAGSchedulerSuite

[ https://issues.apache.org/jira/browse/SPARK-5074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5074: - Fix Version/s: 1.3.2 Flaky test: o.a.s.scheduler.DAGSchedulerSuite

[jira] [Created] (SPARK-7503) Resources in .sparkStaging directory can't be cleaned up on error

Kousuke Saruta created SPARK-7503: - Summary: Resources in .sparkStaging directory can't be cleaned up on error Key: SPARK-7503 URL: https://issues.apache.org/jira/browse/SPARK-7503 Project: Spark

[jira] [Assigned] (SPARK-7503) Resources in .sparkStaging directory can't be cleaned up on error

[ https://issues.apache.org/jira/browse/SPARK-7503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7503: --- Assignee: (was: Apache Spark) Resources in .sparkStaging directory can't be cleaned up

[jira] [Commented] (SPARK-7503) Resources in .sparkStaging directory can't be cleaned up on error

[ https://issues.apache.org/jira/browse/SPARK-7503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14536334#comment-14536334 ] Apache Spark commented on SPARK-7503: - User 'sarutak' has created a pull request for

[jira] [Updated] (SPARK-6653) New configuration property to specify port for sparkYarnAM actor system

[ https://issues.apache.org/jira/browse/SPARK-6653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6653: - Fix Version/s: (was: 1.5.0) New configuration property to specify port for sparkYarnAM actor system

[jira] [Updated] (SPARK-5112) Expose SizeEstimator as a developer API

[ https://issues.apache.org/jira/browse/SPARK-5112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5112: - Fix Version/s: (was: 1.5.0) Expose SizeEstimator as a developer API

[jira] [Updated] (SPARK-7350) Attach the Streaming page when calling ssc.start()

[ https://issues.apache.org/jira/browse/SPARK-7350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7350: - Fix Version/s: (was: 1.5.0) Attach the Streaming page when calling ssc.start()

[jira] [Updated] (SPARK-5074) Flaky test: o.a.s.scheduler.DAGSchedulerSuite

[ https://issues.apache.org/jira/browse/SPARK-5074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5074: - Fix Version/s: (was: 1.5.0) (was: 1.3.2) Flaky test:

[jira] [Updated] (SPARK-6824) Fill the docs for DataFrame API in SparkR

[ https://issues.apache.org/jira/browse/SPARK-6824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6824: - Fix Version/s: (was: 1.5.0) Fill the docs for DataFrame API in SparkR

[jira] [Commented] (SPARK-7439) Should delete temporary local directories

[ https://issues.apache.org/jira/browse/SPARK-7439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14536315#comment-14536315 ] Sean Owen commented on SPARK-7439: -- In {{DiskBlockManager}}, the directory that is

[jira] [Commented] (SPARK-7439) Should delete temporary local directories

[ https://issues.apache.org/jira/browse/SPARK-7439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14536723#comment-14536723 ] Prasanna Gautam commented on SPARK-7439: If the Spark Context is closed properly

[jira] [Comment Edited] (SPARK-7504) NullPointerException when initializing SparkContext in YARN-cluster mode

[ https://issues.apache.org/jira/browse/SPARK-7504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14536729#comment-14536729 ] Zoltán Zvara edited comment on SPARK-7504 at 5/9/15 3:46 PM: -

[jira] [Commented] (SPARK-7504) NullPointerException when initializing SparkContext in YARN-cluster mode

[ https://issues.apache.org/jira/browse/SPARK-7504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14536729#comment-14536729 ] Zoltán Zvara commented on SPARK-7504: - I did not run in by accident. I was writing

[jira] [Commented] (SPARK-7280) Add a method for dropping a column

[ https://issues.apache.org/jira/browse/SPARK-7280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14536733#comment-14536733 ] Nicholas Chammas commented on SPARK-7280: - I don't think we should mark this as

[jira] [Reopened] (SPARK-7280) Add a method for dropping a column

[ https://issues.apache.org/jira/browse/SPARK-7280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas reopened SPARK-7280: - Add a method for dropping a column --

[jira] [Commented] (SPARK-7504) NullPointerException when initializing SparkContext in YARN-cluster mode

[ https://issues.apache.org/jira/browse/SPARK-7504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14536744#comment-14536744 ] Zoltán Zvara commented on SPARK-7504: - I did not run ApplicationMaster directly

[jira] [Commented] (SPARK-6994) Allow to fetch field values by name in sql.Row

[ https://issues.apache.org/jira/browse/SPARK-6994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14536770#comment-14536770 ] Apache Spark commented on SPARK-6994: - User 'vidma' has created a pull request for

[jira] [Commented] (SPARK-7504) NullPointerException when initializing SparkContext in YARN-cluster mode

[ https://issues.apache.org/jira/browse/SPARK-7504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14536727#comment-14536727 ] Sean Owen commented on SPARK-7504: -- I don't understand the scenario. How do you

[jira] [Commented] (SPARK-7504) NullPointerException when initializing SparkContext in YARN-cluster mode

[ https://issues.apache.org/jira/browse/SPARK-7504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14536734#comment-14536734 ] Sean Owen commented on SPARK-7504: -- I don't think that's supported, but in any event the

[jira] [Commented] (SPARK-7035) Drop __getattr__ on pyspark.sql.DataFrame

[ https://issues.apache.org/jira/browse/SPARK-7035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14536751#comment-14536751 ] Nicholas Chammas commented on SPARK-7035: - {quote} Zen of Python states there

[jira] [Closed] (SPARK-7072) Document fetching field values by name on sql.Row/DataFrame

[ https://issues.apache.org/jira/browse/SPARK-7072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vidmantas zemleris closed SPARK-7072. - Resolution: Fixed Document fetching field values by name on sql.Row/DataFrame

[jira] [Assigned] (SPARK-6784) Clean up all the inbound/outbound conversions for DateType

[ https://issues.apache.org/jira/browse/SPARK-6784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6784: --- Assignee: Apache Spark (was: Yin Huai) Clean up all the inbound/outbound conversions for

[jira] [Commented] (SPARK-6784) Clean up all the inbound/outbound conversions for DateType

[ https://issues.apache.org/jira/browse/SPARK-6784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14536518#comment-14536518 ] Apache Spark commented on SPARK-6784: - User 'scwf' has created a pull request for this

[jira] [Assigned] (SPARK-6784) Clean up all the inbound/outbound conversions for DateType

[ https://issues.apache.org/jira/browse/SPARK-6784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6784: --- Assignee: Yin Huai (was: Apache Spark) Clean up all the inbound/outbound conversions for

[jira] [Commented] (SPARK-6929) Alias for more complex expression causes attribute not been able to resolve

[ https://issues.apache.org/jira/browse/SPARK-6929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14536627#comment-14536627 ] Fei Wang commented on SPARK-6929: - SPARK SQL use c_0 as inner alias name, i think you can

[jira] [Commented] (SPARK-7504) NullPointerException when initializing SparkContext in YARN-cluster mode

[ https://issues.apache.org/jira/browse/SPARK-7504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14536677#comment-14536677 ] Apache Spark commented on SPARK-7504: - User 'ehnalis' has created a pull request for

[jira] [Assigned] (SPARK-7504) NullPointerException when initializing SparkContext in YARN-cluster mode

[ https://issues.apache.org/jira/browse/SPARK-7504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7504: --- Assignee: (was: Apache Spark) NullPointerException when initializing SparkContext in

[jira] [Created] (SPARK-7504) NullPointerException when initializing SparkContext in YARN-cluster mode

Zoltán Zvara created SPARK-7504: --- Summary: NullPointerException when initializing SparkContext in YARN-cluster mode Key: SPARK-7504 URL: https://issues.apache.org/jira/browse/SPARK-7504 Project: Spark

[jira] [Updated] (SPARK-7505) Update PySpark DataFrame docs: encourage __getitem__, mark as experimental, etc.

[ https://issues.apache.org/jira/browse/SPARK-7505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-7505: Component/s: PySpark Update PySpark DataFrame docs: encourage __getitem__, mark as

[jira] [Created] (SPARK-7505) Update PySpark DataFrame docs: encourage __getitem__, mark as experimental, etc.

Nicholas Chammas created SPARK-7505: --- Summary: Update PySpark DataFrame docs: encourage __getitem__, mark as experimental, etc. Key: SPARK-7505 URL: https://issues.apache.org/jira/browse/SPARK-7505

[jira] [Comment Edited] (SPARK-6479) Create external block store API

[ https://issues.apache.org/jira/browse/SPARK-6479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14536793#comment-14536793 ] Dmitriy Setrakyan edited comment on SPARK-6479 at 5/9/15 5:57 PM:

[jira] [Commented] (SPARK-6479) Create external block store API

[ https://issues.apache.org/jira/browse/SPARK-6479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14536793#comment-14536793 ] Dmitriy Setrakyan commented on SPARK-6479: -- I believe that you maybe able to

[jira] [Commented] (SPARK-7504) NullPointerException when initializing SparkContext in YARN-cluster mode

[ https://issues.apache.org/jira/browse/SPARK-7504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14536799#comment-14536799 ] Andrew Or commented on SPARK-7504: -- Zoltan, what do you mean configuring a SparkContext

[jira] [Created] (SPARK-7507) pyspark.sql.types.StructType and Row should implement __iter__()

Nicholas Chammas created SPARK-7507: --- Summary: pyspark.sql.types.StructType and Row should implement __iter__() Key: SPARK-7507 URL: https://issues.apache.org/jira/browse/SPARK-7507 Project: Spark

[jira] [Created] (SPARK-7506) pyspark.sql.types.StructType.fromJson() is incorrectly named

Nicholas Chammas created SPARK-7506: --- Summary: pyspark.sql.types.StructType.fromJson() is incorrectly named Key: SPARK-7506 URL: https://issues.apache.org/jira/browse/SPARK-7506 Project: Spark

[jira] [Updated] (SPARK-7505) Update PySpark DataFrame docs: encourage __getitem__, mark as experimental, etc.

[ https://issues.apache.org/jira/browse/SPARK-7505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-7505: Component/s: SQL Update PySpark DataFrame docs: encourage __getitem__, mark as

[jira] [Commented] (SPARK-7345) Spark cannot detect renamed columns using JDBC connector

[ https://issues.apache.org/jira/browse/SPARK-7345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14536805#comment-14536805 ] Apache Spark commented on SPARK-7345: - User 'osidorkin' has created a pull request for

[jira] [Assigned] (SPARK-7345) Spark cannot detect renamed columns using JDBC connector

[ https://issues.apache.org/jira/browse/SPARK-7345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7345: --- Assignee: Apache Spark Spark cannot detect renamed columns using JDBC connector

[jira] [Assigned] (SPARK-7345) Spark cannot detect renamed columns using JDBC connector

[ https://issues.apache.org/jira/browse/SPARK-7345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7345: --- Assignee: (was: Apache Spark) Spark cannot detect renamed columns using JDBC connector

[jira] [Created] (SPARK-7508) JettyUtils-generated servlets to log report all errors

Steve Loughran created SPARK-7508: - Summary: JettyUtils-generated servlets to log report all errors Key: SPARK-7508 URL: https://issues.apache.org/jira/browse/SPARK-7508 Project: Spark

[jira] [Commented] (SPARK-7504) NullPointerException when initializing SparkContext in YARN-cluster mode

[ https://issues.apache.org/jira/browse/SPARK-7504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14536820#comment-14536820 ] Zoltán Zvara commented on SPARK-7504: - No, I did not use {{spark-submit}}, but I ran a

[jira] [Comment Edited] (SPARK-7504) NullPointerException when initializing SparkContext in YARN-cluster mode

[ https://issues.apache.org/jira/browse/SPARK-7504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14536820#comment-14536820 ] Zoltán Zvara edited comment on SPARK-7504 at 5/9/15 6:36 PM: -

[jira] [Assigned] (SPARK-7508) JettyUtils-generated servlets to log report all errors

[ https://issues.apache.org/jira/browse/SPARK-7508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7508: --- Assignee: Apache Spark JettyUtils-generated servlets to log report all errors

[jira] [Commented] (SPARK-7508) JettyUtils-generated servlets to log report all errors

[ https://issues.apache.org/jira/browse/SPARK-7508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14536824#comment-14536824 ] Apache Spark commented on SPARK-7508: - User 'steveloughran' has created a pull request

[jira] [Assigned] (SPARK-7508) JettyUtils-generated servlets to log report all errors

[ https://issues.apache.org/jira/browse/SPARK-7508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7508: --- Assignee: (was: Apache Spark) JettyUtils-generated servlets to log report all errors

[jira] [Updated] (SPARK-6798) Fix Date serialization in SparkR

[ https://issues.apache.org/jira/browse/SPARK-6798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6798: - Target Version/s: 1.5.0 (was: 1.4.0) Fix Date serialization in SparkR

[jira] [Closed] (SPARK-7469) DAG visualization: show operators for SQL

[ https://issues.apache.org/jira/browse/SPARK-7469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-7469. Resolution: Fixed Fix Version/s: 1.4.0 DAG visualization: show operators for SQL

[jira] [Updated] (SPARK-7500) DAG visualization: cluster name bleeds beyond the cluster

[ https://issues.apache.org/jira/browse/SPARK-7500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7500: - Issue Type: Sub-task (was: Bug) Parent: SPARK-7463 DAG visualization: cluster name bleeds

[jira] [Updated] (SPARK-7502) DAG visualization: handle removed stages gracefully

[ https://issues.apache.org/jira/browse/SPARK-7502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7502: - Issue Type: Sub-task (was: Bug) Parent: SPARK-7463 DAG visualization: handle removed stages

[jira] [Updated] (SPARK-7501) DAG visualization: show DStream operations for Streaming

[ https://issues.apache.org/jira/browse/SPARK-7501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7501: - Issue Type: Sub-task (was: Bug) Parent: SPARK-7463 DAG visualization: show DStream operations

[jira] [Updated] (SPARK-7506) pyspark.sql.types.StructType.fromJson() is incorrectly named

[ https://issues.apache.org/jira/browse/SPARK-7506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7506: --- Assignee: Davies Liu pyspark.sql.types.StructType.fromJson() is incorrectly named

[jira] [Updated] (SPARK-7506) pyspark.sql.types.StructType.fromJson() is incorrectly named

[ https://issues.apache.org/jira/browse/SPARK-7506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7506: --- Issue Type: Sub-task (was: Bug) Parent: SPARK-6116 pyspark.sql.types.StructType.fromJson()

[jira] [Updated] (SPARK-7505) Update PySpark DataFrame docs: encourage __getitem__, mark as experimental, etc.

[ https://issues.apache.org/jira/browse/SPARK-7505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7505: --- Issue Type: Sub-task (was: Improvement) Parent: SPARK-6116 Update PySpark DataFrame docs:

[jira] [Updated] (SPARK-7507) pyspark.sql.types.StructType and Row should implement __iter__()

[ https://issues.apache.org/jira/browse/SPARK-7507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7507: --- Issue Type: Sub-task (was: Improvement) Parent: SPARK-6116 pyspark.sql.types.StructType and

[jira] [Assigned] (SPARK-7501) DAG visualization: show DStream operations for Streaming

[ https://issues.apache.org/jira/browse/SPARK-7501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7501: --- Assignee: Apache Spark (was: Andrew Or) DAG visualization: show DStream operations for

[jira] [Commented] (SPARK-7501) DAG visualization: show DStream operations for Streaming

[ https://issues.apache.org/jira/browse/SPARK-7501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14536833#comment-14536833 ] Apache Spark commented on SPARK-7501: - User 'andrewor14' has created a pull request

[jira] [Assigned] (SPARK-7501) DAG visualization: show DStream operations for Streaming

[ https://issues.apache.org/jira/browse/SPARK-7501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7501: --- Assignee: Andrew Or (was: Apache Spark) DAG visualization: show DStream operations for

[jira] [Created] (SPARK-7509) Add drop column to Python DataFrame API

Reynold Xin created SPARK-7509: -- Summary: Add drop column to Python DataFrame API Key: SPARK-7509 URL: https://issues.apache.org/jira/browse/SPARK-7509 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-7280) Add a method for dropping a column in Java/Scala

[ https://issues.apache.org/jira/browse/SPARK-7280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7280: --- Summary: Add a method for dropping a column in Java/Scala (was: Add a method for dropping a column)

[jira] [Commented] (SPARK-7280) Add a method for dropping a column in Java/Scala

[ https://issues.apache.org/jira/browse/SPARK-7280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14536834#comment-14536834 ] Reynold Xin commented on SPARK-7280: I don't think it is question of which one is more

[jira] [Commented] (SPARK-7280) Add a method for dropping a column in Java/Scala

[ https://issues.apache.org/jira/browse/SPARK-7280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14536835#comment-14536835 ] Nicholas Chammas commented on SPARK-7280: - SGTM. Add a method for dropping a

[jira] [Created] (SPARK-7510) DAG visualization: Arrows should not cover text

Andrew Or created SPARK-7510: Summary: DAG visualization: Arrows should not cover text Key: SPARK-7510 URL: https://issues.apache.org/jira/browse/SPARK-7510 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-7510) DAG visualization: Arrows should not cover text

[ https://issues.apache.org/jira/browse/SPARK-7510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7510: - Attachment: arrows-cover-text.png DAG visualization: Arrows should not cover text

[jira] [Commented] (SPARK-7280) Add a method for dropping a column in Java/Scala

[ https://issues.apache.org/jira/browse/SPARK-7280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14536841#comment-14536841 ] Nicholas Chammas commented on SPARK-7280: - So do we still need to add this method

[jira] [Resolved] (SPARK-7228) SparkR public API for 1.4 release

[ https://issues.apache.org/jira/browse/SPARK-7228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-7228. -- Resolution: Fixed Resolving as all the sub-tasks have been now resolved