[jira] [Resolved] (SPARK-21950) pyspark.sql.tests.SQLTests2 should stop SparkContext.

[ https://issues.apache.org/jira/browse/SPARK-21950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-21950. --- Resolution: Fixed Fix Version/s: 2.1.2 2.3.0

[jira] [Assigned] (SPARK-21950) pyspark.sql.tests.SQLTests2 should stop SparkContext.

[ https://issues.apache.org/jira/browse/SPARK-21950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin reassigned SPARK-21950: - Assignee: Takuya Ueshin > pyspark.sql.tests.SQLTests2 should stop SparkContext. >

[jira] [Commented] (SPARK-18278) SPIP: Support native submission of spark jobs to a kubernetes cluster

[ https://issues.apache.org/jira/browse/SPARK-18278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16158100#comment-16158100 ] Anirudh Ramanathan commented on SPARK-18278: The plan is to support k8s features (beta/GA) in

[jira] [Closed] (SPARK-21948) How to use spark streaming for deal two table from one topic of topic??

[ https://issues.apache.org/jira/browse/SPARK-21948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaP524 closed SPARK-21948. --- > How to use spark streaming for deal two table from one topic of topic?? >

[jira] [Closed] (SPARK-21776) How to use the memory-mapped file on Spark??

[ https://issues.apache.org/jira/browse/SPARK-21776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaP524 closed SPARK-21776. --- > How to use the memory-mapped file on Spark?? > > >

[jira] [Comment Edited] (SPARK-21944) Watermark on window column is wrong

[ https://issues.apache.org/jira/browse/SPARK-21944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16158055#comment-16158055 ] Kevin Zhang edited comment on SPARK-21944 at 9/8/17 2:51 AM: - I found the

[jira] [Commented] (SPARK-21944) Watermark on window column is wrong

[ https://issues.apache.org/jira/browse/SPARK-21944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16158055#comment-16158055 ] Kevin Zhang commented on SPARK-21944: - I found the problem when I use kafka source consuming our

[jira] [Comment Edited] (SPARK-18278) SPIP: Support native submission of spark jobs to a kubernetes cluster

[ https://issues.apache.org/jira/browse/SPARK-18278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16158051#comment-16158051 ] Cyanny edited comment on SPARK-18278 at 9/8/17 2:49 AM: Does spark-on-k8s have

[jira] [Commented] (SPARK-18278) SPIP: Support native submission of spark jobs to a kubernetes cluster

[ https://issues.apache.org/jira/browse/SPARK-18278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16158051#comment-16158051 ] Cyanny commented on SPARK-18278: Does spark-on-k8s have any plan to support priority when submit

[jira] [Assigned] (SPARK-21950) pyspark.sql.tests.SQLTests2 should stop SparkContext.

[ https://issues.apache.org/jira/browse/SPARK-21950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21950: Assignee: Apache Spark > pyspark.sql.tests.SQLTests2 should stop SparkContext. >

[jira] [Assigned] (SPARK-21950) pyspark.sql.tests.SQLTests2 should stop SparkContext.

[ https://issues.apache.org/jira/browse/SPARK-21950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21950: Assignee: (was: Apache Spark) > pyspark.sql.tests.SQLTests2 should stop SparkContext.

[jira] [Commented] (SPARK-21950) pyspark.sql.tests.SQLTests2 should stop SparkContext.

[ https://issues.apache.org/jira/browse/SPARK-21950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16158047#comment-16158047 ] Apache Spark commented on SPARK-21950: -- User 'ueshin' has created a pull request for this issue:

[jira] [Commented] (SPARK-21946) Flaky test: InMemoryCatalogedDDLSuite.`alter table: rename cached table`

[ https://issues.apache.org/jira/browse/SPARK-21946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16158046#comment-16158046 ] Dongjoon Hyun commented on SPARK-21946: --- Thanks! Go for it! :) > Flaky test:

[jira] [Commented] (SPARK-21946) Flaky test: InMemoryCatalogedDDLSuite.`alter table: rename cached table`

[ https://issues.apache.org/jira/browse/SPARK-21946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16158044#comment-16158044 ] Kazuaki Ishizaki commented on SPARK-21946: -- If someone has not worked for this, I will create a

[jira] [Created] (SPARK-21950) pyspark.sql.tests.SQLTests2 should stop SparkContext.

Takuya Ueshin created SPARK-21950: - Summary: pyspark.sql.tests.SQLTests2 should stop SparkContext. Key: SPARK-21950 URL: https://issues.apache.org/jira/browse/SPARK-21950 Project: Spark

[jira] [Commented] (SPARK-21914) Running examples as tests in SQL builtin function documentation

[ https://issues.apache.org/jira/browse/SPARK-21914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16158017#comment-16158017 ] Hyukjin Kwon commented on SPARK-21914: -- I see. What do you think about controlling it, for example,

[jira] [Assigned] (SPARK-21949) Tables created in unit tests should be dropped after use

[ https://issues.apache.org/jira/browse/SPARK-21949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21949: Assignee: Apache Spark > Tables created in unit tests should be dropped after use >

[jira] [Assigned] (SPARK-21949) Tables created in unit tests should be dropped after use

[ https://issues.apache.org/jira/browse/SPARK-21949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21949: Assignee: (was: Apache Spark) > Tables created in unit tests should be dropped after

[jira] [Commented] (SPARK-21949) Tables created in unit tests should be dropped after use

[ https://issues.apache.org/jira/browse/SPARK-21949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16158003#comment-16158003 ] Apache Spark commented on SPARK-21949: -- User '10110346' has created a pull request for this issue:

[jira] [Created] (SPARK-21949) Tables created in unit tests should be dropped after use

liuxian created SPARK-21949: --- Summary: Tables created in unit tests should be dropped after use Key: SPARK-21949 URL: https://issues.apache.org/jira/browse/SPARK-21949 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-21939) Use TimeLimits instead of Timeouts

[ https://issues.apache.org/jira/browse/SPARK-21939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao reassigned SPARK-21939: --- Assignee: Dongjoon Hyun > Use TimeLimits instead of Timeouts >

[jira] [Resolved] (SPARK-21939) Use TimeLimits instead of Timeouts

[ https://issues.apache.org/jira/browse/SPARK-21939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao resolved SPARK-21939. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19150

[jira] [Updated] (SPARK-21948) How to use spark streaming for deal two table from one topic of topic??

[ https://issues.apache.org/jira/browse/SPARK-21948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaP524 updated SPARK-21948: Remaining Estimate: 12h Original Estimate: 12h > How to use spark streaming for deal two table from

[jira] [Updated] (SPARK-21776) How to use the memory-mapped file on Spark??

[ https://issues.apache.org/jira/browse/SPARK-21776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaP524 updated SPARK-21776: Remaining Estimate: 12h Original Estimate: 12h > How to use the memory-mapped file on Spark?? >

[jira] [Commented] (SPARK-19090) Dynamic Resource Allocation not respecting spark.executor.cores

[ https://issues.apache.org/jira/browse/SPARK-19090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157932#comment-16157932 ] Carlos Vicenti commented on SPARK-19090: I have found the same issue while using Hive On Spark

[jira] [Resolved] (SPARK-21948) How to use spark streaming for deal two table from one topic of topic??

[ https://issues.apache.org/jira/browse/SPARK-21948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-21948. -- Resolution: Invalid Questions should go to the mailing list rather than describing it as a

[jira] [Updated] (SPARK-21948) How to use spark streaming for deal two table from one topic of topic??

[ https://issues.apache.org/jira/browse/SPARK-21948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaP524 updated SPARK-21948: Attachment: QQ图片20170908080946.png > How to use spark streaming for deal two table from one topic of

[jira] [Updated] (SPARK-21946) Flaky test: InMemoryCatalogedDDLSuite.`alter table: rename cached table`

[ https://issues.apache.org/jira/browse/SPARK-21946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-21946: -- Priority: Minor (was: Major) > Flaky test: InMemoryCatalogedDDLSuite.`alter table: rename

[jira] [Issue Comment Deleted] (SPARK-21948) How to use spark streaming for deal two table from one topic of topic??

[ https://issues.apache.org/jira/browse/SPARK-21948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaP524 updated SPARK-21948: Comment: was deleted (was: !http://example.com/image.png!) > How to use spark streaming for deal two

[jira] [Commented] (SPARK-21948) How to use spark streaming for deal two table from one topic of topic??

[ https://issues.apache.org/jira/browse/SPARK-21948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157912#comment-16157912 ] zhaP524 commented on SPARK-21948: - !http://example.com/image.png! > How to use spark streaming for deal

[jira] [Created] (SPARK-21948) How to use spark streaming for deal two table from one topic of topic??

zhaP524 created SPARK-21948: --- Summary: How to use spark streaming for deal two table from one topic of topic?? Key: SPARK-21948 URL: https://issues.apache.org/jira/browse/SPARK-21948 Project: Spark

[jira] [Created] (SPARK-21947) monotonically_increasing_id doesn't work in Structured Streaming

Shixiong Zhu created SPARK-21947: Summary: monotonically_increasing_id doesn't work in Structured Streaming Key: SPARK-21947 URL: https://issues.apache.org/jira/browse/SPARK-21947 Project: Spark

[jira] [Assigned] (SPARK-13656) Delete spark.sql.parquet.cacheMetadata

[ https://issues.apache.org/jira/browse/SPARK-13656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-13656: --- Assignee: Dongjoon Hyun > Delete spark.sql.parquet.cacheMetadata >

[jira] [Resolved] (SPARK-13656) Delete spark.sql.parquet.cacheMetadata

[ https://issues.apache.org/jira/browse/SPARK-13656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-13656. - Resolution: Fixed Fix Version/s: 2.3.0 > Delete spark.sql.parquet.cacheMetadata >

[jira] [Resolved] (SPARK-18769) Spark to be smarter about what the upper bound is and to restrict number of executor when dynamic allocation is enabled

[ https://issues.apache.org/jira/browse/SPARK-18769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-18769. Resolution: Won't Fix See discussion in PR. The main driver for this was a request from

[jira] [Updated] (SPARK-21946) Flaky test: InMemoryCatalogedDDLSuite.`alter table: rename cached table`

[ https://issues.apache.org/jira/browse/SPARK-21946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-21946: -- Description: According to the [Apache Spark Jenkins

[jira] [Created] (SPARK-21946) Flaky test: InMemoryCatalogedDDLSuite.`alter table: rename cached table`

Dongjoon Hyun created SPARK-21946: - Summary: Flaky test: InMemoryCatalogedDDLSuite.`alter table: rename cached table` Key: SPARK-21946 URL: https://issues.apache.org/jira/browse/SPARK-21946 Project:

[jira] [Created] (SPARK-21945) pyspark --py-files doesn't work in yarn client mode

Thomas Graves created SPARK-21945: - Summary: pyspark --py-files doesn't work in yarn client mode Key: SPARK-21945 URL: https://issues.apache.org/jira/browse/SPARK-21945 Project: Spark Issue

[jira] [Commented] (SPARK-21914) Running examples as tests in SQL builtin function documentation

[ https://issues.apache.org/jira/browse/SPARK-21914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157542#comment-16157542 ] Reynold Xin commented on SPARK-21914: - Thanks for pinging me. Given the test coverage for this is

[jira] [Commented] (SPARK-9776) Another instance of Derby may have already booted the database

[ https://issues.apache.org/jira/browse/SPARK-9776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157531#comment-16157531 ] Holger Brandl commented on SPARK-9776: -- But isn't it a major flaw/bug, if the current (that is v.2.2)

[jira] [Commented] (SPARK-21942) DiskBlockManager crashing when a root local folder has been externally deleted by OS

[ https://issues.apache.org/jira/browse/SPARK-21942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157529#comment-16157529 ] Ruslan Shestopalyuk commented on SPARK-21942: - I can't comment on how common it is in

[jira] [Commented] (SPARK-21842) Support Kerberos ticket renewal and creation in Mesos

[ https://issues.apache.org/jira/browse/SPARK-21842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157527#comment-16157527 ] Kalvin Chau commented on SPARK-21842: - Hey [~arand] no worries, I just recently got time to get

[jira] [Comment Edited] (SPARK-21942) DiskBlockManager crashing when a root local folder has been externally deleted by OS

[ https://issues.apache.org/jira/browse/SPARK-21942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157489#comment-16157489 ] Ruslan Shestopalyuk edited comment on SPARK-21942 at 9/7/17 7:34 PM: -

[jira] [Comment Edited] (SPARK-21942) DiskBlockManager crashing when a root local folder has been externally deleted by OS

[ https://issues.apache.org/jira/browse/SPARK-21942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157489#comment-16157489 ] Ruslan Shestopalyuk edited comment on SPARK-21942 at 9/7/17 7:33 PM: -

[jira] [Comment Edited] (SPARK-21942) DiskBlockManager crashing when a root local folder has been externally deleted by OS

[ https://issues.apache.org/jira/browse/SPARK-21942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157489#comment-16157489 ] Ruslan Shestopalyuk edited comment on SPARK-21942 at 9/7/17 7:32 PM: -

[jira] [Commented] (SPARK-21942) DiskBlockManager crashing when a root local folder has been externally deleted by OS

[ https://issues.apache.org/jira/browse/SPARK-21942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157503#comment-16157503 ] Sean Owen commented on SPARK-21942: --- It's possible that these files aren't touched for a very long

[jira] [Comment Edited] (SPARK-21942) DiskBlockManager crashing when a root local folder has been externally deleted by OS

[ https://issues.apache.org/jira/browse/SPARK-21942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157489#comment-16157489 ] Ruslan Shestopalyuk edited comment on SPARK-21942 at 9/7/17 7:31 PM: -

[jira] [Commented] (SPARK-21942) DiskBlockManager crashing when a root local folder has been externally deleted by OS

[ https://issues.apache.org/jira/browse/SPARK-21942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157489#comment-16157489 ] Ruslan Shestopalyuk commented on SPARK-21942: - Sean, OS won't ever delete the files that are

[jira] [Commented] (SPARK-20589) Allow limiting task concurrency per stage

[ https://issues.apache.org/jira/browse/SPARK-20589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157424#comment-16157424 ] Apache Spark commented on SPARK-20589: -- User 'dhruve' has created a pull request for this issue:

[jira] [Updated] (SPARK-21890) ObtainCredentials does not pass creds to addDelegationTokens

[ https://issues.apache.org/jira/browse/SPARK-21890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-21890: --- Fix Version/s: 2.2.1 > ObtainCredentials does not pass creds to addDelegationTokens >

[jira] [Resolved] (SPARK-21890) ObtainCredentials does not pass creds to addDelegationTokens

[ https://issues.apache.org/jira/browse/SPARK-21890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-21890. --- Resolution: Fixed Assignee: Sanket Reddy Fix Version/s: 2.3.0 >

[jira] [Commented] (SPARK-18971) Netty issue may cause the shuffle client hang

[ https://issues.apache.org/jira/browse/SPARK-18971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157113#comment-16157113 ] niccolo becchi commented on SPARK-18971: We are facing the same issue, and we are planning to

[jira] [Commented] (SPARK-21944) Watermark on window column is wrong

[ https://issues.apache.org/jira/browse/SPARK-21944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157091#comment-16157091 ] Marco Gaido commented on SPARK-21944: - May you please provide some sample data to reproduce the

[jira] [Commented] (SPARK-21942) DiskBlockManager crashing when a root local folder has been externally deleted by OS

[ https://issues.apache.org/jira/browse/SPARK-21942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157041#comment-16157041 ] Sean Owen commented on SPARK-21942: --- I suppose my real doubt is whether this would actually resolve the

[jira] [Resolved] (SPARK-21919) inconsistent behavior of AFTsurvivalRegression algorithm

[ https://issues.apache.org/jira/browse/SPARK-21919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21919. --- Resolution: Duplicate > inconsistent behavior of AFTsurvivalRegression algorithm >

[jira] [Commented] (SPARK-21919) inconsistent behavior of AFTsurvivalRegression algorithm

[ https://issues.apache.org/jira/browse/SPARK-21919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157027#comment-16157027 ] Yanbo Liang commented on SPARK-21919: - [~srowen] You are right, that is caused by line search bug.

[jira] [Commented] (SPARK-21919) inconsistent behavior of AFTsurvivalRegression algorithm

[ https://issues.apache.org/jira/browse/SPARK-21919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157013#comment-16157013 ] Sean Owen commented on SPARK-21919: --- Hm, yeah, I suppose I should have tried it too. On {{master}}, and

[jira] [Commented] (SPARK-17147) Spark Streaming Kafka 0.10 Consumer Can't Handle Non-consecutive Offsets (i.e. Log Compaction)

[ https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157002#comment-16157002 ] Cody Koeninger commented on SPARK-17147: Patch is there, if anyone wants to test it and provide

[jira] [Updated] (SPARK-21942) DiskBlockManager crashing when a root local folder has been externally deleted by OS

[ https://issues.apache.org/jira/browse/SPARK-21942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruslan Shestopalyuk updated SPARK-21942: Summary: DiskBlockManager crashing when a root local folder has been externally

[jira] [Commented] (SPARK-21942) ix DiskBlockManager crashing when a root local folder has been externally deleted by OS

[ https://issues.apache.org/jira/browse/SPARK-21942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16156983#comment-16156983 ] Ruslan Shestopalyuk commented on SPARK-21942: - I respectfully agree, just want to point that:

[jira] [Comment Edited] (SPARK-21919) inconsistent behavior of AFTsurvivalRegression algorithm

[ https://issues.apache.org/jira/browse/SPARK-21919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16156979#comment-16156979 ] Yanbo Liang edited comment on SPARK-21919 at 9/7/17 2:02 PM: -

[jira] [Comment Edited] (SPARK-21919) inconsistent behavior of AFTsurvivalRegression algorithm

[ https://issues.apache.org/jira/browse/SPARK-21919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16156979#comment-16156979 ] Yanbo Liang edited comment on SPARK-21919 at 9/7/17 2:02 PM: -

[jira] [Comment Edited] (SPARK-21919) inconsistent behavior of AFTsurvivalRegression algorithm

[ https://issues.apache.org/jira/browse/SPARK-21919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16156979#comment-16156979 ] Yanbo Liang edited comment on SPARK-21919 at 9/7/17 1:59 PM: -

[jira] [Comment Edited] (SPARK-21919) inconsistent behavior of AFTsurvivalRegression algorithm

[ https://issues.apache.org/jira/browse/SPARK-21919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16156979#comment-16156979 ] Yanbo Liang edited comment on SPARK-21919 at 9/7/17 1:58 PM: -

[jira] [Commented] (SPARK-21919) inconsistent behavior of AFTsurvivalRegression algorithm

[ https://issues.apache.org/jira/browse/SPARK-21919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16156979#comment-16156979 ] Yanbo Liang commented on SPARK-21919: - [~ashishchopra0308] [~srowen] I can't reproduce this issue, I

[jira] [Updated] (SPARK-21942) ix DiskBlockManager crashing when a root local folder has been externally deleted by OS

[ https://issues.apache.org/jira/browse/SPARK-21942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruslan Shestopalyuk updated SPARK-21942: Description: _DiskBlockManager_ has a notion of a "scratch" local folder(s), which

[jira] [Updated] (SPARK-21942) ix DiskBlockManager crashing when a root local folder has been externally deleted by OS

[ https://issues.apache.org/jira/browse/SPARK-21942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruslan Shestopalyuk updated SPARK-21942: Description: _DiskBlockManager_ has a notion of a "scratch" local folder(s), which

[jira] [Updated] (SPARK-21942) ix DiskBlockManager crashing when a root local folder has been externally deleted by OS

[ https://issues.apache.org/jira/browse/SPARK-21942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruslan Shestopalyuk updated SPARK-21942: Description: _DiskBlockManager_ has a notion of a "scratch" local folder(s), which

[jira] [Updated] (SPARK-21942) ix DiskBlockManager crashing when a root local folder has been externally deleted by OS

[ https://issues.apache.org/jira/browse/SPARK-21942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruslan Shestopalyuk updated SPARK-21942: Description: _DiskBlockManager_ has a notion of a "scratch" local folder(s), which

[jira] [Commented] (SPARK-20427) Issue with Spark interpreting Oracle datatype NUMBER

[ https://issues.apache.org/jira/browse/SPARK-20427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16156966#comment-16156966 ] Krzysztof Sobusiak commented on SPARK-20427: As far as Oracle is concerned this is the code

[jira] [Commented] (SPARK-21943) When I use rest Api (/ applications / [app-id] / jobs / [job-id]) to view some of the jobs that are running jobs, the returned json information is missing the “descrip

[ https://issues.apache.org/jira/browse/SPARK-21943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16156953#comment-16156953 ] Sean Owen commented on SPARK-21943: --- Is there no description, then? what does the UI say? are you sure

[jira] [Commented] (SPARK-17147) Spark Streaming Kafka 0.10 Consumer Can't Handle Non-consecutive Offsets (i.e. Log Compaction)

[ https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16156937#comment-16156937 ] Michal W commented on SPARK-17147: -- Hey, just wanted to check if there's any progress on this issue? >

[jira] [Commented] (SPARK-19634) Feature parity for descriptive statistics in MLlib

[ https://issues.apache.org/jira/browse/SPARK-19634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16156936#comment-16156936 ] Apache Spark commented on SPARK-19634: -- User 'WeichenXu123' has created a pull request for this

[jira] [Commented] (SPARK-21942) ix DiskBlockManager crashing when a root local folder has been externally deleted by OS

[ https://issues.apache.org/jira/browse/SPARK-21942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16156914#comment-16156914 ] Saisai Shao commented on SPARK-21942: - I think in a production environment, user should always

[jira] [Created] (SPARK-21944) Watermark on window column is wrong

Kevin Zhang created SPARK-21944: --- Summary: Watermark on window column is wrong Key: SPARK-21944 URL: https://issues.apache.org/jira/browse/SPARK-21944 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-20427) Issue with Spark interpreting Oracle datatype NUMBER

[ https://issues.apache.org/jira/browse/SPARK-20427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16156829#comment-16156829 ] Krzysztof Sobusiak edited comment on SPARK-20427 at 9/7/17 12:30 PM: -

[jira] [Closed] (SPARK-21937) Spark SQL DDL/DML docs non-existent

[ https://issues.apache.org/jira/browse/SPARK-21937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves closed SPARK-21937. - Resolution: Duplicate > Spark SQL DDL/DML docs non-existent >

[jira] [Comment Edited] (SPARK-21942) ix DiskBlockManager crashing when a root local folder has been externally deleted by OS

[ https://issues.apache.org/jira/browse/SPARK-21942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16156708#comment-16156708 ] Ruslan Shestopalyuk edited comment on SPARK-21942 at 9/7/17 11:49 AM:

[jira] [Commented] (SPARK-20427) Issue with Spark interpreting Oracle datatype NUMBER

[ https://issues.apache.org/jira/browse/SPARK-20427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16156829#comment-16156829 ] Krzysztof Sobusiak commented on SPARK-20427: You can have very big and very small numbers at

[jira] [Closed] (SPARK-21932) Add test CartesianProduct join case and BroadcastNestedLoop join case in JoinBenchmark

[ https://issues.apache.org/jira/browse/SPARK-21932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] caoxuewen closed SPARK-21932. - Resolution: Resolved > Add test CartesianProduct join case and BroadcastNestedLoop join case in >

[jira] [Commented] (SPARK-21943) When I use rest Api (/ applications / [app-id] / jobs / [job-id]) to view some of the jobs that are running jobs, the returned json information is missing the “descrip

[ https://issues.apache.org/jira/browse/SPARK-21943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16156808#comment-16156808 ] xianquan commented on SPARK-21943: -- I would like to know why the return of the two json records, the

[jira] [Commented] (SPARK-18085) SPIP: Better History Server scalability for many / large applications

[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16156784#comment-16156784 ] jincheng commented on SPARK-18085: -- thanks. it was ok! > SPIP: Better History Server scalability for

[jira] [Comment Edited] (SPARK-21942) ix DiskBlockManager crashing when a root local folder has been externally deleted by OS

[ https://issues.apache.org/jira/browse/SPARK-21942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16156708#comment-16156708 ] Ruslan Shestopalyuk edited comment on SPARK-21942 at 9/7/17 10:09 AM:

[jira] [Updated] (SPARK-21943) When I use rest Api (/ applications / [app-id] / jobs / [job-id]) to view some of the jobs that are running jobs, the returned json information is missing the “descripti

[ https://issues.apache.org/jira/browse/SPARK-21943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-21943: -- Priority: Minor (was: Critical) What description do you expect? is there any? > When I use rest Api

[jira] [Created] (SPARK-21943) When I use rest Api (/ applications / [app-id] / jobs / [job-id]) to view some of the jobs that are running jobs, the returned json information is missing the “descripti

xianquan created SPARK-21943: Summary: When I use rest Api (/ applications / [app-id] / jobs / [job-id]) to view some of the jobs that are running jobs, the returned json information is missing the “description” field. Key:

[jira] [Assigned] (SPARK-7008) An implementation of Factorization Machine (LibFM)

[ https://issues.apache.org/jira/browse/SPARK-7008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7008: --- Assignee: (was: Apache Spark) > An implementation of Factorization Machine (LibFM) >

[jira] [Assigned] (SPARK-7008) An implementation of Factorization Machine (LibFM)

[ https://issues.apache.org/jira/browse/SPARK-7008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7008: --- Assignee: Apache Spark > An implementation of Factorization Machine (LibFM) >

[jira] [Assigned] (SPARK-21942) ix DiskBlockManager crashing when a root local folder has been externally deleted by OS

[ https://issues.apache.org/jira/browse/SPARK-21942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21942: Assignee: (was: Apache Spark) > ix DiskBlockManager crashing when a root local folder

[jira] [Assigned] (SPARK-21942) ix DiskBlockManager crashing when a root local folder has been externally deleted by OS

[ https://issues.apache.org/jira/browse/SPARK-21942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21942: Assignee: Apache Spark > ix DiskBlockManager crashing when a root local folder has been

[jira] [Commented] (SPARK-21942) ix DiskBlockManager crashing when a root local folder has been externally deleted by OS

[ https://issues.apache.org/jira/browse/SPARK-21942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16156712#comment-16156712 ] Apache Spark commented on SPARK-21942: -- User 'rshest' has created a pull request for this issue:

[jira] [Commented] (SPARK-21942) ix DiskBlockManager crashing when a root local folder has been externally deleted by OS

[ https://issues.apache.org/jira/browse/SPARK-21942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16156708#comment-16156708 ] Ruslan Shestopalyuk commented on SPARK-21942: - Yes, configuring a different scratch directory

[jira] [Updated] (SPARK-21942) ix DiskBlockManager crashing when a root local folder has been externally deleted by OS

[ https://issues.apache.org/jira/browse/SPARK-21942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruslan Shestopalyuk updated SPARK-21942: Description: _DiskBlockManager_ has a notion of a "scratch" local folder(s), which

[jira] [Commented] (SPARK-21942) ix DiskBlockManager crashing when a root local folder has been externally deleted by OS

[ https://issues.apache.org/jira/browse/SPARK-21942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16156702#comment-16156702 ] Sean Owen commented on SPARK-21942: --- You'll want to configure a different scratch directory, or stop

[jira] [Updated] (SPARK-21942) ix DiskBlockManager crashing when a root local folder has been externally deleted by OS

[ https://issues.apache.org/jira/browse/SPARK-21942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruslan Shestopalyuk updated SPARK-21942: Description: DiskBlockManager has a notion of a "scratch" local folder(s), which

[jira] [Created] (SPARK-21942) ix DiskBlockManager crashing when a root local folder has been externally deleted by OS

Ruslan Shestopalyuk created SPARK-21942: --- Summary: ix DiskBlockManager crashing when a root local folder has been externally deleted by OS Key: SPARK-21942 URL:

[jira] [Commented] (SPARK-12449) Pushing down arbitrary logical plans to data sources

[ https://issues.apache.org/jira/browse/SPARK-12449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16156622#comment-16156622 ] Andrew Ash commented on SPARK-12449: [~velvia] I'm not involved with the CatalystSource or SAP

[jira] [Assigned] (SPARK-21941) Stop storing unused attemptId in SQLTaskMetrics

[ https://issues.apache.org/jira/browse/SPARK-21941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21941: Assignee: Apache Spark > Stop storing unused attemptId in SQLTaskMetrics >

[jira] [Assigned] (SPARK-21941) Stop storing unused attemptId in SQLTaskMetrics

[ https://issues.apache.org/jira/browse/SPARK-21941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21941: Assignee: (was: Apache Spark) > Stop storing unused attemptId in SQLTaskMetrics >

[jira] [Commented] (SPARK-21941) Stop storing unused attemptId in SQLTaskMetrics

[ https://issues.apache.org/jira/browse/SPARK-21941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16156602#comment-16156602 ] Apache Spark commented on SPARK-21941: -- User 'ash211' has created a pull request for this issue:

[jira] [Created] (SPARK-21941) Stop storing unused attemptId in SQLTaskMetrics

Andrew Ash created SPARK-21941: -- Summary: Stop storing unused attemptId in SQLTaskMetrics Key: SPARK-21941 URL: https://issues.apache.org/jira/browse/SPARK-21941 Project: Spark Issue Type: Bug

  1   2   >