[jira] [Commented] (SPARK-18136) Make PySpark pip install works on windows

[ https://issues.apache.org/jira/browse/SPARK-18136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16182868#comment-16182868 ] Apache Spark commented on SPARK-18136: -- User 'jsnowacki' has created a pull request for this issue:

[jira] [Created] (SPARK-22147) BlockId.hashCode allocates a StringBuilder/String on each call

Sergei Lebedev created SPARK-22147: -- Summary: BlockId.hashCode allocates a StringBuilder/String on each call Key: SPARK-22147 URL: https://issues.apache.org/jira/browse/SPARK-22147 Project: Spark

[jira] [Created] (SPARK-22148) TaskSetManager.abortIfCompletelyBlacklisted should not abort when all current executors are blacklisted but dynamic allocation is enabled

Juan Rodríguez Hortalá created SPARK-22148: -- Summary: TaskSetManager.abortIfCompletelyBlacklisted should not abort when all current executors are blacklisted but dynamic allocation is enabled Key: SPARK-22148

[jira] [Assigned] (SPARK-22146) FileNotFoundException while reading ORC files containing '%'

[ https://issues.apache.org/jira/browse/SPARK-22146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22146: Assignee: Apache Spark > FileNotFoundException while reading ORC files containing '%' >

[jira] [Assigned] (SPARK-22146) FileNotFoundException while reading ORC files containing '%'

[ https://issues.apache.org/jira/browse/SPARK-22146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22146: Assignee: (was: Apache Spark) > FileNotFoundException while reading ORC files

[jira] [Commented] (SPARK-22146) FileNotFoundException while reading ORC files containing '%'

[ https://issues.apache.org/jira/browse/SPARK-22146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16182733#comment-16182733 ] Apache Spark commented on SPARK-22146: -- User 'mgaido91' has created a pull request for this issue:

[jira] [Updated] (SPARK-22141) Propagate empty relation before checking Cartesian products

[ https://issues.apache.org/jira/browse/SPARK-22141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-22141: -- Fix Version/s: 2.2.1 > Propagate empty relation before checking Cartesian products >

[jira] [Created] (SPARK-22149) spark.shuffle.memoryFraction (deprecated) in spark 2

regis le bretonnic created SPARK-22149: -- Summary: spark.shuffle.memoryFraction (deprecated) in spark 2 Key: SPARK-22149 URL: https://issues.apache.org/jira/browse/SPARK-22149 Project: Spark

[jira] [Commented] (SPARK-22077) RpcEndpointAddress fails to parse spark URL if it is an ipv6 address.

[ https://issues.apache.org/jira/browse/SPARK-22077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183117#comment-16183117 ] Eric Vandenberg commented on SPARK-22077: - We are using a Facebook internal cluster scheduler. I

[jira] [Commented] (SPARK-18136) Make PySpark pip install works on windows

[ https://issues.apache.org/jira/browse/SPARK-18136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183077#comment-16183077 ] Jakub Nowacki commented on SPARK-18136: --- PR 19370 (https://github.com/apache/spark/pull/19370)

[jira] [Created] (SPARK-22150) PeriodicCheckpointer fails with FileNotFoundException in case of dependant RDDs

Sergey Zhemzhitsky created SPARK-22150: -- Summary: PeriodicCheckpointer fails with FileNotFoundException in case of dependant RDDs Key: SPARK-22150 URL: https://issues.apache.org/jira/browse/SPARK-22150

[jira] [Commented] (SPARK-22145) Issues with driver re-starting on mesos (supervise)

[ https://issues.apache.org/jira/browse/SPARK-22145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183352#comment-16183352 ] Apache Spark commented on SPARK-22145: -- User 'skonto' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22145) Issues with driver re-starting on mesos (supervise)

[ https://issues.apache.org/jira/browse/SPARK-22145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22145: Assignee: (was: Apache Spark) > Issues with driver re-starting on mesos (supervise) >

[jira] [Assigned] (SPARK-22145) Issues with driver re-starting on mesos (supervise)

[ https://issues.apache.org/jira/browse/SPARK-22145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22145: Assignee: Apache Spark > Issues with driver re-starting on mesos (supervise) >

[jira] [Updated] (SPARK-21549) Spark fails to complete job correctly in case of OutputFormat which do not write into hdfs

[ https://issues.apache.org/jira/browse/SPARK-21549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Zhemzhitsky updated SPARK-21549: --- Fix Version/s: 2.2.1 > Spark fails to complete job correctly in case of OutputFormat

[jira] [Assigned] (SPARK-22150) PeriodicCheckpointer fails with FileNotFoundException in case of dependant RDDs

[ https://issues.apache.org/jira/browse/SPARK-22150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22150: Assignee: Apache Spark > PeriodicCheckpointer fails with FileNotFoundException in case of

[jira] [Commented] (SPARK-22150) PeriodicCheckpointer fails with FileNotFoundException in case of dependant RDDs

[ https://issues.apache.org/jira/browse/SPARK-22150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183322#comment-16183322 ] Apache Spark commented on SPARK-22150: -- User 'szhem' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22150) PeriodicCheckpointer fails with FileNotFoundException in case of dependant RDDs

[ https://issues.apache.org/jira/browse/SPARK-22150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22150: Assignee: (was: Apache Spark) > PeriodicCheckpointer fails with FileNotFoundException

[jira] [Updated] (SPARK-22123) Add latest failure reason for task set blacklist

[ https://issues.apache.org/jira/browse/SPARK-22123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-22123: Priority: Minor (was: Major) > Add latest failure reason for task set blacklist >

[jira] [Resolved] (SPARK-22123) Add latest failure reason for task set blacklist

[ https://issues.apache.org/jira/browse/SPARK-22123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao resolved SPARK-22123. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19338

[jira] [Assigned] (SPARK-22123) Add latest failure reason for task set blacklist

[ https://issues.apache.org/jira/browse/SPARK-22123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao reassigned SPARK-22123: --- Assignee: zhoukang > Add latest failure reason for task set blacklist >

[jira] [Closed] (SPARK-21956) Fetch up to max bytes when buf really released

[ https://issues.apache.org/jira/browse/SPARK-21956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang closed SPARK-21956. Resolution: Won't Fix > Fetch up to max bytes when buf really released >

[jira] [Commented] (SPARK-21737) Create communication channel between arbitrary clients and the Spark AM in YARN mode

[ https://issues.apache.org/jira/browse/SPARK-21737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183563#comment-16183563 ] Saisai Shao commented on SPARK-21737: - [~yoonlee95], are you still working on this thing? I think

[jira] [Updated] (SPARK-22152) Add Dataset flatten function

[ https://issues.apache.org/jira/browse/SPARK-22152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-22152: - Issue Type: New Feature (was: Wish) > Add Dataset flatten function >

[jira] [Updated] (SPARK-22152) Add Dataset flatten function

[ https://issues.apache.org/jira/browse/SPARK-22152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-22152: - Component/s: (was: Spark Core) SQL > Add Dataset flatten function >

[jira] [Commented] (SPARK-22151) PYTHONPATH not picked up from the spark.yarn.appMasterEnv properly

[ https://issues.apache.org/jira/browse/SPARK-22151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183581#comment-16183581 ] Saisai Shao commented on SPARK-22151: - Checking the Yarn client code, looks like there's specific

[jira] [Commented] (SPARK-22152) Add Dataset flatten function

[ https://issues.apache.org/jira/browse/SPARK-22152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183570#comment-16183570 ] Takeshi Yamamuro commented on SPARK-22152: -- `Dataset[Option[T]]` is used in a natural usecase?

[jira] [Comment Edited] (SPARK-22152) Add Dataset flatten function

[ https://issues.apache.org/jira/browse/SPARK-22152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183570#comment-16183570 ] Takeshi Yamamuro edited comment on SPARK-22152 at 9/28/17 2:14 AM: ---

[jira] [Closed] (SPARK-22149) spark.shuffle.memoryFraction (deprecated) in spark 2

[ https://issues.apache.org/jira/browse/SPARK-22149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro closed SPARK-22149. Resolution: Invalid > spark.shuffle.memoryFraction (deprecated) in spark 2 >

[jira] [Commented] (SPARK-22149) spark.shuffle.memoryFraction (deprecated) in spark 2

[ https://issues.apache.org/jira/browse/SPARK-22149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183575#comment-16183575 ] Takeshi Yamamuro commented on SPARK-22149: -- I think you should first ask in the spark mailing

[jira] [Commented] (SPARK-22152) Add Dataset flatten function

[ https://issues.apache.org/jira/browse/SPARK-22152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183585#comment-16183585 ] Drew Robb commented on SPARK-22152: --- I personally use `Option` very frequently in datasets, and it is

[jira] [Commented] (SPARK-22147) BlockId.hashCode allocates a StringBuilder/String on each call

[ https://issues.apache.org/jira/browse/SPARK-22147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16182852#comment-16182852 ] Apache Spark commented on SPARK-22147: -- User 'superbobry' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22147) BlockId.hashCode allocates a StringBuilder/String on each call

[ https://issues.apache.org/jira/browse/SPARK-22147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22147: Assignee: Apache Spark > BlockId.hashCode allocates a StringBuilder/String on each call >

[jira] [Assigned] (SPARK-22147) BlockId.hashCode allocates a StringBuilder/String on each call

[ https://issues.apache.org/jira/browse/SPARK-22147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22147: Assignee: (was: Apache Spark) > BlockId.hashCode allocates a StringBuilder/String on

[jira] [Resolved] (SPARK-22140) Add a test suite for TPCDS queries

[ https://issues.apache.org/jira/browse/SPARK-22140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22140. - Resolution: Fixed Fix Version/s: 2.3.0 2.2.1 > Add a test suite for TPCDS

[jira] [Created] (SPARK-22152) Add Dataset flatten function

Drew Robb created SPARK-22152: - Summary: Add Dataset flatten function Key: SPARK-22152 URL: https://issues.apache.org/jira/browse/SPARK-22152 Project: Spark Issue Type: Wish

[jira] [Resolved] (SPARK-22143) OffHeapColumnVector may leak memory

[ https://issues.apache.org/jira/browse/SPARK-22143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-22143. --- Resolution: Fixed Fix Version/s: 2.3.0 > OffHeapColumnVector may leak memory

[jira] [Created] (SPARK-22151) PYTHONPATH not picked up from the spark.yarn.appMasterEnv properly

Thomas Graves created SPARK-22151: - Summary: PYTHONPATH not picked up from the spark.yarn.appMasterEnv properly Key: SPARK-22151 URL: https://issues.apache.org/jira/browse/SPARK-22151 Project: Spark

[jira] [Created] (SPARK-22153) Rename ShuffleExchange -> ShuffleExchangeExec

Reynold Xin created SPARK-22153: --- Summary: Rename ShuffleExchange -> ShuffleExchangeExec Key: SPARK-22153 URL: https://issues.apache.org/jira/browse/SPARK-22153 Project: Spark Issue Type: Task

[jira] [Assigned] (SPARK-22153) Rename ShuffleExchange -> ShuffleExchangeExec

[ https://issues.apache.org/jira/browse/SPARK-22153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22153: Assignee: Reynold Xin (was: Apache Spark) > Rename ShuffleExchange ->

[jira] [Commented] (SPARK-22153) Rename ShuffleExchange -> ShuffleExchangeExec

[ https://issues.apache.org/jira/browse/SPARK-22153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183652#comment-16183652 ] Apache Spark commented on SPARK-22153: -- User 'rxin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22153) Rename ShuffleExchange -> ShuffleExchangeExec

[ https://issues.apache.org/jira/browse/SPARK-22153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22153: Assignee: Apache Spark (was: Reynold Xin) > Rename ShuffleExchange ->

[jira] [Commented] (SPARK-22074) Task killed by other attempt task should not be resubmitted

[ https://issues.apache.org/jira/browse/SPARK-22074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16182062#comment-16182062 ] Saisai Shao commented on SPARK-22074: - So if I understand correctly, this happens when speculation is

[jira] [Commented] (SPARK-22074) Task killed by other attempt task should not be resubmitted

[ https://issues.apache.org/jira/browse/SPARK-22074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16182095#comment-16182095 ] Li Yuanjian commented on SPARK-22074: - Yes, that's right. > Task killed by other attempt task should

[jira] [Created] (SPARK-22139) Remove the variable which is never used in SparkConf.scala

guoxiaolongzte created SPARK-22139: -- Summary: Remove the variable which is never used in SparkConf.scala Key: SPARK-22139 URL: https://issues.apache.org/jira/browse/SPARK-22139 Project: Spark

[jira] [Assigned] (SPARK-22139) Remove the variable which is never used in SparkConf.scala

[ https://issues.apache.org/jira/browse/SPARK-22139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22139: Assignee: (was: Apache Spark) > Remove the variable which is never used in

[jira] [Assigned] (SPARK-22139) Remove the variable which is never used in SparkConf.scala

[ https://issues.apache.org/jira/browse/SPARK-22139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22139: Assignee: Apache Spark > Remove the variable which is never used in SparkConf.scala >

[jira] [Commented] (SPARK-22139) Remove the variable which is never used in SparkConf.scala

[ https://issues.apache.org/jira/browse/SPARK-22139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16182107#comment-16182107 ] Apache Spark commented on SPARK-22139: -- User 'guoxiaolongzte' has created a pull request for this

[jira] [Created] (SPARK-22140) Add a test suite for TPCDS queries

Xiao Li created SPARK-22140: --- Summary: Add a test suite for TPCDS queries Key: SPARK-22140 URL: https://issues.apache.org/jira/browse/SPARK-22140 Project: Spark Issue Type: Test

[jira] [Assigned] (SPARK-22140) Add a test suite for TPCDS queries

[ https://issues.apache.org/jira/browse/SPARK-22140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22140: Assignee: Xiao Li (was: Apache Spark) > Add a test suite for TPCDS queries >

[jira] [Commented] (SPARK-22140) Add a test suite for TPCDS queries

[ https://issues.apache.org/jira/browse/SPARK-22140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16182135#comment-16182135 ] Apache Spark commented on SPARK-22140: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22140) Add a test suite for TPCDS queries

[ https://issues.apache.org/jira/browse/SPARK-22140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22140: Assignee: Apache Spark (was: Xiao Li) > Add a test suite for TPCDS queries >

[jira] [Created] (SPARK-22141) Propagate empty relation before checking Cartesian products

Gengliang Wang created SPARK-22141: -- Summary: Propagate empty relation before checking Cartesian products Key: SPARK-22141 URL: https://issues.apache.org/jira/browse/SPARK-22141 Project: Spark

[jira] [Resolved] (SPARK-22134) StackOverflowError issue when applying large nested UDF calls

[ https://issues.apache.org/jira/browse/SPARK-22134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22134. --- Resolution: Not A Problem Deeper stack traces are a property of Scala-based apps in general, and yes

[jira] [Created] (SPARK-22142) Move Flume support behind a profile

Sean Owen created SPARK-22142: - Summary: Move Flume support behind a profile Key: SPARK-22142 URL: https://issues.apache.org/jira/browse/SPARK-22142 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-22141) Propagate empty relation before checking Cartesian products

[ https://issues.apache.org/jira/browse/SPARK-22141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22141: Assignee: Apache Spark > Propagate empty relation before checking Cartesian products >

[jira] [Updated] (SPARK-22141) Propagate empty relation before checking Cartesian products

[ https://issues.apache.org/jira/browse/SPARK-22141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-22141: --- Description: When inferring constraints from children, Join's condition can be simplified as

[jira] [Assigned] (SPARK-22141) Propagate empty relation before checking Cartesian products

[ https://issues.apache.org/jira/browse/SPARK-22141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22141: Assignee: (was: Apache Spark) > Propagate empty relation before checking Cartesian

[jira] [Commented] (SPARK-22141) Propagate empty relation before checking Cartesian products

[ https://issues.apache.org/jira/browse/SPARK-22141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16182161#comment-16182161 ] Apache Spark commented on SPARK-22141: -- User 'gengliangwang' has created a pull request for this

[jira] [Created] (SPARK-22143) OffHeapColumnVector may leak memory

Herman van Hovell created SPARK-22143: - Summary: OffHeapColumnVector may leak memory Key: SPARK-22143 URL: https://issues.apache.org/jira/browse/SPARK-22143 Project: Spark Issue Type:

[jira] [Updated] (SPARK-22143) OffHeapColumnVector may leak memory

[ https://issues.apache.org/jira/browse/SPARK-22143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-22143: -- Description: ColumnVector does not clean-up its children on close. This means that we

[jira] [Created] (SPARK-22144) ExchangeCoordinator will not combine the partitions of an 0 sized pre-shuffle

Lijia Liu created SPARK-22144: - Summary: ExchangeCoordinator will not combine the partitions of an 0 sized pre-shuffle Key: SPARK-22144 URL: https://issues.apache.org/jira/browse/SPARK-22144 Project:

[jira] [Assigned] (SPARK-22144) ExchangeCoordinator will not combine the partitions of an 0 sized pre-shuffle

[ https://issues.apache.org/jira/browse/SPARK-22144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22144: Assignee: (was: Apache Spark) > ExchangeCoordinator will not combine the partitions

[jira] [Assigned] (SPARK-22144) ExchangeCoordinator will not combine the partitions of an 0 sized pre-shuffle

[ https://issues.apache.org/jira/browse/SPARK-22144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22144: Assignee: Apache Spark > ExchangeCoordinator will not combine the partitions of an 0

[jira] [Commented] (SPARK-22144) ExchangeCoordinator will not combine the partitions of an 0 sized pre-shuffle

[ https://issues.apache.org/jira/browse/SPARK-22144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16182281#comment-16182281 ] Apache Spark commented on SPARK-22144: -- User 'liutang123' has created a pull request for this issue:

[jira] [Commented] (SPARK-22144) ExchangeCoordinator will not combine the partitions of an 0 sized pre-shuffle

[ https://issues.apache.org/jira/browse/SPARK-22144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16182317#comment-16182317 ] Lijia Liu commented on SPARK-22144: --- cc Yin Huai > ExchangeCoordinator will not combine the partitions

[jira] [Issue Comment Deleted] (SPARK-22144) ExchangeCoordinator will not combine the partitions of an 0 sized pre-shuffle

[ https://issues.apache.org/jira/browse/SPARK-22144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijia Liu updated SPARK-22144: -- Comment: was deleted (was: cc Yin Huai) > ExchangeCoordinator will not combine the partitions of an 0

[jira] [Resolved] (SPARK-22141) Propagate empty relation before checking Cartesian products

[ https://issues.apache.org/jira/browse/SPARK-22141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-22141. --- Resolution: Fixed Assignee: Gengliang Wang Fix Version/s: 2.3.0 >

[jira] [Commented] (SPARK-9103) Tracking spark's memory usage

[ https://issues.apache.org/jira/browse/SPARK-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16182372#comment-16182372 ] Steve Loughran commented on SPARK-9103: --- If it helps, most uses of ByteBuffer in hadoop core & HDFS

[jira] [Assigned] (SPARK-22142) Move Flume support behind a profile

[ https://issues.apache.org/jira/browse/SPARK-22142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22142: Assignee: Sean Owen (was: Apache Spark) > Move Flume support behind a profile >

[jira] [Commented] (SPARK-22142) Move Flume support behind a profile

[ https://issues.apache.org/jira/browse/SPARK-22142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16182377#comment-16182377 ] Apache Spark commented on SPARK-22142: -- User 'srowen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22142) Move Flume support behind a profile

[ https://issues.apache.org/jira/browse/SPARK-22142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22142: Assignee: Apache Spark (was: Sean Owen) > Move Flume support behind a profile >

[jira] [Created] (SPARK-22145) Issues for driver re-start on mesos

Stavros Kontopoulos created SPARK-22145: --- Summary: Issues for driver re-start on mesos Key: SPARK-22145 URL: https://issues.apache.org/jira/browse/SPARK-22145 Project: Spark Issue

[jira] [Updated] (SPARK-22145) Issues for driver re-start on mesos

[ https://issues.apache.org/jira/browse/SPARK-22145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-22145: Description: There are two issues with driver re-starts on mesos: - We need to add

[jira] [Commented] (SPARK-22145) Issues for driver re-start on mesos

[ https://issues.apache.org/jira/browse/SPARK-22145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16182393#comment-16182393 ] Stavros Kontopoulos commented on SPARK-22145: - [~susanxhuynh][~arand] pls take a look. I will

[jira] [Comment Edited] (SPARK-22145) Issues for driver re-start on mesos

[ https://issues.apache.org/jira/browse/SPARK-22145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16182393#comment-16182393 ] Stavros Kontopoulos edited comment on SPARK-22145 at 9/27/17 11:16 AM:

[jira] [Updated] (SPARK-22145) Issues with driver re-starts on mesos

[ https://issues.apache.org/jira/browse/SPARK-22145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-22145: Summary: Issues with driver re-starts on mesos (was: Issues for driver re-start

[jira] [Updated] (SPARK-22145) Issues with driver re-starting on mesos

[ https://issues.apache.org/jira/browse/SPARK-22145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-22145: Summary: Issues with driver re-starting on mesos (was: Issues with driver

[jira] [Updated] (SPARK-22145) Issues with driver re-starting on mesos (supervise)

[ https://issues.apache.org/jira/browse/SPARK-22145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-22145: Summary: Issues with driver re-starting on mesos (supervise) (was: Issues with

[jira] [Updated] (SPARK-22145) Issues with driver re-starting on mesos

[ https://issues.apache.org/jira/browse/SPARK-22145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-22145: Description: There are two issues with driver re-starting on mesos: - We need to

[jira] [Updated] (SPARK-22145) Issues with driver re-starting on mesos

[ https://issues.apache.org/jira/browse/SPARK-22145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-22145: Description: There are two issues with driver re-starting on mesos using the

[jira] [Commented] (SPARK-22141) Propagate empty relation before checking Cartesian products

[ https://issues.apache.org/jira/browse/SPARK-22141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16182431#comment-16182431 ] Apache Spark commented on SPARK-22141: -- User 'gengliangwang' has created a pull request for this

[jira] [Commented] (SPARK-20462) Spark-Kinesis Direct Connector

[ https://issues.apache.org/jira/browse/SPARK-20462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16182478#comment-16182478 ] Arush Kharbanda commented on SPARK-20462: - I would like to start work on this. > Spark-Kinesis

[jira] [Resolved] (SPARK-20642) Use key-value store to keep History Server application listing

[ https://issues.apache.org/jira/browse/SPARK-20642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-20642. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 18887

[jira] [Assigned] (SPARK-20642) Use key-value store to keep History Server application listing

[ https://issues.apache.org/jira/browse/SPARK-20642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-20642: --- Assignee: Marcelo Vanzin > Use key-value store to keep History Server application listing >

[jira] [Assigned] (SPARK-20785) Spark should provide jump links and add (count) in the SQL web ui.

[ https://issues.apache.org/jira/browse/SPARK-20785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao reassigned SPARK-20785: --- Assignee: guoxiaolongzte > Spark should provide jump links and add (count) in the SQL web

[jira] [Resolved] (SPARK-20785) Spark should provide jump links and add (count) in the SQL web ui.

[ https://issues.apache.org/jira/browse/SPARK-20785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao resolved SPARK-20785. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19346

[jira] [Created] (SPARK-22146) FileNotFoundException while reading ORC files containing '%'

Marco Gaido created SPARK-22146: --- Summary: FileNotFoundException while reading ORC files containing '%' Key: SPARK-22146 URL: https://issues.apache.org/jira/browse/SPARK-22146 Project: Spark

[jira] [Commented] (SPARK-22146) FileNotFoundException while reading ORC files containing '%'

[ https://issues.apache.org/jira/browse/SPARK-22146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16182540#comment-16182540 ] Sean Owen commented on SPARK-22146: --- Does the file actually exist locally, or is it meant to be on

[jira] [Closed] (SPARK-22127) The Master Register Application Function requires an warn log to increase the waiting status

[ https://issues.apache.org/jira/browse/SPARK-22127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guoxiaolongzte closed SPARK-22127. -- Resolution: Won't Fix > The Master Register Application Function requires an warn log to

[jira] [Commented] (SPARK-18649) sc.textFile(my_file).collect() raises socket.timeout on large files

[ https://issues.apache.org/jira/browse/SPARK-18649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16182582#comment-16182582 ] Vladimir Ivanov commented on SPARK-18649: - Should be fixed in

[jira] [Updated] (SPARK-22145) Issues with driver re-starting on mesos (supervise)

[ https://issues.apache.org/jira/browse/SPARK-22145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-22145: Description: There are two issues with driver re-starting on mesos using the

[jira] [Updated] (SPARK-22145) Issues with driver re-starting on mesos (supervise)

[ https://issues.apache.org/jira/browse/SPARK-22145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-22145: Description: There are two issues with driver re-starting on mesos using the

[jira] [Updated] (SPARK-22145) Issues with driver re-starting on mesos (supervise)

[ https://issues.apache.org/jira/browse/SPARK-22145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-22145: Description: There are two issues with driver re-starting on mesos using the

[jira] [Updated] (SPARK-22145) Issues with driver re-starting on mesos (supervise)

[ https://issues.apache.org/jira/browse/SPARK-22145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-22145: Description: There are two issues with driver re-starting on mesos using the

[jira] [Updated] (SPARK-22145) Issues with driver re-starting on mesos (supervise)

[ https://issues.apache.org/jira/browse/SPARK-22145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-22145: Description: There are two issues with driver re-starting on mesos using the

[jira] [Updated] (SPARK-22145) Issues with driver re-starting on mesos (supervise)

[ https://issues.apache.org/jira/browse/SPARK-22145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-22145: Description: There are two issues with driver re-starting on mesos using the

[jira] [Commented] (SPARK-22143) OffHeapColumnVector may leak memory

[ https://issues.apache.org/jira/browse/SPARK-22143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16182611#comment-16182611 ] Apache Spark commented on SPARK-22143: -- User 'hvanhovell' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22143) OffHeapColumnVector may leak memory

[ https://issues.apache.org/jira/browse/SPARK-22143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22143: Assignee: Herman van Hovell (was: Apache Spark) > OffHeapColumnVector may leak memory >

[jira] [Assigned] (SPARK-22143) OffHeapColumnVector may leak memory

[ https://issues.apache.org/jira/browse/SPARK-22143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22143: Assignee: Apache Spark (was: Herman van Hovell) > OffHeapColumnVector may leak memory >

  1   2   >