[jira] [Created] (SPARK-3506) 1.1.0-SNAPSHOT in docs for 1.1.0 under docs/latest

2014-09-12 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-3506: -- Summary: 1.1.0-SNAPSHOT in docs for 1.1.0 under docs/latest Key: SPARK-3506 URL: https://issues.apache.org/jira/browse/SPARK-3506 Project: Spark Issue

[jira] [Created] (SPARK-9250) ./dev/change-scala-version.sh should offer guidance what versions are accepted, i.e. 2.10 or 2.11

2015-07-22 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-9250: -- Summary: ./dev/change-scala-version.sh should offer guidance what versions are accepted, i.e. 2.10 or 2.11 Key: SPARK-9250 URL:

[jira] [Created] (SPARK-11267) NettyRpcEnv and sparkDriver services report the same port in the logs

2015-10-22 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-11267: --- Summary: NettyRpcEnv and sparkDriver services report the same port in the logs Key: SPARK-11267 URL: https://issues.apache.org/jira/browse/SPARK-11267 Project:

[jira] [Commented] (SPARK-11686) Issue WARN when dynamic allocation is disabled due to spark.dynamicAllocation.enabled and spark.executor.instances both set

2015-11-11 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15001757#comment-15001757 ] Jacek Laskowski commented on SPARK-11686: - I'd like to work on this if agreed. > Issue WARN when

[jira] [Created] (SPARK-11686) Issue WARN when dynamic allocation is disabled due to spark.dynamicAllocation.enabled and spark.executor.instances both set

2015-11-11 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-11686: --- Summary: Issue WARN when dynamic allocation is disabled due to spark.dynamicAllocation.enabled and spark.executor.instances both set Key: SPARK-11686 URL:

[jira] [Created] (SPARK-11631) DAGScheduler prints "Stopping DAGScheduler" at INFO to the logs with no corresponding "Starting"

2015-11-10 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-11631: --- Summary: DAGScheduler prints "Stopping DAGScheduler" at INFO to the logs with no corresponding "Starting" Key: SPARK-11631 URL:

[jira] [Updated] (SPARK-2992) The transforms formerly known as non-lazy

2015-11-02 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Laskowski updated SPARK-2992: --- Description: An umbrella for a grab-bag of tickets involving lazy implementations of

[jira] [Created] (SPARK-11218) `./sbin/start-slave.sh --help` should print out the help message

2015-10-20 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-11218: --- Summary: `./sbin/start-slave.sh --help` should print out the help message Key: SPARK-11218 URL: https://issues.apache.org/jira/browse/SPARK-11218 Project:

[jira] [Updated] (SPARK-11051) NullPointerException when action called on localCheckpointed RDD (that was checkpointed before)

2015-10-10 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Laskowski updated SPARK-11051: Environment: Spark version 1.6.0-SNAPSHOT built from the sources as of today - Oct, 10th

[jira] [Created] (SPARK-11051) NullPointerException when action called on localCheckpointed RDD (that was checkpointed before)

2015-10-10 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-11051: --- Summary: NullPointerException when action called on localCheckpointed RDD (that was checkpointed before) Key: SPARK-11051 URL:

[jira] [Created] (SPARK-10368) "Could not parse Master URL" leaves spark-shell unusable

2015-08-31 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-10368: --- Summary: "Could not parse Master URL" leaves spark-shell unusable Key: SPARK-10368 URL: https://issues.apache.org/jira/browse/SPARK-10368 Project: Spark

[jira] [Created] (SPARK-10391) Spark 1.4.1 released news under news/spark-1-3-1-released.html

2015-09-01 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-10391: --- Summary: Spark 1.4.1 released news under news/spark-1-3-1-released.html Key: SPARK-10391 URL: https://issues.apache.org/jira/browse/SPARK-10391 Project: Spark

[jira] [Updated] (SPARK-10581) Groups are not resolved in scaladoc for org.apache.spark.sql.Column

2015-09-13 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Laskowski updated SPARK-10581: Description: The Scala API documentation (scaladoc) for

[jira] [Created] (SPARK-10581) Groups are not resolved in scaladoc for org.apache.spark.sql.Column

2015-09-13 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-10581: --- Summary: Groups are not resolved in scaladoc for org.apache.spark.sql.Column Key: SPARK-10581 URL: https://issues.apache.org/jira/browse/SPARK-10581 Project:

[jira] [Commented] (SPARK-10557) Publish Spark 1.5.0 on Maven central

2015-09-11 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14740288#comment-14740288 ] Jacek Laskowski commented on SPARK-10557: - Also, as part of the release process the sources

[jira] [Updated] (SPARK-10662) Code snippets are not properly formatted in docs

2015-09-17 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Laskowski updated SPARK-10662: Issue Type: Task (was: Bug) Summary: Code snippets are not properly formatted in

[jira] [Created] (SPARK-10662) Code examples are not properly formatted

2015-09-17 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-10662: --- Summary: Code examples are not properly formatted Key: SPARK-10662 URL: https://issues.apache.org/jira/browse/SPARK-10662 Project: Spark Issue Type:

[jira] [Updated] (SPARK-10662) Code snippets are not properly formatted in docs

2015-09-17 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Laskowski updated SPARK-10662: Attachment: spark-docs-backticks-tables.png > Code snippets are not properly formatted in

[jira] [Updated] (SPARK-10662) Code snippets are not properly formatted in docs

2015-09-17 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Laskowski updated SPARK-10662: Issue Type: Bug (was: Task) > Code snippets are not properly formatted in docs >

[jira] [Commented] (SPARK-10525) Add Python example for VectorSlicer to user guide

2015-09-14 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14744071#comment-14744071 ] Jacek Laskowski commented on SPARK-10525: - There's an example in

[jira] [Created] (SPARK-10921) Completely remove the use of SparkContext.preferredNodeLocationData

2015-10-04 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-10921: --- Summary: Completely remove the use of SparkContext.preferredNodeLocationData Key: SPARK-10921 URL: https://issues.apache.org/jira/browse/SPARK-10921 Project:

[jira] [Updated] (SPARK-10662) Code snippets are not properly formatted in tables

2015-09-19 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Laskowski updated SPARK-10662: Summary: Code snippets are not properly formatted in tables (was: Code snippets are not

[jira] [Commented] (SPARK-10662) Code snippets are not properly formatted in tables

2015-09-21 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901460#comment-14901460 ] Jacek Laskowski commented on SPARK-10662: - It's [~jlaskowski] not [~jlewandowski] in Assignee.

[jira] [Comment Edited] (SPARK-10662) Code snippets are not properly formatted in tables

2015-09-21 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901460#comment-14901460 ] Jacek Laskowski edited comment on SPARK-10662 at 9/21/15 9:39 PM: -- It's

[jira] [Created] (SPARK-12237) Unsupported message RpcMessage causes message retries

2015-12-09 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-12237: --- Summary: Unsupported message RpcMessage causes message retries Key: SPARK-12237 URL: https://issues.apache.org/jira/browse/SPARK-12237 Project: Spark

[jira] [Commented] (SPARK-12237) Unsupported message RpcMessage causes message retries

2015-12-09 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15049182#comment-15049182 ] Jacek Laskowski commented on SPARK-12237: - While learning about Spark's internals, I was playing

[jira] [Created] (SPARK-12267) Standalone master keeps references to disassociated workers until they sent no heartbeats

2015-12-10 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-12267: --- Summary: Standalone master keeps references to disassociated workers until they sent no heartbeats Key: SPARK-12267 URL: https://issues.apache.org/jira/browse/SPARK-12267

[jira] [Commented] (SPARK-12237) Unsupported message RpcMessage causes message retries

2015-12-10 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051500#comment-15051500 ] Jacek Laskowski commented on SPARK-12237: - Sure, but that's not the issue who talks to whom, but

[jira] [Created] (SPARK-12339) NullPointerException on stage kill from web UI

2015-12-15 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-12339: --- Summary: NullPointerException on stage kill from web UI Key: SPARK-12339 URL: https://issues.apache.org/jira/browse/SPARK-12339 Project: Spark Issue

[jira] [Created] (SPARK-12366) IllegalArgumentException: requirement failed: File not found: ...sql/catalyst/expressions/GeneratedClass.class when df.show

2015-12-16 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-12366: --- Summary: IllegalArgumentException: requirement failed: File not found: ...sql/catalyst/expressions/GeneratedClass.class when df.show Key: SPARK-12366 URL:

[jira] [Created] (SPARK-12263) IllegalStateException: Memory can't be 0 for SPARK_WORKER_MEMORY without unit

2015-12-10 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-12263: --- Summary: IllegalStateException: Memory can't be 0 for SPARK_WORKER_MEMORY without unit Key: SPARK-12263 URL: https://issues.apache.org/jira/browse/SPARK-12263

[jira] [Commented] (SPARK-12263) IllegalStateException: Memory can't be 0 for SPARK_WORKER_MEMORY without unit

2015-12-10 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051017#comment-15051017 ] Jacek Laskowski commented on SPARK-12263: - Well, let's call it a doc issue. I don't mind unless

[jira] [Created] (SPARK-12736) Standalone Master cannot be started due to NoClassDefFoundError: org/spark-project/guava/collect/Maps

2016-01-09 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-12736: --- Summary: Standalone Master cannot be started due to NoClassDefFoundError: org/spark-project/guava/collect/Maps Key: SPARK-12736 URL:

[jira] [Updated] (SPARK-12739) Details of batch in Streaming tab uses two Duration columns

2016-01-09 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Laskowski updated SPARK-12739: Attachment: SPARK-12739.png > Details of batch in Streaming tab uses two Duration columns

[jira] [Created] (SPARK-12739) Details of batch in Streaming tab uses two Duration columns

2016-01-09 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-12739: --- Summary: Details of batch in Streaming tab uses two Duration columns Key: SPARK-12739 URL: https://issues.apache.org/jira/browse/SPARK-12739 Project: Spark

[jira] [Created] (SPARK-12535) Generating scaladoc using sbt fails for network-common and catalyst modules

2015-12-27 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-12535: --- Summary: Generating scaladoc using sbt fails for network-common and catalyst modules Key: SPARK-12535 URL: https://issues.apache.org/jira/browse/SPARK-12535

[jira] [Commented] (SPARK-12535) Generating scaladoc using sbt fails for network-common and catalyst modules

2015-12-27 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15072501#comment-15072501 ] Jacek Laskowski commented on SPARK-12535: - I fixed the others, but this one has no solution yet:

[jira] [Created] (SPARK-12037) Executors use heartbeatReceiverRef to report heartbeats and task metrics that might not be initialized and leads to NullPointerException

2015-11-29 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-12037: --- Summary: Executors use heartbeatReceiverRef to report heartbeats and task metrics that might not be initialized and leads to NullPointerException Key: SPARK-12037 URL:

[jira] [Commented] (SPARK-11859) Regex for master URL for Mesos accepts incorrect zk:// prefix

2015-11-20 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15016705#comment-15016705 ] Jacek Laskowski commented on SPARK-11859: - Sorry for not being clear - the regex says {{zk://}}

[jira] [Created] (SPARK-11859) Regex for master URL for Mesos accepts incorrect zk:// prefix

2015-11-19 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-11859: --- Summary: Regex for master URL for Mesos accepts incorrect zk:// prefix Key: SPARK-11859 URL: https://issues.apache.org/jira/browse/SPARK-11859 Project: Spark

[jira] [Created] (SPARK-11909) Spark Standalone's master URL accepts URLs without port (assuming default 7077)

2015-11-22 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-11909: --- Summary: Spark Standalone's master URL accepts URLs without port (assuming default 7077) Key: SPARK-11909 URL: https://issues.apache.org/jira/browse/SPARK-11909

[jira] [Commented] (SPARK-11909) Spark Standalone's master URL accepts URLs without port (assuming default 7077)

2015-11-22 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021153#comment-15021153 ] Jacek Laskowski commented on SPARK-11909: - _"The default is not a well-known port like 80 for

[jira] [Commented] (SPARK-11909) Spark Standalone's master URL accepts URLs without port (assuming default 7077)

2015-11-22 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021186#comment-15021186 ] Jacek Laskowski commented on SPARK-11909: - What about a WARN message about the port in use to

[jira] [Comment Edited] (SPARK-11909) Spark Standalone's master URL accepts URLs without port (assuming default 7077)

2015-11-22 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021186#comment-15021186 ] Jacek Laskowski edited comment on SPARK-11909 at 11/22/15 8:51 PM: ---

[jira] [Created] (SPARK-15868) Executors table in Executors tab should sort Executor IDs in numerical order (not alphabetical order)

2016-06-10 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-15868: --- Summary: Executors table in Executors tab should sort Executor IDs in numerical order (not alphabetical order) Key: SPARK-15868 URL:

[jira] [Updated] (SPARK-15868) Executors table in Executors tab should sort Executor IDs in numerical order (not alphabetical order)

2016-06-10 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Laskowski updated SPARK-15868: Attachment: spark-webui-executors-sorting.png

[jira] [Created] (SPARK-15641) Incorrect Completed for Incomplete applications in HistoryServer

2016-05-28 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-15641: --- Summary: Incorrect Completed for Incomplete applications in HistoryServer Key: SPARK-15641 URL: https://issues.apache.org/jira/browse/SPARK-15641 Project:

[jira] [Updated] (SPARK-15641) Incorrect Completed for Incomplete applications in HistoryServer

2016-05-28 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Laskowski updated SPARK-15641: Attachment: spark-historyserver-completed-incorrect.png > Incorrect Completed for

[jira] [Created] (SPARK-15876) Remove support for "zk://" master URL

2016-06-10 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-15876: --- Summary: Remove support for "zk://" master URL Key: SPARK-15876 URL: https://issues.apache.org/jira/browse/SPARK-15876 Project: Spark Issue Type: Task

[jira] [Commented] (SPARK-15984) WARN message "o.a.h.y.s.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 8 is invalid" when starting application on YARN

2016-06-18 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15337693#comment-15337693 ] Jacek Laskowski commented on SPARK-15984: - The problem is that I am *not* changing Spark at all

[jira] [Commented] (SPARK-16047) Sort by status and id fields in Executors table

2016-06-19 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15338783#comment-15338783 ] Jacek Laskowski commented on SPARK-16047: - The problem is when there are more than one executors

[jira] [Updated] (SPARK-16047) Sort by status and id fields in Executors table

2016-06-18 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Laskowski updated SPARK-16047: Attachment: spark-webui-executors.png Current default sorting > Sort by status and id

[jira] [Created] (SPARK-16048) spark-shell unresponsive after "FetchFailedException: java.lang.UnsupportedOperationException: Unsupported shuffle manager" with YARN and spark.shuffle.service.enabled

2016-06-18 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-16048: --- Summary: spark-shell unresponsive after "FetchFailedException: java.lang.UnsupportedOperationException: Unsupported shuffle manager" with YARN and spark.shuffle.service.enabled Key:

[jira] [Updated] (SPARK-16047) Sort by status and id fields in Executors table

2016-06-18 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Laskowski updated SPARK-16047: Description: With multiple executors with the same ID the default sorting *seems* to be by

[jira] [Created] (SPARK-16047) Sort by status and id fields in Executors table

2016-06-18 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-16047: --- Summary: Sort by status and id fields in Executors table Key: SPARK-16047 URL: https://issues.apache.org/jira/browse/SPARK-16047 Project: Spark Issue

[jira] [Updated] (SPARK-16048) spark-shell unresponsive after "FetchFailedException: java.lang.UnsupportedOperationException: Unsupported shuffle manager" with YARN and spark.shuffle.service.enabled

2016-06-18 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Laskowski updated SPARK-16048: Description: With Spark on YARN with external shuffle service

[jira] [Commented] (SPARK-12736) Standalone Master cannot be started due to NoClassDefFoundError: org/spark-project/guava/collect/Maps

2016-01-10 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15091039#comment-15091039 ] Jacek Laskowski commented on SPARK-12736: - Good point! I didn't think about it. Thanks. >

[jira] [Commented] (SPARK-12739) Details of batch in Streaming tab uses two Duration columns

2016-01-15 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15101644#comment-15101644 ] Jacek Laskowski commented on SPARK-12739: - Ok, I'll work on it. Thanks. > Details of batch in

[jira] [Created] (SPARK-12857) Streaming tab in web UI uses records and events interchangeably

2016-01-16 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-12857: --- Summary: Streaming tab in web UI uses records and events interchangeably Key: SPARK-12857 URL: https://issues.apache.org/jira/browse/SPARK-12857 Project: Spark

[jira] [Created] (SPARK-12859) Names of input streams with receivers don't fit in Streaming page

2016-01-16 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-12859: --- Summary: Names of input streams with receivers don't fit in Streaming page Key: SPARK-12859 URL: https://issues.apache.org/jira/browse/SPARK-12859 Project:

[jira] [Updated] (SPARK-12859) Names of input streams with receivers don't fit in Streaming page

2016-01-16 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Laskowski updated SPARK-12859: Attachment: spark-streaming-webui-names-too-long-to-fit.png > Names of input streams with

[jira] [Created] (SPARK-15984) WARN message "o.a.h.y.s.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 8 is invalid" when starting application on YARN

2016-06-16 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-15984: --- Summary: WARN message "o.a.h.y.s.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 8 is invalid" when starting application on YARN Key: SPARK-15984

[jira] [Created] (SPARK-13229) When checkpoint interval for ConstantInputDStream is lower than batch duration IllegalArgumentException says it is due to slide time instead

2016-02-07 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-13229: --- Summary: When checkpoint interval for ConstantInputDStream is lower than batch duration IllegalArgumentException says it is due to slide time instead Key: SPARK-13229 URL:

[jira] [Updated] (SPARK-13229) When checkpoint interval for ConstantInputDStream is lower than batch duration IllegalArgumentException says it is due to slide time instead

2016-02-07 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Laskowski updated SPARK-13229: Priority: Minor (was: Major) Issue Type: Improvement (was: Bug) > When checkpoint

[jira] [Commented] (SPARK-13211) StreamingContext throws NoSuchElementException when created from non-existent checkpoint directory

2016-02-07 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136262#comment-15136262 ] Jacek Laskowski commented on SPARK-13211: - Can I read it as if you'd approve a pull request for

[jira] [Commented] (SPARK-13211) StreamingContext throws NoSuchElementException when created from non-existent checkpoint directory

2016-02-07 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136266#comment-15136266 ] Jacek Laskowski commented on SPARK-13211: - Thanks! I'm on it. > StreamingContext throws

[jira] [Commented] (SPARK-13211) StreamingContext throws NoSuchElementException when created from non-existent checkpoint directory

2016-02-05 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15133816#comment-15133816 ] Jacek Laskowski commented on SPARK-13211: - When agreed to need a fix, I'd like to create a patch

[jira] [Created] (SPARK-13211) StreamingContext throws NoSuchElementException when created from non-existent checkpoint directory

2016-02-05 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-13211: --- Summary: StreamingContext throws NoSuchElementException when created from non-existent checkpoint directory Key: SPARK-13211 URL:

[jira] [Created] (SPARK-13305) With SPARK_WORKER_WEBUI_PORT and --webui-port set for start-slave.sh script, --webui-port is used twice

2016-02-12 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-13305: --- Summary: With SPARK_WORKER_WEBUI_PORT and --webui-port set for start-slave.sh script, --webui-port is used twice Key: SPARK-13305 URL:

[jira] [Commented] (SPARK-12739) Details of batch in Streaming tab uses two Duration columns

2016-02-01 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15126005#comment-15126005 ] Jacek Laskowski commented on SPARK-12739: - Looks like I am. If you could give it a shot, I'd

[jira] [Commented] (SPARK-13305) With SPARK_WORKER_WEBUI_PORT and --webui-port set for start-slave.sh script, --webui-port is used twice

2016-02-12 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145512#comment-15145512 ] Jacek Laskowski commented on SPARK-13305: - I was explicit about the different ways of setting the

[jira] [Created] (SPARK-13316) "SparkException: DStream has not been initialized" when restoring StreamingContext from checkpoint and the dstream is created afterwards

2016-02-14 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-13316: --- Summary: "SparkException: DStream has not been initialized" when restoring StreamingContext from checkpoint and the dstream is created afterwards Key: SPARK-13316 URL:

[jira] [Commented] (SPARK-13825) Upgrade to Scala 2.11.8

2016-03-13 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15192496#comment-15192496 ] Jacek Laskowski commented on SPARK-13825: - I can do it in a separate task. The title would not

[jira] [Created] (SPARK-13815) UnsupportedOperationException: empty collection when metadata for a Pipeline is an empty file

2016-03-11 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-13815: --- Summary: UnsupportedOperationException: empty collection when metadata for a Pipeline is an empty file Key: SPARK-13815 URL:

[jira] [Created] (SPARK-13774) IllegalArgumentException: Can not create a Path from an empty string for incorrect file path

2016-03-09 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-13774: --- Summary: IllegalArgumentException: Can not create a Path from an empty string for incorrect file path Key: SPARK-13774 URL:

[jira] [Created] (SPARK-13824) Upgrade to Scala 2.11.8

2016-03-11 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-13824: --- Summary: Upgrade to Scala 2.11.8 Key: SPARK-13824 URL: https://issues.apache.org/jira/browse/SPARK-13824 Project: Spark Issue Type: Bug Affects

[jira] [Commented] (SPARK-13825) Upgrade to Scala 2.11.8

2016-03-11 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15190930#comment-15190930 ] Jacek Laskowski commented on SPARK-13825: - OK. Thanks. I'm going to send a pull request later

[jira] [Created] (SPARK-13825) Upgrade to Scala 2.11.8

2016-03-11 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-13825: --- Summary: Upgrade to Scala 2.11.8 Key: SPARK-13825 URL: https://issues.apache.org/jira/browse/SPARK-13825 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-14023) Make exceptions consistent regarding fields and columns

2016-03-19 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Laskowski updated SPARK-14023: Summary: Make exceptions consistent regarding fields and columns (was: Make descriptions

[jira] [Created] (SPARK-14023) Make descriptions in exceptions thrown consistent regarding fields and columns

2016-03-19 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-14023: --- Summary: Make descriptions in exceptions thrown consistent regarding fields and columns Key: SPARK-14023 URL: https://issues.apache.org/jira/browse/SPARK-14023

[jira] [Created] (SPARK-14024) SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder" while saving LinearRegressionModel

2016-03-19 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-14024: --- Summary: SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder" while saving LinearRegressionModel Key: SPARK-14024 URL:

[jira] [Commented] (SPARK-13774) IllegalArgumentException: Can not create a Path from an empty string for incorrect file path

2016-03-09 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15187162#comment-15187162 ] Jacek Laskowski commented on SPARK-13774: - It's today's build. No other changes and the line

[jira] [Created] (SPARK-14587) abstract class Receiver should be explicit about the return type of its methods

2016-04-12 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-14587: --- Summary: abstract class Receiver should be explicit about the return type of its methods Key: SPARK-14587 URL: https://issues.apache.org/jira/browse/SPARK-14587

[jira] [Commented] (SPARK-14500) Accept Dataset[_] instead of DataFrame in MLlib APIs

2016-04-09 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15233790#comment-15233790 ] Jacek Laskowski commented on SPARK-14500: - What a nice surprise! Just yesterday faced the very

[jira] [Reopened] (SPARK-14402) initcap UDF doesn't match Hive/Oracle behavior in lowercasing rest of string

2016-04-05 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Laskowski reopened SPARK-14402: - There's a compilation error after the change. > initcap UDF doesn't match Hive/Oracle

[jira] [Created] (SPARK-13998) HashingTF should extend UnaryTransformer

2016-03-19 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-13998: --- Summary: HashingTF should extend UnaryTransformer Key: SPARK-13998 URL: https://issues.apache.org/jira/browse/SPARK-13998 Project: Spark Issue Type:

[jira] [Commented] (SPARK-14023) Make exceptions consistent regarding fields and columns

2016-03-21 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15205185#comment-15205185 ] Jacek Laskowski commented on SPARK-14023: - If [~josephkb] or [~srowen] could help me how and

[jira] [Reopened] (SPARK-13456) Cannot create encoders for case classes defined in Spark shell after upgrading to Scala 2.11

2016-03-23 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Laskowski reopened SPARK-13456: - In today's Spark 2.0.0-SNAPSHOT: {code} scala> :pa // Entering paste mode (ctrl-D to

[jira] [Commented] (SPARK-14155) Hide UserDefinedType in Spark 2.0

2016-03-25 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15211619#comment-15211619 ] Jacek Laskowski commented on SPARK-14155: - Doh, now when I've finally grasped the concept of UDFs

[jira] [Commented] (SPARK-14155) Hide UserDefinedType in Spark 2.0

2016-03-25 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15211654#comment-15211654 ] Jacek Laskowski commented on SPARK-14155: - Right! I'm saved. Thanks. > Hide UserDefinedType in

[jira] [Commented] (SPARK-13998) HashingTF should extend UnaryTransformer

2016-03-25 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15211935#comment-15211935 ] Jacek Laskowski commented on SPARK-13998: - [~mlnick] It's a simple refactoring, i.e. changing

[jira] [Created] (SPARK-14165) NoSuchElementException: None.get when joining DataFrames with Seq of fields of different case

2016-03-25 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-14165: --- Summary: NoSuchElementException: None.get when joining DataFrames with Seq of fields of different case Key: SPARK-14165 URL:

[jira] [Commented] (SPARK-14165) NoSuchElementException: None.get when joining DataFrames with Seq of fields of different case

2016-03-25 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15212365#comment-15212365 ] Jacek Laskowski commented on SPARK-14165: - Right, but: {code} scala> left.join(right, $"abc" ===

[jira] [Commented] (SPARK-14108) calling count() on empty dataframe throws java.util.NoSuchElementException

2016-03-25 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15212368#comment-15212368 ] Jacek Laskowski commented on SPARK-14108: - I'd like to see the code to show case it since:

[jira] [Created] (SPARK-14183) UnsupportedOperationException: empty.max when fitting CrossValidator model

2016-03-27 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-14183: --- Summary: UnsupportedOperationException: empty.max when fitting CrossValidator model Key: SPARK-14183 URL: https://issues.apache.org/jira/browse/SPARK-14183

[jira] [Commented] (SPARK-13741) make-distribution.sh changed path in master but not refelcted in top README file

2016-03-08 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184784#comment-15184784 ] Jacek Laskowski commented on SPARK-13741: -

[jira] [Commented] (SPARK-13682) Finalize the public API for FileFormat

2016-03-08 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184723#comment-15184723 ] Jacek Laskowski commented on SPARK-13682: - Why? I'd appreciate if you elaborated on the pros of

[jira] [Commented] (SPARK-13665) Initial separation of concerns

2016-03-08 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184727#comment-15184727 ] Jacek Laskowski commented on SPARK-13665: - Sorry for being late on this, but could we have a

[jira] [Commented] (SPARK-13998) HashingTF should extend UnaryTransformer

2016-04-03 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15223326#comment-15223326 ] Jacek Laskowski commented on SPARK-13998: - I don't personally, but I don't really like whenever I

[jira] [Reopened] (SPARK-13456) Cannot create encoders for case classes defined in Spark shell after upgrading to Scala 2.11

2016-04-03 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Laskowski reopened SPARK-13456: - It appears that the issue has not been resolved properly entirely yet. > Cannot create

  1   2   3   >