[jira] [Commented] (SPARK-16240) model loading backward compatibility for ml.clustering.LDA

[ https://issues.apache.org/jira/browse/SPARK-16240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514829#comment-15514829 ] Joseph K. Bradley commented on SPARK-16240: --- I merged this for 2.1 and sent a backport for 2.0:

[jira] [Updated] (SPARK-16240) model loading backward compatibility for ml.clustering.LDA

[ https://issues.apache.org/jira/browse/SPARK-16240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-16240: -- Fix Version/s: 2.1.0 > model loading backward compatibility for ml.clustering.LDA >

[jira] [Updated] (SPARK-17641) collect_set should ignore null values

[ https://issues.apache.org/jira/browse/SPARK-17641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-17641: -- Description: `collect_set` throws the following exception when there are null values. It

[jira] [Created] (SPARK-17641) collect_set should ignore null values

Xiangrui Meng created SPARK-17641: - Summary: collect_set should ignore null values Key: SPARK-17641 URL: https://issues.apache.org/jira/browse/SPARK-17641 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-17640) Avoid using -1 as the default batchId for FileStreamSource.FileEntry

Shixiong Zhu created SPARK-17640: Summary: Avoid using -1 as the default batchId for FileStreamSource.FileEntry Key: SPARK-17640 URL: https://issues.apache.org/jira/browse/SPARK-17640 Project: Spark

[jira] [Assigned] (SPARK-17640) Avoid using -1 as the default batchId for FileStreamSource.FileEntry

[ https://issues.apache.org/jira/browse/SPARK-17640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17640: Assignee: Apache Spark (was: Shixiong Zhu) > Avoid using -1 as the default batchId for

[jira] [Assigned] (SPARK-17640) Avoid using -1 as the default batchId for FileStreamSource.FileEntry

[ https://issues.apache.org/jira/browse/SPARK-17640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17640: Assignee: Shixiong Zhu (was: Apache Spark) > Avoid using -1 as the default batchId for

[jira] [Commented] (SPARK-17640) Avoid using -1 as the default batchId for FileStreamSource.FileEntry

[ https://issues.apache.org/jira/browse/SPARK-17640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514857#comment-15514857 ] Apache Spark commented on SPARK-17640: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Updated] (SPARK-17641) collect_set should ignore null values

[ https://issues.apache.org/jira/browse/SPARK-17641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-17641: - Target Version/s: 2.1.0 (was: 2.0.1, 2.1.0) > collect_set should ignore null values >

[jira] [Updated] (SPARK-17641) collect_set should ignore null values

[ https://issues.apache.org/jira/browse/SPARK-17641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-17641: - Target Version/s: 2.0.1, 2.1.0 > collect_set should ignore null values >

[jira] [Created] (SPARK-17642) support DESC FORMATTED TABLE COLUMN command to show column-level statistics

Zhenhua Wang created SPARK-17642: Summary: support DESC FORMATTED TABLE COLUMN command to show column-level statistics Key: SPARK-17642 URL: https://issues.apache.org/jira/browse/SPARK-17642 Project:

[jira] [Commented] (SPARK-17634) Spark job hangs when using dapply

[ https://issues.apache.org/jira/browse/SPARK-17634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15515176#comment-15515176 ] Felix Cheung commented on SPARK-17634: -- How long have you let it run? > Spark job hangs when using

[jira] [Assigned] (SPARK-17639) Need to add jce.jar to bootclasspath

[ https://issues.apache.org/jira/browse/SPARK-17639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17639: Assignee: (was: Apache Spark) > Need to add jce.jar to bootclasspath >

[jira] [Commented] (SPARK-17639) Need to add jce.jar to bootclasspath

[ https://issues.apache.org/jira/browse/SPARK-17639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514719#comment-15514719 ] Apache Spark commented on SPARK-17639: -- User 'vanzin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17639) Need to add jce.jar to bootclasspath

[ https://issues.apache.org/jira/browse/SPARK-17639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17639: Assignee: Apache Spark > Need to add jce.jar to bootclasspath >

[jira] [Resolved] (SPARK-17635) Remove hardcode "agg_plan" in HashAggregateExec

[ https://issues.apache.org/jira/browse/SPARK-17635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-17635. - Resolution: Fixed Assignee: yucai Fix Version/s: 2.1.0 > Remove hardcode

[jira] [Updated] (SPARK-17635) Remove hardcode "agg_plan" in HashAggregateExec

[ https://issues.apache.org/jira/browse/SPARK-17635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-17635: Affects Version/s: (was: 2.0.0) > Remove hardcode "agg_plan" in HashAggregateExec >

[jira] [Resolved] (SPARK-17616) Getting "java.lang.RuntimeException: Distinct columns cannot exist in Aggregate "

[ https://issues.apache.org/jira/browse/SPARK-17616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-17616. Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Resolving as fixed by

[jira] [Commented] (SPARK-6235) Address various 2G limits

[ https://issues.apache.org/jira/browse/SPARK-6235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15515042#comment-15515042 ] Guoqiang Li commented on SPARK-6235: ping [~rxin] > Address various 2G limits >

[jira] [Updated] (SPARK-17641) collect_set should ignore null values

[ https://issues.apache.org/jira/browse/SPARK-17641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-17641: -- Description: `collect_set` throws the following exception when there are null values. It

[jira] [Created] (SPARK-17639) Need to add jce.jar to bootclasspath

Marcelo Vanzin created SPARK-17639: -- Summary: Need to add jce.jar to bootclasspath Key: SPARK-17639 URL: https://issues.apache.org/jira/browse/SPARK-17639 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-12945) ERROR LiveListenerBus: Listener JobProgressListener threw an exception

[ https://issues.apache.org/jira/browse/SPARK-12945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514850#comment-15514850 ] Josh Rosen commented on SPARK-12945: In general, the {{JobProgressListener}} should not be throwing

[jira] [Updated] (SPARK-17599) Folder deletion after globbing may fail StructuredStreaming jobs

[ https://issues.apache.org/jira/browse/SPARK-17599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-17599: Fix Version/s: 2.0.1 > Folder deletion after globbing may fail StructuredStreaming jobs >

[jira] [Updated] (SPARK-17569) Don't recheck existence of files when generating File Relation resolution in StructuredStreaming

[ https://issues.apache.org/jira/browse/SPARK-17569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-17569: Fix Version/s: 2.0.1 > Don't recheck existence of files when generating File Relation resolution

[jira] [Updated] (SPARK-17642) support DESC FORMATTED TABLE COLUMN command to show column-level statistics

[ https://issues.apache.org/jira/browse/SPARK-17642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenhua Wang updated SPARK-17642: - Description: Support DESC FORMATTED TABLE COLUMN command to show column-level statistics. We

[jira] [Commented] (SPARK-17569) Don't recheck existence of files when generating File Relation resolution in StructuredStreaming

[ https://issues.apache.org/jira/browse/SPARK-17569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514584#comment-15514584 ] Apache Spark commented on SPARK-17569: -- User 'brkyvz' has created a pull request for this issue:

[jira] [Commented] (SPARK-16240) model loading backward compatibility for ml.clustering.LDA

[ https://issues.apache.org/jira/browse/SPARK-16240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514828#comment-15514828 ] Apache Spark commented on SPARK-16240: -- User 'jkbradley' has created a pull request for this issue:

[jira] [Created] (SPARK-17643) Remove comparable requirement from Offset

Michael Armbrust created SPARK-17643: Summary: Remove comparable requirement from Offset Key: SPARK-17643 URL: https://issues.apache.org/jira/browse/SPARK-17643 Project: Spark Issue

[jira] [Assigned] (SPARK-17643) Remove comparable requirement from Offset

[ https://issues.apache.org/jira/browse/SPARK-17643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust reassigned SPARK-17643: Assignee: Michael Armbrust > Remove comparable requirement from Offset >

[jira] [Updated] (SPARK-17609) SessionCatalog.tableExists should not check temp view

[ https://issues.apache.org/jira/browse/SPARK-17609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-17609: Fix Version/s: 2.0.1 > SessionCatalog.tableExists should not check temp view >

[jira] [Updated] (SPARK-17502) Multiple Bugs in DDL Statements on Temporary Views

[ https://issues.apache.org/jira/browse/SPARK-17502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-17502: Fix Version/s: (was: 2.0.1) 2.0.2 > Multiple Bugs in DDL Statements on

[jira] [Updated] (SPARK-17609) SessionCatalog.tableExists should not check temp view

[ https://issues.apache.org/jira/browse/SPARK-17609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-17609: Target Version/s: 2.0.2, 2.1.0 (was: 2.1.0) > SessionCatalog.tableExists should not check temp

[jira] [Updated] (SPARK-17609) SessionCatalog.tableExists should not check temp view

[ https://issues.apache.org/jira/browse/SPARK-17609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-17609: Fix Version/s: (was: 2.0.1) 2.0.2 > SessionCatalog.tableExists should not

[jira] [Updated] (SPARK-17502) Multiple Bugs in DDL Statements on Temporary Views

[ https://issues.apache.org/jira/browse/SPARK-17502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-17502: Fix Version/s: 2.0.1 > Multiple Bugs in DDL Statements on Temporary Views >

[jira] [Commented] (SPARK-17636) Parquet filter push down doesn't handle struct fields

[ https://issues.apache.org/jira/browse/SPARK-17636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514853#comment-15514853 ] Hyukjin Kwon commented on SPARK-17636: -- Yea, Spark implementation currently does not push down

[jira] [Commented] (SPARK-17643) Remove comparable requirement from Offset

[ https://issues.apache.org/jira/browse/SPARK-17643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15515058#comment-15515058 ] Apache Spark commented on SPARK-17643: -- User 'marmbrus' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17643) Remove comparable requirement from Offset

[ https://issues.apache.org/jira/browse/SPARK-17643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17643: Assignee: Michael Armbrust (was: Apache Spark) > Remove comparable requirement from

[jira] [Assigned] (SPARK-17643) Remove comparable requirement from Offset

[ https://issues.apache.org/jira/browse/SPARK-17643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17643: Assignee: Apache Spark (was: Michael Armbrust) > Remove comparable requirement from

[jira] [Assigned] (SPARK-17641) collect_set should ignore null values

[ https://issues.apache.org/jira/browse/SPARK-17641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17641: Assignee: (was: Apache Spark) > collect_set should ignore null values >

[jira] [Assigned] (SPARK-17641) collect_set should ignore null values

[ https://issues.apache.org/jira/browse/SPARK-17641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17641: Assignee: Apache Spark > collect_set should ignore null values >

[jira] [Assigned] (SPARK-17604) Support purging aged file entry for FileStreamSource metadata log

[ https://issues.apache.org/jira/browse/SPARK-17604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17604: Assignee: (was: Apache Spark) > Support purging aged file entry for FileStreamSource

[jira] [Assigned] (SPARK-17604) Support purging aged file entry for FileStreamSource metadata log

[ https://issues.apache.org/jira/browse/SPARK-17604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17604: Assignee: Apache Spark > Support purging aged file entry for FileStreamSource metadata

[jira] [Resolved] (SPARK-17639) Need to add jce.jar to bootclasspath

[ https://issues.apache.org/jira/browse/SPARK-17639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-17639. Resolution: Fixed Assignee: Marcelo Vanzin Fix Version/s: 2.1.0 > Need to

[jira] [Updated] (SPARK-17642) support DESC FORMATTED TABLE COLUMN command to show column-level statistics

[ https://issues.apache.org/jira/browse/SPARK-17642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-17642: Issue Type: Sub-task (was: Improvement) Parent: SPARK-16026 > support DESC FORMATTED TABLE COLUMN

[jira] [Resolved] (SPARK-16719) RandomForest: communicate fewer trees on each iteration

[ https://issues.apache.org/jira/browse/SPARK-16719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-16719. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 14359

[jira] [Resolved] (SPARK-16240) model loading backward compatibility for ml.clustering.LDA

[ https://issues.apache.org/jira/browse/SPARK-16240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-16240. --- Resolution: Fixed Fix Version/s: 2.0.1 > model loading backward compatibility

[jira] [Updated] (SPARK-17642) support DESC FORMATTED TABLE COLUMN command to show column-level statistics

[ https://issues.apache.org/jira/browse/SPARK-17642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-17642: Issue Type: Improvement (was: Task) > support DESC FORMATTED TABLE COLUMN command to show column-level

[jira] [Commented] (SPARK-17637) Packed scheduling for Spark tasks across executors

[ https://issues.apache.org/jira/browse/SPARK-17637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15515247#comment-15515247 ] Zhan Zhang commented on SPARK-17637: cc [~rxin] A quick prototype shows that for a tested pipeline,

[jira] [Commented] (SPARK-17604) Support purging aged file entry for FileStreamSource metadata log

[ https://issues.apache.org/jira/browse/SPARK-17604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15515232#comment-15515232 ] Apache Spark commented on SPARK-17604: -- User 'jerryshao' has created a pull request for this issue:

[jira] [Updated] (SPARK-17642) support DESC FORMATTED TABLE COLUMN command to show column-level statistics

[ https://issues.apache.org/jira/browse/SPARK-17642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-17642: Affects Version/s: (was: 2.0.0) 2.1.0 > support DESC FORMATTED TABLE COLUMN

[jira] [Commented] (SPARK-17134) Use level 2 BLAS operations in LogisticAggregator

[ https://issues.apache.org/jira/browse/SPARK-17134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15515491#comment-15515491 ] DB Tsai commented on SPARK-17134: - I did benchmark again. In old implementation, it takes 1.3hrs for one

[jira] [Commented] (SPARK-17569) Don't recheck existence of files when generating File Relation resolution in StructuredStreaming

[ https://issues.apache.org/jira/browse/SPARK-17569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514512#comment-15514512 ] Apache Spark commented on SPARK-17569: -- User 'brkyvz' has created a pull request for this issue:

[jira] [Commented] (SPARK-17599) Folder deletion after globbing may fail StructuredStreaming jobs

[ https://issues.apache.org/jira/browse/SPARK-17599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514511#comment-15514511 ] Apache Spark commented on SPARK-17599: -- User 'brkyvz' has created a pull request for this issue:

[jira] [Resolved] (SPARK-17638) Stop JVM StreamingContext when the Python process is dead

[ https://issues.apache.org/jira/browse/SPARK-17638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-17638. -- Resolution: Fixed Fix Version/s: 2.1.0 2.0.2 > Stop JVM

[jira] [Commented] (SPARK-17592) SQL: CAST string as INT inconsistent with Hive

[ https://issues.apache.org/jira/browse/SPARK-17592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15512413#comment-15512413 ] Furcy Pin commented on SPARK-17592: --- SQL server: query fails (like postgres)

[jira] [Updated] (SPARK-17625) expectedOutputAttributes should be set when converting SimpleCatalogRelation to LogicalRelation

[ https://issues.apache.org/jira/browse/SPARK-17625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-17625: Assignee: Zhenhua Wang > expectedOutputAttributes should be set when converting

[jira] [Assigned] (SPARK-17632) make console sink and other sinks work with 'recoverFromCheckpointLocation' option enabled

[ https://issues.apache.org/jira/browse/SPARK-17632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17632: Assignee: Apache Spark > make console sink and other sinks work with

[jira] [Commented] (SPARK-17632) make console sink and other sinks work with 'recoverFromCheckpointLocation' option enabled

[ https://issues.apache.org/jira/browse/SPARK-17632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15512552#comment-15512552 ] Apache Spark commented on SPARK-17632: -- User 'chuanlei' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17632) make console sink and other sinks work with 'recoverFromCheckpointLocation' option enabled

[ https://issues.apache.org/jira/browse/SPARK-17632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17632: Assignee: (was: Apache Spark) > make console sink and other sinks work with

[jira] [Commented] (SPARK-14709) spark.ml API for linear SVM

[ https://issues.apache.org/jira/browse/SPARK-14709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15512391#comment-15512391 ] Tae Jun Kim commented on SPARK-14709: - Cheer up guys! I'm looking forward to DF based SVM :-) Always

[jira] [Created] (SPARK-17632) make console sink and other sinks work with 'recoverFromCheckpointLocation' option enabled

Chuanlei Ni created SPARK-17632: --- Summary: make console sink and other sinks work with 'recoverFromCheckpointLocation' option enabled Key: SPARK-17632 URL: https://issues.apache.org/jira/browse/SPARK-17632

[jira] [Commented] (SPARK-17632) make console sink and other sinks work with 'recoverFromCheckpointLocation' option enabled

[ https://issues.apache.org/jira/browse/SPARK-17632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15512554#comment-15512554 ] Chuanlei Ni commented on SPARK-17632: - pr is as below https://github.com/apache/spark/pull/15195 >

[jira] [Issue Comment Deleted] (SPARK-17632) make console sink and other sinks work with 'recoverFromCheckpointLocation' option enabled

[ https://issues.apache.org/jira/browse/SPARK-17632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chuanlei Ni updated SPARK-17632: Comment: was deleted (was: pr is as below https://github.com/apache/spark/pull/15195) > make

[jira] [Updated] (SPARK-17630) jvm-exit-on-fatal-error handler for spark.rpc.netty like there is available for akka

[ https://issues.apache.org/jira/browse/SPARK-17630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mario Briggs updated SPARK-17630: - Summary: jvm-exit-on-fatal-error handler for spark.rpc.netty like there is available for akka

[jira] [Created] (SPARK-17631) Structured Streaming - Add Http Stream Sink

zhangxinyu created SPARK-17631: -- Summary: Structured Streaming - Add Http Stream Sink Key: SPARK-17631 URL: https://issues.apache.org/jira/browse/SPARK-17631 Project: Spark Issue Type: New

[jira] [Commented] (SPARK-13331) AES support for over-the-wire encryption

[ https://issues.apache.org/jira/browse/SPARK-13331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15512340#comment-15512340 ] Junjie Chen commented on SPARK-13331: - Hi [~vanzin] Could you help to review the code? > AES

[jira] [Resolved] (SPARK-17625) expectedOutputAttributes should be set when converting SimpleCatalogRelation to LogicalRelation

[ https://issues.apache.org/jira/browse/SPARK-17625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-17625. - Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 15182

[jira] [Commented] (SPARK-17632) make console sink and other sinks work with 'recoverFromCheckpointLocation' option enabled

[ https://issues.apache.org/jira/browse/SPARK-17632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15512567#comment-15512567 ] Chuanlei Ni commented on SPARK-17632: - hi, [~tdas] could you help me review this pr? > make console

[jira] [Commented] (SPARK-17622) Cannot run create or load DF on Windows- Spark 2.0.0

[ https://issues.apache.org/jira/browse/SPARK-17622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15512561#comment-15512561 ] Sean Owen commented on SPARK-17622: --- I mean that it just shows "InvocationTargetException" which means

[jira] [Resolved] (SPARK-14536) NPE in JDBCRDD when array column contains nulls (postgresql)

[ https://issues.apache.org/jira/browse/SPARK-14536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-14536. --- Resolution: Duplicate > NPE in JDBCRDD when array column contains nulls (postgresql) >

[jira] [Commented] (SPARK-17614) sparkSession.read() .jdbc(***) use the sql syntax "where 1=0" that Cassandra does not support

[ https://issues.apache.org/jira/browse/SPARK-17614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15512743#comment-15512743 ] Apache Spark commented on SPARK-17614: -- User 'srowen' has created a pull request for this issue:

[jira] [Resolved] (SPARK-15815) Hang while enable blacklistExecutor and DynamicExecutorAllocator

[ https://issues.apache.org/jira/browse/SPARK-15815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-15815. --- Resolution: Won't Fix > Hang while enable blacklistExecutor and DynamicExecutorAllocator >

[jira] [Resolved] (SPARK-17421) Document warnings about "MaxPermSize" parameter when building with Maven and Java 8

[ https://issues.apache.org/jira/browse/SPARK-17421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17421. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue resolved by pull

[jira] [Updated] (SPARK-17421) Document warnings about "MaxPermSize" parameter when building with Maven and Java 8

[ https://issues.apache.org/jira/browse/SPARK-17421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-17421: -- Assignee: Frederick Reiss > Document warnings about "MaxPermSize" parameter when building with Maven

[jira] [Resolved] (SPARK-17560) SQLContext tables returns table names in lower case only

[ https://issues.apache.org/jira/browse/SPARK-17560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17560. --- Resolution: Not A Problem If that resolves the issue, then I believe that's the answer. It is a

[jira] [Assigned] (SPARK-17631) Structured Streaming - Add Http Stream Sink

[ https://issues.apache.org/jira/browse/SPARK-17631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17631: Assignee: (was: Apache Spark) > Structured Streaming - Add Http Stream Sink >

[jira] [Commented] (SPARK-17631) Structured Streaming - Add Http Stream Sink

[ https://issues.apache.org/jira/browse/SPARK-17631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15512716#comment-15512716 ] Apache Spark commented on SPARK-17631: -- User 'zhangxinyu1' has created a pull request for this

[jira] [Assigned] (SPARK-17631) Structured Streaming - Add Http Stream Sink

[ https://issues.apache.org/jira/browse/SPARK-17631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17631: Assignee: Apache Spark > Structured Streaming - Add Http Stream Sink >

[jira] [Resolved] (SPARK-17628) Name of "object StreamingExamples" should be more self-explanatory

[ https://issues.apache.org/jira/browse/SPARK-17628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17628. --- Resolution: Not A Problem > Name of "object StreamingExamples" should be more self-explanatory >

[jira] [Resolved] (SPARK-17629) Should ml Word2Vec findSynonyms match the mllib implementation?

[ https://issues.apache.org/jira/browse/SPARK-17629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17629. --- Resolution: Not A Problem This is probably best as a question on dev@, not a JIRA. You can easily

[jira] [Commented] (SPARK-17631) Structured Streaming - Add Http Stream Sink

[ https://issues.apache.org/jira/browse/SPARK-17631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15512781#comment-15512781 ] Apache Spark commented on SPARK-17631: -- User 'zhangxinyu1' has created a pull request for this

[jira] [Updated] (SPARK-17631) Structured Streaming - Add Http Stream Sink

[ https://issues.apache.org/jira/browse/SPARK-17631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangxinyu updated SPARK-17631: --- Shepherd: (was: Reynold Xin) > Structured Streaming - Add Http Stream Sink >

[jira] [Updated] (SPARK-17631) Structured Streaming - Add Http Stream Sink

[ https://issues.apache.org/jira/browse/SPARK-17631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangxinyu updated SPARK-17631: --- Target Version/s: (was: 2.1.0, 2.2.0) > Structured Streaming - Add Http Stream Sink >

[jira] [Resolved] (SPARK-17485) Failed remote cached block reads can lead to whole job failure

[ https://issues.apache.org/jira/browse/SPARK-17485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-17485. Resolution: Fixed Fix Version/s: 1.6.3 Issue resolved by pull request 15186

[jira] [Resolved] (SPARK-14209) Application failure during preemption.

[ https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-14209. Resolution: Fixed Assignee: Josh Rosen Fix Version/s: 2.1.0

[jira] [Comment Edited] (SPARK-14209) Application failure during preemption.

[ https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514054#comment-15514054 ] Josh Rosen edited comment on SPARK-14209 at 9/22/16 6:17 PM: - I have

[jira] [Commented] (SPARK-14209) Application failure during preemption.

[ https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514054#comment-15514054 ] Josh Rosen commented on SPARK-14209: I have backported SPARK-17485 to Spark 1.6.x (for inclusion in

[jira] [Commented] (SPARK-17637) Packed scheduling for Spark tasks across executors

[ https://issues.apache.org/jira/browse/SPARK-17637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514105#comment-15514105 ] Zhan Zhang commented on SPARK-17637: The plan is to introduce a new configuration so that different

[jira] [Commented] (SPARK-14536) NPE in JDBCRDD when array column contains nulls (postgresql)

[ https://issues.apache.org/jira/browse/SPARK-14536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514134#comment-15514134 ] Sean Owen commented on SPARK-14536: --- Yes, sounds like we're both saying this is tied up in the

[jira] [Commented] (SPARK-17601) SparkSQL vectorization cannot handle schema evolution for parquet tables when parquet files use Int whereas DataFrame uses Long

[ https://issues.apache.org/jira/browse/SPARK-17601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514019#comment-15514019 ] Gang Wu commented on SPARK-17601: - [~hyukjin.kwon] Yes I agree. I just created these JIRAs for issues we

[jira] [Commented] (SPARK-17131) Code generation fails when running SQL expressions against a wide dataset (thousands of columns)

[ https://issues.apache.org/jira/browse/SPARK-17131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514085#comment-15514085 ] Aris Vlasakakis commented on SPARK-17131: - Hi there, I discovered a bug, and it also pertains to

[jira] [Commented] (SPARK-17453) Broadcast block already exists in MemoryStore

[ https://issues.apache.org/jira/browse/SPARK-17453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514123#comment-15514123 ] Josh Rosen commented on SPARK-17453: Actually, upon closer inspection I do not believe that this is

[jira] [Commented] (SPARK-14536) NPE in JDBCRDD when array column contains nulls (postgresql)

[ https://issues.apache.org/jira/browse/SPARK-14536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514129#comment-15514129 ] Suresh Thalamati commented on SPARK-14536: -- [~sowen] I am not sure why this issue got closed

[jira] [Commented] (SPARK-17453) Broadcast block already exists in MemoryStore

[ https://issues.apache.org/jira/browse/SPARK-17453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514091#comment-15514091 ] Josh Rosen commented on SPARK-17453: There might be a race-condition here which could occur if

[jira] [Created] (SPARK-17637) Packed scheduling for Spark tasks across executors

Zhan Zhang created SPARK-17637: -- Summary: Packed scheduling for Spark tasks across executors Key: SPARK-17637 URL: https://issues.apache.org/jira/browse/SPARK-17637 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-8790) BlockManager.reregister cause OOM

[ https://issues.apache.org/jira/browse/SPARK-8790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-8790. --- Resolution: Cannot Reproduce I'm going to resolve this issue as "Cannot Reproduce" since it's over a

[jira] [Updated] (SPARK-16356) Add testImplicits for ML unit tests and promote toDF()

[ https://issues.apache.org/jira/browse/SPARK-16356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-16356: Shepherd: Yanbo Liang > Add testImplicits for ML unit tests and promote toDF() >

[jira] [Updated] (SPARK-16356) Add testImplicits for ML unit tests and promote toDF()

[ https://issues.apache.org/jira/browse/SPARK-16356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-16356: Assignee: Hyukjin Kwon > Add testImplicits for ML unit tests and promote toDF() >

[jira] [Commented] (SPARK-17633) texFile() and wholeTextFiles() count difference

[ https://issues.apache.org/jira/browse/SPARK-17633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15513110#comment-15513110 ] Anshul commented on SPARK-17633: RDD is not cached, in this scenario. > texFile() and wholeTextFiles()

[jira] [Updated] (SPARK-14909) Spark UI submitted time is wrong

[ https://issues.apache.org/jira/browse/SPARK-14909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jagadeesan A S updated SPARK-14909: --- Attachment: (was: app2.png) > Spark UI submitted time is wrong >

  1   2   >