[jira] [Commented] (SPARK-17134) Use level 2 BLAS operations in LogisticAggregator

[ https://issues.apache.org/jira/browse/SPARK-17134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15515491#comment-15515491 ] DB Tsai commented on SPARK-17134: - I did benchmark again. In old implementation, it takes 1.3hrs for one

[jira] [Resolved] (SPARK-16240) model loading backward compatibility for ml.clustering.LDA

[ https://issues.apache.org/jira/browse/SPARK-16240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-16240. --- Resolution: Fixed Fix Version/s: 2.0.1 > model loading backward compatibility

[jira] [Updated] (SPARK-17642) support DESC FORMATTED TABLE COLUMN command to show column-level statistics

[ https://issues.apache.org/jira/browse/SPARK-17642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-17642: Issue Type: Improvement (was: Task) > support DESC FORMATTED TABLE COLUMN command to show column-level

[jira] [Updated] (SPARK-17642) support DESC FORMATTED TABLE COLUMN command to show column-level statistics

[ https://issues.apache.org/jira/browse/SPARK-17642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-17642: Issue Type: Sub-task (was: Improvement) Parent: SPARK-16026 > support DESC FORMATTED TABLE COLUMN

[jira] [Updated] (SPARK-17642) support DESC FORMATTED TABLE COLUMN command to show column-level statistics

[ https://issues.apache.org/jira/browse/SPARK-17642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-17642: Affects Version/s: (was: 2.0.0) 2.1.0 > support DESC FORMATTED TABLE COLUMN

[jira] [Resolved] (SPARK-16719) RandomForest: communicate fewer trees on each iteration

[ https://issues.apache.org/jira/browse/SPARK-16719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-16719. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 14359

[jira] [Resolved] (SPARK-17639) Need to add jce.jar to bootclasspath

[ https://issues.apache.org/jira/browse/SPARK-17639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-17639. Resolution: Fixed Assignee: Marcelo Vanzin Fix Version/s: 2.1.0 > Need to

[jira] [Commented] (SPARK-17637) Packed scheduling for Spark tasks across executors

[ https://issues.apache.org/jira/browse/SPARK-17637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15515247#comment-15515247 ] Zhan Zhang commented on SPARK-17637: cc [~rxin] A quick prototype shows that for a tested pipeline,

[jira] [Commented] (SPARK-17604) Support purging aged file entry for FileStreamSource metadata log

[ https://issues.apache.org/jira/browse/SPARK-17604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15515232#comment-15515232 ] Apache Spark commented on SPARK-17604: -- User 'jerryshao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17604) Support purging aged file entry for FileStreamSource metadata log

[ https://issues.apache.org/jira/browse/SPARK-17604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17604: Assignee: (was: Apache Spark) > Support purging aged file entry for FileStreamSource

[jira] [Assigned] (SPARK-17604) Support purging aged file entry for FileStreamSource metadata log

[ https://issues.apache.org/jira/browse/SPARK-17604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17604: Assignee: Apache Spark > Support purging aged file entry for FileStreamSource metadata

[jira] [Commented] (SPARK-17634) Spark job hangs when using dapply

[ https://issues.apache.org/jira/browse/SPARK-17634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15515176#comment-15515176 ] Felix Cheung commented on SPARK-17634: -- How long have you let it run? > Spark job hangs when using

[jira] [Updated] (SPARK-17642) support DESC FORMATTED TABLE COLUMN command to show column-level statistics

[ https://issues.apache.org/jira/browse/SPARK-17642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenhua Wang updated SPARK-17642: - Description: Support DESC FORMATTED TABLE COLUMN command to show column-level statistics. We

[jira] [Updated] (SPARK-17502) Multiple Bugs in DDL Statements on Temporary Views

[ https://issues.apache.org/jira/browse/SPARK-17502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-17502: Fix Version/s: (was: 2.0.1) 2.0.2 > Multiple Bugs in DDL Statements on

[jira] [Updated] (SPARK-17609) SessionCatalog.tableExists should not check temp view

[ https://issues.apache.org/jira/browse/SPARK-17609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-17609: Target Version/s: 2.0.2, 2.1.0 (was: 2.1.0) > SessionCatalog.tableExists should not check temp

[jira] [Updated] (SPARK-17609) SessionCatalog.tableExists should not check temp view

[ https://issues.apache.org/jira/browse/SPARK-17609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-17609: Fix Version/s: 2.0.1 > SessionCatalog.tableExists should not check temp view >

[jira] [Updated] (SPARK-17502) Multiple Bugs in DDL Statements on Temporary Views

[ https://issues.apache.org/jira/browse/SPARK-17502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-17502: Fix Version/s: 2.0.1 > Multiple Bugs in DDL Statements on Temporary Views >

[jira] [Updated] (SPARK-17609) SessionCatalog.tableExists should not check temp view

[ https://issues.apache.org/jira/browse/SPARK-17609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-17609: Fix Version/s: (was: 2.0.1) 2.0.2 > SessionCatalog.tableExists should not

[jira] [Assigned] (SPARK-17641) collect_set should ignore null values

[ https://issues.apache.org/jira/browse/SPARK-17641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17641: Assignee: Apache Spark > collect_set should ignore null values >

[jira] [Assigned] (SPARK-17641) collect_set should ignore null values

[ https://issues.apache.org/jira/browse/SPARK-17641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17641: Assignee: (was: Apache Spark) > collect_set should ignore null values >

[jira] [Assigned] (SPARK-17643) Remove comparable requirement from Offset

[ https://issues.apache.org/jira/browse/SPARK-17643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17643: Assignee: Michael Armbrust (was: Apache Spark) > Remove comparable requirement from

[jira] [Assigned] (SPARK-17643) Remove comparable requirement from Offset

[ https://issues.apache.org/jira/browse/SPARK-17643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17643: Assignee: Apache Spark (was: Michael Armbrust) > Remove comparable requirement from

[jira] [Commented] (SPARK-17643) Remove comparable requirement from Offset

[ https://issues.apache.org/jira/browse/SPARK-17643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15515058#comment-15515058 ] Apache Spark commented on SPARK-17643: -- User 'marmbrus' has created a pull request for this issue:

[jira] [Created] (SPARK-17643) Remove comparable requirement from Offset

Michael Armbrust created SPARK-17643: Summary: Remove comparable requirement from Offset Key: SPARK-17643 URL: https://issues.apache.org/jira/browse/SPARK-17643 Project: Spark Issue

[jira] [Assigned] (SPARK-17643) Remove comparable requirement from Offset

[ https://issues.apache.org/jira/browse/SPARK-17643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust reassigned SPARK-17643: Assignee: Michael Armbrust > Remove comparable requirement from Offset >

[jira] [Commented] (SPARK-6235) Address various 2G limits

[ https://issues.apache.org/jira/browse/SPARK-6235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15515042#comment-15515042 ] Guoqiang Li commented on SPARK-6235: ping [~rxin] > Address various 2G limits >

[jira] [Created] (SPARK-17642) support DESC FORMATTED TABLE COLUMN command to show column-level statistics

Zhenhua Wang created SPARK-17642: Summary: support DESC FORMATTED TABLE COLUMN command to show column-level statistics Key: SPARK-17642 URL: https://issues.apache.org/jira/browse/SPARK-17642 Project:

[jira] [Resolved] (SPARK-17616) Getting "java.lang.RuntimeException: Distinct columns cannot exist in Aggregate "

[ https://issues.apache.org/jira/browse/SPARK-17616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-17616. Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Resolving as fixed by

[jira] [Updated] (SPARK-17635) Remove hardcode "agg_plan" in HashAggregateExec

[ https://issues.apache.org/jira/browse/SPARK-17635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-17635: Affects Version/s: (was: 2.0.0) > Remove hardcode "agg_plan" in HashAggregateExec >

[jira] [Resolved] (SPARK-17635) Remove hardcode "agg_plan" in HashAggregateExec

[ https://issues.apache.org/jira/browse/SPARK-17635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-17635. - Resolution: Fixed Assignee: yucai Fix Version/s: 2.1.0 > Remove hardcode

[jira] [Updated] (SPARK-17599) Folder deletion after globbing may fail StructuredStreaming jobs

[ https://issues.apache.org/jira/browse/SPARK-17599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-17599: Fix Version/s: 2.0.1 > Folder deletion after globbing may fail StructuredStreaming jobs >

[jira] [Updated] (SPARK-17569) Don't recheck existence of files when generating File Relation resolution in StructuredStreaming

[ https://issues.apache.org/jira/browse/SPARK-17569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-17569: Fix Version/s: 2.0.1 > Don't recheck existence of files when generating File Relation resolution

[jira] [Updated] (SPARK-17641) collect_set should ignore null values

[ https://issues.apache.org/jira/browse/SPARK-17641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-17641: - Target Version/s: 2.0.1, 2.1.0 > collect_set should ignore null values >

[jira] [Updated] (SPARK-17641) collect_set should ignore null values

[ https://issues.apache.org/jira/browse/SPARK-17641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-17641: - Target Version/s: 2.1.0 (was: 2.0.1, 2.1.0) > collect_set should ignore null values >

[jira] [Updated] (SPARK-17641) collect_set should ignore null values

[ https://issues.apache.org/jira/browse/SPARK-17641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-17641: -- Description: `collect_set` throws the following exception when there are null values. It

[jira] [Updated] (SPARK-17641) collect_set should ignore null values

[ https://issues.apache.org/jira/browse/SPARK-17641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-17641: -- Description: `collect_set` throws the following exception when there are null values. It

[jira] [Created] (SPARK-17641) collect_set should ignore null values

Xiangrui Meng created SPARK-17641: - Summary: collect_set should ignore null values Key: SPARK-17641 URL: https://issues.apache.org/jira/browse/SPARK-17641 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-17640) Avoid using -1 as the default batchId for FileStreamSource.FileEntry

[ https://issues.apache.org/jira/browse/SPARK-17640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17640: Assignee: Apache Spark (was: Shixiong Zhu) > Avoid using -1 as the default batchId for

[jira] [Assigned] (SPARK-17640) Avoid using -1 as the default batchId for FileStreamSource.FileEntry

[ https://issues.apache.org/jira/browse/SPARK-17640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17640: Assignee: Shixiong Zhu (was: Apache Spark) > Avoid using -1 as the default batchId for

[jira] [Commented] (SPARK-17640) Avoid using -1 as the default batchId for FileStreamSource.FileEntry

[ https://issues.apache.org/jira/browse/SPARK-17640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514857#comment-15514857 ] Apache Spark commented on SPARK-17640: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Commented] (SPARK-17636) Parquet filter push down doesn't handle struct fields

[ https://issues.apache.org/jira/browse/SPARK-17636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514853#comment-15514853 ] Hyukjin Kwon commented on SPARK-17636: -- Yea, Spark implementation currently does not push down

[jira] [Created] (SPARK-17640) Avoid using -1 as the default batchId for FileStreamSource.FileEntry

Shixiong Zhu created SPARK-17640: Summary: Avoid using -1 as the default batchId for FileStreamSource.FileEntry Key: SPARK-17640 URL: https://issues.apache.org/jira/browse/SPARK-17640 Project: Spark

[jira] [Commented] (SPARK-12945) ERROR LiveListenerBus: Listener JobProgressListener threw an exception

[ https://issues.apache.org/jira/browse/SPARK-12945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514850#comment-15514850 ] Josh Rosen commented on SPARK-12945: In general, the {{JobProgressListener}} should not be throwing

[jira] [Commented] (SPARK-16240) model loading backward compatibility for ml.clustering.LDA

[ https://issues.apache.org/jira/browse/SPARK-16240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514829#comment-15514829 ] Joseph K. Bradley commented on SPARK-16240: --- I merged this for 2.1 and sent a backport for 2.0:

[jira] [Updated] (SPARK-16240) model loading backward compatibility for ml.clustering.LDA

[ https://issues.apache.org/jira/browse/SPARK-16240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-16240: -- Fix Version/s: 2.1.0 > model loading backward compatibility for ml.clustering.LDA >

[jira] [Commented] (SPARK-16240) model loading backward compatibility for ml.clustering.LDA

[ https://issues.apache.org/jira/browse/SPARK-16240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514828#comment-15514828 ] Apache Spark commented on SPARK-16240: -- User 'jkbradley' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17639) Need to add jce.jar to bootclasspath

[ https://issues.apache.org/jira/browse/SPARK-17639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17639: Assignee: (was: Apache Spark) > Need to add jce.jar to bootclasspath >

[jira] [Commented] (SPARK-17639) Need to add jce.jar to bootclasspath

[ https://issues.apache.org/jira/browse/SPARK-17639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514719#comment-15514719 ] Apache Spark commented on SPARK-17639: -- User 'vanzin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17639) Need to add jce.jar to bootclasspath

[ https://issues.apache.org/jira/browse/SPARK-17639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17639: Assignee: Apache Spark > Need to add jce.jar to bootclasspath >

[jira] [Created] (SPARK-17639) Need to add jce.jar to bootclasspath

Marcelo Vanzin created SPARK-17639: -- Summary: Need to add jce.jar to bootclasspath Key: SPARK-17639 URL: https://issues.apache.org/jira/browse/SPARK-17639 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-17569) Don't recheck existence of files when generating File Relation resolution in StructuredStreaming

[ https://issues.apache.org/jira/browse/SPARK-17569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514584#comment-15514584 ] Apache Spark commented on SPARK-17569: -- User 'brkyvz' has created a pull request for this issue:

[jira] [Resolved] (SPARK-17638) Stop JVM StreamingContext when the Python process is dead

[ https://issues.apache.org/jira/browse/SPARK-17638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-17638. -- Resolution: Fixed Fix Version/s: 2.1.0 2.0.2 > Stop JVM

[jira] [Commented] (SPARK-17569) Don't recheck existence of files when generating File Relation resolution in StructuredStreaming

[ https://issues.apache.org/jira/browse/SPARK-17569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514512#comment-15514512 ] Apache Spark commented on SPARK-17569: -- User 'brkyvz' has created a pull request for this issue:

[jira] [Commented] (SPARK-17599) Folder deletion after globbing may fail StructuredStreaming jobs

[ https://issues.apache.org/jira/browse/SPARK-17599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514511#comment-15514511 ] Apache Spark commented on SPARK-17599: -- User 'brkyvz' has created a pull request for this issue:

[jira] [Updated] (SPARK-17636) Parquet filter push down doesn't handle struct fields

[ https://issues.apache.org/jira/browse/SPARK-17636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mitesh updated SPARK-17636: --- Priority: Minor (was: Major) > Parquet filter push down doesn't handle struct fields >

[jira] [Updated] (SPARK-17635) Remove hardcode "agg_plan" in HashAggregateExec

[ https://issues.apache.org/jira/browse/SPARK-17635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-17635: Labels: correctness (was: ) > Remove hardcode "agg_plan" in HashAggregateExec >

[jira] [Updated] (SPARK-17613) PartitioningAwareFileCatalog.allFiles doesn't handle URI specified path at parent

[ https://issues.apache.org/jira/browse/SPARK-17613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-17613: --- Fix Version/s: (was: 2.2.0) 2.1.0 > PartitioningAwareFileCatalog.allFiles

[jira] [Resolved] (SPARK-17613) PartitioningAwareFileCatalog.allFiles doesn't handle URI specified path at parent

[ https://issues.apache.org/jira/browse/SPARK-17613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-17613. Resolution: Fixed Fix Version/s: 2.2.0 2.0.1 Issue resolved by pull

[jira] [Updated] (SPARK-17613) PartitioningAwareFileCatalog.allFiles doesn't handle URI specified path at parent

[ https://issues.apache.org/jira/browse/SPARK-17613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-17613: --- Assignee: Burak Yavuz > PartitioningAwareFileCatalog.allFiles doesn't handle URI specified path at

[jira] [Resolved] (SPARK-2539) ConnectionManager should handle Uncaught Exception

[ https://issues.apache.org/jira/browse/SPARK-2539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-2539. --- Resolution: Won't Fix Resolving as "won't fix" since the ConnectionManager has been removed in Spark

[jira] [Commented] (SPARK-16830) Executors Keep Trying to Fetch Blocks from a Bad Host

[ https://issues.apache.org/jira/browse/SPARK-16830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514303#comment-15514303 ] Josh Rosen commented on SPARK-16830: Do you have stacktraces from the failed block fetches? I'd like

[jira] [Assigned] (SPARK-17638) Stop JVM StreamingContext when the Python process is dead

[ https://issues.apache.org/jira/browse/SPARK-17638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17638: Assignee: Shixiong Zhu (was: Apache Spark) > Stop JVM StreamingContext when the Python

[jira] [Assigned] (SPARK-17638) Stop JVM StreamingContext when the Python process is dead

[ https://issues.apache.org/jira/browse/SPARK-17638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17638: Assignee: Apache Spark (was: Shixiong Zhu) > Stop JVM StreamingContext when the Python

[jira] [Commented] (SPARK-17638) Stop JVM StreamingContext when the Python process is dead

[ https://issues.apache.org/jira/browse/SPARK-17638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514280#comment-15514280 ] Apache Spark commented on SPARK-17638: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Created] (SPARK-17638) Stop JVM StreamingContext when the Python process is dead

Shixiong Zhu created SPARK-17638: Summary: Stop JVM StreamingContext when the Python process is dead Key: SPARK-17638 URL: https://issues.apache.org/jira/browse/SPARK-17638 Project: Spark

[jira] [Commented] (SPARK-14536) NPE in JDBCRDD when array column contains nulls (postgresql)

[ https://issues.apache.org/jira/browse/SPARK-14536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514246#comment-15514246 ] Suresh Thalamati commented on SPARK-14536: -- Yes. SPARK-10186 already added array support for

[jira] [Resolved] (SPARK-8790) BlockManager.reregister cause OOM

[ https://issues.apache.org/jira/browse/SPARK-8790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-8790. --- Resolution: Cannot Reproduce I'm going to resolve this issue as "Cannot Reproduce" since it's over a

[jira] [Commented] (SPARK-14536) NPE in JDBCRDD when array column contains nulls (postgresql)

[ https://issues.apache.org/jira/browse/SPARK-14536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514134#comment-15514134 ] Sean Owen commented on SPARK-14536: --- Yes, sounds like we're both saying this is tied up in the

[jira] [Commented] (SPARK-14536) NPE in JDBCRDD when array column contains nulls (postgresql)

[ https://issues.apache.org/jira/browse/SPARK-14536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514129#comment-15514129 ] Suresh Thalamati commented on SPARK-14536: -- [~sowen] I am not sure why this issue got closed

[jira] [Commented] (SPARK-17453) Broadcast block already exists in MemoryStore

[ https://issues.apache.org/jira/browse/SPARK-17453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514123#comment-15514123 ] Josh Rosen commented on SPARK-17453: Actually, upon closer inspection I do not believe that this is

[jira] [Commented] (SPARK-17637) Packed scheduling for Spark tasks across executors

[ https://issues.apache.org/jira/browse/SPARK-17637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514105#comment-15514105 ] Zhan Zhang commented on SPARK-17637: The plan is to introduce a new configuration so that different

[jira] [Created] (SPARK-17637) Packed scheduling for Spark tasks across executors

Zhan Zhang created SPARK-17637: -- Summary: Packed scheduling for Spark tasks across executors Key: SPARK-17637 URL: https://issues.apache.org/jira/browse/SPARK-17637 Project: Spark Issue Type:

[jira] [Commented] (SPARK-17453) Broadcast block already exists in MemoryStore

[ https://issues.apache.org/jira/browse/SPARK-17453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514091#comment-15514091 ] Josh Rosen commented on SPARK-17453: There might be a race-condition here which could occur if

[jira] [Commented] (SPARK-17131) Code generation fails when running SQL expressions against a wide dataset (thousands of columns)

[ https://issues.apache.org/jira/browse/SPARK-17131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514085#comment-15514085 ] Aris Vlasakakis commented on SPARK-17131: - Hi there, I discovered a bug, and it also pertains to

[jira] [Resolved] (SPARK-14209) Application failure during preemption.

[ https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-14209. Resolution: Fixed Assignee: Josh Rosen Fix Version/s: 2.1.0

[jira] [Comment Edited] (SPARK-14209) Application failure during preemption.

[ https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514054#comment-15514054 ] Josh Rosen edited comment on SPARK-14209 at 9/22/16 6:17 PM: - I have

[jira] [Commented] (SPARK-14209) Application failure during preemption.

[ https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514054#comment-15514054 ] Josh Rosen commented on SPARK-14209: I have backported SPARK-17485 to Spark 1.6.x (for inclusion in

[jira] [Resolved] (SPARK-17485) Failed remote cached block reads can lead to whole job failure

[ https://issues.apache.org/jira/browse/SPARK-17485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-17485. Resolution: Fixed Fix Version/s: 1.6.3 Issue resolved by pull request 15186

[jira] [Commented] (SPARK-17601) SparkSQL vectorization cannot handle schema evolution for parquet tables when parquet files use Int whereas DataFrame uses Long

[ https://issues.apache.org/jira/browse/SPARK-17601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514019#comment-15514019 ] Gang Wu commented on SPARK-17601: - [~hyukjin.kwon] Yes I agree. I just created these JIRAs for issues we

[jira] [Resolved] (SPARK-17365) Kill multiple executors together to reduce lock contention

[ https://issues.apache.org/jira/browse/SPARK-17365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-17365. Resolution: Fixed Assignee: Dhruve Ashar Fix Version/s: 2.1.0 > Kill

[jira] [Updated] (SPARK-17636) Parquet filter push down doesn't handle struct fields

[ https://issues.apache.org/jira/browse/SPARK-17636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mitesh updated SPARK-17636: --- Description: Theres a `PushedFilters` for a simple numeric field, but not for a numeric field inside a

[jira] [Updated] (SPARK-17636) Parquet filter push down doesn't handle struct fields

[ https://issues.apache.org/jira/browse/SPARK-17636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mitesh updated SPARK-17636: --- Description: Theres a *PushedFilters* for a simple numeric field, but not for a numeric field inside a

[jira] [Updated] (SPARK-17636) Parquet filter push down doesn't handle struct fields

[ https://issues.apache.org/jira/browse/SPARK-17636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mitesh updated SPARK-17636: --- Description: The filter gets pushed down for a simple numeric field, but not for a numeric field inside a

[jira] [Comment Edited] (SPARK-17634) Spark job hangs when using dapply

[ https://issues.apache.org/jira/browse/SPARK-17634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15513673#comment-15513673 ] Thomas Powell edited comment on SPARK-17634 at 9/22/16 4:35 PM: I also

[jira] [Updated] (SPARK-17636) Parquet filter push down doesn't handle struct fields

[ https://issues.apache.org/jira/browse/SPARK-17636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mitesh updated SPARK-17636: --- Description: The filter gets pushed down for a simple numeric field, but not for a numeric field inside a

[jira] [Updated] (SPARK-17636) Parquet filter push down doesn't handle struct fields

[ https://issues.apache.org/jira/browse/SPARK-17636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mitesh updated SPARK-17636: --- Description: The filter gets pushed down for a simple numeric field, but not for a numeric field inside a

[jira] [Created] (SPARK-17636) Parquet filter push down doesn't handle struct fields

Mitesh created SPARK-17636: -- Summary: Parquet filter push down doesn't handle struct fields Key: SPARK-17636 URL: https://issues.apache.org/jira/browse/SPARK-17636 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-17634) Spark job hangs when using dapply

[ https://issues.apache.org/jira/browse/SPARK-17634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15513673#comment-15513673 ] Thomas Powell commented on SPARK-17634: --- I also ran this on a row limited version of this dataset.

[jira] [Closed] (SPARK-17622) Cannot run create or load DF on Windows- Spark 2.0.0

[ https://issues.apache.org/jira/browse/SPARK-17622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] renzhi he closed SPARK-17622. - Resolution: Not A Bug > Cannot run create or load DF on Windows- Spark 2.0.0 >

[jira] [Commented] (SPARK-17622) Cannot run create or load DF on Windows- Spark 2.0.0

[ https://issues.apache.org/jira/browse/SPARK-17622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15513639#comment-15513639 ] renzhi he commented on SPARK-17622: --- Yes, I did not build Hive or other Hadoop-related modules. Still

[jira] [Assigned] (SPARK-17635) Remove hardcode "agg_plan" in HashAggregateExec

[ https://issues.apache.org/jira/browse/SPARK-17635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17635: Assignee: Apache Spark > Remove hardcode "agg_plan" in HashAggregateExec >

[jira] [Assigned] (SPARK-17635) Remove hardcode "agg_plan" in HashAggregateExec

[ https://issues.apache.org/jira/browse/SPARK-17635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17635: Assignee: (was: Apache Spark) > Remove hardcode "agg_plan" in HashAggregateExec >

[jira] [Commented] (SPARK-17635) Remove hardcode "agg_plan" in HashAggregateExec

[ https://issues.apache.org/jira/browse/SPARK-17635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15513504#comment-15513504 ] Apache Spark commented on SPARK-17635: -- User 'yucai' has created a pull request for this issue:

[jira] [Created] (SPARK-17635) Remove hardcode "agg_plan" in HashAggregateExec

yucai created SPARK-17635: - Summary: Remove hardcode "agg_plan" in HashAggregateExec Key: SPARK-17635 URL: https://issues.apache.org/jira/browse/SPARK-17635 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-17634) Spark job hangs when using dapply

Thomas Powell created SPARK-17634: - Summary: Spark job hangs when using dapply Key: SPARK-17634 URL: https://issues.apache.org/jira/browse/SPARK-17634 Project: Spark Issue Type: Bug

[jira] [Reopened] (SPARK-15390) Memory management issue in complex DataFrame join and filter

[ https://issues.apache.org/jira/browse/SPARK-15390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Iulian Dragos reopened SPARK-15390: --- > Memory management issue in complex DataFrame join and filter >

[jira] [Commented] (SPARK-15390) Memory management issue in complex DataFrame join and filter

[ https://issues.apache.org/jira/browse/SPARK-15390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15513206#comment-15513206 ] Iulian Dragos commented on SPARK-15390: --- I'm still seeing a similar stack trace with the 2.0

[jira] [Updated] (SPARK-14909) Spark UI submitted time is wrong

[ https://issues.apache.org/jira/browse/SPARK-14909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jagadeesan A S updated SPARK-14909: --- Attachment: app3.png app2.png app1.png

[jira] [Updated] (SPARK-14909) Spark UI submitted time is wrong

[ https://issues.apache.org/jira/browse/SPARK-14909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jagadeesan A S updated SPARK-14909: --- Attachment: (was: app3.png) > Spark UI submitted time is wrong >

[jira] [Updated] (SPARK-14909) Spark UI submitted time is wrong

[ https://issues.apache.org/jira/browse/SPARK-14909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jagadeesan A S updated SPARK-14909: --- Attachment: (was: master.png) > Spark UI submitted time is wrong >

  1   2   >