[
https://issues.apache.org/jira/browse/SPARK-22326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li resolved SPARK-22326.
-
Resolution: Fixed
Assignee: Zhenhua Wang
Fix Version/s: 2.3.0
> Remove unnecessary
[
https://issues.apache.org/jira/browse/SPARK-21750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213702#comment-16213702
]
Kazuaki Ishizaki commented on SPARK-21750:
--
Thank you. Good to hear that.
> Use arrow 0.6.0
>
[
https://issues.apache.org/jira/browse/SPARK-22326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22326:
Assignee: Apache Spark
> Remove unnecessary hashCode and equals methods
>
[
https://issues.apache.org/jira/browse/SPARK-22326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22326:
Assignee: (was: Apache Spark)
> Remove unnecessary hashCode and equals methods
>
Zhenhua Wang created SPARK-22326:
Summary: Remove unnecessary hashCode and equals methods
Key: SPARK-22326
URL: https://issues.apache.org/jira/browse/SPARK-22326
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-22326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213666#comment-16213666
]
Apache Spark commented on SPARK-22326:
--
User 'wzhfy' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-22307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213432#comment-16213432
]
kevin yu commented on SPARK-22307:
--
It is correct behavior based on SQL standards, as Marco said. Your
[
https://issues.apache.org/jira/browse/SPARK-21929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-21929:
Assignee: (was: Apache Spark)
> Support `ALTER TABLE table_name ADD COLUMNS(..)` for
[
https://issues.apache.org/jira/browse/SPARK-21929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213272#comment-16213272
]
Apache Spark commented on SPARK-21929:
--
User 'dongjoon-hyun' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-21929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-21929:
Assignee: Apache Spark
> Support `ALTER TABLE table_name ADD COLUMNS(..)` for ORC data
[
https://issues.apache.org/jira/browse/SPARK-11844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213216#comment-16213216
]
Cosmin Lehene edited comment on SPARK-11844 at 10/20/17 8:59 PM:
-
I'm
[
https://issues.apache.org/jira/browse/SPARK-11844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213216#comment-16213216
]
Cosmin Lehene commented on SPARK-11844:
---
I'm seeing these with spark-2.2.1-SNAPSHOT
{noformat}
[
https://issues.apache.org/jira/browse/SPARK-22323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213182#comment-16213182
]
Bryan Cutler edited comment on SPARK-22323 at 10/20/17 8:30 PM:
Is this
[
https://issues.apache.org/jira/browse/SPARK-22323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213182#comment-16213182
]
Bryan Cutler commented on SPARK-22323:
--
I this meant to be a user doc?
> Design doc for different
[
https://issues.apache.org/jira/browse/SPARK-22323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213167#comment-16213167
]
Li Jin commented on SPARK-22323:
Bryan I think Spark-1 is more about types between spark/arrow, like
[
https://issues.apache.org/jira/browse/SPARK-22323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213151#comment-16213151
]
Bryan Cutler commented on SPARK-22323:
--
Should I close SPARK-1 since it looks like the docs will
[
https://issues.apache.org/jira/browse/SPARK-22325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin deleted SPARK-22325:
> SPARK_TESTING env variable breaking non-spark builds on amplab jenkins
>
[
https://issues.apache.org/jira/browse/SPARK-22325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
shane knapp updated SPARK-22325:
Description:
in the riselab jenkins master config, the SPARK_TESTING environment variable is
set
shane knapp created SPARK-22325:
---
Summary: SPARK_TESTING env variable breaking non-spark builds on
amplab jenkins
Key: SPARK-22325
URL: https://issues.apache.org/jira/browse/SPARK-22325
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-21750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun closed SPARK-21750.
-
SPARK-22324 supercedes this.
> Use arrow 0.6.0
> ---
>
> Key:
[
https://issues.apache.org/jira/browse/SPARK-21750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213016#comment-16213016
]
Dongjoon Hyun commented on SPARK-21750:
---
Great! Thanks, [~bryanc]. I'll monitor SPARK-22324.
> Use
[
https://issues.apache.org/jira/browse/SPARK-22296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213015#comment-16213015
]
Randy Tidd edited comment on SPARK-22296 at 10/20/17 6:34 PM:
--
Thank you I
[
https://issues.apache.org/jira/browse/SPARK-22296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213015#comment-16213015
]
Randy Tidd commented on SPARK-22296:
Thank you I was just installing 2.2.0 and related components to
[
https://issues.apache.org/jira/browse/SPARK-21750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213012#comment-16213012
]
Bryan Cutler commented on SPARK-21750:
--
Thanks [~dongjoon], I opened SPARK-22324 under the Arrow
Bryan Cutler created SPARK-22324:
Summary: Upgrade Arrow to version 0.8.0
Key: SPARK-22324
URL: https://issues.apache.org/jira/browse/SPARK-22324
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-22296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16212999#comment-16212999
]
Dongjoon Hyun commented on SPARK-22296:
---
[~tiddman]. Please refer the following in 2.2. This is
[
https://issues.apache.org/jira/browse/SPARK-22296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16212983#comment-16212983
]
Randy Tidd edited comment on SPARK-22296 at 10/20/17 6:17 PM:
--
The example
[
https://issues.apache.org/jira/browse/SPARK-22296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16212983#comment-16212983
]
Randy Tidd commented on SPARK-22296:
The example above does not exhibit the problem. Here is a
[
https://issues.apache.org/jira/browse/SPARK-21926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16212962#comment-16212962
]
Joseph K. Bradley commented on SPARK-21926:
---
One more report from the dev list: HashingTF and
[
https://issues.apache.org/jira/browse/SPARK-21926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Joseph K. Bradley updated SPARK-21926:
--
Shepherd: Joseph K. Bradley
> Compatibility between ML Transformers and Structured
[
https://issues.apache.org/jira/browse/SPARK-21926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Joseph K. Bradley updated SPARK-21926:
--
Summary: Compatibility between ML Transformers and Structured Streaming
(was: Some
[
https://issues.apache.org/jira/browse/SPARK-21926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Joseph K. Bradley updated SPARK-21926:
--
Issue Type: Umbrella (was: Bug)
> Compatibility between ML Transformers and
[
https://issues.apache.org/jira/browse/SPARK-19007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16212932#comment-16212932
]
Michael Mior commented on SPARK-19007:
--
I see from the following statement from the PR discussion,
[
https://issues.apache.org/jira/browse/SPARK-19007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16212924#comment-16212924
]
Michael Mior commented on SPARK-19007:
--
[~josephkb] I'm confused why it's necessary to cache more
[
https://issues.apache.org/jira/browse/SPARK-22209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16212890#comment-16212890
]
Bryan Cutler edited comment on SPARK-22209 at 10/20/17 5:01 PM:
It does
[
https://issues.apache.org/jira/browse/SPARK-22209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16212890#comment-16212890
]
Bryan Cutler commented on SPARK-22209:
--
It does seem like a bug to me so it should be fixed, I
[
https://issues.apache.org/jira/browse/SPARK-21055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li resolved SPARK-21055.
-
Resolution: Fixed
Assignee: cen yuhai
Fix Version/s: 2.3.0
> Support grouping__id
>
[
https://issues.apache.org/jira/browse/SPARK-22323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16212778#comment-16212778
]
Apache Spark commented on SPARK-22323:
--
User 'icexelloss' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-22323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22323:
Assignee: Apache Spark
> Design doc for different types of pandas_udf
>
[
https://issues.apache.org/jira/browse/SPARK-22323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22323:
Assignee: (was: Apache Spark)
> Design doc for different types of pandas_udf
>
[
https://issues.apache.org/jira/browse/SPARK-19606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16212770#comment-16212770
]
Apache Spark commented on SPARK-19606:
--
User 'pmackles' has created a pull request for this issue:
Li Jin created SPARK-22323:
--
Summary: Design doc for different types of pandas_udf
Key: SPARK-22323
URL: https://issues.apache.org/jira/browse/SPARK-22323
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-21750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16212741#comment-16212741
]
Dongjoon Hyun commented on SPARK-21750:
---
Hi, [~kiszk].
Two more Arrow releases seem to be out. How
[
https://issues.apache.org/jira/browse/SPARK-21750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16212740#comment-16212740
]
Apache Spark commented on SPARK-21750:
--
User 'kiszk' has created a pull request for this issue:
Sean Owen created SPARK-22322:
-
Summary: Update FutureAction for compatibility with Scala 2.12
future
Key: SPARK-22322
URL: https://issues.apache.org/jira/browse/SPARK-22322
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-22320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16212640#comment-16212640
]
Dongjoon Hyun commented on SPARK-22320:
---
Thank you, [~hyukjin.kwon]!
> ORC should support
[
https://issues.apache.org/jira/browse/SPARK-22320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16212638#comment-16212638
]
Hyukjin Kwon commented on SPARK-22320:
--
{quote}
Is this ORC only issue? What about Parquet?
{quote}
[
https://issues.apache.org/jira/browse/SPARK-22320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16212637#comment-16212637
]
Dongjoon Hyun commented on SPARK-22320:
---
Thank you, [~podongfeng]. I checked that and updated this
[
https://issues.apache.org/jira/browse/SPARK-22320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16212629#comment-16212629
]
zhengruifeng commented on SPARK-22320:
--
I test on spark 2.2.0.
parquet works fine.
I have not try
[
https://issues.apache.org/jira/browse/SPARK-22320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16212624#comment-16212624
]
zhengruifeng commented on SPARK-22320:
--
I test on spark 2.2.0.
parquet works fine.
I have not try
[
https://issues.apache.org/jira/browse/SPARK-22305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16212608#comment-16212608
]
Yuval Itzchakov commented on SPARK-22305:
-
[~tdas] What do you think?
>
[
https://issues.apache.org/jira/browse/SPARK-22320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16212601#comment-16212601
]
Dongjoon Hyun commented on SPARK-22320:
---
Ping [~hyukjin.kwon] since you worked on SPARK-17765.
>
[
https://issues.apache.org/jira/browse/SPARK-22320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16212581#comment-16212581
]
Dongjoon Hyun commented on SPARK-22320:
---
I checked that 2.2.0 and 2.1.2 has the same problem and
[
https://issues.apache.org/jira/browse/SPARK-22320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-22320:
--
Affects Version/s: 2.0.2
> ORC should support VectorUDT/MatrixUDT
>
[
https://issues.apache.org/jira/browse/SPARK-22320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-22320:
--
Affects Version/s: 2.1.2
> ORC should support VectorUDT/MatrixUDT
>
[
https://issues.apache.org/jira/browse/SPARK-22320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-22320:
--
Affects Version/s: (was: 2.3.0)
> ORC should support VectorUDT/MatrixUDT
>
[
https://issues.apache.org/jira/browse/SPARK-22320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-22320:
--
Affects Version/s: 2.2.0
> ORC should support VectorUDT/MatrixUDT
>
Stavros Kontopoulos created SPARK-22321:
---
Summary: Improve Logging in the mesos scheduler
Key: SPARK-22321
URL: https://issues.apache.org/jira/browse/SPARK-22321
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-22321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Stavros Kontopoulos updated SPARK-22321:
Summary: Improve logging in the mesos scheduler (was: Improve Logging in
the
[
https://issues.apache.org/jira/browse/SPARK-18935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Stavros Kontopoulos updated SPARK-18935:
Component/s: Mesos
> Use Mesos "Dynamic Reservation" resource for Spark
>
[
https://issues.apache.org/jira/browse/SPARK-21492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16212522#comment-16212522
]
Bartosz Mścichowski commented on SPARK-21492:
-
Here's a script that exposes memory leak
[
https://issues.apache.org/jira/browse/SPARK-22284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16212513#comment-16212513
]
Ben commented on SPARK-22284:
-
[~kiszk], happy to help, and thanks for your assistance.
So, if I understand
[
https://issues.apache.org/jira/browse/SPARK-22320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16212507#comment-16212507
]
Dongjoon Hyun commented on SPARK-22320:
---
Thank you for reporting, [~podongfeng].
- Is this ORC only
[
https://issues.apache.org/jira/browse/SPARK-22320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhengruifeng updated SPARK-22320:
-
Description:
I save dataframe containing vectors in ORC format, when I read it back, the
format
[
https://issues.apache.org/jira/browse/SPARK-22320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhengruifeng updated SPARK-22320:
-
Summary: ORC should support VectorUDT/MatrixUDT (was: ORC should support
VectorUDF/MatrixUDT)
zhengruifeng created SPARK-22320:
Summary: ORC should support VectorUDF/MatrixUDT
Key: SPARK-22320
URL: https://issues.apache.org/jira/browse/SPARK-22320
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-22320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhengruifeng updated SPARK-22320:
-
Description:
I save dataframe containing {{ml.Vector}}s in ORC format, when I read it back,
the
[
https://issues.apache.org/jira/browse/SPARK-9?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16212462#comment-16212462
]
Rob Vesse commented on SPARK-9:
---
[~yuvaldeg], thanks for providing additional clarifications
If a
[
https://issues.apache.org/jira/browse/SPARK-22296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-22296.
---
Resolution: Duplicate
> CodeGenerator - failed to compile when constructor has
>
[
https://issues.apache.org/jira/browse/SPARK-22307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-22307.
---
Resolution: Not A Problem
> NOT condition working incorrectly
> -
>
[
https://issues.apache.org/jira/browse/SPARK-21551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-21551:
--
Fix Version/s: 2.1.3
> pyspark's collect fails when getaddrinfo is too slow
>
[
https://issues.apache.org/jira/browse/SPARK-22309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-22309.
---
Resolution: Duplicate
This is actually just an addition to your change in SPARK-20930
> Remove
[
https://issues.apache.org/jira/browse/SPARK-22318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-22318.
---
Resolution: Invalid
There's no bug reported here. It's normal that the job waits at start()
[
https://issues.apache.org/jira/browse/SPARK-22317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-22317.
---
Resolution: Not A Problem
As the error says, run the process with more memory.
> Spark Thrift job
74 matches
Mail list logo
