[
https://issues.apache.org/jira/browse/SPARK-22231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198305#comment-16198305
]
DB Tsai commented on SPARK-22231:
-
[~rxin] {{df.drop("items.b")}} works too. We also want to have
[
https://issues.apache.org/jira/browse/SPARK-22152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-22152.
---
Resolution: Won't Fix
> Add Dataset flatten function
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-22231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198286#comment-16198286
]
DB Tsai commented on SPARK-22231:
-
[~viirya] Thanks. I fixed the typo :) Yes, {{mapItems}} will work on
[
https://issues.apache.org/jira/browse/SPARK-21646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-21646:
Summary: Add new type coercion rules to compatible with Hive (was: Add new
type coercion to
[
https://issues.apache.org/jira/browse/SPARK-22233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198526#comment-16198526
]
Apache Spark commented on SPARK-22233:
--
User 'liutang123' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-22233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22233:
Assignee: (was: Apache Spark)
> filter out empty InputSplit in HadoopRDD
>
[
https://issues.apache.org/jira/browse/SPARK-22233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22233:
Assignee: Apache Spark
> filter out empty InputSplit in HadoopRDD
>
[
https://issues.apache.org/jira/browse/SPARK-22231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198306#comment-16198306
]
Reynold Xin commented on SPARK-22231:
-
Can you say more? I can't think of a case in which you'd want
[
https://issues.apache.org/jira/browse/SPARK-21646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-21646:
Summary: Add new type coercion to compatible with Hive (was:
BinaryComparison shouldn't auto cast
[
https://issues.apache.org/jira/browse/SPARK-5?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198326#comment-16198326
]
sam commented on SPARK-5:
-
Thanks [~srowen] and [~hyukjin.kwon], I wasn't aware of either of these
cen yuhai created SPARK-22234:
-
Summary: Distinct window functions are not supported
Key: SPARK-22234
URL: https://issues.apache.org/jira/browse/SPARK-22234
Project: Spark
Issue Type: New
[
https://issues.apache.org/jira/browse/SPARK-21770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-21770.
---
Resolution: Fixed
Fix Version/s: 2.3.0
Issue resolved by pull request 19106
[
https://issues.apache.org/jira/browse/SPARK-22231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198301#comment-16198301
]
Reynold Xin commented on SPARK-22231:
-
For drop columns - why not just df.drop("items.b")?
>
[
https://issues.apache.org/jira/browse/SPARK-5?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198287#comment-16198287
]
Sean Owen commented on SPARK-5:
---
I tend to agree that this is already available from binaryFiles as
[
https://issues.apache.org/jira/browse/SPARK-21770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen reassigned SPARK-21770:
-
Assignee: Weichen Xu
> ProbabilisticClassificationModel: Improve normalization of all-zero raw
[
https://issues.apache.org/jira/browse/SPARK-0?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198295#comment-16198295
]
Marco Gaido commented on SPARK-0:
-
Please may you provide some sample data and easy code to
[
https://issues.apache.org/jira/browse/SPARK-5?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198335#comment-16198335
]
Hyukjin Kwon commented on SPARK-5:
--
Sure, Thanks [~sams].
> wholeTextFilesIterators
>
Mariusz Dubielecki created SPARK-22235:
--
Summary: Can not kill job gracefully in spark standalone cluster
Key: SPARK-22235
URL: https://issues.apache.org/jira/browse/SPARK-22235
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-8186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198651#comment-16198651
]
Hyukjin Kwon commented on SPARK-8186:
-
I think the problem is filed in separately - SPARK-17174.
>
[
https://issues.apache.org/jira/browse/SPARK-9?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198716#comment-16198716
]
Liang-Chi Hsieh commented on SPARK-9:
-
As we have the pluggable mechanism to set up external
[
https://issues.apache.org/jira/browse/SPARK-20171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198719#comment-16198719
]
Hyukjin Kwon commented on SPARK-20171:
--
I happen to look at this JIRA. Looks we now throw a
[
https://issues.apache.org/jira/browse/SPARK-19325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198668#comment-16198668
]
Hyukjin Kwon commented on SPARK-19325:
--
[~Sephiroth-Lin], do you maybe have a reproducer for this?
[
https://issues.apache.org/jira/browse/SPARK-22212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jakub Nowacki resolved SPARK-22212.
---
Resolution: Later
Keeping the resolution on-hold until API unification consensus will be
[
https://issues.apache.org/jira/browse/SPARK-18479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-18479.
--
Resolution: Won't Fix
I am resolving this assuming there is no explicit objection on ^.
>
[
https://issues.apache.org/jira/browse/SPARK-19039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-19039:
-
Affects Version/s: 2.3.0
> UDF ClosureCleaner bug when UDF, col applied in paste mode in REPL
>
[
https://issues.apache.org/jira/browse/SPARK-21737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198674#comment-16198674
]
Saisai Shao commented on SPARK-21737:
-
I was trying to understand how Spark communicate with Mesos,
[
https://issues.apache.org/jira/browse/SPARK-19860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198704#comment-16198704
]
Hyukjin Kwon commented on SPARK-19860:
--
[~wuchang1989], would you mind if I ask self-contained
[
https://issues.apache.org/jira/browse/SPARK-21506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-21506:
---
Assignee: liuxian
> The description of "spark.executor.cores" may be not correct
>
[
https://issues.apache.org/jira/browse/SPARK-21506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-21506.
-
Resolution: Fixed
Fix Version/s: 2.3.0
Issue resolved by pull request 18711
[
https://issues.apache.org/jira/browse/SPARK-20025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-20025.
-
Resolution: Fixed
Fix Version/s: 2.3.0
> Driver fail over will not work, if SPARK_LOCAL*
[
https://issues.apache.org/jira/browse/SPARK-21737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198665#comment-16198665
]
Thomas Graves commented on SPARK-21737:
---
I haven't had time to think about it much since the pr
[
https://issues.apache.org/jira/browse/SPARK-20162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198712#comment-16198712
]
Hyukjin Kwon commented on SPARK-20162:
--
Let me resolve it as Cannot Reproduce. Please reopen this if
[
https://issues.apache.org/jira/browse/SPARK-20162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-20162.
--
Resolution: Cannot Reproduce
> Reading data from MySQL - Cannot up cast from decimal(30,6) to
[
https://issues.apache.org/jira/browse/SPARK-20025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-20025:
---
Assignee: Prashant Sharma
> Driver fail over will not work, if SPARK_LOCAL* env is set.
>
[
https://issues.apache.org/jira/browse/SPARK-18536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198613#comment-16198613
]
Hyukjin Kwon commented on SPARK-18536:
--
The codes:
{code}
import scala.collection.mutable.Queue
[
https://issues.apache.org/jira/browse/SPARK-8186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198630#comment-16198630
]
eugen yushin commented on SPARK-8186:
-
Unfortunately, current implementation doesn't correspond to
[
https://issues.apache.org/jira/browse/SPARK-19039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198655#comment-16198655
]
Hyukjin Kwon commented on SPARK-19039:
--
Still happens in the master:
{code}
scala> :paste
//
[
https://issues.apache.org/jira/browse/SPARK-22231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198965#comment-16198965
]
Jeremy Smith commented on SPARK-22231:
--
I implemented these at Netflix, so I wanted to provide some
[
https://issues.apache.org/jira/browse/SPARK-22231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
DB Tsai reassigned SPARK-22231:
---
Assignee: Jeremy Smith
> Support of map, filter, withColumn, dropColumn in nested list of
[
https://issues.apache.org/jira/browse/SPARK-9?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199052#comment-16199052
]
Yuval Degani commented on SPARK-9:
--
[~srowen], [~viirya], thanks for your response.
Regarding
[
https://issues.apache.org/jira/browse/SPARK-22231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198861#comment-16198861
]
Nathan Kronenfeld commented on SPARK-22231:
---
One couple related concerns...
# I think
[
https://issues.apache.org/jira/browse/SPARK-22231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198861#comment-16198861
]
Nathan Kronenfeld edited comment on SPARK-22231 at 10/10/17 7:39 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-22237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22237:
Assignee: Apache Spark
> Spark submit script should use downloaded files in
[
https://issues.apache.org/jira/browse/SPARK-22237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199296#comment-16199296
]
Apache Spark commented on SPARK-22237:
--
User 'loneknightpy' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-22237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22237:
Assignee: (was: Apache Spark)
> Spark submit script should use downloaded files in
[
https://issues.apache.org/jira/browse/SPARK-9?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199242#comment-16199242
]
Sean Owen commented on SPARK-9:
---
It's still something that should start as a package. I think that
[
https://issues.apache.org/jira/browse/SPARK-21988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199182#comment-16199182
]
Apache Spark commented on SPARK-21988:
--
User 'zsxwing' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-22236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199245#comment-16199245
]
Sean Owen commented on SPARK-22236:
---
Interesting, because the Univocity parser internally seems to
[
https://issues.apache.org/jira/browse/SPARK-9?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199293#comment-16199293
]
Yuval Degani commented on SPARK-9:
--
We already published an open-source package that implements
[
https://issues.apache.org/jira/browse/SPARK-22237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yu Peng updated SPARK-22237:
Description:
SPARK-10643 is added to allow spark-submit script to download jars/files from
remote hadoop
Yu Peng created SPARK-22237:
---
Summary: Spark submit script should use downloaded files in
standalone/local client mode
Key: SPARK-22237
URL: https://issues.apache.org/jira/browse/SPARK-22237
Project: Spark
Ondrej Kokes created SPARK-22236:
Summary: CSV I/O: does not respect RFC 4180
Key: SPARK-22236
URL: https://issues.apache.org/jira/browse/SPARK-22236
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-22231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198861#comment-16198861
]
Nathan Kronenfeld edited comment on SPARK-22231 at 10/10/17 7:38 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-21988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shixiong Zhu reopened SPARK-21988:
--
> Add default stats to StreamingExecutionRelation
>
[
https://issues.apache.org/jira/browse/SPARK-21988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-21988:
Assignee: Apache Spark (was: Jose Torres)
> Add default stats to
[
https://issues.apache.org/jira/browse/SPARK-21988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-21988:
Assignee: Jose Torres (was: Apache Spark)
> Add default stats to
Burak Yavuz created SPARK-22238:
---
Summary: EnsureStatefulOpPartitioning shouldn't ask for the child
RDD before planning is completed
Key: SPARK-22238
URL: https://issues.apache.org/jira/browse/SPARK-22238
[
https://issues.apache.org/jira/browse/SPARK-21907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Herman van Hovell reassigned SPARK-21907:
-
Assignee: Eyal Farago
> NullPointerException in UnsafeExternalSorter.spill()
>
[
https://issues.apache.org/jira/browse/SPARK-22238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199451#comment-16199451
]
Apache Spark commented on SPARK-22238:
--
User 'brkyvz' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-22238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22238:
Assignee: Burak Yavuz (was: Apache Spark)
> EnsureStatefulOpPartitioning shouldn't ask
[
https://issues.apache.org/jira/browse/SPARK-22238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22238:
Assignee: Apache Spark (was: Burak Yavuz)
> EnsureStatefulOpPartitioning shouldn't ask
[
https://issues.apache.org/jira/browse/SPARK-21907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Herman van Hovell resolved SPARK-21907.
---
Resolution: Fixed
Fix Version/s: 2.3.0
> NullPointerException in
[
https://issues.apache.org/jira/browse/SPARK-22216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199514#comment-16199514
]
Hyukjin Kwon commented on SPARK-22216:
--
Thanks for updating.
> Improving PySpark/Pandas
[
https://issues.apache.org/jira/browse/SPARK-22216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199516#comment-16199516
]
Li Jin commented on SPARK-22216:
[~hyukjin.kwon],
My intention is to keep this open to track all the
Li Jin created SPARK-22239:
--
Summary: Used-defined window functions with pandas udf
Key: SPARK-22239
URL: https://issues.apache.org/jira/browse/SPARK-22239
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-22199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198258#comment-16198258
]
Saisai Shao commented on SPARK-22199:
-
Can you please list the steps to reproduce this issue? Also
[
https://issues.apache.org/jira/browse/SPARK-22233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lijia Liu updated SPARK-22233:
--
Description:
Sometimes, Hive will create an empty table with many empty files, Spark use the
[
https://issues.apache.org/jira/browse/SPARK-22233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lijia Liu updated SPARK-22233:
--
Description:
Sometimes, Hive will create an empty table with many empty files, Spark use the
[
https://issues.apache.org/jira/browse/SPARK-22232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bago Amirbekian updated SPARK-22232:
Summary: Row objects in pyspark created using the `Row(**kwars)` syntax do
not get
[
https://issues.apache.org/jira/browse/SPARK-22231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
DB Tsai updated SPARK-22231:
Description:
At Netflix's algorithm team, we work on ranking problems to find the great
content to
[
https://issues.apache.org/jira/browse/SPARK-9?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198284#comment-16198284
]
Sean Owen commented on SPARK-9:
---
RDMA is specialized networking hardware right? I don't think this
[
https://issues.apache.org/jira/browse/SPARK-20396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-20396.
--
Resolution: Fixed
Fix Version/s: 2.3.0
Issue resolved by pull request 18732
[
https://issues.apache.org/jira/browse/SPARK-22216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199502#comment-16199502
]
Hyukjin Kwon commented on SPARK-22216:
--
[~icexelloss] and [~bryanc], do you think we need more
[
https://issues.apache.org/jira/browse/SPARK-20791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Li Jin updated SPARK-20791:
---
Issue Type: Sub-task (was: New Feature)
Parent: SPARK-22216
> Use Apache Arrow to Improve Spark
[
https://issues.apache.org/jira/browse/SPARK-19558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li resolved SPARK-19558.
-
Resolution: Fixed
Assignee: Marcelo Vanzin
Fix Version/s: 2.3.0
> Provide a config
Ritika Maheshwari created SPARK-22241:
-
Summary: Apache spark giving InvalidSchemaException: Cannot write
a schema with an empty group: optional group element {
Key: SPARK-22241
URL:
[
https://issues.apache.org/jira/browse/SPARK-22231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199789#comment-16199789
]
Liang-Chi Hsieh commented on SPARK-22231:
-
[~Jeremy Smith] Thanks for the context. Regarding the
[
https://issues.apache.org/jira/browse/SPARK-20937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199808#comment-16199808
]
Hyukjin Kwon commented on SPARK-20937:
--
+1 too.
> Describe spark.sql.parquet.writeLegacyFormat
[
https://issues.apache.org/jira/browse/SPARK-15474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-15474:
--
Affects Version/s: 2.1.1
> ORC data source fails to write and read back empty dataframe
>
[
https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199831#comment-16199831
]
Michele Costantino Soccio commented on SPARK-3:
---
[~maropu] Not sure I understand
[
https://issues.apache.org/jira/browse/SPARK-20561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-20561.
--
Resolution: Invalid
Question should better usually go to the mailing list, see
[
https://issues.apache.org/jira/browse/SPARK-21641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199811#comment-16199811
]
kant kodali commented on SPARK-21641:
-
[~marmbrus]
> Combining windowing (groupBy) and
[
https://issues.apache.org/jira/browse/SPARK-21641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199811#comment-16199811
]
kant kodali edited comment on SPARK-21641 at 10/11/17 4:58 AM:
---
[
https://issues.apache.org/jira/browse/SPARK-22236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199825#comment-16199825
]
Hyukjin Kwon edited comment on SPARK-22236 at 10/11/17 5:51 AM:
Yup, what
[
https://issues.apache.org/jira/browse/SPARK-21751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li resolved SPARK-21751.
-
Resolution: Fixed
Assignee: Kazuaki Ishizaki
Fix Version/s: 2.3.0
>
[
https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199597#comment-16199597
]
Takeshi Yamamuro commented on SPARK-3:
--
The hash-based aggregate implementation requires the
[
https://issues.apache.org/jira/browse/SPARK-15757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-15757.
---
Resolution: Duplicate
This issue only happens when `convertMetastoreOrc` is true. The root
[
https://issues.apache.org/jira/browse/SPARK-21686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-21686.
---
Resolution: Duplicate
> spark.sql.hive.convertMetastoreOrc is causing NullPointerException
[
https://issues.apache.org/jira/browse/SPARK-22241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199724#comment-16199724
]
Ritika Maheshwari commented on SPARK-22241:
---
I know parquet does not allow empty struct types.
[
https://issues.apache.org/jira/browse/SPARK-21929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-21929:
--
Description:
SPARK-19261 implemented `ADD COLUMNS` at Spark 2.2, but ORC data source is not
StephenZou created SPARK-22243:
--
Summary: job failed to restart from checkpoint
Key: SPARK-22243
URL: https://issues.apache.org/jira/browse/SPARK-22243
Project: Spark
Issue Type: Bug
StephenZou created SPARK-22242:
--
Summary: job failed to restart from checkpoint
Key: SPARK-22242
URL: https://issues.apache.org/jira/browse/SPARK-22242
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-22243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
StephenZou updated SPARK-22243:
---
Summary: streaming job failed to restart from checkpoint (was: job failed
to restart from
[
https://issues.apache.org/jira/browse/SPARK-15474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-15474:
--
Affects Version/s: 2.2.0
> ORC data source fails to write and read back empty dataframe
>
[
https://issues.apache.org/jira/browse/SPARK-22236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199825#comment-16199825
]
Hyukjin Kwon commented on SPARK-22236:
--
Yup, what is said ^ looks all correct. I think we should set
[
https://issues.apache.org/jira/browse/SPARK-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199666#comment-16199666
]
Swaapnika Guntaka commented on SPARK-1911:
--
Does this issue still exist with Spark-2.2.?
> Warn
[
https://issues.apache.org/jira/browse/SPARK-22243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22243:
Assignee: (was: Apache Spark)
> job failed to restart from checkpoint
>
[
https://issues.apache.org/jira/browse/SPARK-22243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22243:
Assignee: Apache Spark
> job failed to restart from checkpoint
>
[
https://issues.apache.org/jira/browse/SPARK-22243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
StephenZou updated SPARK-22243:
---
Attachment: CheckpointTest.scala
the reproducible demo
> job failed to restart from checkpoint
>
[
https://issues.apache.org/jira/browse/SPARK-22243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199763#comment-16199763
]
Apache Spark commented on SPARK-22243:
--
User 'ChenjunZou' has created a pull request for this issue:
1 - 100 of 116 matches
Mail list logo
