[
https://issues.apache.org/jira/browse/SPARK-22395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22395:
Assignee: (was: Apache Spark)
> Fix the behavior of timestamp values for Pandas to
[
https://issues.apache.org/jira/browse/SPARK-22395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16224399#comment-16224399
]
Apache Spark commented on SPARK-22395:
--
User 'ueshin' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-22395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22395:
Assignee: Apache Spark
> Fix the behavior of timestamp values for Pandas to respect
[
https://issues.apache.org/jira/browse/SPARK-7019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16224388#comment-16224388
]
Xin Lu commented on SPARK-7019:
---
recent pr here:
[
https://issues.apache.org/jira/browse/SPARK-7019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16224386#comment-16224386
]
Xin Lu commented on SPARK-7019:
---
It looks like unidoc is running on new PRs now. Maybe this can be closed
[
https://issues.apache.org/jira/browse/SPARK-21657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16224374#comment-16224374
]
Ohad Raviv commented on SPARK-21657:
ok i found the relevant rule:
[
https://issues.apache.org/jira/browse/SPARK-21657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16224365#comment-16224365
]
Ohad Raviv commented on SPARK-21657:
After futher investigating I believe that my assesment is
[
https://issues.apache.org/jira/browse/SPARK-2?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16224358#comment-16224358
]
Xin Lu edited comment on SPARK-2 at 10/30/17 4:12 AM:
--
I checked the
Takuya Ueshin created SPARK-22395:
-
Summary: Fix the behavior of timestamp values for Pandas to
respect session timezone
Key: SPARK-22395
URL: https://issues.apache.org/jira/browse/SPARK-22395
[
https://issues.apache.org/jira/browse/SPARK-2?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16224358#comment-16224358
]
Xin Lu edited comment on SPARK-2 at 10/30/17 4:04 AM:
--
I checked the
[
https://issues.apache.org/jira/browse/SPARK-2?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16224358#comment-16224358
]
Xin Lu commented on SPARK-2:
I checked the dependencies and it looks like lz4-java already updated to
[
https://issues.apache.org/jira/browse/SPARK-22333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16224342#comment-16224342
]
Apache Spark commented on SPARK-22333:
--
User 'DonnyZone' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-21625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-21625:
Description:
SQRT:
{code:sql}
hive> select SQRT(-10.0);
OK
NULL
Time taken: 0.384 seconds,
[
https://issues.apache.org/jira/browse/SPARK-21625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-21625:
Component/s: (was: SQL)
Documentation
> sqrt(negative number) should be null
[
https://issues.apache.org/jira/browse/SPARK-21625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-21625:
Summary: Add incompatible Hive UDF describe to DOC (was: sqrt(negative
number) should be null)
>
[
https://issues.apache.org/jira/browse/SPARK-22379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin resolved SPARK-22379.
---
Resolution: Resolved
> Reduce duplication setUpClass and tearDownClass in PySpark SQL tests
[
https://issues.apache.org/jira/browse/SPARK-22379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16224333#comment-16224333
]
Takuya Ueshin commented on SPARK-22379:
---
Issue resolved by pull request 19595
[
https://issues.apache.org/jira/browse/SPARK-22379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin updated SPARK-22379:
--
Fix Version/s: 2.3.0
> Reduce duplication setUpClass and tearDownClass in PySpark SQL tests
>
[
https://issues.apache.org/jira/browse/SPARK-22379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin reassigned SPARK-22379:
-
Assignee: Hyukjin Kwon
> Reduce duplication setUpClass and tearDownClass in PySpark SQL
[
https://issues.apache.org/jira/browse/SPARK-22344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16224301#comment-16224301
]
Shivaram Venkataraman commented on SPARK-22344:
---
well uninstall is just removing
[
https://issues.apache.org/jira/browse/SPARK-22394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22394:
Assignee: (was: Apache Spark)
> Redundant synchronization for metastore access
>
[
https://issues.apache.org/jira/browse/SPARK-22394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16224296#comment-16224296
]
Apache Spark commented on SPARK-22394:
--
User 'wzhfy' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-22394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22394:
Assignee: Apache Spark
> Redundant synchronization for metastore access
>
[
https://issues.apache.org/jira/browse/SPARK-22291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16224289#comment-16224289
]
Apache Spark commented on SPARK-22291:
--
User 'jmchung' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-22365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16224284#comment-16224284
]
guoxiaolongzte commented on SPARK-22365:
You need to provide a snapshot to help other people
[
https://issues.apache.org/jira/browse/SPARK-22308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reopened SPARK-22308:
--
> Support unit tests of spark code using ScalaTest using suites other than
> FunSuite
>
[
https://issues.apache.org/jira/browse/SPARK-22291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16224248#comment-16224248
]
Jen-Ming Chung commented on SPARK-22291:
Thank you all :)
> Postgresql UUID[] to Cassandra:
[
https://issues.apache.org/jira/browse/SPARK-22291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16224247#comment-16224247
]
Liang-Chi Hsieh commented on SPARK-22291:
-
Thanks [~hyukjin.kwon].
> Postgresql UUID[] to
[
https://issues.apache.org/jira/browse/SPARK-22291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-22291:
Assignee: Jen-Ming Chung (was: Fabio J. Walter)
> Postgresql UUID[] to Cassandra:
[
https://issues.apache.org/jira/browse/SPARK-22291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16224246#comment-16224246
]
Hyukjin Kwon commented on SPARK-22291:
--
I happened to see this comment first and just updated.
>
[
https://issues.apache.org/jira/browse/SPARK-22291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16224245#comment-16224245
]
Liang-Chi Hsieh commented on SPARK-22291:
-
[~cloud_fan] The Assignee should be [~jmchung].
[
https://issues.apache.org/jira/browse/SPARK-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reopened SPARK-15689:
-
> Data source API v2
> --
>
> Key: SPARK-15689
>
[
https://issues.apache.org/jira/browse/SPARK-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16224224#comment-16224224
]
Wenchen Fan commented on SPARK-15689:
-
ah missed this one, reopen this ticket. My concern is that,
[
https://issues.apache.org/jira/browse/SPARK-22393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16224194#comment-16224194
]
Sean Owen commented on SPARK-22393:
---
I'm guessing it's something to do with how it overrides the shell
[
https://issues.apache.org/jira/browse/SPARK-22393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16224158#comment-16224158
]
Ryan Williams commented on SPARK-22393:
---
Everything works fine in a Scala shell ({{scala -cp
[
https://issues.apache.org/jira/browse/SPARK-22344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16224139#comment-16224139
]
Felix Cheung commented on SPARK-22344:
--
Kinda we don't have any uninstall feature though
>
[
https://issues.apache.org/jira/browse/SPARK-2465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16224124#comment-16224124
]
Matteo Cossu commented on SPARK-2465:
-
For example, with this limitation it is not possible to use
[
https://issues.apache.org/jira/browse/SPARK-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16224122#comment-16224122
]
Reynold Xin commented on SPARK-15689:
-
Why not put all of them as subtasks here?
Also
[
https://issues.apache.org/jira/browse/SPARK-22394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16224120#comment-16224120
]
Wenchen Fan commented on SPARK-22394:
-
looks like so, can you send a PR? thanks!
> Redundant
[
https://issues.apache.org/jira/browse/SPARK-22291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-22291.
-
Resolution: Fixed
Assignee: Fabio J. Walter
Fix Version/s: 2.3.0
> Postgresql
[
https://issues.apache.org/jira/browse/SPARK-22393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-22393:
--
Priority: Minor (was: Major)
> spark-shell can't find imported types in class constructors, extends
[
https://issues.apache.org/jira/browse/SPARK-22393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16224040#comment-16224040
]
Sean Owen commented on SPARK-22393:
---
That's a weird one. {{class P(p: org.apache.spark.Partition)}}
[
https://issues.apache.org/jira/browse/SPARK-22394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16224028#comment-16224028
]
Zhenhua Wang commented on SPARK-22394:
--
[~cloud_fan] [~smilegator] [~rxin] Do I understand it
Zhenhua Wang created SPARK-22394:
Summary: Redundant synchronization for metastore access
Key: SPARK-22394
URL: https://issues.apache.org/jira/browse/SPARK-22394
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-22393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Williams updated SPARK-22393:
--
Affects Version/s: (was: 2.0.0)
2.0.2
> spark-shell can't find
Ryan Williams created SPARK-22393:
-
Summary: spark-shell can't find imported types in class
constructors, extends clause
Key: SPARK-22393
URL: https://issues.apache.org/jira/browse/SPARK-22393
[
https://issues.apache.org/jira/browse/SPARK-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-15689.
-
Resolution: Fixed
Fix Version/s: 2.3.0
> Data source API v2
> --
>
>
[
https://issues.apache.org/jira/browse/SPARK-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223988#comment-16223988
]
Wenchen Fan commented on SPARK-15689:
-
The basic read/write interfaces are done, I'm resolving this
Wenchen Fan created SPARK-22392:
---
Summary: columnar reader interface
Key: SPARK-22392
URL: https://issues.apache.org/jira/browse/SPARK-22392
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-22391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-22391:
Description: please refer to the discussion in the dev list with this
email: *[discuss] Data
[
https://issues.apache.org/jira/browse/SPARK-21657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223987#comment-16223987
]
Wenchen Fan commented on SPARK-21657:
-
I'd say they are different issues, and I haven't figured out
[
https://issues.apache.org/jira/browse/SPARK-22391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-22391:
Description: please refer to the discussion and the dev list with this
email: *[discuss] Data
Wenchen Fan created SPARK-22391:
---
Summary: add `MetadataCreationSupport` trait to separate data and
metadata handling at write path
Key: SPARK-22391
URL: https://issues.apache.org/jira/browse/SPARK-22391
[
https://issues.apache.org/jira/browse/SPARK-22389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-22389:
---
Assignee: Wenchen Fan
> partitioning reporting
> --
>
>
Wenchen Fan created SPARK-22390:
---
Summary: Aggregate push down
Key: SPARK-22390
URL: https://issues.apache.org/jira/browse/SPARK-22390
Project: Spark
Issue Type: Sub-task
Components:
Wenchen Fan created SPARK-22389:
---
Summary: partitioning reporting
Key: SPARK-22389
URL: https://issues.apache.org/jira/browse/SPARK-22389
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-22387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-22387:
Description:
This is an open discussion. The general idea is we should allow users to set
some
Wenchen Fan created SPARK-22388:
---
Summary: Limit push down
Key: SPARK-22388
URL: https://issues.apache.org/jira/browse/SPARK-22388
Project: Spark
Issue Type: Sub-task
Components: SQL
[
https://issues.apache.org/jira/browse/SPARK-22387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-22387:
Description:
This is an open discussion. The general idea is we should allow users to set
some
[
https://issues.apache.org/jira/browse/SPARK-22387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-22387:
Description:
This is an open discussion. The general idea is we should allow users to set
some
[
https://issues.apache.org/jira/browse/SPARK-22387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-22387:
Description:
This is an open discussion. The general idea is we should allow users to set
some
Wenchen Fan created SPARK-22387:
---
Summary: propagate session configs to data source read/write
options
Key: SPARK-22387
URL: https://issues.apache.org/jira/browse/SPARK-22387
Project: Spark
Wenchen Fan created SPARK-22386:
---
Summary: Data Source V2 improvements
Key: SPARK-22386
URL: https://issues.apache.org/jira/browse/SPARK-22386
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-21657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223971#comment-16223971
]
Sean Owen commented on SPARK-21657:
---
Thanks [~cloud_fan] for the fast look. You're saying that
[
https://issues.apache.org/jira/browse/SPARK-22385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22385:
Assignee: Wenchen Fan (was: Apache Spark)
> MapObjects should not access list element by
[
https://issues.apache.org/jira/browse/SPARK-22385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22385:
Assignee: Apache Spark (was: Wenchen Fan)
> MapObjects should not access list element by
[
https://issues.apache.org/jira/browse/SPARK-22385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223958#comment-16223958
]
Apache Spark commented on SPARK-22385:
--
User 'cloud-fan' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-22385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-22385:
Issue Type: Improvement (was: Bug)
> MapObjects should not access list element by index
>
Wenchen Fan created SPARK-22385:
---
Summary: MapObjects should not access list element by index
Key: SPARK-22385
URL: https://issues.apache.org/jira/browse/SPARK-22385
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-21657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223946#comment-16223946
]
Ohad Raviv commented on SPARK-21657:
Sure,
the plan for
{code:java}
val df_exploded =
[
https://issues.apache.org/jira/browse/SPARK-21657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223927#comment-16223927
]
Sean Owen commented on SPARK-21657:
---
Can you paste the plans? this difference might be down to a
[
https://issues.apache.org/jira/browse/SPARK-22380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-22380.
---
Resolution: Won't Fix
You need to shade your dependencies in your app, not Spark. Look at the
[
https://issues.apache.org/jira/browse/SPARK-21657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223902#comment-16223902
]
Ohad Raviv commented on SPARK-21657:
I Switched to toArray instead of toList in the above code and I
[
https://issues.apache.org/jira/browse/SPARK-22375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-22375.
--
Resolution: Fixed
Fix Version/s: 2.3.0
> Test script can fail if eggs are installed by
[
https://issues.apache.org/jira/browse/SPARK-22384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223880#comment-16223880
]
Apache Spark commented on SPARK-22384:
--
User 'jinxing64' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-22384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22384:
Assignee: (was: Apache Spark)
> Refine partition pruning when attribute is wrapped in
[
https://issues.apache.org/jira/browse/SPARK-22384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22384:
Assignee: Apache Spark
> Refine partition pruning when attribute is wrapped in Cast
>
jin xing created SPARK-22384:
Summary: Refine partition pruning when attribute is wrapped in Cast
Key: SPARK-22384
URL: https://issues.apache.org/jira/browse/SPARK-22384
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-22375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223877#comment-16223877
]
Hyukjin Kwon commented on SPARK-22375:
--
Fixed in https://github.com/apache/spark/pull/19597
> Test
[
https://issues.apache.org/jira/browse/SPARK-22375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-22375:
-
External issue URL: https://github.com/pypa/setuptools/issues/391
> Test script can fail if eggs
80 matches
Mail list logo
