[jira] [Assigned] (SPARK-23662) Support selective tests in SQLQueryTestSuite

2018-03-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23662: Assignee: Apache Spark > Support selective tests in SQLQueryTestSuite >

[jira] [Assigned] (SPARK-23662) Support selective tests in SQLQueryTestSuite

2018-03-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23662: Assignee: (was: Apache Spark) > Support selective tests in SQLQueryTestSuite >

[jira] [Commented] (SPARK-23662) Support selective tests in SQLQueryTestSuite

2018-03-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396562#comment-16396562 ] Apache Spark commented on SPARK-23662: -- User 'maropu' has created a pull request for this issue:

[jira] [Created] (SPARK-23662) Support selective tests in SQLQueryTestSuite

2018-03-12 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-23662: Summary: Support selective tests in SQLQueryTestSuite Key: SPARK-23662 URL: https://issues.apache.org/jira/browse/SPARK-23662 Project: Spark Issue

[jira] [Commented] (SPARK-23659) Spark Job gets stuck during shuffle

2018-03-12 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396553#comment-16396553 ] Yuming Wang commented on SPARK-23659: - It may be is duplicated by

[jira] [Updated] (SPARK-23523) Incorrect result caused by the rule OptimizeMetadataOnlyQuery

2018-03-12 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-23523: Fix Version/s: 2.3.1 > Incorrect result caused by the rule OptimizeMetadataOnlyQuery >

[jira] [Assigned] (SPARK-23660) Yarn throws exception in cluster mode when the application is small

2018-03-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23660: Assignee: (was: Apache Spark) > Yarn throws exception in cluster mode when the

[jira] [Assigned] (SPARK-23660) Yarn throws exception in cluster mode when the application is small

2018-03-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23660: Assignee: Apache Spark > Yarn throws exception in cluster mode when the application is

[jira] [Commented] (SPARK-23660) Yarn throws exception in cluster mode when the application is small

2018-03-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396541#comment-16396541 ] Apache Spark commented on SPARK-23660: -- User 'gaborgsomogyi' has created a pull request for this

[jira] [Assigned] (SPARK-23661) Implement treeAggregate on Dataset API

2018-03-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23661: Assignee: (was: Apache Spark) > Implement treeAggregate on Dataset API >

[jira] [Commented] (SPARK-23661) Implement treeAggregate on Dataset API

2018-03-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396538#comment-16396538 ] Apache Spark commented on SPARK-23661: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23661) Implement treeAggregate on Dataset API

2018-03-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23661: Assignee: Apache Spark > Implement treeAggregate on Dataset API >

[jira] [Commented] (SPARK-23655) Add support for type aclitem (PostgresDialect)

2018-03-12 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396537#comment-16396537 ] Takeshi Yamamuro commented on SPARK-23655: -- Is it bad to cast `aclitem` to strings or others in

[jira] [Commented] (SPARK-23659) Spark Job gets stuck during shuffle

2018-03-12 Thread Mohamed Elagamy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396502#comment-16396502 ] Mohamed Elagamy commented on SPARK-23659: - that's what's in my class path netty-3.10.6.Final.jar

[jira] [Created] (SPARK-23661) Implement treeAggregate on Dataset API

2018-03-12 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-23661: --- Summary: Implement treeAggregate on Dataset API Key: SPARK-23661 URL: https://issues.apache.org/jira/browse/SPARK-23661 Project: Spark Issue Type: New

[jira] [Commented] (SPARK-23660) Yarn throws exception in cluster mode when the application is small

2018-03-12 Thread Gabor Somogyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396388#comment-16396388 ] Gabor Somogyi commented on SPARK-23660: --- I'm working on it. > Yarn throws exception in cluster

[jira] [Created] (SPARK-23660) Yarn throws exception in cluster mode when the application is small

2018-03-12 Thread Gabor Somogyi (JIRA)
Gabor Somogyi created SPARK-23660: - Summary: Yarn throws exception in cluster mode when the application is small Key: SPARK-23660 URL: https://issues.apache.org/jira/browse/SPARK-23660 Project: Spark

[jira] [Commented] (SPARK-20525) ClassCast exception when interpreting UDFs from a String in spark-shell

2018-03-12 Thread UFO (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396372#comment-16396372 ] UFO commented on SPARK-20525: - I also met the same problem. Have you solved it? > ClassCast exception when

[jira] [Commented] (SPARK-23659) Spark Job gets stuck during shuffle

2018-03-12 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396332#comment-16396332 ] Yuming Wang commented on SPARK-23659: - Can you please check your {{netty-all}} version? > Spark Job

[jira] [Commented] (SPARK-4502) Spark SQL reads unneccesary nested fields from Parquet

2018-03-12 Thread Gesly George (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396281#comment-16396281 ] Gesly George commented on SPARK-4502: - What are the chances that this will make it into 2..4.0? For

[jira] [Created] (SPARK-23659) Spark Job gets stuck during shuffle

2018-03-12 Thread Mohamed Elagamy (JIRA)
Mohamed Elagamy created SPARK-23659: --- Summary: Spark Job gets stuck during shuffle Key: SPARK-23659 URL: https://issues.apache.org/jira/browse/SPARK-23659 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-21479) Outer join filter pushdown in null supplying table when condition is on one of the joined columns

2018-03-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21479: Assignee: (was: Apache Spark) > Outer join filter pushdown in null supplying table

[jira] [Commented] (SPARK-21479) Outer join filter pushdown in null supplying table when condition is on one of the joined columns

2018-03-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396235#comment-16396235 ] Apache Spark commented on SPARK-21479: -- User 'maryannxue' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21479) Outer join filter pushdown in null supplying table when condition is on one of the joined columns

2018-03-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21479: Assignee: Apache Spark > Outer join filter pushdown in null supplying table when

[jira] [Commented] (SPARK-23607) Use HDFS extended attributes to store application summary to improve the Spark History Server performance

2018-03-12 Thread Ye Zhou (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396193#comment-16396193 ] Ye Zhou commented on SPARK-23607: - [~vanzin] Cool. I will post a PR soon. Thanks. > Use HDFS extended

[jira] [Updated] (SPARK-23658) InProcessAppHandle uses the wrong class in getLogger

2018-03-12 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated SPARK-23658: - Description: {{InProcessAppHandle}} uses {{ChildProcAppHandle}} as the class in {{getLogger}},

[jira] [Updated] (SPARK-23658) InProcessAppHandle uses the wrong class in getLogger

2018-03-12 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated SPARK-23658: - Summary: InProcessAppHandle uses the wrong class in getLogger (was: InProcessAppHandle and

[jira] [Commented] (SPARK-23658) InProcessAppHandle and AbstractAppHandle use wrong class in getLogger

2018-03-12 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396164#comment-16396164 ] Marcelo Vanzin commented on SPARK-23658: I already fixed {{AbstractAppHandle}} but missed

[jira] [Created] (SPARK-23658) InProcessAppHandle and AbstractAppHandle use wrong class in getLogger

2018-03-12 Thread Sahil Takiar (JIRA)
Sahil Takiar created SPARK-23658: Summary: InProcessAppHandle and AbstractAppHandle use wrong class in getLogger Key: SPARK-23658 URL: https://issues.apache.org/jira/browse/SPARK-23658 Project: Spark

[jira] [Commented] (SPARK-22366) Support ignoreMissingFiles flag parallel to ignoreCorruptFiles

2018-03-12 Thread Shridhar Ramachandran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396102#comment-16396102 ] Shridhar Ramachandran commented on SPARK-22366: --- Thanks for this, it's a useful feature. I

[jira] [Resolved] (SPARK-23550) Cleanup unused / redundant methods in Utils object

2018-03-12 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-23550. Resolution: Fixed Assignee: Marcelo Vanzin Fix Version/s: 2.4.0 > Cleanup

[jira] [Commented] (SPARK-23576) SparkSQL - Decimal data missing decimal point

2018-03-12 Thread Henry Robinson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16395803#comment-16395803 ] Henry Robinson commented on SPARK-23576: Do you have a smaller repro, or does it only reproduce

[jira] [Assigned] (SPARK-23412) Add cosine distance measure to BisectingKMeans

2018-03-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-23412: - Assignee: Marco Gaido > Add cosine distance measure to BisectingKMeans >

[jira] [Resolved] (SPARK-23412) Add cosine distance measure to BisectingKMeans

2018-03-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-23412. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 20600

[jira] [Assigned] (SPARK-23656) Assertion in XXH64Suite.testKnownByteArrayInputs() is not performed on big endian platform

2018-03-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23656: Assignee: Apache Spark > Assertion in XXH64Suite.testKnownByteArrayInputs() is not

[jira] [Assigned] (SPARK-23656) Assertion in XXH64Suite.testKnownByteArrayInputs() is not performed on big endian platform

2018-03-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23656: Assignee: (was: Apache Spark) > Assertion in XXH64Suite.testKnownByteArrayInputs() is

[jira] [Commented] (SPARK-23656) Assertion in XXH64Suite.testKnownByteArrayInputs() is not performed on big endian platform

2018-03-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16395783#comment-16395783 ] Apache Spark commented on SPARK-23656: -- User 'kiszk' has created a pull request for this issue:

[jira] [Commented] (SPARK-23325) DataSourceV2 readers should always produce InternalRow.

2018-03-12 Thread Ryan Blue (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16395752#comment-16395752 ] Ryan Blue commented on SPARK-23325: --- I created SPARK-23657 to track this in parallel. Feel free to

[jira] [Created] (SPARK-23657) Document InternalRow and expose it as a stable interface

2018-03-12 Thread Ryan Blue (JIRA)
Ryan Blue created SPARK-23657: - Summary: Document InternalRow and expose it as a stable interface Key: SPARK-23657 URL: https://issues.apache.org/jira/browse/SPARK-23657 Project: Spark Issue

[jira] [Updated] (SPARK-23656) Assertion in XXH64Suite is not performed on big endian platform

2018-03-12 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-23656: - Description: {{XXH64Suite.testKnownByteArrayInputs()}} performs assertions only on

[jira] [Updated] (SPARK-23656) Assertion in XXH64Suite.testKnownByteArrayInputs() is not performed on big endian platform

2018-03-12 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-23656: - Summary: Assertion in XXH64Suite.testKnownByteArrayInputs() is not performed on big

[jira] [Created] (SPARK-23656) Assertion in XXH64Suite is not performed on big endian platform

2018-03-12 Thread Kazuaki Ishizaki (JIRA)
Kazuaki Ishizaki created SPARK-23656: Summary: Assertion in XXH64Suite is not performed on big endian platform Key: SPARK-23656 URL: https://issues.apache.org/jira/browse/SPARK-23656 Project:

[jira] [Commented] (SPARK-23618) docker-image-tool.sh Fails While Building Image

2018-03-12 Thread Anirudh Ramanathan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16395686#comment-16395686 ] Anirudh Ramanathan commented on SPARK-23618: [~felixcheung], just merged this PR. But I'm

[jira] [Resolved] (SPARK-23618) docker-image-tool.sh Fails While Building Image

2018-03-12 Thread Anirudh Ramanathan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anirudh Ramanathan resolved SPARK-23618. Resolution: Fixed > docker-image-tool.sh Fails While Building Image >

[jira] [Commented] (SPARK-23325) DataSourceV2 readers should always produce InternalRow.

2018-03-12 Thread Ryan Blue (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16395655#comment-16395655 ] Ryan Blue commented on SPARK-23325: --- I agree that the binary format is more work and probably out of

[jira] [Created] (SPARK-23655) Add support for type aclitem (PostgresDialect)

2018-03-12 Thread Diego da Silva Colombo (JIRA)
Diego da Silva Colombo created SPARK-23655: -- Summary: Add support for type aclitem (PostgresDialect) Key: SPARK-23655 URL: https://issues.apache.org/jira/browse/SPARK-23655 Project: Spark

[jira] [Updated] (SPARK-23655) Add support for type aclitem (PostgresDialect)

2018-03-12 Thread Diego da Silva Colombo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Diego da Silva Colombo updated SPARK-23655: --- Description: When I try to load the data of pg_database, an exception

[jira] [Updated] (SPARK-23654) cut jets3t as a dependency of spark-core; exclude it from hadoop-cloud module as incompatible

2018-03-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated SPARK-23654: --- Summary: cut jets3t as a dependency of spark-core; exclude it from hadoop-cloud module as

[jira] [Commented] (SPARK-23654) cut jets3t as a dependency of spark-core

2018-03-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16395451#comment-16395451 ] Steve Loughran commented on SPARK-23654: SPARK-22634 highights that the spark-hadoop-cloud module

[jira] [Commented] (SPARK-23652) Verify error when using ASF s3:// connector. & Jetty 0.9.4

2018-03-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16395449#comment-16395449 ] Steve Loughran commented on SPARK-23652: this stack trace is just HADOOP-11086; tagging as a

[jira] [Updated] (SPARK-23652) Verify error when using ASF s3:// connector. & Jetty 0.9.4

2018-03-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated SPARK-23652: --- Priority: Minor (was: Critical) > Verify error when using ASF s3:// connector. & Jetty

[jira] [Updated] (SPARK-23652) Verify error when using ASF s3:// connector. & Jetty 0.9.4

2018-03-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated SPARK-23652: --- Summary: Verify error when using ASF s3:// connector. & Jetty 0.9.4 (was: Verify error when

[jira] [Updated] (SPARK-23652) Verify error when using ASF s3:// connector.

2018-03-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated SPARK-23652: --- Summary: Verify error when using ASF s3:// connector. (was: Spark Connection with S3) >

[jira] [Created] (SPARK-23654) cut jets3t as a dependency of spark-core

2018-03-12 Thread Steve Loughran (JIRA)
Steve Loughran created SPARK-23654: -- Summary: cut jets3t as a dependency of spark-core Key: SPARK-23654 URL: https://issues.apache.org/jira/browse/SPARK-23654 Project: Spark Issue Type:

[jira] [Commented] (SPARK-23652) Spark Connection with S3

2018-03-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16395428#comment-16395428 ] Steve Loughran commented on SPARK-23652: Don't use the s3:// connector which ships with the ASF

[jira] [Commented] (SPARK-5997) Increase partition count without performing a shuffle

2018-03-12 Thread Josiah Berkebile (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16395408#comment-16395408 ] Josiah Berkebile commented on SPARK-5997: - Maybe it's worth mentioning that I've had to do this

[jira] [Issue Comment Deleted] (SPARK-5997) Increase partition count without performing a shuffle

2018-03-12 Thread Josiah Berkebile (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josiah Berkebile updated SPARK-5997: Comment: was deleted (was: This functionality can be useful when re-partitioning to output

[jira] [Commented] (SPARK-5997) Increase partition count without performing a shuffle

2018-03-12 Thread Josiah Berkebile (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16395405#comment-16395405 ] Josiah Berkebile commented on SPARK-5997: - This functionality can be useful when re-partitioning

[jira] [Comment Edited] (SPARK-23645) pandas_udf can not be called with keyword arguments

2018-03-12 Thread Stu (Michael Stewart) (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16395390#comment-16395390 ] Stu (Michael Stewart) edited comment on SPARK-23645 at 3/12/18 3:28 PM:

[jira] [Commented] (SPARK-23645) pandas_udf can not be called with keyword arguments

2018-03-12 Thread Stu (Michael Stewart) (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16395390#comment-16395390 ] Stu (Michael Stewart) commented on SPARK-23645: --- [~hyukjin.kwon] thanks for the thoughts.

[jira] [Commented] (SPARK-22683) DynamicAllocation wastes resources by allocating containers that will barely be used

2018-03-12 Thread Julien Cuquemelle (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16395364#comment-16395364 ] Julien Cuquemelle commented on SPARK-22683: --- PR updated, including [~xuefuz]'s proposal >

[jira] [Commented] (SPARK-23653) Show sql statement in spark SQL UI

2018-03-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16395259#comment-16395259 ] Apache Spark commented on SPARK-23653: -- User 'LantaoJin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23653) Show sql statement in spark SQL UI

2018-03-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23653: Assignee: Apache Spark > Show sql statement in spark SQL UI >

[jira] [Assigned] (SPARK-23653) Show sql statement in spark SQL UI

2018-03-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23653: Assignee: (was: Apache Spark) > Show sql statement in spark SQL UI >

[jira] [Commented] (SPARK-23653) Show sql statement in spark SQL UI

2018-03-12 Thread Lantao Jin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16395241#comment-16395241 ] Lantao Jin commented on SPARK-23653: The best way is displaying the intact sql statement in SQL Tab

[jira] [Updated] (SPARK-23653) Show sql statement in spark SQL UI

2018-03-12 Thread Lantao Jin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lantao Jin updated SPARK-23653: --- Attachment: Screen Shot 2018-03-12 at 20.16.14.png > Show sql statement in spark SQL UI >

[jira] [Updated] (SPARK-23653) Show sql statement in spark SQL UI

2018-03-12 Thread Lantao Jin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lantao Jin updated SPARK-23653: --- Attachment: Screen Shot 2018-03-12 at 14.25.51.png > Show sql statement in spark SQL UI >

[jira] [Updated] (SPARK-23653) Show sql statement in spark SQL UI

2018-03-12 Thread Lantao Jin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lantao Jin updated SPARK-23653: --- Description: [SPARK-4871|https://issues.apache.org/jira/browse/SPARK-4871] has already added the

[jira] [Updated] (SPARK-23653) Show sql statement in spark SQL UI

2018-03-12 Thread Lantao Jin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lantao Jin updated SPARK-23653: --- Attachment: Screen Shot 2018-03-12 at 20.16.23.png > Show sql statement in spark SQL UI >

[jira] [Created] (SPARK-23653) Show sql statement in spark SQL UI

2018-03-12 Thread Lantao Jin (JIRA)
Lantao Jin created SPARK-23653: -- Summary: Show sql statement in spark SQL UI Key: SPARK-23653 URL: https://issues.apache.org/jira/browse/SPARK-23653 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-23462) Improve the error message in `StructType`

2018-03-12 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-23462: Assignee: Xiayun Sun > Improve the error message in `StructType` >

[jira] [Resolved] (SPARK-23462) Improve the error message in `StructType`

2018-03-12 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-23462. -- Resolution: Fixed Fix Version/s: 2.3.1 2.4.0 Issue resolved by pull

[jira] [Created] (SPARK-23652) Spark Connection with S3

2018-03-12 Thread Abhishek Shrivastava (JIRA)
Abhishek Shrivastava created SPARK-23652: Summary: Spark Connection with S3 Key: SPARK-23652 URL: https://issues.apache.org/jira/browse/SPARK-23652 Project: Spark Issue Type:

[jira] [Commented] (SPARK-23651) Add a check for host name

2018-03-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16395094#comment-16395094 ] Apache Spark commented on SPARK-23651: -- User '10110346' has created a pull request for this issue:

[jira] [Commented] (SPARK-23565) Improved error message for when the number of sources for a query changes

2018-03-12 Thread Roman Maier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16395023#comment-16395023 ] Roman Maier commented on SPARK-23565: - I would like to take up this ticket, in case none are working

[jira] [Commented] (SPARK-23437) [ML] Distributed Gaussian Process Regression for MLlib

2018-03-12 Thread Valeriy Avanesov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16395014#comment-16395014 ] Valeriy Avanesov commented on SPARK-23437: -- So, the basic implementation is ready. Please, feel

[jira] [Commented] (SPARK-16859) History Server storage information is missing

2018-03-12 Thread Andrei Ivanov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16394993#comment-16394993 ] Andrei Ivanov commented on SPARK-16859: --- [~Yohan123], it really looks like this was implemented in

[jira] [Updated] (SPARK-23603) When the length of the json is in a range,get_json_object will result in missing tail data

2018-03-12 Thread dzcxzl (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dzcxzl updated SPARK-23603: --- Description: Jackson(>=2.7.7) fixes the possibility of missing tail data when the length of the value is in

[jira] [Updated] (SPARK-23603) When the length of the json is in a range,get_json_object will result in missing tail data

2018-03-12 Thread dzcxzl (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dzcxzl updated SPARK-23603: --- Description: Jackson(>=2.7.7) fixes the possibility of missing tail data when the length of the value is in

[jira] [Commented] (SPARK-23651) Add a check for host name

2018-03-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16394926#comment-16394926 ] Apache Spark commented on SPARK-23651: -- User '10110346' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23651) Add a check for host name

2018-03-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23651: Assignee: (was: Apache Spark) > Add a check for host name >

[jira] [Assigned] (SPARK-23651) Add a check for host name

2018-03-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23651: Assignee: Apache Spark > Add a check for host name > -- > >

[jira] [Created] (SPARK-23651) Add a check for host name

2018-03-12 Thread liuxian (JIRA)
liuxian created SPARK-23651: --- Summary: Add a check for host name Key: SPARK-23651 URL: https://issues.apache.org/jira/browse/SPARK-23651 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-23632) sparkR.session() error with spark packages - JVM is not ready after 10 seconds

2018-03-12 Thread Jaehyeon Kim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16394865#comment-16394865 ] Jaehyeon Kim commented on SPARK-23632: -- It wouldn't be an issue if code is run in an interactive way