[jira] [Created] (SPARK-21575) Eliminate needless synchronization in java-R serialization

Iurii Antykhovych created SPARK-21575: - Summary: Eliminate needless synchronization in java-R serialization Key: SPARK-21575 URL: https://issues.apache.org/jira/browse/SPARK-21575 Project: Spark

[jira] [Commented] (SPARK-21567) Dataset with Tuple of type alias throws error

[ https://issues.apache.org/jira/browse/SPARK-21567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16106317#comment-16106317 ] Liang-Chi Hsieh commented on SPARK-21567: - I tried it. Seems Scala fails to find implicit encoder

[jira] [Commented] (SPARK-21533) "configure(...)" method not called when using Hive Generic UDFs

[ https://issues.apache.org/jira/browse/SPARK-21533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16106306#comment-16106306 ] Takeshi Yamamuro commented on SPARK-21533: -- I'm not 100% sure what your UDFs do though, do you

[jira] [Updated] (SPARK-19451) rangeBetween method should accept Long value as boundary

[ https://issues.apache.org/jira/browse/SPARK-19451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-19451: Fix Version/s: (was: 2.2.1) > rangeBetween method should accept Long value as boundary >

[jira] [Commented] (SPARK-21547) Spark cleaner cost too many time

[ https://issues.apache.org/jira/browse/SPARK-21547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16106292#comment-16106292 ] DjvuLee commented on SPARK-21547: - Ok, I will try and posted the result later. > Spark cleaner cost

[jira] [Commented] (SPARK-21547) Spark cleaner cost too many time

[ https://issues.apache.org/jira/browse/SPARK-21547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16106262#comment-16106262 ] Shixiong Zhu commented on SPARK-21547: -- Could you try 2.1.1 or 2.2.0? This may be just SPARK-18991

[jira] [Commented] (SPARK-21533) "configure(...)" method not called when using Hive Generic UDFs

[ https://issues.apache.org/jira/browse/SPARK-21533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16106236#comment-16106236 ] Dean Gurvitz commented on SPARK-21533: -- Feng - I have a GenericUDF that requires configure to work,

[jira] [Comment Edited] (SPARK-21478) Unpersist a DF also unpersists related DFs

[ https://issues.apache.org/jira/browse/SPARK-21478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16106213#comment-16106213 ] Xiao Li edited comment on SPARK-21478 at 7/29/17 6:49 PM: -- The current cache

[jira] [Resolved] (SPARK-21478) Unpersist a DF also unpersists related DFs

[ https://issues.apache.org/jira/browse/SPARK-21478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-21478. - Resolution: Not A Problem The current cache design requires the query correctness. If you want to keep

[jira] [Comment Edited] (SPARK-21478) Unpersist a DF also unpersists related DFs

[ https://issues.apache.org/jira/browse/SPARK-21478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16106213#comment-16106213 ] Xiao Li edited comment on SPARK-21478 at 7/29/17 6:48 PM: -- The current cache

[jira] [Commented] (SPARK-21478) Unpersist a DF also unpersists related DFs

[ https://issues.apache.org/jira/browse/SPARK-21478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16106212#comment-16106212 ] Xiao Li commented on SPARK-21478: - This is by design. We do not want to use the invalid cached data. See

[jira] [Commented] (SPARK-21478) Unpersist a DF also unpersists related DFs

[ https://issues.apache.org/jira/browse/SPARK-21478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16106203#comment-16106203 ] Vinod KC commented on SPARK-21478: -- https://github.com/apache/spark/pull/18771 > Unpersist a DF also

[jira] [Resolved] (SPARK-20962) Support subquery column aliases in FROM clause

[ https://issues.apache.org/jira/browse/SPARK-20962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-20962. - Resolution: Fixed Assignee: Takeshi Yamamuro Fix Version/s: 2.3.0 > Support subquery

[jira] [Resolved] (SPARK-19451) rangeBetween method should accept Long value as boundary

[ https://issues.apache.org/jira/browse/SPARK-19451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-19451. - Resolution: Fixed Assignee: Jiang Xingbo Fix Version/s: 2.3.0 2.2.1 >

[jira] [Updated] (SPARK-19451) rangeBetween method should accept Long value as boundary

[ https://issues.apache.org/jira/browse/SPARK-19451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-19451: Component/s: (was: Spark Core) SQL > rangeBetween method should accept Long value as

[jira] [Resolved] (SPARK-21555) GROUP BY don't work with expressions with NVL and nested objects

[ https://issues.apache.org/jira/browse/SPARK-21555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-21555. - Resolution: Fixed Fix Version/s: 2.3.0 2.2.1 2.1.2 > GROUP

[jira] [Assigned] (SPARK-21555) GROUP BY don't work with expressions with NVL and nested objects

[ https://issues.apache.org/jira/browse/SPARK-21555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-21555: --- Assignee: Liang-Chi Hsieh > GROUP BY don't work with expressions with NVL and nested objects >

[jira] [Comment Edited] (SPARK-21570) File __spark_libs__XXX.zip does not exist on networked file system w/ yarn

[ https://issues.apache.org/jira/browse/SPARK-21570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16106157#comment-16106157 ] Albert Chu edited comment on SPARK-21570 at 7/29/17 3:42 PM: - The file was

[jira] [Comment Edited] (SPARK-21570) File __spark_libs__XXX.zip does not exist on networked file system w/ yarn

[ https://issues.apache.org/jira/browse/SPARK-21570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16106157#comment-16106157 ] Albert Chu edited comment on SPARK-21570 at 7/29/17 3:41 PM: - The file was

[jira] [Comment Edited] (SPARK-21570) File __spark_libs__XXX.zip does not exist on networked file system w/ yarn

[ https://issues.apache.org/jira/browse/SPARK-21570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16106157#comment-16106157 ] Albert Chu edited comment on SPARK-21570 at 7/29/17 3:41 PM: - The file was

[jira] [Commented] (SPARK-21570) File __spark_libs__XXX.zip does not exist on networked file system w/ yarn

[ https://issues.apache.org/jira/browse/SPARK-21570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16106157#comment-16106157 ] Albert Chu commented on SPARK-21570: The file was confirmed to show up, although at the time I did

[jira] [Assigned] (SPARK-21357) FileInputDStream not remove out of date RDD

[ https://issues.apache.org/jira/browse/SPARK-21357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-21357: - Assignee: dadazheng > FileInputDStream not remove out of date RDD >

[jira] [Resolved] (SPARK-21357) FileInputDStream not remove out of date RDD

[ https://issues.apache.org/jira/browse/SPARK-21357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21357. --- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 18718

[jira] [Assigned] (SPARK-21508) Documentation on 'Spark Streaming Custom Receivers' has error in example code

[ https://issues.apache.org/jira/browse/SPARK-21508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-21508: - Assignee: Remis Haroon > Documentation on 'Spark Streaming Custom Receivers' has error in

[jira] [Resolved] (SPARK-21508) Documentation on 'Spark Streaming Custom Receivers' has error in example code

[ https://issues.apache.org/jira/browse/SPARK-21508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21508. --- Resolution: Fixed Fix Version/s: 2.3.0 2.2.1 Issue resolved by pull

[jira] [Commented] (SPARK-21573) Tests failing with run-tests.py SyntaxError occasionally in Jenkins

[ https://issues.apache.org/jira/browse/SPARK-21573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16106113#comment-16106113 ] Sean Owen commented on SPARK-21573: --- [~shaneknapp] could this be an env issue? it does seem like only

[jira] [Commented] (SPARK-21508) Documentation on 'Spark Streaming Custom Receivers' has error in example code

[ https://issues.apache.org/jira/browse/SPARK-21508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16106110#comment-16106110 ] Remis Haroon commented on SPARK-21508: -- [~srowen] , I raised a pull request for this

[jira] [Created] (SPARK-21574) set hive.exec.max.dynamic.partitions lose effect

Yuming Wang created SPARK-21574: --- Summary: set hive.exec.max.dynamic.partitions lose effect Key: SPARK-21574 URL: https://issues.apache.org/jira/browse/SPARK-21574 Project: Spark Issue Type:

[jira] [Commented] (SPARK-14927) DataFrame. saveAsTable creates RDD partitions but not Hive partitions

[ https://issues.apache.org/jira/browse/SPARK-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16106058#comment-16106058 ] Raul Saez Tapia commented on SPARK-14927: - *SOMASUNDARAM SUDALAIMUTHU* I am sorry but I am out of

[jira] [Comment Edited] (SPARK-21067) Thrift Server - CTAS fail with Unable to move source

[ https://issues.apache.org/jira/browse/SPARK-21067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16106057#comment-16106057 ] xinzhang edited comment on SPARK-21067 at 7/29/17 7:09 AM: --- hi.Reynold Xin i

[jira] [Commented] (SPARK-21067) Thrift Server - CTAS fail with Unable to move source

[ https://issues.apache.org/jira/browse/SPARK-21067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16106057#comment-16106057 ] xinzhang commented on SPARK-21067: -- hi.Reynold Xin i am looking forwad to your reply > Thrift Server -

[jira] [Commented] (SPARK-21569) Internal Spark class needs to be kryo-registered

[ https://issues.apache.org/jira/browse/SPARK-21569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16106054#comment-16106054 ] Sean Owen commented on SPARK-21569: --- Inline your repro here please; it's simple and makes this

[jira] [Updated] (SPARK-20433) Update jackson-databind to 2.6.7

[ https://issues.apache.org/jira/browse/SPARK-20433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-20433: -- Labels: (was: security) Priority: Minor (was: Major) Issue Type: Improvement (was:

[jira] [Commented] (SPARK-21570) File __spark_libs__XXX.zip does not exist on networked file system w/ yarn

[ https://issues.apache.org/jira/browse/SPARK-21570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16106051#comment-16106051 ] Sean Owen commented on SPARK-21570: --- I think it is either indeed that the file doesn't show up, or has