[jira] [Commented] (SPARK-35885) Use keyserver.ubuntu.com as a keyserver for CRAN

2021-11-22 Thread Marek Novotny (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17447386#comment-17447386 ] Marek Novotny commented on SPARK-35885: --- [~dongjoon] FYI, buster-cran35 is signed by a different

[jira] [Commented] (SPARK-25469) Eval methods of Concat, Reverse and ElementAt should use pattern matching only once

2018-09-21 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623222#comment-16623222 ] Marek Novotny commented on SPARK-25469: --- [~hyukjin.kwon] Thanks for your help! > Eval methods of

[jira] [Commented] (SPARK-25469) Eval methods of Concat, Reverse and ElementAt should use pattern matching only once

2018-09-20 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621792#comment-16621792 ] Marek Novotny commented on SPARK-25469: --- [~hyukjin.kwon] Appologize for the duplicated ticket.

[jira] [Updated] (SPARK-25469) Eval methods of Concat, Reverse and ElementAt should use pattern matching only once

2018-09-20 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marek Novotny updated SPARK-25469: -- Description: Pattern matching is utilized for each call of {{Concat.eval}},

[jira] [Updated] (SPARK-25469) Eval methods of Concat, Reverse and ElementAt should use pattern matching only once

2018-09-20 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marek Novotny updated SPARK-25469: -- Summary: Eval methods of Concat, Reverse and ElementAt should use pattern matching only once

[jira] [Created] (SPARK-25469) Eval method of Concat expression should call pattern matching only once

2018-09-19 Thread Marek Novotny (JIRA)
Marek Novotny created SPARK-25469: - Summary: Eval method of Concat expression should call pattern matching only once Key: SPARK-25469 URL: https://issues.apache.org/jira/browse/SPARK-25469 Project:

[jira] [Created] (SPARK-25470) Eval method of Concat expression should call pattern matching only once

2018-09-19 Thread Marek Novotny (JIRA)
Marek Novotny created SPARK-25470: - Summary: Eval method of Concat expression should call pattern matching only once Key: SPARK-25470 URL: https://issues.apache.org/jira/browse/SPARK-25470 Project:

[jira] [Updated] (SPARK-25122) Deduplication of supports equals code

2018-08-15 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marek Novotny updated SPARK-25122: -- Description: The method {{*supportEquals}} determining whether elements of a data type could

[jira] [Created] (SPARK-25122) Deduplication of supports equals code

2018-08-15 Thread Marek Novotny (JIRA)
Marek Novotny created SPARK-25122: - Summary: Deduplication of supports equals code Key: SPARK-25122 URL: https://issues.apache.org/jira/browse/SPARK-25122 Project: Spark Issue Type:

[jira] [Commented] (SPARK-25068) High-order function: exists(array, function) → boolean

2018-08-14 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16579386#comment-16579386 ] Marek Novotny commented on SPARK-25068: --- That's a good point. Thanks for your answer! >

[jira] [Commented] (SPARK-25068) High-order function: exists(array, function) → boolean

2018-08-13 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16578087#comment-16578087 ] Marek Novotny commented on SPARK-25068: --- I am curious about the motivation for adding this

[jira] [Resolved] (SPARK-24042) High-order function: zip_with_index

2018-08-09 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marek Novotny resolved SPARK-24042. --- Resolution: Won't Fix > High-order function: zip_with_index >

[jira] [Commented] (SPARK-23938) High-order function: map_zip_with(map, map, function) → map

2018-08-06 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16570148#comment-16570148 ] Marek Novotny commented on SPARK-23938: --- I'm working on this. Thanks. > High-order function:

[jira] [Commented] (SPARK-23901) Data Masking Functions

2018-07-16 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16545443#comment-16545443 ] Marek Novotny commented on SPARK-23901: --- Is there a consensus on getting the masking functions to

[jira] [Commented] (SPARK-24741) Have a built-in AVRO data source implementation

2018-07-13 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16543367#comment-16543367 ] Marek Novotny commented on SPARK-24741: --- Hi [~smilegator], The main motivation for creation of

[jira] [Commented] (SPARK-24741) Have a built-in AVRO data source implementation

2018-07-09 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16536907#comment-16536907 ] Marek Novotny commented on SPARK-24741: --- It would be nice if the build-in data source was

[jira] [Commented] (SPARK-24165) UDF within when().otherwise() raises NullPointerException

2018-06-29 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16527734#comment-16527734 ] Marek Novotny commented on SPARK-24165: --- [~jingxuan001] Please could you provide a short example

[jira] [Comment Edited] (SPARK-24165) UDF within when().otherwise() raises NullPointerException

2018-06-29 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16527556#comment-16527556 ] Marek Novotny edited comment on SPARK-24165 at 6/29/18 12:33 PM: - It

[jira] [Commented] (SPARK-24165) UDF within when().otherwise() raises NullPointerException

2018-06-29 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16527556#comment-16527556 ] Marek Novotny commented on SPARK-24165: --- It seems that Spark is not able resolve nullability for

[jira] [Updated] (SPARK-24636) Type Coercion of Arrays for array_join Function

2018-06-23 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marek Novotny updated SPARK-24636: -- Description: The description of SPARK-23916 refers to the implementation of {{array_join}}

[jira] [Created] (SPARK-24636) Type Coercion of Arrays for array_join Function

2018-06-23 Thread Marek Novotny (JIRA)
Marek Novotny created SPARK-24636: - Summary: Type Coercion of Arrays for array_join Function Key: SPARK-24636 URL: https://issues.apache.org/jira/browse/SPARK-24636 Project: Spark Issue

[jira] [Updated] (SPARK-24331) Add arrays_overlap / array_repeat / map_entries

2018-05-25 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marek Novotny updated SPARK-24331: -- Description: Add SparkR equivalent to: * arrays_overlap - SPARK-23922 * array_repeat - 

[jira] [Updated] (SPARK-24331) Add arrays_overlap / array_repeat / map_entries

2018-05-25 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marek Novotny updated SPARK-24331: -- Summary: Add arrays_overlap / array_repeat / map_entries(was: Add cardinality /

[jira] [Commented] (SPARK-24331) Add cardinality / arrays_overlap / array_repeat / map_entries

2018-05-21 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16482577#comment-16482577 ] Marek Novotny commented on SPARK-24331: --- I will work on this. Thanks! > Add cardinality /

[jira] [Created] (SPARK-24331) Add cardinality / arrays_overlap / array_repeat / map_entries

2018-05-21 Thread Marek Novotny (JIRA)
Marek Novotny created SPARK-24331: - Summary: Add cardinality / arrays_overlap / array_repeat / map_entries Key: SPARK-24331 URL: https://issues.apache.org/jira/browse/SPARK-24331 Project: Spark

[jira] [Created] (SPARK-24305) Avoid serialization of private fields in new collection expressions

2018-05-17 Thread Marek Novotny (JIRA)
Marek Novotny created SPARK-24305: - Summary: Avoid serialization of private fields in new collection expressions Key: SPARK-24305 URL: https://issues.apache.org/jira/browse/SPARK-24305 Project: Spark

[jira] [Commented] (SPARK-23928) High-order function: shuffle(x) → array

2018-05-15 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16476108#comment-16476108 ] Marek Novotny commented on SPARK-23928: --- [~hzlu] Cool. (Re: Testing) Sounds good to me. It would be

[jira] [Commented] (SPARK-23928) High-order function: shuffle(x) → array

2018-05-15 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16475451#comment-16475451 ] Marek Novotny commented on SPARK-23928: --- [~hzlu] Any joy? I can take this one or help. >

[jira] [Commented] (SPARK-23931) High-order function: zip(array1, array2[, ...]) → array

2018-05-11 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16472169#comment-16472169 ] Marek Novotny commented on SPARK-23931: --- Ok. Good luck! > High-order function: zip(array1,

[jira] [Commented] (SPARK-23931) High-order function: zip(array1, array2[, ...]) → array

2018-05-11 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16472157#comment-16472157 ] Marek Novotny commented on SPARK-23931: --- [~DylanGuedes] Any joy? I can take this one if you want.

[jira] [Updated] (SPARK-24197) add array_sort function

2018-05-07 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marek Novotny updated SPARK-24197: -- Description: Add a SparkR equivalent function to 

[jira] [Updated] (SPARK-24197) add array_sort function

2018-05-07 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marek Novotny updated SPARK-24197: -- Description: Add a SparkR equivalent function to SPARK-23921. (was: Add a SparkR equivalent

[jira] [Commented] (SPARK-24198) add slice function

2018-05-07 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16465627#comment-16465627 ] Marek Novotny commented on SPARK-24198: --- I will work on this. Thanks. > add slice function >

[jira] [Created] (SPARK-24198) add slice function

2018-05-07 Thread Marek Novotny (JIRA)
Marek Novotny created SPARK-24198: - Summary: add slice function Key: SPARK-24198 URL: https://issues.apache.org/jira/browse/SPARK-24198 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-24197) add array_sort function

2018-05-07 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16465626#comment-16465626 ] Marek Novotny commented on SPARK-24197: --- I will work on this. Thanks. > add array_sort function >

[jira] [Created] (SPARK-24197) add array_sort function

2018-05-07 Thread Marek Novotny (JIRA)
Marek Novotny created SPARK-24197: - Summary: add array_sort function Key: SPARK-24197 URL: https://issues.apache.org/jira/browse/SPARK-24197 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-24148) Adding Ability to Specify SQL Type of Empty Arrays

2018-05-02 Thread Marek Novotny (JIRA)
Marek Novotny created SPARK-24148: - Summary: Adding Ability to Specify SQL Type of Empty Arrays Key: SPARK-24148 URL: https://issues.apache.org/jira/browse/SPARK-24148 Project: Spark Issue

[jira] [Commented] (SPARK-23935) High-order function: map_entries(map<K, V>) → array<row<K,V>>

2018-04-27 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16456274#comment-16456274 ] Marek Novotny commented on SPARK-23935: --- I will work on this one. Thanks. > High-order function:

[jira] [Commented] (SPARK-23934) High-order function: map_from_entries(array<row<K, V>>) → map<K,V>

2018-04-27 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16456272#comment-16456272 ] Marek Novotny commented on SPARK-23934: --- I will work on this one. Thanks. > High-order function:

[jira] [Comment Edited] (SPARK-23925) High-order function: repeat(element, count) → array

2018-04-26 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16454526#comment-16454526 ] Marek Novotny edited comment on SPARK-23925 at 4/26/18 4:47 PM:

[jira] [Commented] (SPARK-23925) High-order function: repeat(element, count) → array

2018-04-26 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16454526#comment-16454526 ] Marek Novotny commented on SPARK-23925: --- @pepinoflo Any joy? I can take this one or help if you

[jira] [Created] (SPARK-24042) High-order function: zip_with_index

2018-04-21 Thread Marek Novotny (JIRA)
Marek Novotny created SPARK-24042: - Summary: High-order function: zip_with_index Key: SPARK-24042 URL: https://issues.apache.org/jira/browse/SPARK-24042 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-23936) High-order function: map_concat(map1<K, V>, map2<K, V>, ..., mapN<K, V>) → map<K,V>

2018-04-11 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16434185#comment-16434185 ] Marek Novotny commented on SPARK-23936: --- Shouldn't we overload _concat_ function for maps instead

[jira] [Commented] (SPARK-23926) High-order function: reverse(x) → array

2018-04-09 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16430539#comment-16430539 ] Marek Novotny commented on SPARK-23926: --- I take this one. > High-order function: reverse(x) →

[jira] [Updated] (SPARK-23821) Collection function: flatten

2018-03-29 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marek Novotny updated SPARK-23821: -- Summary: Collection function: flatten (was: Collection functions: flatten) > Collection

[jira] [Created] (SPARK-23821) Collection functions: flatten

2018-03-29 Thread Marek Novotny (JIRA)
Marek Novotny created SPARK-23821: - Summary: Collection functions: flatten Key: SPARK-23821 URL: https://issues.apache.org/jira/browse/SPARK-23821 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-23798) The CreateArray and ConcatArray should return the default array type when no children provided

2018-03-27 Thread Marek Novotny (JIRA)
Marek Novotny created SPARK-23798: - Summary: The CreateArray and ConcatArray should return the default array type when no children provided Key: SPARK-23798 URL: https://issues.apache.org/jira/browse/SPARK-23798

[jira] [Commented] (SPARK-23504) Flaky test: RateSourceV2Suite.basic microbatch execution

2018-03-27 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16415313#comment-16415313 ] Marek Novotny commented on SPARK-23504: --- Experienced the [same

[jira] [Updated] (SPARK-23736) Extension of the concat function to support array columns

2018-03-26 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marek Novotny updated SPARK-23736: -- Description: Extend the _concat_ function to also support array columns. Example:

[jira] [Updated] (SPARK-23736) Extension of the concat function to support array columns

2018-03-26 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marek Novotny updated SPARK-23736: -- Description: Extend the _concat_ function to also support array columns. Example:

[jira] [Updated] (SPARK-23736) collection function: concat_arrays

2018-03-19 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marek Novotny updated SPARK-23736: -- Issue Type: New Feature (was: Story) > collection function: concat_arrays >

[jira] [Created] (SPARK-23736) collection function: concat_arrays

2018-03-19 Thread Marek Novotny (JIRA)
Marek Novotny created SPARK-23736: - Summary: collection function: concat_arrays Key: SPARK-23736 URL: https://issues.apache.org/jira/browse/SPARK-23736 Project: Spark Issue Type: Story