[jira] [Commented] (SPARK-24382) Spark Structured Streaming aggregation on old timestamp data

[ https://issues.apache.org/jira/browse/SPARK-24382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16523227#comment-16523227 ] Richard Yu commented on SPARK-24382: [~karthikus] Yes, the old dates would in fact matter, primarily

[jira] [Comment Edited] (SPARK-24382) Spark Structured Streaming aggregation on old timestamp data

[ https://issues.apache.org/jira/browse/SPARK-24382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16523227#comment-16523227 ] Richard Yu edited comment on SPARK-24382 at 6/26/18 5:34 AM: - [~karthikus]

[jira] [Commented] (SPARK-23014) Migrate MemorySink fully to v2

[ https://issues.apache.org/jira/browse/SPARK-23014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524481#comment-16524481 ] Richard Yu commented on SPARK-23014: Hi [~joseph.torres] Are you still working on this PR? It seems

[jira] [Comment Edited] (SPARK-23102) Migrate kafka sink

[ https://issues.apache.org/jira/browse/SPARK-23102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524615#comment-16524615 ] Richard Yu edited comment on SPARK-23102 at 6/27/18 6:04 AM: -

[jira] [Commented] (SPARK-23102) Migrate kafka sink

[ https://issues.apache.org/jira/browse/SPARK-23102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524628#comment-16524628 ] Richard Yu commented on SPARK-23102: Hi [~joseph.torres] Mind if I take this JIRA? > Migrate kafka

[jira] [Commented] (SPARK-23102) Migrate kafka sink

[ https://issues.apache.org/jira/browse/SPARK-23102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524675#comment-16524675 ] Richard Yu commented on SPARK-23102: I took a look, and it looks like {{KafkaStreamWriter}} already

[jira] [Comment Edited] (SPARK-23102) Migrate kafka sink

[ https://issues.apache.org/jira/browse/SPARK-23102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524615#comment-16524615 ] Richard Yu edited comment on SPARK-23102 at 6/27/18 6:03 AM: -

[jira] [Commented] (SPARK-23102) Migrate kafka sink

[ https://issues.apache.org/jira/browse/SPARK-23102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524615#comment-16524615 ] Richard Yu commented on SPARK-23102: Just a question: I have noted that

[jira] [Issue Comment Deleted] (SPARK-23102) Migrate kafka sink

[ https://issues.apache.org/jira/browse/SPARK-23102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Yu updated SPARK-23102: --- Comment: was deleted (was: [~joseph.torres] Just a question: I have noted that 

[jira] [Commented] (SPARK-18258) Sinks need access to offset representation

[ https://issues.apache.org/jira/browse/SPARK-18258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524921#comment-16524921 ] Richard Yu commented on SPARK-18258: Just a question, I noticed that in {{KafkaSink}}'s particular

[jira] [Comment Edited] (SPARK-18258) Sinks need access to offset representation

[ https://issues.apache.org/jira/browse/SPARK-18258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524921#comment-16524921 ] Richard Yu edited comment on SPARK-18258 at 6/27/18 11:12 AM: -- Just a

[jira] [Comment Edited] (SPARK-16859) History Server storage information is missing

[ https://issues.apache.org/jira/browse/SPARK-16859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16394580#comment-16394580 ] Richard Yu edited comment on SPARK-16859 at 3/11/18 5:25 PM: - Is this issue

[jira] [Commented] (SPARK-16859) History Server storage information is missing

[ https://issues.apache.org/jira/browse/SPARK-16859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16394580#comment-16394580 ] Richard Yu commented on SPARK-16859: Is this issue not already resolved? When looking into

[jira] [Comment Edited] (SPARK-16859) History Server storage information is missing

[ https://issues.apache.org/jira/browse/SPARK-16859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16394580#comment-16394580 ] Richard Yu edited comment on SPARK-16859 at 3/11/18 5:26 PM: - Is this issue

[jira] [Comment Edited] (SPARK-10815) Public API: Streaming Sources and Sinks

[ https://issues.apache.org/jira/browse/SPARK-10815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16394583#comment-16394583 ] Richard Yu edited comment on SPARK-10815 at 3/11/18 5:42 PM: -

[jira] [Commented] (SPARK-10815) Public API: Streaming Sources and Sinks

[ https://issues.apache.org/jira/browse/SPARK-10815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16394583#comment-16394583 ] Richard Yu commented on SPARK-10815: [~c...@koeninger.org] Is this still applicable to Spark? This

[jira] [Commented] (SPARK-18057) Update structured streaming kafka from 0.10.0.1 to 1.1.0

[ https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16441802#comment-16441802 ] Richard Yu commented on SPARK-18057: Kafka contributors / developers are currently still discussing

[jira] [Comment Edited] (SPARK-18057) Update structured streaming kafka from 0.10.0.1 to 1.1.0

[ https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16441802#comment-16441802 ] Richard Yu edited comment on SPARK-18057 at 4/18/18 2:46 AM: - Kafka

[jira] [Commented] (SPARK-18057) Update structured streaming kafka from 0.10.0.1 to 1.1.0

[ https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16384488#comment-16384488 ] Richard Yu commented on SPARK-18057: [~sliebau]  Hi, I'm interested in participating in this JIRA.

[jira] [Commented] (SPARK-18057) Update structured streaming kafka from 0.10.0.1 to 1.1.0

[ https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386982#comment-16386982 ] Richard Yu commented on SPARK-18057: Hi all, I'm currently working on KAFKA-6608 which is part of

[jira] [Comment Edited] (SPARK-18057) Update structured streaming kafka from 0.10.0.1 to 1.1.0

[ https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386982#comment-16386982 ] Richard Yu edited comment on SPARK-18057 at 3/5/18 11:48 PM: - Hi all, I'm

[jira] [Issue Comment Deleted] (SPARK-24144) monotonically_increasing_id on streaming dataFrames

[ https://issues.apache.org/jira/browse/SPARK-24144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Yu updated SPARK-24144: --- Comment: was deleted (was: So do you propose to send the information regarding

[jira] [Commented] (SPARK-18258) Sinks need access to offset representation

[ https://issues.apache.org/jira/browse/SPARK-18258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16526936#comment-16526936 ] Richard Yu commented on SPARK-18258: {quote} * We need agreement on whether it is worth making a

[jira] [Commented] (SPARK-24144) monotonically_increasing_id on streaming dataFrames

[ https://issues.apache.org/jira/browse/SPARK-24144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16527306#comment-16527306 ] Richard Yu commented on SPARK-24144: Hi [~marmbrus] I'm interested in doing this JIRA, but I'm

[jira] [Commented] (SPARK-23098) Migrate Kafka batch source to v2

[ https://issues.apache.org/jira/browse/SPARK-23098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525919#comment-16525919 ] Richard Yu commented on SPARK-23098: Wasn't this issue resolved by SPARK-23362? > Migrate Kafka

[jira] [Commented] (SPARK-24144) monotonically_increasing_id on streaming dataFrames

[ https://issues.apache.org/jira/browse/SPARK-24144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16526075#comment-16526075 ] Richard Yu commented on SPARK-24144: So do you propose to send the information regarding

[jira] [Commented] (SPARK-24662) Structured Streaming should support LIMIT

[ https://issues.apache.org/jira/browse/SPARK-24662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16526065#comment-16526065 ] Richard Yu commented on SPARK-24662: Just to be clear on the function of the limit operator, could

[jira] [Commented] (SPARK-18258) Sinks need access to offset representation

[ https://issues.apache.org/jira/browse/SPARK-18258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525883#comment-16525883 ] Richard Yu commented on SPARK-18258: [~c...@koeninger.org] I have a bit of a concern regarding where

[jira] [Comment Edited] (SPARK-18258) Sinks need access to offset representation

[ https://issues.apache.org/jira/browse/SPARK-18258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525883#comment-16525883 ] Richard Yu edited comment on SPARK-18258 at 6/28/18 3:56 AM: -

[jira] [Comment Edited] (SPARK-26841) Timestamp pushdown on Kafka table

[ https://issues.apache.org/jira/browse/SPARK-26841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16843509#comment-16843509 ] Richard Yu edited comment on SPARK-26841 at 5/19/19 5:53 PM: - [~Bartalos]

[jira] [Commented] (SPARK-26841) Timestamp pushdown on Kafka table

[ https://issues.apache.org/jira/browse/SPARK-26841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16843509#comment-16843509 ] Richard Yu commented on SPARK-26841: [~Bartalos] Could you expain what use cases there are for

[jira] [Created] (SPARK-44059) Add named argument support for SQL functions

Richard Yu created SPARK-44059: -- Summary: Add named argument support for SQL functions Key: SPARK-44059 URL: https://issues.apache.org/jira/browse/SPARK-44059 Project: Spark Issue Type: New

[jira] [Updated] (SPARK-44059) Add named argument support for SQL functions

[ https://issues.apache.org/jira/browse/SPARK-44059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Yu updated SPARK-44059: --- Description: Today, there is increasing demand for named argument functions, especially as we

[jira] [Updated] (SPARK-43815) Add SQL functions to_varchar and extend to_char functionality

[ https://issues.apache.org/jira/browse/SPARK-43815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Yu updated SPARK-43815: --- Description: Today, users who have SQL engines which support \{code:java} to_varchar \{code} 

[jira] [Updated] (SPARK-43815) Add SQL functions to_varchar and extend to_char functionality

[ https://issues.apache.org/jira/browse/SPARK-43815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Yu updated SPARK-43815: --- Description: Today, users who have SQL engines which support  ```to_varchar```  needs to change

[jira] [Created] (SPARK-43815) Add SQL functions to_varchar and extend to_char functionality

Richard Yu created SPARK-43815: -- Summary: Add SQL functions to_varchar and extend to_char functionality Key: SPARK-43815 URL: https://issues.apache.org/jira/browse/SPARK-43815 Project: Spark

[jira] [Updated] (SPARK-43815) Add SQL functions to_varchar and extend to_char functionality

[ https://issues.apache.org/jira/browse/SPARK-43815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Yu updated SPARK-43815: --- Description: We want to add support for the follow functions: * to_varchar() as an alias for

[jira] [Updated] (SPARK-43815) Add SQL functions to_varchar alias for to_char

[ https://issues.apache.org/jira/browse/SPARK-43815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Yu updated SPARK-43815: --- Summary: Add SQL functions to_varchar alias for to_char (was: Add SQL functions to_varchar and

[jira] [Updated] (SPARK-43815) Add to_varchar alias for to_char SQL function

[ https://issues.apache.org/jira/browse/SPARK-43815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Yu updated SPARK-43815: --- Summary: Add to_varchar alias for to_char SQL function (was: Add SQL functions to_varchar alias

[jira] [Updated] (SPARK-43815) Add SQL functions to_varchar alias for to_char

[ https://issues.apache.org/jira/browse/SPARK-43815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Yu updated SPARK-43815: --- Description: We want to add the alias to_varchar for the function to_char.  For users who are

[jira] [Updated] (SPARK-43815) Add to_varchar alias for to_char SQL function

[ https://issues.apache.org/jira/browse/SPARK-43815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Yu updated SPARK-43815: --- Description: We want to add the alias to_varchar for the function to_char.  For users who are

[jira] [Updated] (SPARK-43922) Add named parameter support in parser for function call

[ https://issues.apache.org/jira/browse/SPARK-43922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Yu updated SPARK-43922: --- Description: Today, we are implementing named parameter support for user defined functions, some

[jira] [Updated] (SPARK-43922) Add named parameter support in parser for function call

[ https://issues.apache.org/jira/browse/SPARK-43922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Yu updated SPARK-43922: --- Description: Today, we are implementing named parameter support for user defined functions, some

[jira] [Created] (SPARK-43922) Add named parameter support in parser for function call

Richard Yu created SPARK-43922: -- Summary: Add named parameter support in parser for function call Key: SPARK-43922 URL: https://issues.apache.org/jira/browse/SPARK-43922 Project: Spark Issue

[jira] [Updated] (SPARK-43922) Add named argument support in parser for function call

[ https://issues.apache.org/jira/browse/SPARK-43922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Yu updated SPARK-43922: --- Description: Today, we are implementing named argument support for user defined functions, some

[jira] [Updated] (SPARK-43922) Add named argument support in parser for function call

[ https://issues.apache.org/jira/browse/SPARK-43922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Yu updated SPARK-43922: --- Summary: Add named argument support in parser for function call (was: Add named parameter support

[jira] [Updated] (SPARK-43922) Add named argument support in parser for function call

[ https://issues.apache.org/jira/browse/SPARK-43922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Yu updated SPARK-43922: --- Parent: SPARK-44059 Issue Type: Sub-task (was: New Feature) > Add named argument support

[jira] [Created] (SPARK-44196) Add analyzer support of named arguments for built-in functions

Richard Yu created SPARK-44196: -- Summary: Add analyzer support of named arguments for built-in functions Key: SPARK-44196 URL: https://issues.apache.org/jira/browse/SPARK-44196 Project: Spark

[jira] [Updated] (SPARK-44059) Add named argument support for SQL functions

[ https://issues.apache.org/jira/browse/SPARK-44059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Yu updated SPARK-44059: --- Description: Today, there is increasing demand for named argument functions, especially as we