[jira] [Updated] (FLINK-17589) Extend StreamingFileSink to Support Streaming Hive Connector

2024-03-11 Thread lincoln lee (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-17589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

lincoln lee updated FLINK-17589:

Fix Version/s: (was: 1.19.0)

> Extend StreamingFileSink to Support Streaming Hive Connector
> 
>
> Key: FLINK-17589
> URL: https://issues.apache.org/jira/browse/FLINK-17589
> Project: Flink
>  Issue Type: New Feature
>  Components: Connectors / FileSystem
>Reporter: Yun Gao
>Priority: Minor
>  Labels: auto-deprioritized-major, auto-unassigned
> Fix For: 1.20.0
>
>
> According to the [discussion on FLIP-115 | 
> https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E
>  
> |https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E],
>  we will use StreamingFileSink to support the streaming hive connector. This 
> requires to make some extension to the current StreamingFileSink:
>  #   Support path-based writer to write the specified Hadoop path.
>  #   Provides listeners to collect the bucket state so that the Hive sink 
> could decide when one bucket is terminated and then writing meta-info to Hive.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (FLINK-17589) Extend StreamingFileSink to Support Streaming Hive Connector

2024-03-11 Thread lincoln lee (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-17589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

lincoln lee updated FLINK-17589:

Fix Version/s: 1.20.0

> Extend StreamingFileSink to Support Streaming Hive Connector
> 
>
> Key: FLINK-17589
> URL: https://issues.apache.org/jira/browse/FLINK-17589
> Project: Flink
>  Issue Type: New Feature
>  Components: Connectors / FileSystem
>Reporter: Yun Gao
>Priority: Minor
>  Labels: auto-deprioritized-major, auto-unassigned
> Fix For: 1.19.0, 1.20.0
>
>
> According to the [discussion on FLIP-115 | 
> https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E
>  
> |https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E],
>  we will use StreamingFileSink to support the streaming hive connector. This 
> requires to make some extension to the current StreamingFileSink:
>  #   Support path-based writer to write the specified Hadoop path.
>  #   Provides listeners to collect the bucket state so that the Hive sink 
> could decide when one bucket is terminated and then writing meta-info to Hive.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (FLINK-17589) Extend StreamingFileSink to Support Streaming Hive Connector

2023-10-13 Thread Jing Ge (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-17589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jing Ge updated FLINK-17589:

Fix Version/s: 1.19.0
   (was: 1.18.0)

> Extend StreamingFileSink to Support Streaming Hive Connector
> 
>
> Key: FLINK-17589
> URL: https://issues.apache.org/jira/browse/FLINK-17589
> Project: Flink
>  Issue Type: New Feature
>  Components: Connectors / FileSystem
>Reporter: Yun Gao
>Priority: Minor
>  Labels: auto-deprioritized-major, auto-unassigned
> Fix For: 1.19.0
>
>
> According to the [discussion on FLIP-115 | 
> https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E
>  
> |https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E],
>  we will use StreamingFileSink to support the streaming hive connector. This 
> requires to make some extension to the current StreamingFileSink:
>  #   Support path-based writer to write the specified Hadoop path.
>  #   Provides listeners to collect the bucket state so that the Hive sink 
> could decide when one bucket is terminated and then writing meta-info to Hive.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (FLINK-17589) Extend StreamingFileSink to Support Streaming Hive Connector

2023-03-23 Thread Xintong Song (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-17589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Xintong Song updated FLINK-17589:
-
Fix Version/s: 1.18.0
   (was: 1.17.0)

> Extend StreamingFileSink to Support Streaming Hive Connector
> 
>
> Key: FLINK-17589
> URL: https://issues.apache.org/jira/browse/FLINK-17589
> Project: Flink
>  Issue Type: New Feature
>  Components: Connectors / FileSystem
>Reporter: Yun Gao
>Priority: Minor
>  Labels: auto-deprioritized-major, auto-unassigned
> Fix For: 1.18.0
>
>
> According to the [discussion on FLIP-115 | 
> https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E
>  
> |https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E],
>  we will use StreamingFileSink to support the streaming hive connector. This 
> requires to make some extension to the current StreamingFileSink:
>  #   Support path-based writer to write the specified Hadoop path.
>  #   Provides listeners to collect the bucket state so that the Hive sink 
> could decide when one bucket is terminated and then writing meta-info to Hive.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (FLINK-17589) Extend StreamingFileSink to Support Streaming Hive Connector

2022-08-22 Thread Godfrey He (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-17589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Godfrey He updated FLINK-17589:
---
Fix Version/s: 1.17.0
   (was: 1.16.0)

> Extend StreamingFileSink to Support Streaming Hive Connector
> 
>
> Key: FLINK-17589
> URL: https://issues.apache.org/jira/browse/FLINK-17589
> Project: Flink
>  Issue Type: New Feature
>  Components: Connectors / FileSystem
>Reporter: Yun Gao
>Priority: Minor
>  Labels: auto-deprioritized-major, auto-unassigned
> Fix For: 1.17.0
>
>
> According to the [discussion on FLIP-115 | 
> https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E
>  
> |https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E],
>  we will use StreamingFileSink to support the streaming hive connector. This 
> requires to make some extension to the current StreamingFileSink:
>  #   Support path-based writer to write the specified Hadoop path.
>  #   Provides listeners to collect the bucket state so that the Hive sink 
> could decide when one bucket is terminated and then writing meta-info to Hive.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (FLINK-17589) Extend StreamingFileSink to Support Streaming Hive Connector

2022-04-13 Thread Yun Gao (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-17589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yun Gao updated FLINK-17589:

Fix Version/s: 1.16.0

> Extend StreamingFileSink to Support Streaming Hive Connector
> 
>
> Key: FLINK-17589
> URL: https://issues.apache.org/jira/browse/FLINK-17589
> Project: Flink
>  Issue Type: New Feature
>  Components: Connectors / FileSystem
>Reporter: Yun Gao
>Priority: Minor
>  Labels: auto-deprioritized-major, auto-unassigned
> Fix For: 1.15.0, 1.16.0
>
>
> According to the [discussion on FLIP-115 | 
> https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E
>  
> |https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E],
>  we will use StreamingFileSink to support the streaming hive connector. This 
> requires to make some extension to the current StreamingFileSink:
>  #   Support path-based writer to write the specified Hadoop path.
>  #   Provides listeners to collect the bucket state so that the Hive sink 
> could decide when one bucket is terminated and then writing meta-info to Hive.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Updated] (FLINK-17589) Extend StreamingFileSink to Support Streaming Hive Connector

2021-09-28 Thread Xintong Song (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-17589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Xintong Song updated FLINK-17589:
-
Fix Version/s: (was: 1.14.0)
   1.15.0

> Extend StreamingFileSink to Support Streaming Hive Connector
> 
>
> Key: FLINK-17589
> URL: https://issues.apache.org/jira/browse/FLINK-17589
> Project: Flink
>  Issue Type: New Feature
>  Components: Connectors / FileSystem
>Reporter: Yun Gao
>Priority: Minor
>  Labels: auto-deprioritized-major, auto-unassigned
> Fix For: 1.15.0
>
>
> According to the [discussion on FLIP-115 | 
> https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E
>  
> |https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E],
>  we will use StreamingFileSink to support the streaming hive connector. This 
> requires to make some extension to the current StreamingFileSink:
>  #   Support path-based writer to write the specified Hadoop path.
>  #   Provides listeners to collect the bucket state so that the Hive sink 
> could decide when one bucket is terminated and then writing meta-info to Hive.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (FLINK-17589) Extend StreamingFileSink to Support Streaming Hive Connector

2021-06-10 Thread Flink Jira Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-17589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Flink Jira Bot updated FLINK-17589:
---
  Labels: auto-deprioritized-major auto-unassigned  (was: auto-unassigned 
stale-major)
Priority: Minor  (was: Major)

This issue was labeled "stale-major" 7 ago and has not received any updates so 
it is being deprioritized. If this ticket is actually Major, please raise the 
priority and ask a committer to assign you the issue or revive the public 
discussion.


> Extend StreamingFileSink to Support Streaming Hive Connector
> 
>
> Key: FLINK-17589
> URL: https://issues.apache.org/jira/browse/FLINK-17589
> Project: Flink
>  Issue Type: New Feature
>  Components: Connectors / FileSystem
>Reporter: Yun Gao
>Priority: Minor
>  Labels: auto-deprioritized-major, auto-unassigned
> Fix For: 1.14.0
>
>
> According to the [discussion on FLIP-115 | 
> https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E
>  
> |https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E],
>  we will use StreamingFileSink to support the streaming hive connector. This 
> requires to make some extension to the current StreamingFileSink:
>  #   Support path-based writer to write the specified Hadoop path.
>  #   Provides listeners to collect the bucket state so that the Hive sink 
> could decide when one bucket is terminated and then writing meta-info to Hive.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (FLINK-17589) Extend StreamingFileSink to Support Streaming Hive Connector

2021-06-02 Thread Flink Jira Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-17589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Flink Jira Bot updated FLINK-17589:
---
Labels: auto-unassigned stale-major  (was: auto-unassigned)

I am the [Flink Jira Bot|https://github.com/apache/flink-jira-bot/] and I help 
the community manage its development. I see this issues has been marked as 
Major but is unassigned and neither itself nor its Sub-Tasks have been updated 
for 30 days. I have gone ahead and added a "stale-major" to the issue". If this 
ticket is a Major, please either assign yourself or give an update. Afterwards, 
please remove the label or in 7 days the issue will be deprioritized.


> Extend StreamingFileSink to Support Streaming Hive Connector
> 
>
> Key: FLINK-17589
> URL: https://issues.apache.org/jira/browse/FLINK-17589
> Project: Flink
>  Issue Type: New Feature
>  Components: Connectors / FileSystem
>Reporter: Yun Gao
>Priority: Major
>  Labels: auto-unassigned, stale-major
> Fix For: 1.14.0
>
>
> According to the [discussion on FLIP-115 | 
> https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E
>  
> |https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E],
>  we will use StreamingFileSink to support the streaming hive connector. This 
> requires to make some extension to the current StreamingFileSink:
>  #   Support path-based writer to write the specified Hadoop path.
>  #   Provides listeners to collect the bucket state so that the Hive sink 
> could decide when one bucket is terminated and then writing meta-info to Hive.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (FLINK-17589) Extend StreamingFileSink to Support Streaming Hive Connector

2021-04-29 Thread Dawid Wysakowicz (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-17589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Dawid Wysakowicz updated FLINK-17589:
-
Fix Version/s: (was: 1.13.0)
   1.14.0

> Extend StreamingFileSink to Support Streaming Hive Connector
> 
>
> Key: FLINK-17589
> URL: https://issues.apache.org/jira/browse/FLINK-17589
> Project: Flink
>  Issue Type: New Feature
>  Components: Connectors / FileSystem
>Reporter: Yun Gao
>Priority: Major
>  Labels: auto-unassigned
> Fix For: 1.14.0
>
>
> According to the [discussion on FLIP-115 | 
> https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E
>  
> |https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E],
>  we will use StreamingFileSink to support the streaming hive connector. This 
> requires to make some extension to the current StreamingFileSink:
>  #   Support path-based writer to write the specified Hadoop path.
>  #   Provides listeners to collect the bucket state so that the Hive sink 
> could decide when one bucket is terminated and then writing meta-info to Hive.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (FLINK-17589) Extend StreamingFileSink to Support Streaming Hive Connector

2021-04-27 Thread Flink Jira Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-17589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Flink Jira Bot updated FLINK-17589:
---
Labels: auto-unassigned  (was: stale-assigned)

> Extend StreamingFileSink to Support Streaming Hive Connector
> 
>
> Key: FLINK-17589
> URL: https://issues.apache.org/jira/browse/FLINK-17589
> Project: Flink
>  Issue Type: New Feature
>  Components: Connectors / FileSystem
>Reporter: Yun Gao
>Assignee: Yun Gao
>Priority: Major
>  Labels: auto-unassigned
> Fix For: 1.13.0
>
>
> According to the [discussion on FLIP-115 | 
> https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E
>  
> |https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E],
>  we will use StreamingFileSink to support the streaming hive connector. This 
> requires to make some extension to the current StreamingFileSink:
>  #   Support path-based writer to write the specified Hadoop path.
>  #   Provides listeners to collect the bucket state so that the Hive sink 
> could decide when one bucket is terminated and then writing meta-info to Hive.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (FLINK-17589) Extend StreamingFileSink to Support Streaming Hive Connector

2021-04-16 Thread Flink Jira Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-17589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Flink Jira Bot updated FLINK-17589:
---
Labels: stale-assigned  (was: )

> Extend StreamingFileSink to Support Streaming Hive Connector
> 
>
> Key: FLINK-17589
> URL: https://issues.apache.org/jira/browse/FLINK-17589
> Project: Flink
>  Issue Type: New Feature
>  Components: Connectors / FileSystem
>Reporter: Yun Gao
>Assignee: Yun Gao
>Priority: Major
>  Labels: stale-assigned
> Fix For: 1.13.0
>
>
> According to the [discussion on FLIP-115 | 
> https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E
>  
> |https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E],
>  we will use StreamingFileSink to support the streaming hive connector. This 
> requires to make some extension to the current StreamingFileSink:
>  #   Support path-based writer to write the specified Hadoop path.
>  #   Provides listeners to collect the bucket state so that the Hive sink 
> could decide when one bucket is terminated and then writing meta-info to Hive.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (FLINK-17589) Extend StreamingFileSink to Support Streaming Hive Connector

2020-12-07 Thread Robert Metzger (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-17589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Robert Metzger updated FLINK-17589:
---
Fix Version/s: (was: 1.12.0)
   1.13.0

> Extend StreamingFileSink to Support Streaming Hive Connector
> 
>
> Key: FLINK-17589
> URL: https://issues.apache.org/jira/browse/FLINK-17589
> Project: Flink
>  Issue Type: New Feature
>  Components: Connectors / FileSystem
>Reporter: Yun Gao
>Assignee: Yun Gao
>Priority: Major
> Fix For: 1.13.0
>
>
> According to the [discussion on FLIP-115 | 
> https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E
>  
> |https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E],
>  we will use StreamingFileSink to support the streaming hive connector. This 
> requires to make some extension to the current StreamingFileSink:
>  #   Support path-based writer to write the specified Hadoop path.
>  #   Provides listeners to collect the bucket state so that the Hive sink 
> could decide when one bucket is terminated and then writing meta-info to Hive.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (FLINK-17589) Extend StreamingFileSink to Support Streaming Hive Connector

2020-06-02 Thread Danny Chen (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-17589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Danny Chen updated FLINK-17589:
---
Fix Version/s: (was: 1.11.0)
   1.12.0

> Extend StreamingFileSink to Support Streaming Hive Connector
> 
>
> Key: FLINK-17589
> URL: https://issues.apache.org/jira/browse/FLINK-17589
> Project: Flink
>  Issue Type: New Feature
>  Components: Connectors / FileSystem
>Reporter: Yun Gao
>Assignee: Yun Gao
>Priority: Major
> Fix For: 1.12.0
>
>
> According to the [discussion on FLIP-115 | 
> https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E
>  
> |https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E],
>  we will use StreamingFileSink to support the streaming hive connector. This 
> requires to make some extension to the current StreamingFileSink:
>  #   Support path-based writer to write the specified Hadoop path.
>  #   Provides listeners to collect the bucket state so that the Hive sink 
> could decide when one bucket is terminated and then writing meta-info to Hive.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (FLINK-17589) Extend StreamingFileSink to Support Streaming Hive Connector

2020-05-09 Thread Yun Gao (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-17589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yun Gao updated FLINK-17589:

Description: 
According to the [discussion on FLIP-115 | 
https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E
 
|https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E],
 we will use StreamingFileSink to support the streaming hive connector. This 
requires to make some extension to the current StreamingFileSink:
 #   Support path-based writer to write the specified Hadoop path.
 #   Provides listeners to collect the bucket state so that the Hive sink could 
decide when one bucket is terminated and then writing meta-info to Hive.

  was:
According to the [link title|http://example.com] [Discussion on FLIP-115 | 
[https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E
 
|https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E]],
 we will use StreamingFileSink to support the streaming hive connector. This 
requires to make some extension to the current StreamingFileSink:
 #   Support path-based writer to write the specified Hadoop path.
 #   Provides listeners to collect the bucket state so that the Hive sink could 
decide when one bucket is terminated and then writing meta-info to Hive.


> Extend StreamingFileSink to Support Streaming Hive Connector
> 
>
> Key: FLINK-17589
> URL: https://issues.apache.org/jira/browse/FLINK-17589
> Project: Flink
>  Issue Type: New Feature
>  Components: Connectors / FileSystem
>Reporter: Yun Gao
>Assignee: Yun Gao
>Priority: Major
> Fix For: 1.11.0
>
>
> According to the [discussion on FLIP-115 | 
> https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E
>  
> |https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E],
>  we will use StreamingFileSink to support the streaming hive connector. This 
> requires to make some extension to the current StreamingFileSink:
>  #   Support path-based writer to write the specified Hadoop path.
>  #   Provides listeners to collect the bucket state so that the Hive sink 
> could decide when one bucket is terminated and then writing meta-info to Hive.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (FLINK-17589) Extend StreamingFileSink to Support Streaming Hive Connector

2020-05-09 Thread Yun Gao (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-17589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yun Gao updated FLINK-17589:

Description: 
According to the [link title|http://example.com] [Discussion on FLIP-115 | 
[https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E
 
|https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E]],
 we will use StreamingFileSink to support the streaming hive connector. This 
requires to make some extension to the current StreamingFileSink:
 #   Support path-based writer to write the specified Hadoop path.
 #   Provides listeners to collect the bucket state so that the Hive sink could 
decide when one bucket is terminated and then writing meta-info to Hive.

  was:
According to the  [Discussion on FLIP-115 | 
[https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E
 
|https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E]],
 we will use StreamingFileSink to support the streaming hive connector. This 
requires to make some extension to the current StreamingFileSink:
 #   Support path-based writer to write the specified Hadoop path.
 #   Provides listeners to collect the bucket state so that the Hive sink could 
decide when one bucket is terminated and then writing meta-info to Hive.


> Extend StreamingFileSink to Support Streaming Hive Connector
> 
>
> Key: FLINK-17589
> URL: https://issues.apache.org/jira/browse/FLINK-17589
> Project: Flink
>  Issue Type: New Feature
>  Components: Connectors / FileSystem
>Reporter: Yun Gao
>Assignee: Yun Gao
>Priority: Major
> Fix For: 1.11.0
>
>
> According to the [link title|http://example.com] [Discussion on FLIP-115 | 
> [https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E
>  
> |https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E]],
>  we will use StreamingFileSink to support the streaming hive connector. This 
> requires to make some extension to the current StreamingFileSink:
>  #   Support path-based writer to write the specified Hadoop path.
>  #   Provides listeners to collect the bucket state so that the Hive sink 
> could decide when one bucket is terminated and then writing meta-info to Hive.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (FLINK-17589) Extend StreamingFileSink to Support Streaming Hive Connector

2020-05-09 Thread Yun Gao (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-17589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yun Gao updated FLINK-17589:

Description: 
According to the [ Discussion on FLIP-115 | 
[https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E
 
|https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E]],
 we will use StreamingFileSink to support the streaming hive connector. This 
requires to make some extension to the current StreamingFileSink:
 #   Support path-based writer to write the specified Hadoop path.
 #   Provides listeners to collect the bucket state so that the Hive sink could 
decide when one bucket is terminated and then writing meta-info to Hive.

  was:
According to the [Discussion on 
FLIP-115|[https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E]],
 we will use StreamingFileSink to support the streaming hive connector. This 
requires to make some extension to the current StreamingFileSink:
 #   Support path-based writer to write the specified Hadoop path.
 #   Provides listeners to collect the bucket state so that the Hive sink could 
decide when one bucket is terminated and then writing meta-info to Hive.


> Extend StreamingFileSink to Support Streaming Hive Connector
> 
>
> Key: FLINK-17589
> URL: https://issues.apache.org/jira/browse/FLINK-17589
> Project: Flink
>  Issue Type: New Feature
>  Components: Connectors / FileSystem
>Reporter: Yun Gao
>Assignee: Yun Gao
>Priority: Major
> Fix For: 1.11.0
>
>
> According to the [ Discussion on FLIP-115 | 
> [https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E
>  
> |https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E]],
>  we will use StreamingFileSink to support the streaming hive connector. This 
> requires to make some extension to the current StreamingFileSink:
>  #   Support path-based writer to write the specified Hadoop path.
>  #   Provides listeners to collect the bucket state so that the Hive sink 
> could decide when one bucket is terminated and then writing meta-info to Hive.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (FLINK-17589) Extend StreamingFileSink to Support Streaming Hive Connector

2020-05-09 Thread Yun Gao (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-17589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yun Gao updated FLINK-17589:

Description: 
According to the  [Discussion on FLIP-115 | 
[https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E
 
|https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E]],
 we will use StreamingFileSink to support the streaming hive connector. This 
requires to make some extension to the current StreamingFileSink:
 #   Support path-based writer to write the specified Hadoop path.
 #   Provides listeners to collect the bucket state so that the Hive sink could 
decide when one bucket is terminated and then writing meta-info to Hive.

  was:
According to the  [Discussion on 
FLIP-115|[https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E
 
|https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E]],
 we will use StreamingFileSink to support the streaming hive connector. This 
requires to make some extension to the current StreamingFileSink:
 #   Support path-based writer to write the specified Hadoop path.
 #   Provides listeners to collect the bucket state so that the Hive sink could 
decide when one bucket is terminated and then writing meta-info to Hive.


> Extend StreamingFileSink to Support Streaming Hive Connector
> 
>
> Key: FLINK-17589
> URL: https://issues.apache.org/jira/browse/FLINK-17589
> Project: Flink
>  Issue Type: New Feature
>  Components: Connectors / FileSystem
>Reporter: Yun Gao
>Assignee: Yun Gao
>Priority: Major
> Fix For: 1.11.0
>
>
> According to the  [Discussion on FLIP-115 | 
> [https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E
>  
> |https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E]],
>  we will use StreamingFileSink to support the streaming hive connector. This 
> requires to make some extension to the current StreamingFileSink:
>  #   Support path-based writer to write the specified Hadoop path.
>  #   Provides listeners to collect the bucket state so that the Hive sink 
> could decide when one bucket is terminated and then writing meta-info to Hive.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (FLINK-17589) Extend StreamingFileSink to Support Streaming Hive Connector

2020-05-09 Thread Yun Gao (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-17589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yun Gao updated FLINK-17589:

Description: 
According to the  [Discussion on 
FLIP-115|[https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E
 
|https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E]],
 we will use StreamingFileSink to support the streaming hive connector. This 
requires to make some extension to the current StreamingFileSink:
 #   Support path-based writer to write the specified Hadoop path.
 #   Provides listeners to collect the bucket state so that the Hive sink could 
decide when one bucket is terminated and then writing meta-info to Hive.

  was:
According to the [ Discussion on FLIP-115 | 
[https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E
 
|https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E]],
 we will use StreamingFileSink to support the streaming hive connector. This 
requires to make some extension to the current StreamingFileSink:
 #   Support path-based writer to write the specified Hadoop path.
 #   Provides listeners to collect the bucket state so that the Hive sink could 
decide when one bucket is terminated and then writing meta-info to Hive.


> Extend StreamingFileSink to Support Streaming Hive Connector
> 
>
> Key: FLINK-17589
> URL: https://issues.apache.org/jira/browse/FLINK-17589
> Project: Flink
>  Issue Type: New Feature
>  Components: Connectors / FileSystem
>Reporter: Yun Gao
>Assignee: Yun Gao
>Priority: Major
> Fix For: 1.11.0
>
>
> According to the  [Discussion on 
> FLIP-115|[https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E
>  
> |https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E]],
>  we will use StreamingFileSink to support the streaming hive connector. This 
> requires to make some extension to the current StreamingFileSink:
>  #   Support path-based writer to write the specified Hadoop path.
>  #   Provides listeners to collect the bucket state so that the Hive sink 
> could decide when one bucket is terminated and then writing meta-info to Hive.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)