[
https://issues.apache.org/jira/browse/SPARK-12513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shawn Guo updated SPARK-12513:
------------------------------
Description:
I add a SocketReceiver test based on the NetworkWordCount.
Using pipeline and tail the continuous output to netcat
tail -f xxx.log | nc -lk 9999
and create a SocketReceiver to receive the continuous output from remote netcat.
After about 10 hours, SocketReceiver hang and can not receive no more data.
Netcat only accept one socket connection and push stdin to connected socket.
other connection is wating in the netcat queue.
When restart SocketReceive, new socket connection is created to connect to
Netcat. However old connection is not closed properly. new connection can not
read anything from Netcat.
was:
I add a SocketReceiver test based on the NetworkWordCount.
Using pipeline and tail the continuous output to netcat
tail -f xxx.log | nc -lk 9999
and create a SocketReceiver to receive the continuous output from remote netcat.
After about 10 hours, SocketReceiver hang and can not receive no more data.
> SocketReceiver hang in Netcat example
> -------------------------------------
>
> Key: SPARK-12513
> URL: https://issues.apache.org/jira/browse/SPARK-12513
> Project: Spark
> Issue Type: Bug
> Components: Streaming
> Affects Versions: 1.5.2
> Reporter: Shawn Guo
> Priority: Minor
>
> I add a SocketReceiver test based on the NetworkWordCount.
> Using pipeline and tail the continuous output to netcat
> tail -f xxx.log | nc -lk 9999
> and create a SocketReceiver to receive the continuous output from remote
> netcat.
> After about 10 hours, SocketReceiver hang and can not receive no more data.
> Netcat only accept one socket connection and push stdin to connected socket.
> other connection is wating in the netcat queue.
> When restart SocketReceive, new socket connection is created to connect to
> Netcat. However old connection is not closed properly. new connection can not
> read anything from Netcat.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
