[
https://issues.apache.org/jira/browse/FLINK-1090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Stefan Bunk updated FLINK-1090:
-------------------------------
Description:
I have a join inside a delta iteration, which hangs, i.e.I think it's
deadlocked.
If I do the join without a delta iteration, it works.
_Why I think it's a deadlock_:
- no output in the logs
- CPU idles
- no IO (measured using iotop)
- stacktrace (when starting in debug mode and stopping at arbitrary points)
locks deadlockish !http://i.imgur.com/4TgSK3x.png!
_Join properties_:
- size of the operands: 6.1 GB, 257 MB
- estimated result size: 50 MB
- the deadlock only occurs for big inputs, if I decrease the size of the first
operand to something smaller, e.g. 1MB, it works.
I am using the Scala API.
Let me know, which further information you need. The code is basically the one
I posted on the [mailing
list|http://apache-flink-incubator-user-mailing-list-archive.2336050.n4.nabble.com/Delta-Iteration-Runtime-Error-quot-Could-not-set-up-runtime-strategy-for-input-channel-to-node-quot-td6.html].
was:
I have a join inside a delta iteration, which hangs, i.e.I think it's
deadlocked.
If I do the join without a delta iteration, it works.
_Why I think it's a deadlock_:
- no output in the logs
- CPU idles
- no IO (measured using iotop)
- stacktrace (when starting in debug mode and stopping at arbitrary points)
locks deadlockish !http://i.imgur.com/4TgSK3x.png!
_Join properties_:
- size of the operands: 6.1 GB, 257 MB
- estimated result size: 50 MB
- the deadlock only occurs for big inputs, if I decrease the size of the first
operand to something smaller, e.g. 1MB, it works.
I am using the Scala API.
Let me know, which further information you need (do you need the code?).
> Join deadlocks when used inside Delta iteration
> -----------------------------------------------
>
> Key: FLINK-1090
> URL: https://issues.apache.org/jira/browse/FLINK-1090
> Project: Flink
> Issue Type: Bug
> Components: Distributed Runtime, Iterations, Scala API
> Affects Versions: 0.6-incubating
> Environment: Ubuntu 14.04, Flink 0.6-incubating
> LocalExecutor
> JVM 1.7 with 7 GB RAM assigned
> Reporter: Stefan Bunk
>
> I have a join inside a delta iteration, which hangs, i.e.I think it's
> deadlocked.
> If I do the join without a delta iteration, it works.
> _Why I think it's a deadlock_:
> - no output in the logs
> - CPU idles
> - no IO (measured using iotop)
> - stacktrace (when starting in debug mode and stopping at arbitrary points)
> locks deadlockish !http://i.imgur.com/4TgSK3x.png!
> _Join properties_:
> - size of the operands: 6.1 GB, 257 MB
> - estimated result size: 50 MB
> - the deadlock only occurs for big inputs, if I decrease the size of the
> first operand to something smaller, e.g. 1MB, it works.
> I am using the Scala API.
> Let me know, which further information you need. The code is basically the
> one I posted on the [mailing
> list|http://apache-flink-incubator-user-mailing-list-archive.2336050.n4.nabble.com/Delta-Iteration-Runtime-Error-quot-Could-not-set-up-runtime-strategy-for-input-channel-to-node-quot-td6.html].
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
