[jira] [Commented] (FLINK-3788) Local variable values are not distributed to job runners
[ https://issues.apache.org/jira/browse/FLINK-3788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15247919#comment-15247919 ] Andreas C. Osowski commented on FLINK-3788: --- In that case, the behaviour can probably be explained by: bq. It should be noted that this trait is implemented using the DelayedInit functionality, which means that fields of the object will not have been initialized before the main method has been executed. Source: http://www.scala-lang.org/api/current/index.html#scala.App > Local variable values are not distributed to job runners > > > Key: FLINK-3788 > URL: https://issues.apache.org/jira/browse/FLINK-3788 > Project: Flink > Issue Type: Bug > Components: DataSet API >Affects Versions: 1.0.0, 1.0.1 > Environment: Scala 2.11.8 > Sun JDK 1.8.0_65 or OpenJDK 1.8.0_77 > Fedora 25, 4.6.0-0.rc2.git3.1.fc25.x86_64 >Reporter: Andreas C. Osowski > Attachments: FLINK-3788.tgz > > > Variable values of non-elementary types aren't caught and distributed to job > runners, causing them to remain 'null' and causing NPEs upon access when > running on a cluster. Running locally through `flink-clients` works fine. > Changing parallelism or disabling the closure cleaner don't seem to have any > effect. > Minimal example, also see the attached archive. > {code:java} > case class IntWrapper(a1: Int) > val wrapped = IntWrapper(42) > env.readTextFile("myTextFile.txt").map(line => wrapped.toString).collect > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (FLINK-3788) Local variable values are not distributed to job runners
[ https://issues.apache.org/jira/browse/FLINK-3788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andreas C. Osowski updated FLINK-3788: -- Summary: Local variable values are not distributed to job runners (was: Local variable values are not distributed to task runners) > Local variable values are not distributed to job runners > > > Key: FLINK-3788 > URL: https://issues.apache.org/jira/browse/FLINK-3788 > Project: Flink > Issue Type: Bug > Components: DataSet API >Affects Versions: 1.0.0, 1.0.1 > Environment: Scala 2.11.8 > Sun JDK 1.8.0_65 or OpenJDK 1.8.0_77 > Fedora 25, 4.6.0-0.rc2.git3.1.fc25.x86_64 >Reporter: Andreas C. Osowski > Attachments: FLINK-3788.tgz > > > Variable values of non-elementary types aren't caught and distributed to job > runners, causing them to remain 'null' and causing NPEs upon access when > running on a cluster. Running locally through `flink-clients` works fine. > Changing parallelism or disabling the closure cleaner don't seem to have any > effect. > Minimal example, also see the attached archive. > {code:java} > case class IntWrapper(a1: Int) > val wrapped = IntWrapper(42) > env.readTextFile("myTextFile.txt").map(line => wrapped.toString).collect > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (FLINK-3788) Local variable values are not distributed to task runners
[ https://issues.apache.org/jira/browse/FLINK-3788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andreas C. Osowski updated FLINK-3788: -- Attachment: FLINK-3788.tgz > Local variable values are not distributed to task runners > - > > Key: FLINK-3788 > URL: https://issues.apache.org/jira/browse/FLINK-3788 > Project: Flink > Issue Type: Bug > Components: DataSet API >Affects Versions: 1.0.0, 1.0.1 > Environment: Scala 2.11.8 > Sun JDK 1.8.0_65 or OpenJDK 1.8.0_77 > Fedora 25, 4.6.0-0.rc2.git3.1.fc25.x86_64 >Reporter: Andreas C. Osowski > Attachments: FLINK-3788.tgz > > > Variable values of non-elementary types aren't caught and distributed to job > runners, causing them to remain 'null' and causing NPEs upon access when > running on a cluster. Running locally through `flink-clients` works fine. > Changing parallelism or disabling the closure cleaner don't seem to have any > effect. > Minimal example, also see the attached archive. > {code:java} > case class IntWrapper(a1: Int) > val wrapped = IntWrapper(42) > env.readTextFile("myTextFile.txt").map(line => wrapped.toString).collect > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (FLINK-3788) Local variable values are not distributed to task runners
Andreas C. Osowski created FLINK-3788: - Summary: Local variable values are not distributed to task runners Key: FLINK-3788 URL: https://issues.apache.org/jira/browse/FLINK-3788 Project: Flink Issue Type: Bug Components: DataSet API Affects Versions: 1.0.1, 1.0.0 Environment: Scala 2.11.8 Sun JDK 1.8.0_65 or OpenJDK 1.8.0_77 Fedora 25, 4.6.0-0.rc2.git3.1.fc25.x86_64 Reporter: Andreas C. Osowski Variable values of non-elementary types aren't caught and distributed to job runners, causing them to remain 'null' and causing NPEs upon access when running on a cluster. Running locally through `flink-clients` works fine. Changing parallelism or disabling the closure cleaner don't seem to have any effect. Minimal example, also see the attached archive. {code:java} case class IntWrapper(a1: Int) val wrapped = IntWrapper(42) env.readTextFile("myTextFile.txt").map(line => wrapped.toString).collect {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)