[jira] [Commented] (YARN-3768) ArrayIndexOutOfBoundsException with empty environment variables
[
https://issues.apache.org/jira/browse/YARN-3768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15827329#comment-15827329
]
ASF GitHub Bot commented on YARN-3768:
--
Github user bellemare commented on the issue:
https://github.com/apache/incubator-predictionio/issues/337
Ah geez, I realize now that I may have made a mistake.
```
"SPARK_YARN_USER_ENV" -> sys.env.filter(kv => kv._1.startsWith("PIO_")).
map(kv => s"${kv._1}=${kv._2}").mkString(",")).run())
Note the map: kv => s"${kv._1}=${kv._2}"
```
This indicates that it does INDEED create a key=value pair so I must
have an empty parameter that I am setting, which is a known Yarn bug
(https://issues.apache.org/jira/browse/YARN-3768). That being said, I could not
find an empty parameter in my debug logging. Weird.
I'll close this for now, since it does not seem to be the case that my
reported issue is a bug.
> ArrayIndexOutOfBoundsException with empty environment variables
> ---
>
> Key: YARN-3768
> URL: https://issues.apache.org/jira/browse/YARN-3768
> Project: Hadoop YARN
> Issue Type: Bug
> Components: yarn
>Affects Versions: 2.5.0
>Reporter: Joe Ferner
>Assignee: zhihai xu
> Fix For: 2.8.0, 3.0.0-alpha1
>
> Attachments: YARN-3768.000.patch, YARN-3768.001.patch,
> YARN-3768.002.patch, YARN-3768.003.patch, YARN-3768.004.patch
>
>
> Looking at line 80 of org.apache.hadoop.yarn.util.Apps an index out of range
> exception occurs if an environment variable is encountered without a value.
> {code}
> java.lang.ArrayIndexOutOfBoundsException: 1
> at org.apache.hadoop.yarn.util.Apps.setEnvFromInputString(Apps.java:80)
> {code}
> I believe this occurs because java will not return empty strings from the
> split method. Similar to this
> http://stackoverflow.com/questions/14602062/java-string-split-removed-empty-values
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-3768) ArrayIndexOutOfBoundsException with empty environment variables
[
https://issues.apache.org/jira/browse/YARN-3768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14610569#comment-14610569
]
Hudson commented on YARN-3768:
--
SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #243 (See
[https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/243/])
YARN-3768. ArrayIndexOutOfBoundsException with empty environment variables.
(Zhihai Xu via gera) (gera: rev 6f2a41e37d0b36cdafcfff75125165f212c612a6)
*
hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/Shell.java
* hadoop-yarn-project/CHANGES.txt
*
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apache/hadoop/yarn/util/TestApps.java
*
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/Apps.java
> ArrayIndexOutOfBoundsException with empty environment variables
> ---
>
> Key: YARN-3768
> URL: https://issues.apache.org/jira/browse/YARN-3768
> Project: Hadoop YARN
> Issue Type: Bug
> Components: yarn
>Affects Versions: 2.5.0
>Reporter: Joe Ferner
>Assignee: zhihai xu
> Fix For: 2.8.0
>
> Attachments: YARN-3768.000.patch, YARN-3768.001.patch,
> YARN-3768.002.patch, YARN-3768.003.patch, YARN-3768.004.patch
>
>
> Looking at line 80 of org.apache.hadoop.yarn.util.Apps an index out of range
> exception occurs if an environment variable is encountered without a value.
> {code}
> java.lang.ArrayIndexOutOfBoundsException: 1
> at org.apache.hadoop.yarn.util.Apps.setEnvFromInputString(Apps.java:80)
> {code}
> I believe this occurs because java will not return empty strings from the
> split method. Similar to this
> http://stackoverflow.com/questions/14602062/java-string-split-removed-empty-values
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (YARN-3768) ArrayIndexOutOfBoundsException with empty environment variables
[
https://issues.apache.org/jira/browse/YARN-3768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14610538#comment-14610538
]
Hudson commented on YARN-3768:
--
FAILURE: Integrated in Hadoop-Mapreduce-trunk #2191 (See
[https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2191/])
YARN-3768. ArrayIndexOutOfBoundsException with empty environment variables.
(Zhihai Xu via gera) (gera: rev 6f2a41e37d0b36cdafcfff75125165f212c612a6)
*
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apache/hadoop/yarn/util/TestApps.java
* hadoop-yarn-project/CHANGES.txt
*
hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/Shell.java
*
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/Apps.java
> ArrayIndexOutOfBoundsException with empty environment variables
> ---
>
> Key: YARN-3768
> URL: https://issues.apache.org/jira/browse/YARN-3768
> Project: Hadoop YARN
> Issue Type: Bug
> Components: yarn
>Affects Versions: 2.5.0
>Reporter: Joe Ferner
>Assignee: zhihai xu
> Fix For: 2.8.0
>
> Attachments: YARN-3768.000.patch, YARN-3768.001.patch,
> YARN-3768.002.patch, YARN-3768.003.patch, YARN-3768.004.patch
>
>
> Looking at line 80 of org.apache.hadoop.yarn.util.Apps an index out of range
> exception occurs if an environment variable is encountered without a value.
> {code}
> java.lang.ArrayIndexOutOfBoundsException: 1
> at org.apache.hadoop.yarn.util.Apps.setEnvFromInputString(Apps.java:80)
> {code}
> I believe this occurs because java will not return empty strings from the
> split method. Similar to this
> http://stackoverflow.com/questions/14602062/java-string-split-removed-empty-values
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (YARN-3768) ArrayIndexOutOfBoundsException with empty environment variables
[
https://issues.apache.org/jira/browse/YARN-3768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14610373#comment-14610373
]
Hudson commented on YARN-3768:
--
FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #233 (See
[https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/233/])
YARN-3768. ArrayIndexOutOfBoundsException with empty environment variables.
(Zhihai Xu via gera) (gera: rev 6f2a41e37d0b36cdafcfff75125165f212c612a6)
*
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/Apps.java
* hadoop-yarn-project/CHANGES.txt
*
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apache/hadoop/yarn/util/TestApps.java
*
hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/Shell.java
> ArrayIndexOutOfBoundsException with empty environment variables
> ---
>
> Key: YARN-3768
> URL: https://issues.apache.org/jira/browse/YARN-3768
> Project: Hadoop YARN
> Issue Type: Bug
> Components: yarn
>Affects Versions: 2.5.0
>Reporter: Joe Ferner
>Assignee: zhihai xu
> Fix For: 2.8.0
>
> Attachments: YARN-3768.000.patch, YARN-3768.001.patch,
> YARN-3768.002.patch, YARN-3768.003.patch, YARN-3768.004.patch
>
>
> Looking at line 80 of org.apache.hadoop.yarn.util.Apps an index out of range
> exception occurs if an environment variable is encountered without a value.
> {code}
> java.lang.ArrayIndexOutOfBoundsException: 1
> at org.apache.hadoop.yarn.util.Apps.setEnvFromInputString(Apps.java:80)
> {code}
> I believe this occurs because java will not return empty strings from the
> split method. Similar to this
> http://stackoverflow.com/questions/14602062/java-string-split-removed-empty-values
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (YARN-3768) ArrayIndexOutOfBoundsException with empty environment variables
[
https://issues.apache.org/jira/browse/YARN-3768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14610331#comment-14610331
]
Hudson commented on YARN-3768:
--
FAILURE: Integrated in Hadoop-Hdfs-trunk #2172 (See
[https://builds.apache.org/job/Hadoop-Hdfs-trunk/2172/])
YARN-3768. ArrayIndexOutOfBoundsException with empty environment variables.
(Zhihai Xu via gera) (gera: rev 6f2a41e37d0b36cdafcfff75125165f212c612a6)
* hadoop-yarn-project/CHANGES.txt
*
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/Apps.java
*
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apache/hadoop/yarn/util/TestApps.java
*
hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/Shell.java
> ArrayIndexOutOfBoundsException with empty environment variables
> ---
>
> Key: YARN-3768
> URL: https://issues.apache.org/jira/browse/YARN-3768
> Project: Hadoop YARN
> Issue Type: Bug
> Components: yarn
>Affects Versions: 2.5.0
>Reporter: Joe Ferner
>Assignee: zhihai xu
> Fix For: 2.8.0
>
> Attachments: YARN-3768.000.patch, YARN-3768.001.patch,
> YARN-3768.002.patch, YARN-3768.003.patch, YARN-3768.004.patch
>
>
> Looking at line 80 of org.apache.hadoop.yarn.util.Apps an index out of range
> exception occurs if an environment variable is encountered without a value.
> {code}
> java.lang.ArrayIndexOutOfBoundsException: 1
> at org.apache.hadoop.yarn.util.Apps.setEnvFromInputString(Apps.java:80)
> {code}
> I believe this occurs because java will not return empty strings from the
> split method. Similar to this
> http://stackoverflow.com/questions/14602062/java-string-split-removed-empty-values
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (YARN-3768) ArrayIndexOutOfBoundsException with empty environment variables
[
https://issues.apache.org/jira/browse/YARN-3768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14610006#comment-14610006
]
Hudson commented on YARN-3768:
--
SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #245 (See
[https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/245/])
YARN-3768. ArrayIndexOutOfBoundsException with empty environment variables.
(Zhihai Xu via gera) (gera: rev 6f2a41e37d0b36cdafcfff75125165f212c612a6)
*
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apache/hadoop/yarn/util/TestApps.java
*
hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/Shell.java
*
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/Apps.java
* hadoop-yarn-project/CHANGES.txt
> ArrayIndexOutOfBoundsException with empty environment variables
> ---
>
> Key: YARN-3768
> URL: https://issues.apache.org/jira/browse/YARN-3768
> Project: Hadoop YARN
> Issue Type: Bug
> Components: yarn
>Affects Versions: 2.5.0
>Reporter: Joe Ferner
>Assignee: zhihai xu
> Fix For: 2.8.0
>
> Attachments: YARN-3768.000.patch, YARN-3768.001.patch,
> YARN-3768.002.patch, YARN-3768.003.patch, YARN-3768.004.patch
>
>
> Looking at line 80 of org.apache.hadoop.yarn.util.Apps an index out of range
> exception occurs if an environment variable is encountered without a value.
> {code}
> java.lang.ArrayIndexOutOfBoundsException: 1
> at org.apache.hadoop.yarn.util.Apps.setEnvFromInputString(Apps.java:80)
> {code}
> I believe this occurs because java will not return empty strings from the
> split method. Similar to this
> http://stackoverflow.com/questions/14602062/java-string-split-removed-empty-values
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (YARN-3768) ArrayIndexOutOfBoundsException with empty environment variables
[
https://issues.apache.org/jira/browse/YARN-3768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14609990#comment-14609990
]
Hudson commented on YARN-3768:
--
FAILURE: Integrated in Hadoop-Yarn-trunk #975 (See
[https://builds.apache.org/job/Hadoop-Yarn-trunk/975/])
YARN-3768. ArrayIndexOutOfBoundsException with empty environment variables.
(Zhihai Xu via gera) (gera: rev 6f2a41e37d0b36cdafcfff75125165f212c612a6)
*
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apache/hadoop/yarn/util/TestApps.java
*
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/Apps.java
*
hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/Shell.java
* hadoop-yarn-project/CHANGES.txt
> ArrayIndexOutOfBoundsException with empty environment variables
> ---
>
> Key: YARN-3768
> URL: https://issues.apache.org/jira/browse/YARN-3768
> Project: Hadoop YARN
> Issue Type: Bug
> Components: yarn
>Affects Versions: 2.5.0
>Reporter: Joe Ferner
>Assignee: zhihai xu
> Fix For: 2.8.0
>
> Attachments: YARN-3768.000.patch, YARN-3768.001.patch,
> YARN-3768.002.patch, YARN-3768.003.patch, YARN-3768.004.patch
>
>
> Looking at line 80 of org.apache.hadoop.yarn.util.Apps an index out of range
> exception occurs if an environment variable is encountered without a value.
> {code}
> java.lang.ArrayIndexOutOfBoundsException: 1
> at org.apache.hadoop.yarn.util.Apps.setEnvFromInputString(Apps.java:80)
> {code}
> I believe this occurs because java will not return empty strings from the
> split method. Similar to this
> http://stackoverflow.com/questions/14602062/java-string-split-removed-empty-values
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (YARN-3768) ArrayIndexOutOfBoundsException with empty environment variables
[
https://issues.apache.org/jira/browse/YARN-3768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14609234#comment-14609234
]
zhihai xu commented on YARN-3768:
-
thanks [~xgong] for the review! thanks [~jira.shegalov] for the good idea,
review and committing the patch.
> ArrayIndexOutOfBoundsException with empty environment variables
> ---
>
> Key: YARN-3768
> URL: https://issues.apache.org/jira/browse/YARN-3768
> Project: Hadoop YARN
> Issue Type: Bug
> Components: yarn
>Affects Versions: 2.5.0
>Reporter: Joe Ferner
>Assignee: zhihai xu
> Fix For: 2.8.0
>
> Attachments: YARN-3768.000.patch, YARN-3768.001.patch,
> YARN-3768.002.patch, YARN-3768.003.patch, YARN-3768.004.patch
>
>
> Looking at line 80 of org.apache.hadoop.yarn.util.Apps an index out of range
> exception occurs if an environment variable is encountered without a value.
> {code}
> java.lang.ArrayIndexOutOfBoundsException: 1
> at org.apache.hadoop.yarn.util.Apps.setEnvFromInputString(Apps.java:80)
> {code}
> I believe this occurs because java will not return empty strings from the
> split method. Similar to this
> http://stackoverflow.com/questions/14602062/java-string-split-removed-empty-values
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (YARN-3768) ArrayIndexOutOfBoundsException with empty environment variables
[
https://issues.apache.org/jira/browse/YARN-3768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14609191#comment-14609191
]
Hudson commented on YARN-3768:
--
FAILURE: Integrated in Hadoop-trunk-Commit #8097 (See
[https://builds.apache.org/job/Hadoop-trunk-Commit/8097/])
YARN-3768. ArrayIndexOutOfBoundsException with empty environment variables.
(Zhihai Xu via gera) (gera: rev 6f2a41e37d0b36cdafcfff75125165f212c612a6)
*
hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/Shell.java
* hadoop-yarn-project/CHANGES.txt
*
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apache/hadoop/yarn/util/TestApps.java
*
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/Apps.java
> ArrayIndexOutOfBoundsException with empty environment variables
> ---
>
> Key: YARN-3768
> URL: https://issues.apache.org/jira/browse/YARN-3768
> Project: Hadoop YARN
> Issue Type: Bug
> Components: yarn
>Affects Versions: 2.5.0
>Reporter: Joe Ferner
>Assignee: zhihai xu
> Fix For: 2.8.0
>
> Attachments: YARN-3768.000.patch, YARN-3768.001.patch,
> YARN-3768.002.patch, YARN-3768.003.patch, YARN-3768.004.patch
>
>
> Looking at line 80 of org.apache.hadoop.yarn.util.Apps an index out of range
> exception occurs if an environment variable is encountered without a value.
> {code}
> java.lang.ArrayIndexOutOfBoundsException: 1
> at org.apache.hadoop.yarn.util.Apps.setEnvFromInputString(Apps.java:80)
> {code}
> I believe this occurs because java will not return empty strings from the
> split method. Similar to this
> http://stackoverflow.com/questions/14602062/java-string-split-removed-empty-values
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
