[jira] [Comment Edited] (FLINK-16052) Homebrew test failed with 1.10.0 dist package
[
https://issues.apache.org/jira/browse/FLINK-16052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17037023#comment-17037023
]
Yu Li edited comment on FLINK-16052 at 2/14/20 3:13 PM:
Thanks for the investigation [~xintongsong] and [~karmagyz].
I checked the commit history and confirmed this new `bash-java-utils.jar` under
`bin` directory was introduced by FLINK-15519 on purpose, and I agree the right
way to fix this is to copy the jar file back to `bin` directory after
`env_script_all_files` is executed. (the `env_script_all_files` action is
necessary to make sure all scripts executed with the proper JAVA_HOME).
I've prepared a new [PR|https://github.com/Homebrew/homebrew-core/pull/50240]
on `apache-flink.rb` for Homebrew, and confirmed `brew test` could pass with
it. Will close the issue here if the new PR is accepted by Homebrew.
was (Author: carp84):
Thanks for the investigation [~xintongsong] and [~karmagyz].
I checked the commit history and confirmed this new `bash-java-utils.jar` under
`bin` directory was introduced by FLINK-15519 on purpose, and I agree the right
way to fix this is to copy the jar file back to `bin` directory after
`env_script_all_files` is executed. (the `env_script_all_files` action is
necessary to make sure all scripts executed with the proper JAVA_HOME).
I've prepared a new PR on `apache-flink.rb` for Homebrew, and confirmed `brew
test` could pass with it. Will close the issue here if the new PR is accepted
by Homebrew.
> Homebrew test failed with 1.10.0 dist package
> -
>
> Key: FLINK-16052
> URL: https://issues.apache.org/jira/browse/FLINK-16052
> Project: Flink
> Issue Type: Bug
> Components: Deployment / Scripts
>Affects Versions: 1.10.0
>Reporter: Yu Li
>Priority: Major
> Fix For: 1.10.1, 1.11.0
>
>
> After updating the Homebrew formula to 1.10.0 (in {{$(brew --repository
> homebrew/core)}} directory) with patch of this
> [PR|https://github.com/Homebrew/homebrew-core/pull/50110], executing `brew
> install --build-from-source Formula/apache-flink.rb` and then `brew test
> Formula/apache-flink.rb`, we could see below error:
> {code:java}
> [ERROR] Unexpected result: Error: Could not find or load main class
> org.apache.flink.runtime.util.BashJavaUtils
> [ERROR] The last line of the BashJavaUtils outputs is expected to be the
> execution result, following the prefix 'BASH_JAVA_UTILS_EXEC_RESULT:'
> Picked up _JAVA_OPTIONS:
> -Djava.io.tmpdir=/private/tmp/apache-flink-test-20200214-33361-1jotper
> -Duser.home=/Users/jueding/Library/Caches/Homebrew/java_cache
> Error: Could not find or load main class
> org.apache.flink.runtime.util.BashJavaUtils
> [ERROR] Could not get JVM parameters properly.
> Error: apache-flink: failed
> Failed executing:
> {code}
> After a bisect checking on {{flink-dist/src/main/flink-bin/bin}} changes,
> confirmed the above issue is related to FLINK-15488, but we will see new
> errors like below after reverting FLINK-15488 (and FLINK-15519):
> {code:java}
> ==> /usr/local/Cellar/apache-flink/1.10.0/libexec/bin/start-cluster.sh
> ==> /usr/local/Cellar/apache-flink/1.10.0/bin/flink run -p 1
> /usr/local/Cellar/apache-flink/1.10.0/libexec/examples/streaming/WordCount.jar
> --input input --output result
> Last 15 lines from
> /Users/jueding/Library/Logs/Homebrew/apache-flink/test.02.flink:
> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:592)
> at akka.actor.ActorCell.invoke(ActorCell.scala:561)
> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:258)
> at akka.dispatch.Mailbox.run(Mailbox.scala:225)
> at akka.dispatch.Mailbox.exec(Mailbox.scala:235)
> ... 4 more
> Caused by:
> org.apache.flink.runtime.resourcemanager.exceptions.UnfulfillableSlotRequestException:
> Could not fulfill slot request b7f17c0928112209ae873d089123b1c6. Requested
> resource profile (ResourceProfile{UNKNOWN}) is unfulfillable.
> at
> org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl.lambda$fulfillPendingSlotRequestWithPendingTaskManagerSlot$9(SlotManagerImpl.java:772)
> at
> org.apache.flink.util.OptionalConsumer.ifNotPresent(OptionalConsumer.java:52)
> at
> org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl.fulfillPendingSlotRequestWithPendingTaskManagerSlot(SlotManagerImpl.java:768)
> at
> org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl.lambda$internalRequestSlot$7(SlotManagerImpl.java:755)
> at
> org.apache.flink.util.OptionalConsumer.ifNotPresent(OptionalConsumer.java:52)
> at
> org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl.internalRequestSlot(SlotManagerImpl.java:755)
> at
>
[jira] [Comment Edited] (FLINK-16052) Homebrew test failed with 1.10.0 dist package
[
https://issues.apache.org/jira/browse/FLINK-16052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17036950#comment-17036950
]
Yangze Guo edited comment on FLINK-16052 at 2/14/20 1:02 PM:
-
FYI:
I just install Flink-1.10 by 'brew install --build-from-source'. When I go into
the "/usr/local/Cellar/apache-flink/1.10.0/libexec/libexec", I manually run the
start-cluster.sh and meet the same issue described here. What I figure out is:
* The classpath param pass to the java is
"/usr/local/Cellar/apache-flink/1.10.0/libexec/bin/bash-java-utils.jar:/usr/local/Cellar/apache-flink/1.10.0/libexec/lib/flink-dist_2.11-1.10.0.jar",
it seems bash-java-utils.jar is included.
* I can find the BashJavaUtils.class by running "jar -tf bash-java-utils.jar |
grep BashJavaUtils" in
/usr/local/Cellar/apache-flink/1.10.0/libexec/libexec/bash-java-utils.jar.
However, it seems that the bash-java-utils.jar in "libexec/lib" and
"libexec/libexec" has a different size, 150B vs 490K.
Append: I think I found the root cause. In [this
line|[https://github.com/Homebrew/homebrew-core/blob/116ed56fd92e77c641b64c5caab185005cc5224e/Formula/apache-flink.rb#L16]]
, we using "env_script_all_files" transform(not link) all the files under
"libexec/libexec" to "libexec/lib". However, this method is not suitable for
the jar file. Thus, we could not load the correct bash-java-utils.jar to our
classpath.
To fix it, we may just copy the bash-java-utils.jar to the "libexec/lib"
directory. I'm not familiar with Ruby though.
was (Author: karmagyz):
FYI:
I just install Flink-1.10 by 'brew install --build-from-source'. When I go into
the "/usr/local/Cellar/apache-flink/1.10.0/libexec/libexec", I manually run the
start-cluster.sh and meet the same issue described here. What I figure out is:
* The classpath param pass to the java is
"/usr/local/Cellar/apache-flink/1.10.0/libexec/bin/bash-java-utils.jar:/usr/local/Cellar/apache-flink/1.10.0/libexec/lib/flink-dist_2.11-1.10.0.jar",
it seems bash-java-utils.jar is included.
* I can find the BashJavaUtils.class by running "jar -tf bash-java-utils.jar |
grep BashJavaUtils" in
/usr/local/Cellar/apache-flink/1.10.0/libexec/libexec/bash-java-utils.jar.
However, it seems that the bash-java-utils.jar in "libexec/lib" and
"libexec/libexec" has a different size, 150B vs 490K.
Append: I think I found the root cause. In
[https://github.com/Homebrew/homebrew-core/blob/116ed56fd92e77c641b64c5caab185005cc5224e/Formula/apache-flink.rb#L16]
, we using "env_script_all_files" transform all the files under
"libexec/libexec" to "libexec/lib". However, this method is not suitable for
the jar file. Thus, we could not load the correct bash-java-utils.jar to our
classpath.
To fix it, we may just copy the bash-java-utils.jar to the "libexec/lib"
directory. I'm not familiar with Ruby though.
> Homebrew test failed with 1.10.0 dist package
> -
>
> Key: FLINK-16052
> URL: https://issues.apache.org/jira/browse/FLINK-16052
> Project: Flink
> Issue Type: Bug
> Components: Deployment / Scripts
>Affects Versions: 1.10.0
>Reporter: Yu Li
>Priority: Major
> Fix For: 1.10.1, 1.11.0
>
>
> After updating the Homebrew formula to 1.10.0 (in {{$(brew --repository
> homebrew/core)}} directory) with patch of this
> [PR|https://github.com/Homebrew/homebrew-core/pull/50110], executing `brew
> install --build-from-source Formula/apache-flink.rb` and then `brew test
> Formula/apache-flink.rb`, we could see below error:
> {code:java}
> [ERROR] Unexpected result: Error: Could not find or load main class
> org.apache.flink.runtime.util.BashJavaUtils
> [ERROR] The last line of the BashJavaUtils outputs is expected to be the
> execution result, following the prefix 'BASH_JAVA_UTILS_EXEC_RESULT:'
> Picked up _JAVA_OPTIONS:
> -Djava.io.tmpdir=/private/tmp/apache-flink-test-20200214-33361-1jotper
> -Duser.home=/Users/jueding/Library/Caches/Homebrew/java_cache
> Error: Could not find or load main class
> org.apache.flink.runtime.util.BashJavaUtils
> [ERROR] Could not get JVM parameters properly.
> Error: apache-flink: failed
> Failed executing:
> {code}
> After a bisect checking on {{flink-dist/src/main/flink-bin/bin}} changes,
> confirmed the above issue is related to FLINK-15488, but we will see new
> errors like below after reverting FLINK-15488 (and FLINK-15519):
> {code:java}
> ==> /usr/local/Cellar/apache-flink/1.10.0/libexec/bin/start-cluster.sh
> ==> /usr/local/Cellar/apache-flink/1.10.0/bin/flink run -p 1
> /usr/local/Cellar/apache-flink/1.10.0/libexec/examples/streaming/WordCount.jar
> --input input --output result
> Last 15 lines from
> /Users/jueding/Library/Logs/Homebrew/apache-flink/test.02.flink:
> at
[jira] [Comment Edited] (FLINK-16052) Homebrew test failed with 1.10.0 dist package
[
https://issues.apache.org/jira/browse/FLINK-16052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17036950#comment-17036950
]
Yangze Guo edited comment on FLINK-16052 at 2/14/20 12:59 PM:
--
FYI:
I just install Flink-1.10 by 'brew install --build-from-source'. When I go into
the "/usr/local/Cellar/apache-flink/1.10.0/libexec/libexec", I manually run the
start-cluster.sh and meet the same issue described here. What I figure out is:
* The classpath param pass to the java is
"/usr/local/Cellar/apache-flink/1.10.0/libexec/bin/bash-java-utils.jar:/usr/local/Cellar/apache-flink/1.10.0/libexec/lib/flink-dist_2.11-1.10.0.jar",
it seems bash-java-utils.jar is included.
* I can find the BashJavaUtils.class by running "jar -tf bash-java-utils.jar |
grep BashJavaUtils" in
/usr/local/Cellar/apache-flink/1.10.0/libexec/libexec/bash-java-utils.jar.
However, it seems that the bash-java-utils.jar in "libexec/lib" and
"libexec/libexec" has a different size, 150B vs 490K.
Append: I think I found the root cause. In
[https://github.com/Homebrew/homebrew-core/blob/116ed56fd92e77c641b64c5caab185005cc5224e/Formula/apache-flink.rb#L16]
, we using "env_script_all_files" transform all the files under
"libexec/libexec" to "libexec/lib". However, this method is not suitable for
the jar file. Thus, we could not load the correct bash-java-utils.jar to our
classpath.
To fix it, we may just copy the bash-java-utils.jar to the "libexec/lib"
directory. I'm not familiar with Ruby though.
was (Author: karmagyz):
FYI:
I just install Flink-1.10 by 'brew install --build-from-source'. When I go into
the "/usr/local/Cellar/apache-flink/1.10.0/libexec/libexec", I manually run the
start-cluster.sh and meet the same issue described here. What I figure out is:
* The classpath param pass to the java is
"/usr/local/Cellar/apache-flink/1.10.0/libexec/bin/bash-java-utils.jar:/usr/local/Cellar/apache-flink/1.10.0/libexec/lib/flink-dist_2.11-1.10.0.jar",
it seems bash-java-utils.jar is included.
* I can find the BashJavaUtils.class by running "jar -tf bash-java-utils.jar |
grep BashJavaUtils" in
/usr/local/Cellar/apache-flink/1.10.0/libexec/libexec/bash-java-utils.jar.
However, it seems that the bash-java-utils.jar in "libexec/lib" and
"libexec/libexec" has a different size, 150B vs 490K.
> Homebrew test failed with 1.10.0 dist package
> -
>
> Key: FLINK-16052
> URL: https://issues.apache.org/jira/browse/FLINK-16052
> Project: Flink
> Issue Type: Bug
> Components: Deployment / Scripts
>Affects Versions: 1.10.0
>Reporter: Yu Li
>Priority: Major
> Fix For: 1.10.1, 1.11.0
>
>
> After updating the Homebrew formula to 1.10.0 (in {{$(brew --repository
> homebrew/core)}} directory) with patch of this
> [PR|https://github.com/Homebrew/homebrew-core/pull/50110], executing `brew
> install --build-from-source Formula/apache-flink.rb` and then `brew test
> Formula/apache-flink.rb`, we could see below error:
> {code:java}
> [ERROR] Unexpected result: Error: Could not find or load main class
> org.apache.flink.runtime.util.BashJavaUtils
> [ERROR] The last line of the BashJavaUtils outputs is expected to be the
> execution result, following the prefix 'BASH_JAVA_UTILS_EXEC_RESULT:'
> Picked up _JAVA_OPTIONS:
> -Djava.io.tmpdir=/private/tmp/apache-flink-test-20200214-33361-1jotper
> -Duser.home=/Users/jueding/Library/Caches/Homebrew/java_cache
> Error: Could not find or load main class
> org.apache.flink.runtime.util.BashJavaUtils
> [ERROR] Could not get JVM parameters properly.
> Error: apache-flink: failed
> Failed executing:
> {code}
> After a bisect checking on {{flink-dist/src/main/flink-bin/bin}} changes,
> confirmed the above issue is related to FLINK-15488, but we will see new
> errors like below after reverting FLINK-15488 (and FLINK-15519):
> {code:java}
> ==> /usr/local/Cellar/apache-flink/1.10.0/libexec/bin/start-cluster.sh
> ==> /usr/local/Cellar/apache-flink/1.10.0/bin/flink run -p 1
> /usr/local/Cellar/apache-flink/1.10.0/libexec/examples/streaming/WordCount.jar
> --input input --output result
> Last 15 lines from
> /Users/jueding/Library/Logs/Homebrew/apache-flink/test.02.flink:
> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:592)
> at akka.actor.ActorCell.invoke(ActorCell.scala:561)
> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:258)
> at akka.dispatch.Mailbox.run(Mailbox.scala:225)
> at akka.dispatch.Mailbox.exec(Mailbox.scala:235)
> ... 4 more
> Caused by:
> org.apache.flink.runtime.resourcemanager.exceptions.UnfulfillableSlotRequestException:
> Could not fulfill slot request b7f17c0928112209ae873d089123b1c6. Requested
> resource profile (ResourceProfile{UNKNOWN}) is unfulfillable.
> at
>
[jira] [Comment Edited] (FLINK-16052) Homebrew test failed with 1.10.0 dist package
[
https://issues.apache.org/jira/browse/FLINK-16052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17036950#comment-17036950
]
Yangze Guo edited comment on FLINK-16052 at 2/14/20 12:45 PM:
--
FYI:
I just install Flink-1.10 by 'brew install --build-from-source'. When I go into
the "/usr/local/Cellar/apache-flink/1.10.0/libexec/libexec", I manually run the
start-cluster.sh and meet the same issue described here. What I figure out is:
* The classpath param pass to the java is
"/usr/local/Cellar/apache-flink/1.10.0/libexec/bin/bash-java-utils.jar:/usr/local/Cellar/apache-flink/1.10.0/libexec/lib/flink-dist_2.11-1.10.0.jar",
it seems bash-java-utils.jar is included.
* I can find the BashJavaUtils.class by running "jar -tf bash-java-utils.jar |
grep BashJavaUtils" in
/usr/local/Cellar/apache-flink/1.10.0/libexec/libexec/bash-java-utils.jar.
However, it seems that the bash-java-utils.jar in "libexec/lib" and
"libexec/libexec" has a different size, 150B vs 490K.
was (Author: karmagyz):
FYI:
I just install Flink-1.10 by 'brew install --build-from-source'. When I go into
the "/usr/local/Cellar/apache-flink/1.10.0/libexec/libexec", I manually run the
start-cluster.sh and meet the same issue described here. What I figure out is:
* The classpath param pass to the java is
"/usr/local/Cellar/apache-flink/1.10.0/libexec/bin/bash-java-utils.jar:/usr/local/Cellar/apache-flink/1.10.0/libexec/lib/flink-dist_2.11-1.10.0.jar",
it seems bash-java-utils.jar is included.
* I can find the BashJavaUtils.class by running "jar -tf bash-java-utils.jar |
grep BashJavaUtils".
> Homebrew test failed with 1.10.0 dist package
> -
>
> Key: FLINK-16052
> URL: https://issues.apache.org/jira/browse/FLINK-16052
> Project: Flink
> Issue Type: Bug
> Components: Deployment / Scripts
>Affects Versions: 1.10.0
>Reporter: Yu Li
>Priority: Major
> Fix For: 1.10.1, 1.11.0
>
>
> After updating the Homebrew formula to 1.10.0 (in {{$(brew --repository
> homebrew/core)}} directory) with patch of this
> [PR|https://github.com/Homebrew/homebrew-core/pull/50110], executing `brew
> install --build-from-source Formula/apache-flink.rb` and then `brew test
> Formula/apache-flink.rb`, we could see below error:
> {code:java}
> [ERROR] Unexpected result: Error: Could not find or load main class
> org.apache.flink.runtime.util.BashJavaUtils
> [ERROR] The last line of the BashJavaUtils outputs is expected to be the
> execution result, following the prefix 'BASH_JAVA_UTILS_EXEC_RESULT:'
> Picked up _JAVA_OPTIONS:
> -Djava.io.tmpdir=/private/tmp/apache-flink-test-20200214-33361-1jotper
> -Duser.home=/Users/jueding/Library/Caches/Homebrew/java_cache
> Error: Could not find or load main class
> org.apache.flink.runtime.util.BashJavaUtils
> [ERROR] Could not get JVM parameters properly.
> Error: apache-flink: failed
> Failed executing:
> {code}
> After a bisect checking on {{flink-dist/src/main/flink-bin/bin}} changes,
> confirmed the above issue is related to FLINK-15488, but we will see new
> errors like below after reverting FLINK-15488 (and FLINK-15519):
> {code:java}
> ==> /usr/local/Cellar/apache-flink/1.10.0/libexec/bin/start-cluster.sh
> ==> /usr/local/Cellar/apache-flink/1.10.0/bin/flink run -p 1
> /usr/local/Cellar/apache-flink/1.10.0/libexec/examples/streaming/WordCount.jar
> --input input --output result
> Last 15 lines from
> /Users/jueding/Library/Logs/Homebrew/apache-flink/test.02.flink:
> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:592)
> at akka.actor.ActorCell.invoke(ActorCell.scala:561)
> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:258)
> at akka.dispatch.Mailbox.run(Mailbox.scala:225)
> at akka.dispatch.Mailbox.exec(Mailbox.scala:235)
> ... 4 more
> Caused by:
> org.apache.flink.runtime.resourcemanager.exceptions.UnfulfillableSlotRequestException:
> Could not fulfill slot request b7f17c0928112209ae873d089123b1c6. Requested
> resource profile (ResourceProfile{UNKNOWN}) is unfulfillable.
> at
> org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl.lambda$fulfillPendingSlotRequestWithPendingTaskManagerSlot$9(SlotManagerImpl.java:772)
> at
> org.apache.flink.util.OptionalConsumer.ifNotPresent(OptionalConsumer.java:52)
> at
> org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl.fulfillPendingSlotRequestWithPendingTaskManagerSlot(SlotManagerImpl.java:768)
> at
> org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl.lambda$internalRequestSlot$7(SlotManagerImpl.java:755)
> at
> org.apache.flink.util.OptionalConsumer.ifNotPresent(OptionalConsumer.java:52)
> at
>
[jira] [Comment Edited] (FLINK-16052) Homebrew test failed with 1.10.0 dist package
[
https://issues.apache.org/jira/browse/FLINK-16052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17036923#comment-17036923
]
Xintong Song edited comment on FLINK-16052 at 2/14/20 11:23 AM:
I think reverting FLINK-15519 does not fix the problem that `BashJavaUtils` is
not found. FLINK-15519 introduced checks on the execution result of
`BashJavaUtils`, and will fail early if it is not executed successfully.
Without this check, a task executor may failed being launched silently.
That explains the `UnfulfillableSlotRequestException`. For a standalone
cluster, RM leaves a start-up period to allow TMs register to it and report the
slots. After this period, if a slot request still cannot be satisfied by any of
the registered slot, the exception will be thrown. That means, if no TM is
successfully launched and registered, you will see the
`UnfulfillableSlotRequestException`.
was (Author: xintongsong):
I think reverting FLINK-15519 does not fixe the problem that `BashJavaUtils` is
not found. FLINK-15519 introduces checks on execution result of
`BashJavaUtils`, and will fail early if it is not executed successfully.
Without this check, a task executor may failed being launched silently.
That makes `UnfulfillableSlotRequestException` kind of expected. For a
standalone cluster, RM leaves a start-up period to allow TMs register to it and
report the slots. After this period, if a slot request still cannot be
satisfied by any of the registered slot, the exception will be thrown. That
means, if no TM is successfully launched and registered, you will see the
`UnfulfillableSlotRequestException`.
> Homebrew test failed with 1.10.0 dist package
> -
>
> Key: FLINK-16052
> URL: https://issues.apache.org/jira/browse/FLINK-16052
> Project: Flink
> Issue Type: Bug
> Components: Deployment / Scripts
>Affects Versions: 1.10.0
>Reporter: Yu Li
>Priority: Major
> Fix For: 1.10.1, 1.11.0
>
>
> After updating the Homebrew formula to 1.10.0 (in {{$(brew --repository
> homebrew/core)}} directory) with patch of this
> [PR|https://github.com/Homebrew/homebrew-core/pull/50110], executing `brew
> install --build-from-source Formula/apache-flink.rb` and then `brew test
> Formula/apache-flink.rb`, we could see below error:
> {code:java}
> [ERROR] Unexpected result: Error: Could not find or load main class
> org.apache.flink.runtime.util.BashJavaUtils
> [ERROR] The last line of the BashJavaUtils outputs is expected to be the
> execution result, following the prefix 'BASH_JAVA_UTILS_EXEC_RESULT:'
> Picked up _JAVA_OPTIONS:
> -Djava.io.tmpdir=/private/tmp/apache-flink-test-20200214-33361-1jotper
> -Duser.home=/Users/jueding/Library/Caches/Homebrew/java_cache
> Error: Could not find or load main class
> org.apache.flink.runtime.util.BashJavaUtils
> [ERROR] Could not get JVM parameters properly.
> Error: apache-flink: failed
> Failed executing:
> {code}
> After a bisect checking on {{flink-dist/src/main/flink-bin/bin}} changes,
> confirmed the above issue is related to FLINK-15488, but we will see new
> errors like below after reverting FLINK-15488 (and FLINK-15519):
> {code:java}
> ==> /usr/local/Cellar/apache-flink/1.10.0/libexec/bin/start-cluster.sh
> ==> /usr/local/Cellar/apache-flink/1.10.0/bin/flink run -p 1
> /usr/local/Cellar/apache-flink/1.10.0/libexec/examples/streaming/WordCount.jar
> --input input --output result
> Last 15 lines from
> /Users/jueding/Library/Logs/Homebrew/apache-flink/test.02.flink:
> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:592)
> at akka.actor.ActorCell.invoke(ActorCell.scala:561)
> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:258)
> at akka.dispatch.Mailbox.run(Mailbox.scala:225)
> at akka.dispatch.Mailbox.exec(Mailbox.scala:235)
> ... 4 more
> Caused by:
> org.apache.flink.runtime.resourcemanager.exceptions.UnfulfillableSlotRequestException:
> Could not fulfill slot request b7f17c0928112209ae873d089123b1c6. Requested
> resource profile (ResourceProfile{UNKNOWN}) is unfulfillable.
> at
> org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl.lambda$fulfillPendingSlotRequestWithPendingTaskManagerSlot$9(SlotManagerImpl.java:772)
> at
> org.apache.flink.util.OptionalConsumer.ifNotPresent(OptionalConsumer.java:52)
> at
> org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl.fulfillPendingSlotRequestWithPendingTaskManagerSlot(SlotManagerImpl.java:768)
> at
> org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl.lambda$internalRequestSlot$7(SlotManagerImpl.java:755)
> at
> org.apache.flink.util.OptionalConsumer.ifNotPresent(OptionalConsumer.java:52)
> at
>
[jira] [Comment Edited] (FLINK-16052) Homebrew test failed with 1.10.0 dist package
[
https://issues.apache.org/jira/browse/FLINK-16052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17036857#comment-17036857
]
Yu Li edited comment on FLINK-16052 at 2/14/20 10:05 AM:
-
[~xintongsong] `brew test` means Homebrew test, more information refer to [this
doc|https://docs.brew.sh/How-To-Open-a-Homebrew-Pull-Request]. I has nothing to
do with maven test.
The whole story is about installing flink on macOS (or Linux) using Homebrew,
and making sure it could launch successfully. More information please refer to
Homebrew official website [here|https://brew.sh/].
Adding you into the loop because of the second issue after the BashJavaUtils
loading problem resolved:
{code:java}
Caused by:
org.apache.flink.runtime.resourcemanager.exceptions.UnfulfillableSlotRequestException:
Could not fulfill slot request b7f17c0928112209ae873d089123b1c6. Requested
resource profile (ResourceProfile{UNKNOWN}) is unfulfillable.
{code}
was (Author: carp84):
[~xintongsong] `brew test` means Homebrew test, more information refer to [this
doc|https://docs.brew.sh/How-To-Open-a-Homebrew-Pull-Request]. I has nothing to
do with maven test.
The whole story is about installing a flink standalone session on macOS (or
Linux) using Homebrew. More information please refer to Homebrew official
website [here|https://brew.sh/].
Adding you into the loop because of the second issue after the BashJavaUtils
loading problem resolved:
{code}
Caused by:
org.apache.flink.runtime.resourcemanager.exceptions.UnfulfillableSlotRequestException:
Could not fulfill slot request b7f17c0928112209ae873d089123b1c6. Requested
resource profile (ResourceProfile{UNKNOWN}) is unfulfillable.
{code}
> Homebrew test failed with 1.10.0 dist package
> -
>
> Key: FLINK-16052
> URL: https://issues.apache.org/jira/browse/FLINK-16052
> Project: Flink
> Issue Type: Bug
> Components: Deployment / Scripts
>Affects Versions: 1.10.0
>Reporter: Yu Li
>Priority: Major
> Fix For: 1.10.1, 1.11.0
>
>
> After updating the Homebrew formula to 1.10.0 (in {{$(brew --repository
> homebrew/core)}} directory) with patch of this
> [PR|https://github.com/Homebrew/homebrew-core/pull/50110], executing `brew
> install --build-from-source Formula/apache-flink.rb` and then `brew test
> Formula/apache-flink.rb`, we could see below error:
> {code:java}
> [ERROR] Unexpected result: Error: Could not find or load main class
> org.apache.flink.runtime.util.BashJavaUtils
> [ERROR] The last line of the BashJavaUtils outputs is expected to be the
> execution result, following the prefix 'BASH_JAVA_UTILS_EXEC_RESULT:'
> Picked up _JAVA_OPTIONS:
> -Djava.io.tmpdir=/private/tmp/apache-flink-test-20200214-33361-1jotper
> -Duser.home=/Users/jueding/Library/Caches/Homebrew/java_cache
> Error: Could not find or load main class
> org.apache.flink.runtime.util.BashJavaUtils
> [ERROR] Could not get JVM parameters properly.
> Error: apache-flink: failed
> Failed executing:
> {code}
> After a bisect checking on {{flink-dist/src/main/flink-bin/bin}} changes,
> confirmed the above issue is related to FLINK-15488, but we will see new
> errors like below after reverting FLINK-15488 (and FLINK-15519):
> {code:java}
> ==> /usr/local/Cellar/apache-flink/1.10.0/libexec/bin/start-cluster.sh
> ==> /usr/local/Cellar/apache-flink/1.10.0/bin/flink run -p 1
> /usr/local/Cellar/apache-flink/1.10.0/libexec/examples/streaming/WordCount.jar
> --input input --output result
> Last 15 lines from
> /Users/jueding/Library/Logs/Homebrew/apache-flink/test.02.flink:
> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:592)
> at akka.actor.ActorCell.invoke(ActorCell.scala:561)
> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:258)
> at akka.dispatch.Mailbox.run(Mailbox.scala:225)
> at akka.dispatch.Mailbox.exec(Mailbox.scala:235)
> ... 4 more
> Caused by:
> org.apache.flink.runtime.resourcemanager.exceptions.UnfulfillableSlotRequestException:
> Could not fulfill slot request b7f17c0928112209ae873d089123b1c6. Requested
> resource profile (ResourceProfile{UNKNOWN}) is unfulfillable.
> at
> org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl.lambda$fulfillPendingSlotRequestWithPendingTaskManagerSlot$9(SlotManagerImpl.java:772)
> at
> org.apache.flink.util.OptionalConsumer.ifNotPresent(OptionalConsumer.java:52)
> at
> org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl.fulfillPendingSlotRequestWithPendingTaskManagerSlot(SlotManagerImpl.java:768)
> at
> org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl.lambda$internalRequestSlot$7(SlotManagerImpl.java:755)
> at
> org.apache.flink.util.OptionalConsumer.ifNotPresent(OptionalConsumer.java:52)
>
[jira] [Comment Edited] (FLINK-16052) Homebrew test failed with 1.10.0 dist package
[
https://issues.apache.org/jira/browse/FLINK-16052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17036857#comment-17036857
]
Yu Li edited comment on FLINK-16052 at 2/14/20 10:03 AM:
-
[~xintongsong] `brew test` means Homebrew test, more information refer to [this
doc|https://docs.brew.sh/How-To-Open-a-Homebrew-Pull-Request]. I has nothing to
do with maven test.
The whole story is about installing a flink standalone session on macOS (or
Linux) using Homebrew. More information please refer to Homebrew official
website [here|https://brew.sh/].
Adding you into the loop because of the second issue after the BashJavaUtils
loading problem resolved:
{code}
Caused by:
org.apache.flink.runtime.resourcemanager.exceptions.UnfulfillableSlotRequestException:
Could not fulfill slot request b7f17c0928112209ae873d089123b1c6. Requested
resource profile (ResourceProfile{UNKNOWN}) is unfulfillable.
{code}
was (Author: carp84):
[~xintongsong] `brew test` means Homebrew test, more information refer to [this
doc|https://docs.brew.sh/How-To-Open-a-Homebrew-Pull-Request]. I has nothing to
do with maven test.
The whole story is about installing a flink standalone session on macOS (or
Linux) using Homebrew. More information please refer to Homebrew official
website [here|https://brew.sh/].
> Homebrew test failed with 1.10.0 dist package
> -
>
> Key: FLINK-16052
> URL: https://issues.apache.org/jira/browse/FLINK-16052
> Project: Flink
> Issue Type: Bug
> Components: Deployment / Scripts
>Affects Versions: 1.10.0
>Reporter: Yu Li
>Priority: Major
> Fix For: 1.10.1, 1.11.0
>
>
> After updating the Homebrew formula to 1.10.0 (in {{$(brew --repository
> homebrew/core)}} directory) with patch of this
> [PR|https://github.com/Homebrew/homebrew-core/pull/50110], executing `brew
> install --build-from-source Formula/apache-flink.rb` and then `brew test
> Formula/apache-flink.rb`, we could see below error:
> {code:java}
> [ERROR] Unexpected result: Error: Could not find or load main class
> org.apache.flink.runtime.util.BashJavaUtils
> [ERROR] The last line of the BashJavaUtils outputs is expected to be the
> execution result, following the prefix 'BASH_JAVA_UTILS_EXEC_RESULT:'
> Picked up _JAVA_OPTIONS:
> -Djava.io.tmpdir=/private/tmp/apache-flink-test-20200214-33361-1jotper
> -Duser.home=/Users/jueding/Library/Caches/Homebrew/java_cache
> Error: Could not find or load main class
> org.apache.flink.runtime.util.BashJavaUtils
> [ERROR] Could not get JVM parameters properly.
> Error: apache-flink: failed
> Failed executing:
> {code}
> After a bisect checking on {{flink-dist/src/main/flink-bin/bin}} changes,
> confirmed the above issue is related to FLINK-15488, but we will see new
> errors like below after reverting FLINK-15488 (and FLINK-15519):
> {code:java}
> ==> /usr/local/Cellar/apache-flink/1.10.0/libexec/bin/start-cluster.sh
> ==> /usr/local/Cellar/apache-flink/1.10.0/bin/flink run -p 1
> /usr/local/Cellar/apache-flink/1.10.0/libexec/examples/streaming/WordCount.jar
> --input input --output result
> Last 15 lines from
> /Users/jueding/Library/Logs/Homebrew/apache-flink/test.02.flink:
> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:592)
> at akka.actor.ActorCell.invoke(ActorCell.scala:561)
> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:258)
> at akka.dispatch.Mailbox.run(Mailbox.scala:225)
> at akka.dispatch.Mailbox.exec(Mailbox.scala:235)
> ... 4 more
> Caused by:
> org.apache.flink.runtime.resourcemanager.exceptions.UnfulfillableSlotRequestException:
> Could not fulfill slot request b7f17c0928112209ae873d089123b1c6. Requested
> resource profile (ResourceProfile{UNKNOWN}) is unfulfillable.
> at
> org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl.lambda$fulfillPendingSlotRequestWithPendingTaskManagerSlot$9(SlotManagerImpl.java:772)
> at
> org.apache.flink.util.OptionalConsumer.ifNotPresent(OptionalConsumer.java:52)
> at
> org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl.fulfillPendingSlotRequestWithPendingTaskManagerSlot(SlotManagerImpl.java:768)
> at
> org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl.lambda$internalRequestSlot$7(SlotManagerImpl.java:755)
> at
> org.apache.flink.util.OptionalConsumer.ifNotPresent(OptionalConsumer.java:52)
> at
> org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl.internalRequestSlot(SlotManagerImpl.java:755)
> at
> org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl.registerSlotRequest(SlotManagerImpl.java:314)
> ... 27 more
> Error: apache-flink: failed
> Failed executing:
> {code}
--
This message was sent by Atlassian Jira
