Apache Hadoop qbt Report: trunk+JDK8 on Windows/x64

[Apache Jenkins Server]

For more details, see https://builds.apache.org/job/hadoop-trunk-win/415/

[Mar 22, 2018 4:21:52 PM] (inigoiri) HDFS-13318. RBF: Fix FindBugs in 
hadoop-hdfs-rbf. Contributed by Ekanth
[Mar 22, 2018 5:21:10 PM] (kihwal) HDFS-13195. DataNode conf page cannot 
display the current value after
[Mar 22, 2018 5:52:02 PM] (arp) HADOOP-15334. Upgrade Maven surefire plugin. 
Contributed by Arpit
[Mar 22, 2018 6:04:37 PM] (yufei) HADOOP-15331. Fix a race condition causing 
parsing error of
[Mar 22, 2018 6:29:31 PM] (weichiu) HDFS-11900. Hedged reads thread pool 
creation not synchronized.
[Mar 22, 2018 8:32:57 PM] (inigoiri) HDFS-12792. RBF: Test Router-based 
federation using HDFSContract.
[Mar 22, 2018 9:09:06 PM] (jitendra) HADOOP-14067. VersionInfo should load 
version-info.properties from its
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-8723. Integrate the build 
infrastructure with hdfs-client.
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-8724. Import third_party 
libraries into the repository. Contributed
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-8725. Use std::chrono to 
implement the timer in the asio library.
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-8737. Initial implementation 
of a Hadoop RPC v9 client. Contributed
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-8745. Use Doxygen to generate 
documents for libhdfspp. Contributed
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-8758. Implement the 
continuation library in libhdfspp. Contributed
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-8759. Implement remote block 
reader in libhdfspp. Contributed by
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-8764. Generate Hadoop RPC 
stubs from protobuf definitions.
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-8788. Implement unit tests for 
remote block reader in libhdfspp.
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-8775. SASL support for data 
transfer protocol in libhdfspp.
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-8774. Implement FileSystem and 
InputStream API for libhdfspp.
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-8952. 
InputStream.PositionRead() should be aware of available DNs.
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-9025. Fix compilation issues 
on arch linux. Contributed by Owen
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-9093. Initialize protobuf 
fields in RemoteBlockReaderTest.
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-9116. Suppress false positives 
from Valgrind on uninitialized
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-9108. 
InputStreamImpl::ReadBlockContinuation stores wrong pointers
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-9095. RPC client should fail 
gracefully when the connection is
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-9207. Move the implementation 
to the hdfs-native-client module.
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-9265. InputStreamImpl should 
hold a shared_ptr of the BlockReader.
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-9288. Import RapidXML 1.13 for 
libhdfspp. Contributed by Bob
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-8766. Implement a libhdfs(3) 
compatible API. Contributed by James
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-9340. libhdfspp fails to 
compile after HDFS-9207. Contributed by
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-9320. libhdfspp should use 
sizeof(int32_t) instead of sizeof(int)
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-9328. Formalize coding 
standards for libhdfs++. Contributed by
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-9419. Import the optional 
library into libhdfs++. Contributed by
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-9408. Build both static and 
dynamic libraries for libhdfspp.
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-9103. Retry reads on DN 
failure. Contributed by James Clampffer.
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-9368. Implement reads with 
implicit offset state in libhdfs++. 
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-9359.  Test libhdfs++ with 
existing libhdfs tests.  Contributed by
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-9117.  Config file reader / 
options classes for libhdfs++. 
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-9452.  libhdfs++ Fix memory 
stomp in OpenFileForRead.  Contributed
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-9448.  Enable valgrind for 
libhdfspp unit tests.  Contributed by
[Mar 22, 2018 9:19:46 PM] (james.clampffer) Revert HDFS-9448.
[Mar 22, 2018 9:19:46 PM] (james.clampffer) HDFS-9144.  Refactoring libhdfs++ 
into stateful/ephemeral objects. 
[Mar 22, 2018 9:19:46 PM] (james.clampffer) HDFS-9497.  move 
lib/proto/cpp_helpers to third-party since it won't
[Mar 22, 2018 9:19:46 PM] (james.clampffer) HDFS-9504.  Initialize 
BadNodeTracker in FileSystemImpl constructor. 
[Mar 22, 2018 9:19:46 PM] (james.clampffer) HDFS-9228.  libhdfs++ should 
respect NN retry configuration settings. 
[Mar 22, 2018 9:19:46 PM] 

[jira] [Created] (YARN-8072) RM log is getting flooded with MemoryPlacementConstraintManager info logs

[Zian Chen (JIRA)]

Zian Chen created YARN-8072:
---

 Summary: RM log is getting flooded with 
MemoryPlacementConstraintManager info logs
 Key: YARN-8072
 URL: https://issues.apache.org/jira/browse/YARN-8072
 Project: Hadoop YARN
  Issue Type: Task
Reporter: Zian Chen
Assignee: Zian Chen


{quote}Below logs are printed every few seconds or so in RM log
 
2018-03-07 05:31:11,858 INFO  constraint.MemoryPlacementConstraintManager 
(MemoryPlacementConstraintManager.java:getConstraint(216)) - Application 
application_1520376039316_0001 is not registered in the Placement Constraint 
Manager.
2018-03-07 05:31:11,858 INFO  constraint.MemoryPlacementConstraintManager 
(MemoryPlacementConstraintManager.java:getConstraint(216)) - Application 
application_1520376039316_0001 is not registered in the Placement Constraint 
Manager.
2018-03-07 05:31:11,858 INFO  constraint.MemoryPlacementConstraintManager 
(MemoryPlacementConstraintManager.java:getConstraint(216)) - Application 
application_1520376039316_0001 is not registered in the Placement Constraint 
Manager.
2018-03-07 05:31:11,859 INFO  constraint.MemoryPlacementConstraintManager 
(MemoryPlacementConstraintManager.java:getConstraint(216)) - Application 
application_1520376039316_0001 is not registered in the Placement Constraint 
Manager.
2018-03-07 05:31:11,859 INFO  constraint.MemoryPlacementConstraintManager 
(MemoryPlacementConstraintManager.java:getConstraint(216)) - Application 
application_1520376039316_0001 is not registered in the Placement Constraint 
Manager.
2018-03-07 05:31:11,859 INFO  constraint.MemoryPlacementConstraintManager 
(MemoryPlacementConstraintManager.java:getConstraint(216)) - Application 
application_1520376039316_0001 is not registered in the Placement Constraint 
Ma{quote}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org

[jira] [Resolved] (YARN-7767) Excessive logging in scheduler

[Zian Chen (JIRA)]

 [ 
https://issues.apache.org/jira/browse/YARN-7767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Zian Chen resolved YARN-7767.
-
Resolution: Fixed

> Excessive logging in scheduler 
> ---
>
> Key: YARN-7767
> URL: https://issues.apache.org/jira/browse/YARN-7767
> Project: Hadoop YARN
>  Issue Type: Bug
>Reporter: Jian He
>Assignee: Zian Chen
>Priority: Major
>
> Below logs are printed every few seconds or so in RM log 
> {code}
> 2018-01-17 21:17:57,076 INFO  
> capacity.QueuePriorityContainerCandidateSelector 
> (QueuePriorityContainerCandidateSelector.java:intializePriorityDigraph(121)) 
> - Initializing priority preemption directed graph:
> 2018-01-17 21:18:12,076 INFO  
> capacity.QueuePriorityContainerCandidateSelector 
> (QueuePriorityContainerCandidateSelector.java:intializePriorityDigraph(121)) 
> - Initializing priority preemption directed graph:
> 2018-01-17 21:18:27,076 INFO  
> capacity.QueuePriorityContainerCandidateSelector 
> (QueuePriorityContainerCandidateSelector.java:intializePriorityDigraph(121)) 
> - Initializing priority preemption directed graph:
> 2018-01-17 21:18:42,077 INFO  
> capacity.QueuePriorityContainerCandidateSelector 
> (QueuePriorityContainerCandidateSelector.java:intializePriorityDigraph(121)) 
> - Initializing priority preemption directed graph:
> 2018-01-17 21:18:57,076 INFO  
> capacity.QueuePriorityContainerCandidateSelector 
> (QueuePriorityContainerCandidateSelector.java:intializePriorityDigraph(121)) 
> - Initializing priority preemption directed graph:
> 2018-01-17 21:19:12,076 INFO  
> capacity.QueuePriorityContainerCandidateSelector 
> (QueuePriorityContainerCandidateSelector.java:intializePriorityDigraph(121)) 
> - Initializing priority preemption directed graph:
> 2018-01-17 21:19:27,076 INFO  
> capacity.QueuePriorityContainerCandidateSelector 
> (QueuePriorityContainerCandidateSelector.java:intializePriorityDigraph(121)) 
> - Initializing priority preemption directed graph:
> 2018-01-17 21:19:42,076 INFO  
> capacity.QueuePriorityContainerCandidateSelector 
> (QueuePriorityContainerCandidateSelector.java:intializePriorityDigraph(121)) 
> - Initializing priority preemption directed graph:
> 2018-01-17 21:19:57,077 INFO  
> capacity.QueuePriorityContainerCandidateSelector 
> (QueuePriorityContainerCandidateSelector.java:intializePriorityDigraph(121)) 
> - Initializing priority preemption directed graph:
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org

[jira] [Created] (YARN-8071) Provide Spark-like API for setting Environment Variables to enable vars with commas

[Jim Brennan (JIRA)]

Jim Brennan created YARN-8071:
-

 Summary: Provide Spark-like API for setting Environment Variables 
to enable vars with commas
 Key: YARN-8071
 URL: https://issues.apache.org/jira/browse/YARN-8071
 Project: Hadoop YARN
  Issue Type: Bug
  Components: yarn
Affects Versions: 3.0.0
Reporter: Jim Brennan
Assignee: Jim Brennan


YARN-6830 describes a problem where environment variables that contain commas 
cannot be specified via {{-Dmapreduce.map.env}}.

For example:

{{-Dmapreduce.map.env="MODE=bar,IMAGE_NAME=foo,MOUNTS=/tmp/foo,/tmp/bar"}}

will set {{MOUNTS}} to {{/tmp/foo}}

In that Jira, [~aw] suggested that we change the API to provide a way to 
specify environment variables individually, the same way that Spark does.
{quote}Rather than fight with a regex why not redefine the API instead?

 

-Dmapreduce.map.env.MODE=bar
 -Dmapreduce.map.env.IMAGE_NAME=foo
 -Dmapreduce.map.env.MOUNTS=/tmp/foo,/tmp/bar

...

e.g, mapreduce.map.env.[foo]=bar gets turned into foo=bar

This greatly simplifies the input validation needed and makes it clear what is 
actually being defined.
{quote}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org

[jira] [Created] (YARN-8070) Yarn Service API site doc broken due to unwanted character in YarnServiceAPI.md

[Gour Saha (JIRA)]

Gour Saha created YARN-8070:
---

 Summary: Yarn Service API site doc broken due to unwanted 
character in YarnServiceAPI.md
 Key: YARN-8070
 URL: https://issues.apache.org/jira/browse/YARN-8070
 Project: Hadoop YARN
  Issue Type: Sub-task
  Components: site
Affects Versions: 3.1.0
Reporter: Gour Saha


The YARN Service API html page is not rendering properly in the yarn site 
documentation due to unnecessary # character in YarnServiceAPI.md. If possible, 
this should be fixed before we release 3.1.0 since it is the first release for 
YARN Service.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org

[jira] [Created] (YARN-8069) Clean up example hostnames

[Billie Rinaldi (JIRA)]

Billie Rinaldi created YARN-8069:


 Summary: Clean up example hostnames
 Key: YARN-8069
 URL: https://issues.apache.org/jira/browse/YARN-8069
 Project: Hadoop YARN
  Issue Type: Sub-task
Reporter: Billie Rinaldi
Assignee: Billie Rinaldi


The hostnames used in the documentation and registry DNS testing could use some 
cleaning up.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org

[jira] [Created] (YARN-8068) Upgrading apps from Hadoop 2.7 based clients to 2.8+ cause NPE in app timeline publish

[Sunil G (JIRA)]

Sunil G created YARN-8068:
-

 Summary: Upgrading apps from Hadoop 2.7 based clients to 2.8+ 
cause NPE in app timeline publish
 Key: YARN-8068
 URL: https://issues.apache.org/jira/browse/YARN-8068
 Project: Hadoop YARN
  Issue Type: Bug
  Components: yarn
Affects Versions: 2.8.3
Reporter: Sunil G
Assignee: Sunil G


[TimelineServiceV1Publisher|eclipse-javadoc:%E2%98%82=hadoop-yarn-server-resourcemanager/src%5C/main%5C/java%3Corg.apache.hadoop.yarn.server.resourcemanager.metrics%7BTimelineServiceV1Publisher.java%E2%98%83TimelineServiceV1Publisher].appCreated
 will cause NPE as we use like below
{code:java}
entityInfo.put(ApplicationMetricsConstants.APPLICATION_PRIORITY_INFO, 
app.getApplicationPriority().getPriority());{code}
We have to handle this case while recovery.

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

[Lei Xu]

Hi, All

Thanks everyone for voting! The vote passes successfully with 6
binding +1s, 7 non-binding +1s and no -1s.

I will work on the staging and releases.

Best,


On Fri, Mar 23, 2018 at 5:10 AM, Kuhu Shukla  wrote:
> +1 (non-binding)
>
> Built from source.
> Installed on a pseudo distributed cluster.
> Ran word count job and basic hdfs commands.
>
> Thank you for the effort on this release.
>
> Regards,
> Kuhu
>
> On Thu, Mar 22, 2018 at 5:25 PM, Elek, Marton  wrote:
>
>>
>> +1 (non binding)
>>
>> I did a full build from source code, created a docker container and did
>> various basic level tests with robotframework based automation and
>> docker-compose based pseudo clusters[1].
>>
>> Including:
>>
>> * Hdfs federation smoke test
>> * Basic ViewFS configuration
>> * Yarn example jobs
>> * Spark example jobs (with and without yarn)
>> * Simple hive table creation
>>
>> Marton
>>
>>
>> [1]: https://github.com/flokkr/runtime-compose
>>
>> On 03/18/2018 05:11 AM, Lei Xu wrote:
>>
>>> Hi, all
>>>
>>> I've created release candidate RC-1 for Apache Hadoop 3.0.1
>>>
>>> Apache Hadoop 3.0.1 will be the first bug fix release for Apache
>>> Hadoop 3.0 release. It includes 49 bug fixes and security fixes, which
>>> include 12
>>> blockers and 17 are critical.
>>>
>>> Please note:
>>> * HDFS-12990. Change default NameNode RPC port back to 8020. It makes
>>> incompatible changes to Hadoop 3.0.0.  After 3.0.1 releases, Apache
>>> Hadoop 3.0.0 will be deprecated due to this change.
>>>
>>> The release page is:
>>> https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0+Release
>>>
>>> New RC is available at: http://home.apache.org/~lei/hadoop-3.0.1-RC1/
>>>
>>> The git tag is release-3.0.1-RC1, and the latest commit is
>>> 496dc57cc2e4f4da117f7a8e3840aaeac0c1d2d0
>>>
>>> The maven artifacts are available at:
>>> https://repository.apache.org/content/repositories/orgapachehadoop-1081/
>>>
>>> Please try the release and vote; the vote will run for the usual 5
>>> days, ending on 3/22/2017 6pm PST time.
>>>
>>> Thanks!
>>>
>>> -
>>> To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
>>> For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
>>>
>>>
>> -
>> To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
>> For additional commands, e-mail: common-dev-h...@hadoop.apache.org
>>
>>



-- 
Lei (Eddy) Xu
Software Engineer, Cloudera

-
To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org

[jira] [Created] (YARN-8067) RM/UI2: queues views ; unintended scrollbars

[Zoltan Haindrich (JIRA)]

Zoltan Haindrich created YARN-8067:
--

 Summary: RM/UI2: queues views ; unintended scrollbars
 Key: YARN-8067
 URL: https://issues.apache.org/jira/browse/YARN-8067
 Project: Hadoop YARN
  Issue Type: Bug
Reporter: Zoltan Haindrich


I've horizontal/vertical scrollbars; they don't seem to be usefull



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org

[jira] [Created] (YARN-8066) RM/UI2: doughnut chart mis-rendering

[Zoltan Haindrich (JIRA)]

Zoltan Haindrich created YARN-8066:
--

 Summary: RM/UI2: doughnut chart mis-rendering
 Key: YARN-8066
 URL: https://issues.apache.org/jira/browse/YARN-8066
 Project: Hadoop YARN
  Issue Type: Bug
  Components: yarn-ui-v2
Reporter: Zoltan Haindrich


on the overview page; 
http://ctr-e138-1518143905142-140659-01-02.hwx.site:8088/ui2/#/cluster-overview

* when there are 2 subqueues to the root (llap and default); 
* the llap queue is running 1 application
* there are no other active application

the doughtut chart is rendered incorrectly...like something have eaten some 
part of it

the same thing can be observed when there are other applications are active 
while watching the animation during refresh - in that case the incorrect 
drawing appears a number of time during animation - but at the end it 
stabilizes as a correct..








--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

[Apache Jenkins Server]

For more details, see 
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/729/

[Mar 22, 2018 4:21:52 PM] (inigoiri) HDFS-13318. RBF: Fix FindBugs in 
hadoop-hdfs-rbf. Contributed by Ekanth
[Mar 22, 2018 5:21:10 PM] (kihwal) HDFS-13195. DataNode conf page cannot 
display the current value after
[Mar 22, 2018 5:52:02 PM] (arp) HADOOP-15334. Upgrade Maven surefire plugin. 
Contributed by Arpit
[Mar 22, 2018 6:04:37 PM] (yufei) HADOOP-15331. Fix a race condition causing 
parsing error of
[Mar 22, 2018 6:29:31 PM] (weichiu) HDFS-11900. Hedged reads thread pool 
creation not synchronized.
[Mar 22, 2018 8:32:57 PM] (inigoiri) HDFS-12792. RBF: Test Router-based 
federation using HDFSContract.
[Mar 22, 2018 9:09:06 PM] (jitendra) HADOOP-14067. VersionInfo should load 
version-info.properties from its
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-8723. Integrate the build 
infrastructure with hdfs-client.
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-8724. Import third_party 
libraries into the repository. Contributed
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-8725. Use std::chrono to 
implement the timer in the asio library.
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-8737. Initial implementation 
of a Hadoop RPC v9 client. Contributed
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-8745. Use Doxygen to generate 
documents for libhdfspp. Contributed
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-8758. Implement the 
continuation library in libhdfspp. Contributed
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-8759. Implement remote block 
reader in libhdfspp. Contributed by
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-8764. Generate Hadoop RPC 
stubs from protobuf definitions.
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-8788. Implement unit tests for 
remote block reader in libhdfspp.
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-8775. SASL support for data 
transfer protocol in libhdfspp.
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-8774. Implement FileSystem and 
InputStream API for libhdfspp.
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-8952. 
InputStream.PositionRead() should be aware of available DNs.
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-9025. Fix compilation issues 
on arch linux. Contributed by Owen
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-9093. Initialize protobuf 
fields in RemoteBlockReaderTest.
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-9116. Suppress false positives 
from Valgrind on uninitialized
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-9108. 
InputStreamImpl::ReadBlockContinuation stores wrong pointers
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-9095. RPC client should fail 
gracefully when the connection is
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-9207. Move the implementation 
to the hdfs-native-client module.
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-9265. InputStreamImpl should 
hold a shared_ptr of the BlockReader.
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-9288. Import RapidXML 1.13 for 
libhdfspp. Contributed by Bob
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-8766. Implement a libhdfs(3) 
compatible API. Contributed by James
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-9340. libhdfspp fails to 
compile after HDFS-9207. Contributed by
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-9320. libhdfspp should use 
sizeof(int32_t) instead of sizeof(int)
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-9328. Formalize coding 
standards for libhdfs++. Contributed by
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-9419. Import the optional 
library into libhdfs++. Contributed by
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-9408. Build both static and 
dynamic libraries for libhdfspp.
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-9103. Retry reads on DN 
failure. Contributed by James Clampffer.
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-9368. Implement reads with 
implicit offset state in libhdfs++. 
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-9359.  Test libhdfs++ with 
existing libhdfs tests.  Contributed by
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-9117.  Config file reader / 
options classes for libhdfs++. 
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-9452.  libhdfs++ Fix memory 
stomp in OpenFileForRead.  Contributed
[Mar 22, 2018 9:19:45 PM] (james.clampffer) HDFS-9448.  Enable valgrind for 
libhdfspp unit tests.  Contributed by
[Mar 22, 2018 9:19:46 PM] (james.clampffer) Revert HDFS-9448.
[Mar 22, 2018 9:19:46 PM] (james.clampffer) HDFS-9144.  Refactoring libhdfs++ 
into stateful/ephemeral objects. 
[Mar 22, 2018 9:19:46 PM] (james.clampffer) HDFS-9497.  move 
lib/proto/cpp_helpers to third-party since it won't
[Mar 22, 2018 9:19:46 PM] (james.clampffer) HDFS-9504.  Initialize 
BadNodeTracker in FileSystemImpl constructor. 
[Mar 22, 2018 9:19:46 PM] (james.clampffer) HDFS-9228.  libhdfs++ should 
respect NN retry configuration settings. 
[Mar 22, 

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

[Kuhu Shukla]

+1 (non-binding)

Built from source.
Installed on a pseudo distributed cluster.
Ran word count job and basic hdfs commands.

Thank you for the effort on this release.

Regards,
Kuhu

On Thu, Mar 22, 2018 at 5:25 PM, Elek, Marton  wrote:

>
> +1 (non binding)
>
> I did a full build from source code, created a docker container and did
> various basic level tests with robotframework based automation and
> docker-compose based pseudo clusters[1].
>
> Including:
>
> * Hdfs federation smoke test
> * Basic ViewFS configuration
> * Yarn example jobs
> * Spark example jobs (with and without yarn)
> * Simple hive table creation
>
> Marton
>
>
> [1]: https://github.com/flokkr/runtime-compose
>
> On 03/18/2018 05:11 AM, Lei Xu wrote:
>
>> Hi, all
>>
>> I've created release candidate RC-1 for Apache Hadoop 3.0.1
>>
>> Apache Hadoop 3.0.1 will be the first bug fix release for Apache
>> Hadoop 3.0 release. It includes 49 bug fixes and security fixes, which
>> include 12
>> blockers and 17 are critical.
>>
>> Please note:
>> * HDFS-12990. Change default NameNode RPC port back to 8020. It makes
>> incompatible changes to Hadoop 3.0.0.  After 3.0.1 releases, Apache
>> Hadoop 3.0.0 will be deprecated due to this change.
>>
>> The release page is:
>> https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0+Release
>>
>> New RC is available at: http://home.apache.org/~lei/hadoop-3.0.1-RC1/
>>
>> The git tag is release-3.0.1-RC1, and the latest commit is
>> 496dc57cc2e4f4da117f7a8e3840aaeac0c1d2d0
>>
>> The maven artifacts are available at:
>> https://repository.apache.org/content/repositories/orgapachehadoop-1081/
>>
>> Please try the release and vote; the vote will run for the usual 5
>> days, ending on 3/22/2017 6pm PST time.
>>
>> Thanks!
>>
>> -
>> To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
>> For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
>>
>>
> -
> To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
> For additional commands, e-mail: common-dev-h...@hadoop.apache.org
>
>

[jira] [Created] (YARN-8065) Application is failing when AM node is stopped

[Bilwa S T (JIRA)]

Bilwa S T created YARN-8065:
---

 Summary: Application is failing when AM node is stopped
 Key: YARN-8065
 URL: https://issues.apache.org/jira/browse/YARN-8065
 Project: Hadoop YARN
  Issue Type: Bug
Reporter: Bilwa S T
Assignee: Bilwa S T
 Fix For: 3.0.0


Configure yarn.scheduler.capacity.schedule-asynchronously.enable as true and 
yarn.resourcemanager.nodemanagers.heartbeat-interval-ms as 6 .

Run application and make AM node down.Application will fail.

 

 

 

 

 
 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org