[jira] [Resolved] (MAPREDUCE-7385) impove JobEndNotifier#httpNotification With recommended methods
[
https://issues.apache.org/jira/browse/MAPREDUCE-7385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ayush Saxena resolved MAPREDUCE-7385.
-
Fix Version/s: 3.4.0
Hadoop Flags: Reviewed
Resolution: Fixed
> impove JobEndNotifier#httpNotification With recommended methods
> ---
>
> Key: MAPREDUCE-7385
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7385
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
>Reporter: fanshilun
>Assignee: fanshilun
>Priority: Minor
> Labels: pull-request-available
> Fix For: 3.4.0
>
> Time Spent: 2h 50m
> Remaining Estimate: 0h
>
> JobEndNotifier#httpNotification's DefaultHttpClient has been Deprecated, use
> the recommended method instead
> JobEndNotifier#httpNotification
> {code:java}
> private static int httpNotification(String uri, int timeout)
> throws IOException, URISyntaxException {
> DefaultHttpClient client = new DefaultHttpClient();
> client.getParams()
> .setIntParameter(CoreConnectionPNames.SO_TIMEOUT, timeout)
> .setLongParameter(ClientPNames.CONN_MANAGER_TIMEOUT, (long) timeout);
> HttpGet httpGet = new HttpGet(new URI(uri));
> httpGet.setHeader("Accept", "*/*");
> return client.execute(httpGet).getStatusLine().getStatusCode();
> } {code}
> * CoreConnectionPNames.SO_TIMEOUT
> * Use RequestConfig.setSocketTimeout instead
> {code:java}
> Deprecated.Defines the socket timeout (SO_TIMEOUT) in milliseconds, which is
> the timeout for waiting for data or, put differently, a maximum period
> inactivity between two consecutive data packets). A timeout value of zero is
> interpreted as an infinite timeout. {code}
>
> * ClientPNames.CONN_MANAGER_TIMEOUT
> * Use RequestConfig.setConnectionRequestTimeout instead
> {code:java}
> Deprecated. Defines the timeout in milliseconds used when retrieving an
> instance of ManagedClientConnection from the ClientConnectionManager. {code}
>
>
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
-
To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org
[ANNOUNCE] Apache Hadoop 3.3.4 release
On behalf of the Apache Hadoop Project Management Committee, I am pleased to announce the release of Apache Hadoop 3.3.4. --- This is a release of Apache Hadoop 3.3 line. It contains a small number of security and critical integration fixes since 3.3.3. Users of Apache Hadoop 3.3.3 should upgrade to this release. Users of hadoop 2.x and hadoop 3.2 should also upgrade to the 3.3.x line. As well as feature enhancements, this is the sole branch currently receiving fixes for anything other than critical security/data integrity issues. Users are encouraged to read the [overview of major changes][1] since release 3.3.3. For details of bug fixes, improvements, and other enhancements since the previous 3.3.3 release, please check [release notes][2] and [changelog][3]. [1]: http://hadoop.apache.org/docs/r3.3.4/index.html [2]: http://hadoop.apache.org/docs/r3.3.4/hadoop-project-dist/hadoop-common/release/3.3.4/RELEASENOTES.3.3.4.html [3]: http://hadoop.apache.org/docs/r3.3.4/hadoop-project-dist/hadoop-common/release/3.3.4/CHANGELOG.3.3.4.html Many thanks to everyone who helped in this release by supplying patches, reviewing them, helping get this release building and testing and reviewing the final artifacts. -Steve
Re: [VOTE] Release Apache Hadoop 3.3.4
thanks. the release is up for download as is the site; i will do the announcement now. also automated a lot more of the work of doing the release, inc testing across projects https://github.com/steveloughran/validate-hadoop-client-artifacts On Thu, 4 Aug 2022 at 19:08, Stack wrote: > +1 (Sorry, took me a while) > > Ran: ./dev-support/hadoop-vote.sh --source > https://dist.apache.org/repos/dist/dev/hadoop/hadoop-3.3.4-RC1/ > > * Signature: ok > > * Checksum : failed > > * Rat check (17.0.1): ok > > - mvn clean apache-rat:check > > * Built from source (17.0.1): ok > > - mvn clean install -DskipTests > > * Built tar from source (17.0.1): ok > > - mvn clean package -Pdist -DskipTests -Dtar > -Dmaven.javadoc.skip=true > > Took a look at website. Home page says stuff like, “ARM Support: This is > the first release to support ARM architectures.“, which I don’t think is > true of 3.3.4 but otherwise, looks fine. > > Only played with HDFS. UIs looked right. > > Deployed to ten node arm64 cluster. Ran the hbase verification job on top > of it and all passed. Did some kills, stuff came back. > > I didn't spend time on unit tests but one set passed on a local rig here: > > [image: image.png] > Stack > > On Fri, Jul 29, 2022 at 11:48 AM Steve Loughran > wrote: > >> I have put together a release candidate (RC1) for Hadoop 3.3.4 >> >> The RC is available at: >> https://dist.apache.org/repos/dist/dev/hadoop/hadoop-3.3.4-RC1/ >> >> The git tag is release-3.3.4-RC1, commit a585a73c3e0 >> >> The maven artifacts are staged at >> https://repository.apache.org/content/repositories/orgapachehadoop-1358/ >> >> You can find my public key at: >> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS >> >> Change log >> >> https://dist.apache.org/repos/dist/dev/hadoop/hadoop-3.3.4-RC1/CHANGELOG.md >> >> Release notes >> >> https://dist.apache.org/repos/dist/dev/hadoop/hadoop-3.3.4-RC1/RELEASENOTES.md >> >> There's a very small number of changes, primarily critical code/packaging >> issues and security fixes. >> >> See the release notes for details. >> >> Please try the release and vote. The vote will run for 5 days. >> >> steve >> >
Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86_64
For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/946/ [Aug 7, 2022, 7:15:47 AM] (noreply) YARN-10793. Upgrade Junit from 4 to 5 in hadoop-yarn-server-applicationhistoryservice (#4603) [Aug 7, 2022, 9:05:39 PM] (noreply) HADOOP-18387. Fix incorrect placeholder in hadoop-common (#4679). Contributed by fanshilun. - To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org
Apache Hadoop qbt Report: branch-2.10+JDK7 on Linux/x86_64
For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/747/ No changes -1 overall The following subsystems voted -1: asflicense hadolint mvnsite pathlen unit The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck whitespace The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: Failed junit tests : hadoop.fs.TestTrash hadoop.fs.TestFileUtil hadoop.hdfs.server.namenode.TestNameNodeHttpServerXFrame hadoop.hdfs.qjournal.server.TestJournalNodeRespectsBindHostKeys hadoop.hdfs.server.blockmanagement.TestReplicationPolicyWithUpgradeDomain hadoop.contrib.bkjournal.TestBookKeeperHACheckpoints hadoop.contrib.bkjournal.TestBookKeeperHACheckpoints hadoop.hdfs.server.federation.router.TestRouterNamenodeHeartbeat hadoop.hdfs.server.federation.router.TestRouterQuota hadoop.hdfs.server.federation.resolver.TestMultipleDestinationResolver hadoop.hdfs.server.federation.resolver.order.TestLocalResolver hadoop.yarn.server.nodemanager.containermanager.linux.resources.TestNumaResourceAllocator hadoop.yarn.server.nodemanager.containermanager.linux.resources.TestNumaResourceHandlerImpl hadoop.yarn.server.resourcemanager.TestClientRMService hadoop.yarn.server.resourcemanager.monitor.invariants.TestMetricsInvariantChecker hadoop.mapreduce.jobhistory.TestHistoryViewerPrinter hadoop.mapreduce.lib.input.TestLineRecordReader hadoop.mapred.TestLineRecordReader hadoop.tools.TestDistCpSystem hadoop.yarn.sls.TestSLSRunner hadoop.resourceestimator.solver.impl.TestLpSolver hadoop.resourceestimator.service.TestResourceEstimatorService cc: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/747/artifact/out/diff-compile-cc-root.txt [4.0K] javac: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/747/artifact/out/diff-compile-javac-root.txt [488K] checkstyle: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/747/artifact/out/diff-checkstyle-root.txt [14M] hadolint: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/747/artifact/out/diff-patch-hadolint.txt [4.0K] mvnsite: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/747/artifact/out/patch-mvnsite-root.txt [572K] pathlen: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/747/artifact/out/pathlen.txt [12K] pylint: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/747/artifact/out/diff-patch-pylint.txt [20K] shellcheck: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/747/artifact/out/diff-patch-shellcheck.txt [72K] whitespace: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/747/artifact/out/whitespace-eol.txt [12M] https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/747/artifact/out/whitespace-tabs.txt [1.3M] javadoc: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/747/artifact/out/patch-javadoc-root.txt [40K] unit: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/747/artifact/out/patch-unit-hadoop-common-project_hadoop-common.txt [224K] https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/747/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt [432K] https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/747/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs_src_contrib_bkjournal.txt [16K] https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/747/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs-rbf.txt [36K] https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/747/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-common.txt [20K] https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/747/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt [72K] https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/747/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt [116K] https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/747/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-core.txt [104K]
