Rolling out ATS only for tez

Has any one had experience rolling out ATS only for tez execution framework? As it stands, there exists only a single yarn config that enables or disables YarnClient attempting to create a timeline client. If this is turned on in yarn-site.xml, this will enable timeline client for both tez and map

Re: Rolling out ATS only for tez

ml, ideally that should be used. I'm > not > >> sure that's always the case though - and this ends up depending on the > >> order in which Hadoop Configuration handles default-resources. This, I > >> believe, needs to be a TEZ jira to fix the configuration

Re: Branch-0.5

After reading this discussion I found that 'git cherry-pick -x' keeps the original message and appends a cherry-pick message. It may be helpful in remaining consistent. Though I've not experimented with it when hitting a conflict. TEZ-XXX. Original message (cherry picked from commit ecc8192ffa2de

Re: [VOTE] Release Apache Tez 0.5.0 rc2

+1 (non-binding). Verified signatures and checksums. Built from source and successfully ran several examples on a test system On Mon, Sep 1, 2014 at 12:45 AM, Siddharth Seth wrote: > +1 (binding). > > Verified signatures and checksums. > Built from source and successfully ran several examples

Re: [DISCUSS] Creating a branch for TEZ-8

Sounds good to me. Dividing the tasks and getting incremental feedback will allow for a better product faster. On Wed, Sep 10, 2014 at 4:58 PM, Bikas Saha wrote: > Sounds like a plan. Would be good to keep updating the branch from master > for anyone who wants to try the UI while they are develo

Re: [DISCUSS] Creating a branch for TEZ-8

Will do. On Thu, Sep 11, 2014 at 1:31 PM, Hitesh Shah wrote: > Thanks folks. > > @Jonathan, would you like to go ahead and create a branch for TEZ-8? > > thanks > — Hitesh > > > On Sep 11, 2014, at 11:23 AM, Siddharth Seth wrote: > > > Sounds good. Getting the UI work done fast, which will like

Re: [DISCUSS] Creating a branch for TEZ-8

TEZ-8 branch created On Thu, Sep 11, 2014 at 1:50 PM, Jonathan Eagles wrote: > Will do. > > On Thu, Sep 11, 2014 at 1:31 PM, Hitesh Shah wrote: > >> Thanks folks. >> >> @Jonathan, would you like to go ahead and create a branch for TEZ-8? >> >> thanks &

Re: [DISCUSS] Creating a branch for TEZ-8

I am complete agreement with Bikas over the hindrance to users over the lack of a Tez UI. One of the focuses of the 0.5.0 release was the improvement to developers and the stabilization of APIs. Likewise, I would like to suggest one of the charters for the 0.6.0 release be the improvement to users

Re: [DISCUSS] Creating a branch for TEZ-8

As a question of process for feature branches, do JIRAs being checked into feature branches require +1 from committers, +1 from branch committers, or no +1 at all? On Mon, Sep 15, 2014 at 3:04 PM, Jonathan Eagles wrote: > I am complete agreement with Bikas over the hindrance to users over &g

Re: [VOTE] Release Apache Tez 0.5.1 rc0

+1 (non-binding). I was able to verify this build is working successfully. On Sun, Sep 28, 2014 at 9:41 PM, Bikas Saha wrote: > Folks, > > > > I have created an Apache Tez 0.5.1 release candidate (rc0). > > > > This is an incremental release that contains an important fix for API > consistency t

Re: [ANNOUNCE] New Apache Tez Committer - Jeff Zhang

Great work, Jeff! On Oct 16, 2014 6:20 PM, "Jianfeng (Jeff) Zhang" wrote: > Thanks everyone for your help, your comment, review do help me a lot to > get familiar with tez project. I am so excited to become tez committer, > will continue contribute to tez. [?] > > Best Regards, > Jeff Zhang > >

Re: Looking ahead to 0.6

At this point we have all the planned feature work for the first milestone of the Tez UI feature checked into the TEZ-8 branch. At this point, I agree with you it is time to propose to merge these changes back into master. I will start a VOTE thread shortly to get that process moving forward. On T

[VOTE] Merge Tez UI branch TEZ-8 to master

Tez Devs, The Tez community has been working diligently on the Tez UI feature and have reached our first milestone of history server equivalency. At this point, I propose of merge of the TEZ-8 branch back into master in preparation for the upcoming Tez 0.6.0. The vote will be open for at least 72

Re: [VOTE] Merge Tez UI branch TEZ-8 to master

itesh > > On Dec 4, 2014, at 2:13 PM, Jonathan Eagles wrote: > >> Tez Devs, >> >> The Tez community has been working diligently on the Tez UI feature >> and have reached our first milestone of history server equivalency. At >> this point, I propose of merge o

Re: [DISCUSS] What versions of hadoop should we support?

Adding to the discussion. I am using some 2.5 and 2.6 On Wed, Dec 10, 2014 at 8:02 PM, Cheolsoo Park wrote: > We're using EMR 2.4 in production, and it will take a while to upgrade to > 2.6 depending on how fast EMR can provide us 2.6 AMI. But if that's what we > need to fully use Tez-8, we will

Re: Looking ahead to 0.6

As part of the Tez UI feature team, I'd be happy to help as release manager for the Tez 0.6 release. I can start a discussion to help the community voice their thoughts about appropriate content cutoff guidelines and with approximate timelines. Jon

Re: Looking ahead to 0.6

>> Thanks for volunteering Jonathan! Tez 0.6 will be an important release for >> usability. >> >> Bikas >> >> -Original Message- >> From: Jonathan Eagles [mailto:jeag...@gmail.com] >> Sent: Wednesday, December 17, 2014 3:31 PM >> To: dev@tez

Tez branch-0.6 open

Folks, The Tez developers have been hard at work preparing for the upcoming 0.6 release as is evident by the high activity on the mailing lists and JIRA. To that end, I have created Tez branch-0.6 to prepare for the upcoming 0.6.0 release candidate with a stabilizing branch and unblock the 0.7 pat

Tez 0.6.0 Release Prep

Tez Devs, The tez release is within reach with only a handful of blockers and criticals left. http://s.apache.org/tez-0.6.0-blockers Let's spend some time prioritizing this list and resolving the essential issues so that we can begin the process of creating a 0.6.0 release. This will likely sta

Re: [DISCUSS] Pre-commit build emails to dev@

+1. This allows for filtering in email client as well. On Jan 16, 2015 2:05 PM, "Siddharth Seth" wrote: > +1 for moving them over to issues@, or completely getting rid of them - > since the results are posted on jiras in any case, and that would end up > sending out a mail. > > Thanks > - Sid > >

Re: Tez 0.6.0 Release Prep

Heads up. The last of the Tez 0.6.0 blockers has gone in today. I'll be cutting an rc0 tomorrow morning, giving us the rest of the day for last minute changes. Please reach out to me if any issue is found that is worth delaying rc0. Jon On Tue, Jan 6, 2015 at 5:11 PM, Jonathan Eagles

[VOTE] Release Apache Tez-0.6.0 RC0

I have created an tez-0.6.0 release candidate (rc0). GIT source tag https://git-wip-us.apache.org/repos/asf/tez/repo?p=tez.git;a=log;h=refs/tags/release-0.6.0-rc0 Staging site: https://dist.apache.org/repos/dist/dev/tez/tez-0.6.0-src-rc0/ Nexus Staging URL: https://repository.apache.org/content/

Re: Pre-commit checks before committing a patch

Thanks for this effort Hitesh. Very good for the community On Tue, Jan 20, 2015 at 6:23 PM, Hitesh Shah wrote: > A follow-up on the findbugs warnings. From now on, the findbugs counter > should be 0. TEZ-316 tracks all the various issues that need to be fixed to > get to a real 0 value but for

Re: Handling ATS downtime

I just checked this behavior in a secure cluster and if it fails to get a timeline server delegation token or fails to post the domain, the job will fail. We should consider making these operations "best effort" as well. On Jan 21, 2015 5:33 PM, "Hitesh Shah" wrote: > Actually at this time, the

cwiki modify access

Can someone please help me get modify access to the tez wiki site at https://cwiki.apache.org/confluence/display/TEZ? jon

Re: cwiki modify access

jeagles On Fri, Jan 23, 2015 at 3:31 PM, Hitesh Shah wrote: > What is your wiki user id? > > — Hitesh > > On Jan 23, 2015, at 11:10 AM, Jonathan Eagles wrote: > >> Can someone please help me get modify access to the tez wiki site at >> https://cwiki.apache.org/confluence/display/TEZ? >> >> jon >

Re: cwiki modify access

Thanks, Hitesh. This is working great now. On Fri, Jan 23, 2015 at 4:03 PM, Hitesh Shah wrote: > Done. You should have full rights on the Tez space. Let me know if you hit > any issues. > > — Hitesh > > > On Jan 23, 2015, at 1:41 PM, Jonathan Eagles wrote: > >>

[RESULT] Release Apache Tez-0.6.0 RC0

I am pleased to announce this vote passes with 7 +1 votes (4 binding) Binding Votes -- Jonathan Eagles Hitesh Shah Siddharth Seth Rajesh Balamohan Non-Binding Votes - Prakash Ramachandran Jianfeng (Jeff) Zhang Sreenath Somarajapuram Thanks to all who

Re: [VOTE] Release Apache Tez-0.6.0 RC0

> > > >> > > > +1 (non-binding) >> > > > verified checksums, built from src and ran jobs locally. >> > > > tested ui functionality >> > > > >> > > > thanks >> > > > Prakash >> > > > >> &

[ANNOUNCE] Apache Tez 0.6.0.

The Apache Tez team is proud to announce the release of Apache Tez version 0.6.0 The Apache Tez project is aimed at creating a framework to build efficient and scalable data processing applications that can be modeled as data flow graphs. This is an feature release that contains the first impleme

Re: [VOTE] Release Apache Tez-0.6.0 RC0

iswamy >> wrote: >> >> > Created TEZ-1999 and TEZ-2000. First one seems to be a patch only in >> > master. Haven't checked the other one. >> > >> > On Mon, Jan 26, 2015 at 8:08 AM, Jonathan Eagles >> wrote: >> > >> &

TEZ UI component added

Tez Devs, I have added a TEZ UI component that will help easily search for UI issues. Please help by filing UI issues with the component filled out so these issues get filtered appropriately. Jon

Re: backport of TEZ-1661 to 0.6?

Hi André. It's always great to get feedback on Tez, especially how it can be made better for our users. I'd be happy to pull this issue back to 0.6 branch. As to the 0.6.1 release timeline, the community has been working furiously for the past several weeks to prepare for the upcoming 0.6.1 rele

Helpers for MAPREDUCE-3727 scenario

MapReduce (MAPREDUCE-3727) and Pig on Tez (PIG-4333) have implemented a work around to unset the mapreduce.job.credentials.binary property. Now hive has hit the same scenario this week (no jira yet that I see). While Tez dones generally handle mapreduce properties, should we provide a config cleani

Tez 0.6.1 Release Prep

Tez Devs, The tez release is within reach with only a handful of blockers and criticals left. http://s.apache.org/tez-0.6.1-blockers Let's spend some time prioritizing this list and resolving the essential issues so that we can begin the process of creating a 0.6.1 release. This will likely sta

Re: tez 0.6.1 release?

Andre, I have sent out the request for driving down and prioritizing 0.6.1 blockers. This will likely allow us to create a 0.6.1 rc0 candidate next week. Would be great to hear your input and feedback on this release. jeagles On Mon, Mar 16, 2015 at 9:32 PM, Andre Kelpe wrote: > Hi Hitesh, > >

Re: Tez 0.6.1 release?

I'll spend focused time today reviewing the latest blockers with the community and driving this release to a point where we can have a candidate soon. We have been adding a lot of bug fixes and scaling improvements even in the last few days. Thanks for the continued interest and support. Jon On Ap

Re: 0.7.0 release

Well said, Hitesh. There are just a few remaining issues targeted to 0.6.1 that need to be considered before creating a release candidate. You can expect an rc candidate soon on this. Jon On Thu, Apr 30, 2015 at 5:31 PM, Hitesh Shah wrote: > Hello Andre, > > Over the past couple of weeks, we hav

[VOTE] Release Apache Tez-0.6.1 RC0

Hi folks, I have created an tez-0.6.1 release candidate rc0. Tez 0.6.1 includes all the bug fixes and improvement in 0.5.4 (to be released soon). In addition, 0.6.1 contains 70+ Tez UI stabilization fixes and timeline server error handling. GIT source tag https://git-wip-us.apache.org/repos/as

Re: [VOTE] Release Apache Tez-0.6.1 RC0

I am pleased to announce this vote passes with 7 +1 votes (3 binding) Binding Votes -- Jonathan Eagles Hitesh Shah Siddharth Seth Non-Binding Votes - Prakash Ramachandran Jianfeng (Jeff) Zhang Cyrille Chépélov Mit Desai Thanks to all who voted and tried

[ANNOUNCE] Apache Tez 0.6.1

The Apache Tez team is proud to announce the release of Apache Tez version 0.6.1 The Apache Tez project is aimed at creating a framework to build efficient and scalable data processing applications that can be modeled as data flow graphs. This release contains all the bug fixed and improvement ma

Jenkins nodes issues

Looks like 3 of 6 jenkins machines for tez are not working now. With the competition from hdfs mapreduce ambari and the like, we are having delays getting pre commit builds run. Does anyone know if this is being worked on currently? https://builds.apache.org/label/Tez/ Jon

Re: Tez 0.6.2 release?

TEZ-2311 is the most critical of the list. If this goes in today I can start the release process for 0.6.2 On Wed, Jul 22, 2015 at 1:14 PM, Hitesh Shah wrote: > Looking at > "https://issues.apache.org/jira/issues/?jql=project%20%3D%20TEZ%20AND%20resolution%20%3D%20Unresolved%20AND%20%22Target%20

Re: Tez 0.6.2 release?

gt; wrote: >>> >>>> >>>> I am working on a new patch. But I will be on flight this weekend, should >>>> be able to post new patch on Tuesday. >>>> >>>> >>>> Best Regard, >>>> Jeff Zhang >>>> >

[VOTE] Release Apache Tez-0.6.2 RC0

Hi folks, I have created an tez-0.6.2 release candidate rc0. Tez 0.6.2 includes all the bug fixes and improvements in 0.6.1. In addition, there have been many stabilization fixes including two AM hangs, local mode hang for big test suites, HDFS Federation support fix, and Timeline server load re

Re: [VOTE] Release Apache Tez-0.6.2 RC0

; >> From: Mit Desai [mailto:mitdesa...@gmail.com] > >> Sent: Friday, August 07, 2015 1:16 PM > >> To: dev@tez.apache.org > >> Subject: Re: [VOTE] Release Apache Tez-0.6.2 RC0 > >> > >> +1 (non-binding) > >> # Verified signatures and che

Tez Analyzer Usage Question

Can the job analyzer be used at this point for the eager developer? I would like to get started using the functionality that is there. I have ATS data for jobs and would be able to analyzer slow jobs, but don't have instructions on what can be done at this point. I'm assuming there is a way to do

Re: Tez Analyzer Usage Question

eager developer caveats. I am working on a Tool > based jar so that the analysers could be run from the command line using > "Hadoop jar" instead of having to write code to invoke them. Please give me > a day or two for that. > > Bikas > > -Original Message- >

Tez session max attempts of one when recovery is disabled

Running pig on tez (0.7.1 pre-release) with recovery disabled and noticed that when the am fails there is no other attempts. What is it about sessions versus non-sessions (what bad thing are we preventing) that keeps us from retrying when recovery is disabled? (background) Pig only runs sessions e

occational submitDag error

I have a user running 0.6.1 tez (git hash 6e588d15184dc691df1c0227f40db91d9bc6d7d6) and a few times a month the job submitted returns this error. 2015-09-16 01:04:05,069 INFO [IPC Server handler 0 on 50500] app.DAGAppMaster: Running DAG: PigLatin:user_1.pig-0_scope-0 2015-09-16 01:04:05,617 INFO [

Upload downloaded dag timeline data

Has anyone had any experience uploading data that was downloaded from the Tez UI? I am trying to debug some UI issues that certain jobs experience I want to run on the same dag timeline data as well as be able to upload issues filed in the community into my local timeline store. Likely, I'll need t

Re: Upload downloaded dag timeline data

t; > Start that up and go to http://:8188/dagupload to upload the > zip files. > > Caveat: unlike LevelDB it doesn't do de-dups, so uploading the same DAG > twice messes it up. > > Cheers, > Gopal > > On 10/14/15, 11:11 AM, "Jonathan Eagles" wrote: > &

TEZ Release notes

Devs, with the introduction of INFRA-10684 , Release Notes field should now be filled out for any communication needed between us and the users of the new release version. This can range from upgrade instructions, new features, and Incompatible Cha

User defined configuration deprecations

Devs, What is the recommended way to go about adding deprecations for user defined deprecations. For example, vertex managers. You could add them in DeprecatedKeys for know vertex managers like ShuffleVertexManager, but that has not been done historically. In my particular case, I want to transla

Re: User defined configuration deprecations

Filed https://issues.apache.org/jira/browse/TEZ-2935 to partially address this. To add some clarity to the issue, I have a bunch of pig on MR jobs that define the slow start property. Currently there is no translation to pick that setting up in ShuffleVertexManager. Filed TEZ-2935 to address this.

Re: [DISCUSS] Tez UI Ember 2.0 migration

+1. This is a good plan. On Tue, Dec 1, 2015 at 10:42 AM, Hitesh Shah wrote: > +1 on the idea. > > Given this is a major change and if it cannot be done in a single commit, > I would recommend doing these changes on a branch similar to the work for > TEZ-2003. > > thanks > — Hitesh > > > On Nov

Re: [DISCUSS] Release for 0.7.1

Did a quick scan of the jiras targeted to 0.7.1, Of the five listed below, two already have a +1, and the other three are in patch available. Of the 5, TEZ-2943 will have the largest benefit to customers. TEZ-1491 Tez reducer-side merge's counter

Re: Hive with Tez on EMR out of memory error

The error you are experiencing is running out of memory in the Hive Application master. These can be set with the following settings (tune as appropriate). set tez.am.resource.memory.mb=3072;set tez.am.launch.cmd-opts=-Xmx2560m; Also, there has been some improvements in getTask running out of mem

[DISCUSS] Merge OOM improvements

A new pattern of pig jobs that succeed with MR and fail with Tez have been identified. Hoping to brainstorm ideas so we can identify issues and file target jiras. Here is a typical stack trace, though sometimes it occurs with final merge (since in-memory segment overhead > mapout overhead) Caused

Re: [DISCUSS] Merge OOM improvements

Thanks for the recommendation. I can definitely run this job with the proposed setting. In addition, I created a patch in https://issues.apache.org/jira/browse/TEZ-3076 that reduces the memory need in MapOutput and InMemoryReader that allows this job to run without the need for tez.runtime.shuffle.

Re: [DISCUSS] Dropping support for hadoop versions 2.5.x and lower for Tez 0.9.x ?

+1. Assuming hadoop 2.6 running jdk7+. On Fri, Feb 5, 2016 at 8:40 PM, Rajesh Balamohan wrote: > +1. Would be good to drop 2.2 > > ~Rajesh.B > > On Fri, Feb 5, 2016 at 6:29 PM, Siddharth Seth wrote: > > > +1. I'm in favor of dropping support for 2.2 in the next release from the > > 0.8 line as

DME emptyPartitions and sourceId interaction

TL;DR: Why do we send all empty partitions via DME if destination only checks if sourceIndex is empty? While investigating TEZ-3115. I ran a job to check the MapHost string memory need reduction. Here is the job i ran (LEGACY sorter enabled). HADOOP_CLASSPATH="$TEZ_CONF_DIR:$TEZ_HOME/*:$TEZ_HOME/

Re: [VOTE] Remove support for hadoop versions less than 2.6.0 from master

+1. On Tue, Mar 8, 2016 at 5:22 PM, Gopal Vijayaraghavan wrote: > +1 > > The shims will be very useful with hadoop-3.0 in mind. > > Cheers, > Gopal > > On 3/8/16, 11:52 AM, "Hitesh Shah" wrote: > > >Hi > > > >To follow up on our early discussion regarding support of hadoop versions > >for futur

[DISCUSS] Feature branch for Apache Tez Custom Shuffle Handler TEZ-3334

REQUEST TEZ-3334 feature branch creation In order to prevent destabilization of master branch, I propose to create a feature branch TEZ-3334 that can be used to create a Custom Shuffle Handler for this project. Please let me know if there is any objection. FYI After an initial POC, the project wil

Re: [DISCUSS] Feature branch for Apache Tez Custom Shuffle Handler TEZ-3334

taken and a more defined list of potential > >enhancements. > > > >thanks > >‹ Hitesh > > > >> On Jul 19, 2016, at 1:10 AM, Siddharth Seth wrote: > >> > >> Sounds good. +1. > >> > >> On Mon, Jul 18, 2016 at 1:31 PM, Jonatha

Re: Why use FileSystem.getLocal to get Local File System?

Local file system provides checksum of bytes to ensure data from disk or shuffle is correct. On Nov 6, 2016 8:10 AM, "Darion Yaphet" wrote: > Hi experts : > > I found we are using Hadoop API's FileSystem.getLocal to get local file > system and I think maybe use java.nio.file.FileSystem is better

Re: [DISCUSS] Releases - 0.8/0.9

Can we do a cursory glance at deprecated APIs and how they are used in know Tez application (pig, hive, cascading)? This will save us some time in knowing if something has broken. On Thu, Feb 2, 2017 at 1:49 PM, Bikas Saha wrote: > I would say to look for all deprecations tags and remove them in

Re: [DISCUSS] Getting rid of CHANGES.txt

+1 All in favor of this. On Wed, Mar 1, 2017 at 11:35 AM, Siddharth Seth wrote: > We've been following a process where the Fix Version for any committed jira > is set to include the current version on all branches that the patch goes > to. Given this, I think we can generate a change-list / rele

[DISCUSS] Merge TEZ-3334 to master

At this time, it may be advantageous to move the Tez Shuffle Handler development and maintenance to the master line. This would allow the tez community to make this feature available to a wider audience. I would like to get community feedback on proposing a vote to merge the TEZ-3334 branch to the

Re: [DISCUSS] Merge TEZ-3334 to master

Folks, let's have all feedback by EOB Thursday, and I'll start the VOTE on Friday if that is the direction the community is heading. jeagles On Mon, Mar 27, 2017 at 5:49 PM, Jonathan Eagles wrote: > At this time, it may be advantageous to move the Tez Shuffle Handler >

Re: [DISCUSS] Miniumum hadoop version on master to 2.7

+1. I submitted a patch to upgrade to 2.6.3 to fix a port binding issues in tests. An upgrade to 2.7 will fix this. https://issues.apache.org/jira/browse/TEZ-3622 On Wed, Apr 19, 2017 at 3:22 PM, Siddharth Seth wrote: > Assuming the lac of a response to indicate there's no objections to making >

PreCommit-TEZ-Build issue

There seems to be an issue with the PreCommit build possibly regarding the Hadoop labels. Is anyone aware of any ongoing upgrades or changes? https://builds.apache.org/job/PreCommit-TEZ-Build/ Regards, jeagles

Re: PreCommit-TEZ-Build issue

ng anything recently on the > builds@ alias. > > > On Tue, May 16, 2017 at 8:52 AM, Jonathan Eagles > wrote: > > > There seems to be an issue with the PreCommit build possibly regarding > the > > Hadoop labels. Is anyone aware of any ongoing upgrades or changes? > &g

Re: [DISCUSS] Merge TEZ-3334 to master

geting > end of the week. Hopefully before that. > > On Wed, Mar 29, 2017 at 12:23 PM, Jason Lowe > wrote: > > > +1 for merging the new shuffle handler to master. > > Jason > > > > > > On Wednesday, March 29, 2017 9:41 AM, Jonathan Eagles < > &

[VOTE] Merge TEZ-3334 into master

This vote is to merge the Tez Shuffle Handler feature branch (TEZ-3334) into the master branch. Having done extensive testing and thanks to all the feedback given, the Tez Shuffle Handler delivers on its promise to reduce shuffle times for the auto-reduce case and pave the way for more shuffle type

Re: [VOTE] Merge TEZ-3334 into master

[TEZ-3735] Test failures in TestTaskAttempt and TestAMContainerMap - ASF > > JIRA > >| | > > > > | > > > > > > > > > > On Monday, May 22, 2017 3:46 PM, Jason Lowe > > wrote: > > > > > > +1, looking forward to this fu

Re: [VOTE] Merge TEZ-3334 into master

contributing/reviewing patches, testing, voting, and community support. Regards, jeagles On Wed, May 24, 2017 at 2:08 PM, Jonathan Eagles wrote: > Ming, in its current form, Tez Shuffle Handler is not setup to handle > backwards compatibility with MapReduce. This could be easily adde

Re: [VOTE] Merge TEZ-3334 into master

The merge is completed. Thanks for holding off. Please resume any and all normal operations. Regards, jeagles On Wed, May 24, 2017 at 3:54 PM, Jonathan Eagles wrote: > With six +1 votes (5 binding and 1 non-binding) and zero -1 votes, this > feature branch merge vote passes. I will p

Re: [DISCUSS] Release 0.9.0

Hey Sid, thanks for a callout of jiras for 0.9 release. There are a couple of jiras I felt are worthy of considering. None are blocking in that sense, but all are in patch available. As always, I can wait another release cycle if the community is eager for a release sooner rather than later. https

Tez-Build failing

Does anyone have the power to switch the Tez-Build job from jdk 1.7 to jdk 1.8? https://builds.apache.org/blue/organizations/jenkins/Tez-Build/activity [INFO] Building tez 0.9.0-SNAPSHOT [INFO] [INFO] [INFO] --- maven-clean-

Tez 0.9.1 Release

There has been a number of significant contributions as well as bug fixes that haven't made it into an official release. Is there interest in the community for a new release soon? Also, is there any here interested in being the Tez 0.9.1 release manager? Just wanted to start this conversations to

Re: Tez 0.9.1 Release

gt; Thanks! > > Zhiyuan > > > On Nov 6, 2017, at 5:25 PM, > > > wrote: > > > > > > +1 for 0.9.1 release. I can help make the release candidate. > > > > > > Thanks! > > > Zhiyuan > > > > > >> On Nov 6,

Re: Running commands on Hive on Tez failed with NPE

Silas, thanks for reaching out to the Tez community. Going by the stack trace, we have not yet reach tez code. The best way to get some effective help is by reaching out to the hive user list. Jon On Mon, Feb 12, 2018 at 10:55 PM, Ge Silas wrote: > Hi Tez community, > > I recently encountered w

Re: Tez statistics model

Thanks for reaching out to use XuanCao. Sounds like you are planning to use new custom statistics that a new custom Vertex can utilize to make better decisions. Are you planning to contribute these custom statistics changes to tez? Or are are we trying to solidify and enhance the Tez Statistics AP

Re: Ordering requirements in DataMovementEvent and InputFailedEvent and implication on setting inputIsReady

Thanks for reaching out to us Anupam. Going to take a look at these questions in depth over the next couple of days to give a proper reply. Regards, jeagles On Mon, Mar 5, 2018 at 7:51 PM, Anupam wrote: > Hi Tez experts, > > > > We are hitting some issues with proper handling of DataMovementEv

Re: Tez statistics model

te in some way. > > I think it would be a good idea to leverage standard libraries > like DropWizard Metrics: http://metrics.dropwizard.io/4.0.0/ > > DropWizard for example has a really nice number of off-the-shelf > integrations: http://metrics.dropwizard.io/4.0.0/manual/third-p

Re: Ordering requirements in DataMovementEvent and InputFailedEvent and implication on setting inputIsReady

Anupam, I have spent some time looking over the code snippet posted and will try my best to address your questions. But I do have a foundational question that will help guide our continued conversations. - What role and feature benefits do you see Tez taking on and fulfilling for Scope? Pig and H

Re: [VOTE] Move master to Hadoop 3+ and create separate 0.9.x line

Thoughts/Inputs/Discussion from Pig/Hive/Flink/Scalding/Scope communities? I wish we had used a discussion thread to gather more input from Pig/Hive/Flink/Scalding/Scope community before starting this vote whose outcome affects them. Without discussion or votes from those communities I'm not sure

Re: [VOTE] Move master to Hadoop 3+ and create separate 0.9.x line

, but there was a discussion > > thread > > > with no voiced objections well in advance of the vote thread. > > > > > > Jason > > > > > > > > > On Tue, Apr 10, 2018 at 10:18 AM, Jonathan Eagles < > jeag...@gma

[DISCUSS] Master branch 0.10.0 or 1.0.0?

Devs, As part of the moving 0.9.x line to a branch, should we call the new line that supports hadoop 3.x 0.10.x or 1.0.x? Moving to 1.x caries with it a certain connotation of being stable, but I wanted to reach out to the community to get a feel for what people are thinking for the next release

Re: [DISCUSS] Master branch 0.10.0 or 1.0.0?

-3923?focusedCommentId=16458814&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16458814 Wanted to give some background of this discussion so it doesn't seem like we are discussing something we already decided upon. jeagles On Tue, May 1, 2018 at 10:44 AM,

[NOTICE] Master moves to 0.10.0, branch-0.9 created

As part of the work to support hadoop 3+, master branch has moved to 0.10.0 and a 0.9.x branch was cut on the previous release. Committers please propagate all changes to 0.10.x (master) and 0.9.x (branch-0.9) to all proper release lines and target JIRAs appropriately. Reference https://issues.a

[DISCUSS] Request for 0.9 release manager

The Apache Tez Community is of a new Release Manager for the 0.9 release line. There has been a number of substantial fixes to 0.9.x release plus some near-completed work that will be good to package in a formal release. The current process is documented on the Tez wiki and will help give the vol

Re: [DISCUSS] Request for 0.9 release manager

; line. > > > Thanks and Regards, > Kuhu > > On Fri, May 4, 2018 at 2:26 PM, Jonathan Eagles wrote: > > > The Apache Tez Community is of a new Release Manager for the 0.9 release > > line. > > > > There has been a number of substantial fixes to 0.9.x release plu

[DISCUSS] Request for 0.10 release manager

The Apache Tez Community is of a new Release Manager for the 0.10 release line. This release line is aimed at hadoop3+ compatibility and a formal release will help our dependent project teams to verify hadoop3+ with an official Tez release that supports hadoop3+. The current process is documented

Re: [VOTE] Tez 0.10.0 release deadline

+1. Seems like a good plan On Wed, Jul 18, 2018, 2:57 PM Eric Wohlstadter wrote: > Hi all, > I'd like to propose a deadline of July 27th for work on tickets to be > included in the 0.10.0 release. > > Please +1 or -1 this proposal by July 20th. My understanding is that this > proposal requires

Re: Merge process for contributions

Thanks Jaume for bringing up this discussion. I am in agreement that the development process is fluid and should change and evolve in the same way as our code base. After looking into this, I can see that git itself supports a separate committer and author natively and github likewise supports thi

Re: [VOTE] Tez 0.10.0 release deadline

for review. > >>> > >>> On Sun, Jul 22, 2018 at 8:21 AM, Kuhu Shukla > > >>> wrote: > >>> > >>>> +1. > >>>> > >>>> Regards, > >>>> Kuhu > >>>> > >>>> On Fri, Jul 20, 2018 at 1

Re: Submit a patch against branch-0.9

This has to do with the fact that yetus isn't setup for TEZ. Until that occurs, it will always try to apply patches to master. On Wed, Sep 19, 2018 at 4:02 PM, Jaume Marhuenda wrote: > Hello, > > I’m trying to submit a patch against branch-0.9, however it’s doing the > diff against master when i

[DISCUSS] Tez build Yetus support

Devs, I have prototyped a Yetus based build system for Tez. The system has a number of features that would enabled better supporting builds and further the ease for development. Specifically, Yetus has support for patches targeting, increased static analysis, support for docker builds (currently d

  1   2   3   4   5   >