Re: When are incompatible changes acceptable (HDFS-12990)

>>            make change according to HDFS-12990, then this incompatible     >> change does not     >>            make incompatible change compatible.  Other ports are not     >> reverted     >>            according to HDFS-12990.  User will encounter the bad taste

Re: When are incompatible changes acceptable (HDFS-12990)

chance for new comer to encountering “port already in use” >> problem. If we >> make change according to HDFS-12990, then this incompatible >> change does not >> make incompatible change compatible. Other ports are not >&

Re: When are incompatible changes acceptable (HDFS-12990)

: >> >> The fix in HDFS-9427 can potentially bring in new customers >> because less >> chance for new comer to encountering “port already in use” >> problem. If we >> make change according to HDFS-12990, then this incompa

Re: When are incompatible changes acceptable (HDFS-12990)

ris Douglas <cdoug...@apache.org <mailto:cdoug...@apache.org>>, Hadoop Common < common-dev@hadoop.apache.org <mailto:common-dev@hadoop.apache.org>> Subject: Re: When are incompatible changes acceptable (HDFS-12990) On Wed, Jan 10, 2018 at 1

Re: When are incompatible changes acceptable (HDFS-12990)

er to encountering “port already in use” problem. If >>> we >>> make change according to HDFS-12990, then this incompatible change does >>> not >>> make incompatible change compatible. Other ports are not reverted >>> according to HDFS-12990. User will encounte

Re: When are incompatible changes acceptable (HDFS-12990)

Wednesday, January 10, 2018 at 10:53 AM To: Daryn Sharp <da...@oath.com> Cc: "Aaron T. Myers" <a...@apache.org>, Eric Yang <ey...@hortonworks.com>, Chris Douglas <cdoug...@apache.org>, Hadoop Common < common-dev@hadoop.apache.org> Subject: Re: When are incompa

Re: When are incompatible changes acceptable (HDFS-12990)

c...@apache.org> > Date: Wednesday, January 10, 2018 at 10:53 AM > To: Daryn Sharp <da...@oath.com> > Cc: "Aaron T. Myers" <a...@apache.org>, Eric Yang <ey...@hortonworks.com>, > Chris Douglas <cdoug...@apache.org>, Hadoop Common < > common-dev@hadoop.apach

Re: When are incompatible changes acceptable (HDFS-12990)

Thanks > > > > Regards, > > Eric > > > > From: larry mccay <lmc...@apache.org> > > Date: Wednesday, January 10, 2018 at 10:53 AM > > To: Daryn Sharp <da...@oath.com> > > Cc: "Aaron T. Myers" <a...@apache.org>, Eric Yang <ey...

Re: When are incompatible changes acceptable (HDFS-12990)

d taste in the mouth > > that HDFS-9427 attempt to solve. Please do consider both negative side > > effects of reverting as well as incompatible minor release change. > Thanks > > > > Regards, > > Eric > > > > From: larry mccay <lmc...@apache.org> >

Re: When are incompatible changes acceptable (HDFS-12990)

onworks.com> > *Cc: *"Aaron T. Myers" <a...@apache.org>, Daryn Sharp <da...@oath.com>, > Hadoop Common <common-dev@hadoop.apache.org>, larry mccay < > lmc...@apache.org> > > *Subject: *Re: When are incompatible changes acceptable (HDFS-1299

Re: When are incompatible changes acceptable (HDFS-12990)

, 2018 at 7:36 PM To: Eric Yang <ey...@hortonworks.com> Cc: "Aaron T. Myers" <a...@apache.org>, Daryn Sharp <da...@oath.com>, Hadoop Common <common-dev@hadoop.apache.org>, larry mccay <lmc...@apache.org> Subject: Re: When are incompatible changes acceptable

Re: When are incompatible changes acceptable (HDFS-12990)

" <a...@apache.org>, Eric Yang <ey...@hortonworks.com>, > Chris Douglas <cdoug...@apache.org>, Hadoop Common < > common-dev@hadoop.apache.org> > Subject: Re: When are incompatible changes acceptable (HDFS-12990) > > On Wed, Jan 10, 2018 at 1:34 PM, D

Re: When are incompatible changes acceptable (HDFS-12990)

ary 10, 2018 at 10:53 AM To: Daryn Sharp <da...@oath.com> Cc: "Aaron T. Myers" <a...@apache.org>, Eric Yang <ey...@hortonworks.com>, Chris Douglas <cdoug...@apache.org>, Hadoop Common <common-dev@hadoop.apache.org> Subject: Re: When are incompatible changes

Re: When are incompatible changes acceptable (HDFS-12990)

On Wed, Jan 10, 2018 at 1:34 PM, Daryn Sharp wrote: > I fully agree the port changes should be reverted. Although > "incompatible", the potential impact to existing 2.x deploys is huge. I'd > rather inconvenience 3.0 deploys that compromise <1% customers. An > incompatible

Re: When are incompatible changes acceptable (HDFS-12990)

ache.org>, Hadoop Common <common-dev@hadoop.apache.org> Subject: Re: When are incompatible changes acceptable (HDFS-12990) Hey Eric, Comments inline. On Wed, Jan 10, 2018 at 9:06 AM, Eric Yang <ey...@hortonworks.com<mailto:ey...@hortonworks.com>> wrote: Hi Aaron, Correct me i

Re: When are incompatible changes acceptable (HDFS-12990)

Chris Douglas <cdoug...@apache.org>, larry mccay <lmc...@apache.org>, > Hadoop Common <common-dev@hadoop.apache.org> > *Subject: *Re: When are incompatible changes acceptable (HDFS-12990) > > > > On Tue, Jan 9, 2018 at 3:15 PM, Eric Yang <ey...@hortonworks.com&

Re: When are incompatible changes acceptable (HDFS-12990)

..@apache.org> Date: Tuesday, January 9, 2018 at 9:22 PM To: Eric Yang <ey...@hortonworks.com> Cc: Chris Douglas <cdoug...@apache.org>, larry mccay <lmc...@apache.org>, Hadoop Common <common-dev@hadoop.apache.org> Subject: Re: When are incompatible changes acceptable (HDF

Re: When are incompatible changes acceptable (HDFS-12990)

On Tue, Jan 9, 2018 at 3:15 PM, Eric Yang wrote: > While I agree the original port change was unnecessary, I don’t think > Hadoop NN port change is a bad thing. > > I worked for a Hadoop distro that NN RPC port was default to port 9000. > When we migrate from BigInsights

Re: When are incompatible changes acceptable (HDFS-12990)

While I agree the original port change was unnecessary, I don’t think Hadoop NN port change is a bad thing. I worked for a Hadoop distro that NN RPC port was default to port 9000. When we migrate from BigInsights to IOP and now to HDP, we have to move customer Hive metadata to new NN RPC

Re: When are incompatible changes acceptable (HDFS-12990)

Particularly since 9820 isn't in the contiguous range of ports in HDFS-9427, is there any value in this change? Let's change it back to prevent the disruption to users, but downstream projects should treat this as a bug in their tests. Please open JIRAs in affected projects. -C On Tue, Jan 9,

Re: When are incompatible changes acceptable (HDFS-12990)

On Mon, Jan 8, 2018 at 11:28 PM, Aaron T. Myers wrote: > Thanks a lot for the response, Larry. Comments inline. > > On Mon, Jan 8, 2018 at 6:44 PM, larry mccay wrote: > >> Question... >> >> Can this be addressed in some way during or before upgrade that

Re: When are incompatible changes acceptable (HDFS-12990)

The intent of the compat guidelines is to prevent developers from making incompatible "improvements" at inconvenient times.  The guidelines offer some wiggle room for the cases where something truly broken is being fixed, especially for the sake of compatibility.  I would say that in this

Re: When are incompatible changes acceptable (HDFS-12990)

Thanks a lot for the response, Larry. Comments inline. On Mon, Jan 8, 2018 at 6:44 PM, larry mccay wrote: > Question... > > Can this be addressed in some way during or before upgrade that allows it > to only affect new installs? > Even a config based workaround prior to

Re: When are incompatible changes acceptable (HDFS-12990)

Question... Can this be addressed in some way during or before upgrade that allows it to only affect new installs? Even a config based workaround prior to upgrade might make this a change less disruptive. If part of the upgrade process includes a step (maybe even a script) to set the NN RPC port

When are incompatible changes acceptable (HDFS-12990)

Hello all, Over in HDFS-12990 [1], we're having some discussion about whether or not it's ever acceptable to make an incompatible change in a minor or dot release. In general this is of course undesirable and should be avoided in almost all cases.