Re: [VOTE] Migration of git repos to gitbox.apache.org

2019-01-19 Thread Jungtaek Lim
Thanks Ethan for leading the effort on migration! +1 from me.

Thanks,
Jungtaek Lim (HeartSaVioR)

2019년 1월 19일 (토) 오전 4:48, Govind Menon 님이 작성:

> +1
>
> On Fri, 18 Jan 2019 at 13:33, Stig Rohde Døssing 
> wrote:
>
> > +1
> >
> > Den fre. 18. jan. 2019 kl. 16.59 skrev Kishorkumar Patil
> > :
> >
> > > +1
> > >
> > > On Fri, Jan 18, 2019 at 10:47 AM Ethan Li 
> > > wrote:
> > >
> > > > This is a call to vote on migration of git repos to
> gitbox.apache.org
> > <
> > > > http://gitbox.apache.org/>.
> > > >
> > > > The following repositories on git-wip-us belong to our project:
> > > > - storm-site.git
> > > > - storm.git
> > > >
> > > > All repositories not migrated on February 7th will be mass migrated
> > > > without warning. It’s better to work with the infrastructure team to
> > > avoid
> > > > the mass that day.
> > > >
> > > > The notice email is at
> > > >
> > >
> >
> https://lists.apache.org/thread.html/2bb953946ee6652a054329df2814f512f9186e863ec841555f9cc26a@%3Cdev.storm.apache.org%3E
> > > > <
> > > >
> > >
> >
> https://lists.apache.org/thread.html/2bb953946ee6652a054329df2814f512f9186e863ec841555f9cc26a@%3Cdev.storm.apache.org%3E
> > > > >
> > > >
> > > > This vote will be open for at least 24 hours.
> > > >
> > > > Thanks
> > > >
> > > > - Ethan
> > >
> > > --
> > > -Kishor
> > >
> >
>


Re: [VOTE] Release Apache Storm 2.0.0 (rc4)

2019-01-19 Thread Jungtaek Lim
Hello all,

+1 (binding)

> source

- verify file (MD5, SHA)
-- source, tar.gz : OK
-- source, zip : OK

- extract file
-- source, tar.gz : OK
-- source, zip : OK

- diff-ing extracted files between tar.gz and zip : OK

- build source with JDK 8 (-Pall-tests && -Pexternals)
-- source, tar.gz : OK

- build source dist
-- source, tar.gz : OK

- build binary dist
-- source, tar.gz : OK

> binary

- verify file (MD5, SHA)
-- binary, tar.gz : OK
-- binary, zip : OK

- extract file
-- binary, tar.gz : OK
-- binary, zip : OK

- diff-ing extracted files between tar.gz and zip : OK

- launch daemons : OK

- run ExclamationTopology (local) : OK

- run RollingTopWords (remote) : OK
  - activate / deactivate / rebalance / kill : OK
  - logviewer (worker dir, daemon dir) : OK
  - change log level : OK
  - thread dump, heap dump, restart worker : OK
  - log search : OK

I don't think perf. degrade is a blocker for this release, since we are
still providing far better performance then 1.x. As Roshan is planning to
address this, that could be fixed in 2.0.x hopefully.

Thanks,
Jungtaek Lim (heartSaVioR)

2019년 1월 19일 (토) 오전 5:23, Roshan Naik 님이 작성:

>  Was verifying the performance on 2.0 and noticed that the inter worker
> messaging has fallen off a cliff  With ConstSpoutNullBoltTopo (producer
> batch size=1k, ackers=0, workers=2) it was ~3.2mill/sec down  and now its
> down to  ~1.6mill/sec. Something has impacted this recently. Will try to
> narrow down the issue by tomorrow hopefully. Single worker numbers look
> good.
> -roshan
> On Friday, January 11, 2019, 2:46:14 AM PST, Stig Rohde Døssing <
> stigdoess...@gmail.com> wrote:
>
>  Thanks Arun,
>
> I don't have an opinion on it, just wanted to make sure that it wasn't an
> oversight.
>
> +1
>
> Set up Storm from the binary zip file
> Built storm-kafka-client-examples from the zip while pointing Maven at the
> Nexus repo
> Ran one of the example Kafka topologies with a single-node cluster against
> a local Kafka. Verified there were no errors in the logs, clicked around in
> UI.
>
> Den tor. 10. jan. 2019 kl. 22.25 skrev Arun Mahadevan :
>
> > This is for users to use the "auto credentials" mechanism (delegation
> > tokens) with HDFS/Hive/Hbase.
> >
> > We have been shipping it since 1.x (I think since 1.2.0 release) so that
> > users can just add that directory to class path rather than building it
> > separately to get the right dependencies. We could consider removing it
> > from the main binary and ship it separately but it will need changes to
> the
> > build, release and documentation and users will need to download and
> > install it separately.
> >
> >
> > Thanks,
> > Arun
> >
> > On Thu, 10 Jan 2019 at 10:28, Stig Rohde Døssing  >
> > wrote:
> >
> > > I think this was remarked on by Roshan in the last RC, but the binary
> > > distribution has become significantly larger since 1.x. It looks like
> > this
> > > is down to storm-autocreds not being added to the exclusion list in
> > > storm-dist/binary/final-package/src/main/assembly/binary.xml.
> > >
> > > Since the module isn't excluded, external/storm-autocreds contains the
> > > module jar, plus all dependency jars. Is this an accident, or do we
> want
> > to
> > > include these jars in the distribution?
> > >
> > > Den ons. 9. jan. 2019 kl. 19.48 skrev Ethan Li <
> > ethanopensou...@gmail.com
> > > >:
> > >
> > > > +1
> > > >
> > > > - Built from the src, ran all the unit tests and integration tests.
> > > > - Set up a single-node cluster and submit ThroughputVsLatency
> topology.
> > > > - Checked the UI.
> > > > They look good.
> > > >
> > > > Thanks
> > > > Ethan
> > > >
> > > > > On Jan 9, 2019, at 8:48 AM, Bobby Evans  wrote:
> > > > >
> > > > > +1 built from the git tag.  Ran all of the unit tests and ran some
> > > manual
> > > > > tests they all passed.
> > > > >
> > > > > Thanks,
> > > > >
> > > > > Bobby
> > > > >
> > > > > On Tue, Jan 8, 2019 at 6:30 PM Xin Wang 
> > > wrote:
> > > > >
> > > > >> +1
> > > > >>
> > > > >> Built it and ran all of the tests.  Everything passed.
> > > > >>
> > > > >> -Xin
> > > > >>
> > > > >> Kishorkumar Patil  于2019年1月9日周三
> 上午5:08写道:
> > > > >>
> > > > >>> +1
> > > > >>>
> > > > >>> - built from source code and deployment works.
> > > > >>> -  Ran some of the tests for UI, DRPC, ThroughputVsLatency
> > > > >>> -  Validated UI bugs reported in the recent past are fixed in
> this
> > > > >> version
> > > > >>>
> > > > >>> -Kishor
> > > > >>>
> > > > >>>
> > > > >>> On Tue, Jan 8, 2019 at 2:29 PM Arun Mahadevan 
> > > > wrote:
> > > > >>>
> > > >  +1
> > > > 
> > > >  - Downloaded the binaries and validated signatures.
> > > >  - Deployed the binaries, ran some sample topologies and checked
> > the
> > > > UI.
> > > >  - Ran top level build using the source zip.
> > > > 
> > > >  Thanks,
> > > >  Arun
> > > > 
> > > > 
> > > >  On Tue, 8 Jan 2019 at 11:03, P. Taylor Goetz  >
> > > > >> wrote:
> > > > 
> > > >