Re: Multiple node Hadoop cluster on Docker for test and debugging

2016-11-09 Thread Roman Shaposhnik
On Wed, Nov 9, 2016 at 9:30 AM, Zhe Zhang wrote: > Nice work Kai! Quick comment: have you considered Bigtop? It allows > creating a multi-node docker cluster too. But I'm not sure if Bigtop takes > a custom built Hadoop (from the instructions I read, it builds from a

Re: [DISCUSS] Official Docker Image at release time

2016-07-19 Thread Roman Shaposhnik
On Tue, Jul 19, 2016 at 8:12 AM, Sean Busbey wrote: > FWIW, there is a "blessed" apache area on docker hub now, and it's > just an INFRA request to point out the needed Dockerfile in the repo. > > PMCs can also request write access to bintray hosting of docker images > for

FOSDEM 2016 - take action by 4th of December 2015

2015-11-30 Thread Roman Shaposhnik
As most of you probably know FOSDEM 2016 (the biggest, 100% free open source developer conference) is right around the corner: https://fosdem.org/2016/ We hope to have an ASF booth and we would love to see as many ASF projects as possible present at various tracks (AKA Developer rooms):

[jira] [Resolved] (YARN-1329) yarn-config.sh overwrites YARN_CONF_DIR indiscriminately

2015-05-08 Thread Roman Shaposhnik (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roman Shaposhnik resolved YARN-1329. Resolution: Cannot Reproduce This is no longer a problem in both trunk and branch-2 yarn

Re: test-patch failing with OOM errors in javah

2013-10-30 Thread Roman Shaposhnik
I can take a look sometime later today. Meantime I can only say that I've been running into 1Gb limit in a few builds as of late. These days -- I just go with 2G by default. Thanks, Roman. On Wed, Oct 30, 2013 at 3:33 PM, Alejandro Abdelnur t...@cloudera.com wrote: The following is happening in

[jira] [Created] (YARN-1247) test-container-executor has gotten out of sync with the changes to container-executor

2013-09-27 Thread Roman Shaposhnik (JIRA)
Roman Shaposhnik created YARN-1247: -- Summary: test-container-executor has gotten out of sync with the changes to container-executor Key: YARN-1247 URL: https://issues.apache.org/jira/browse/YARN-1247

[jira] [Created] (YARN-1194) TestContainerLogsPage test fails on trunk

2013-09-13 Thread Roman Shaposhnik (JIRA)
Roman Shaposhnik created YARN-1194: -- Summary: TestContainerLogsPage test fails on trunk Key: YARN-1194 URL: https://issues.apache.org/jira/browse/YARN-1194 Project: Hadoop YARN Issue Type

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-06-28 Thread Roman Shaposhnik
I think it would very useful if somebody more familiar with HDFS (Suresh?) could take a look at: https://issues.apache.org/jira/browse/HDFS-4940 Suresh was very helpful in unblocking the client side of things, but even after I followed his recommendations on the heap size, etc. The NN still

Re: Heads up: branch-2.1-beta

2013-06-19 Thread Roman Shaposhnik
On Tue, Jun 18, 2013 at 11:58 PM, Arun C Murthy a...@hortonworks.com wrote: Ping. Any luck? Unfortunately I've ran into: https://issues.apache.org/jira/browse/HADOOP-9654 which was caused by the unrelated memory pressure on the NN, but it had an unfortunate side effect of making the rest of

Re: Heads up: branch-2.1-beta

2013-06-10 Thread Roman Shaposhnik
On Thu, Jun 6, 2013 at 4:48 AM, Arun C Murthy a...@hortonworks.com wrote: On Jun 5, 2013, at 11:04 AM, Roman Shaposhnik wrote On the Bigtop side of things, once we have stable Bigtop 0.6.0 platform based on Hadoop 2.0.x codeline we plan to start running the same battery of integration tests

Re: [VOTE] Release Apache Hadoop 2.0.4.1-alpha

2013-05-31 Thread Roman Shaposhnik
On Thu, May 30, 2013 at 10:50 PM, Konstantin Boudnik c...@apache.org wrote: Thanks Alejandro, that's what my plan for the morning. Thanks for putting together the check-list - would be easier for me not to miss anything. I am aiming to have the bits out by noon or so. Appreciate the help!

Re: Heads up - 2.0.5-beta

2013-04-29 Thread Roman Shaposhnik
On Fri, Apr 26, 2013 at 11:15 AM, Arun C Murthy a...@hortonworks.com wrote: On Apr 25, 2013, at 7:31 PM, Roman Shaposhnik wrote: On Thu, Apr 25, 2013 at 6:34 PM, Arun C Murthy a...@hortonworks.com wrote: With that in mind, I really want to make a serious push to lock down APIs and wire