Re: jenkins nightly build

2023-01-12 Thread MrAsanjar
bump On Tue, Dec 6, 2022 at 12:00 PM MrAsanjar wrote: > Hi all, > What is the status of Jenkins nightly build > https://ci.bigtop.apache.org/job/Bigtop-trunk-packages/? > Do we still need the Jenkins slave for ppc64le? >

jenkins nightly build

2022-12-06 Thread MrAsanjar
Hi all, What is the status of Jenkins nightly build https://ci.bigtop.apache.org/job/Bigtop-trunk-packages/? Do we still need the Jenkins slave for ppc64le?

Re: docker worker ppc-2 down

2022-01-28 Thread MrAsanjar
Hi team, it is running now. Please next time email me directly to asan...@apache.com or amir.san...@ibm.com On Fri, Jan 28, 2022 at 4:32 AM Luca Toscano wrote: > Hi everybody, > > In a previous email I mentioned the fact that the docker ppc-2 worker > has been down for a while. It was mentioned

Re: [jira] [Created] (BIGTOP-3613) Review log4j configurations for CVE-2021-44228

2021-12-13 Thread MrAsanjar
I agree. Meanwhile if the log4j version is v2.1 or greater, we should add the following runtime workaround in the Apache Bigtop site for the current release. set "-Dlog4j2.formatMsgNoLookups=true" to JVM at runtime. On Sat, Dec 11, 2021 at 5:22 AM Luca Toscano (Jira) wrote: > Luca Toscano

Re: Power (ppc64le) CI/CD upgrade

2021-12-13 Thread MrAsanjar
It is weird since, from the logs, it seems that the node works but it > >>> fails at the end when trying to push to dockerhub: > >>> > >>> > https://ci.bigtop.apache.org/job/Docker-Puppet-Trunk/DISTRO=debian-10,PLATFORM=ppc64le-slave/lastBuild/console > >

Re: Power (ppc64le) CI/CD upgrade

2021-12-02 Thread MrAsanjar
done, please verify On Thu, Dec 2, 2021 at 12:33 PM MrAsanjar wrote: > Hi > I have good news and bad news :) The good news is IBM has upgraded the > Power CI/CD server to a faster processor with 16 cores and NVMe drives. > The bad news is during the process, somehow, cloning had fa

Re: Power (ppc64le) CI/CD upgrade

2021-12-02 Thread MrAsanjar
:13 AM MrAsanjar wrote: > Hi team, > IBM is planning to upgrade and relocate the apache bigtop server next > week, again. > There will be a short downtime. Hopefully, the IP addresses will not > change. I'll keep you posted > > On Sun, Oct 24, 2021 at 11:29 AM Evans Y

Re: Power (ppc64le) CI/CD upgrade

2021-11-19 Thread MrAsanjar
Hi team, IBM is planning to upgrade and relocate the apache bigtop server next week, again. There will be a short downtime. Hopefully, the IP addresses will not change. I'll keep you posted On Sun, Oct 24, 2021 at 11:29 AM Evans Ye wrote: > Thanks for the notice, Amir. > > MrAsanjar

Power (ppc64le) CI/CD upgrade

2021-10-22 Thread MrAsanjar
Hi team, IBM plans to upgrade the current Jenkins slave to high-end Power9 with SSD or nvme drives, perhaps next week. There will be a short interruption in the availability.

Upgrade Spark to 3.1.2 or 3.0.2 Version

2021-07-23 Thread MrAsanjar
Hi team, Is there any objection to investigating upgrading the Spark version? The current targetted release, 3.0.1, is *from Sept 2020*.

Re: OpenPOWER Cluster

2021-05-18 Thread MrAsanjar .
Hi Olaf, I got the email and completed the survey on behalf of the Apache bigtop community :) On Tue, May 18, 2021 at 4:40 AM Olaf Flebbe wrote: > Hi Amir and others involved! > > I received an email from the OSL OpenPOWER Computing Cluster Admins > concerning a survey and possible shutdown of

Re: PPC CI server failure

2021-05-03 Thread MrAsanjar .
Olaf > > > > > Am 16.04.2021 um 10:49 schrieb Evans Ye : > > > > > > Let me help. I was busy on a thing. > > > > > > > > > MrAsanjar . 於 2021年4月15日 週四 下午10:30寫道: > > > > > >> In order to set up the new Jenkins slave fo

Re: [ANNOUNCE] Kengo Seki is now officially the chair of Apache Bigtop

2021-05-03 Thread MrAsanjar .
congrats Kengo On Sat, Apr 24, 2021 at 9:27 PM Kengo Seki wrote: > Thank you for voting and heartwarming messages, everyone! > I'll do my best to keep our community active, cooperative and > productive as ever. > > Kengo Seki > > On Fri, Apr 23, 2021 at 1:07 AM Konstantin Boudnik wrote: > > >

Re: PPC CI server failure

2021-04-15 Thread MrAsanjar .
In order to set up the new Jenkins slave for ppc64le ( https://issues.apache.org/jira/browse/BIGTOP-3534) we need Jenkins master's public ssh key. Who can help me here? On Fri, Apr 2, 2021 at 4:00 PM MrAsanjar wrote: > I have verified the state of ppc64le VM, it is operational. Could

Re: PPC CI server failure

2021-04-02 Thread MrAsanjar
I have verified the state of ppc64le VM, it is operational. Could we enable the ppc64le build before OpenStack flag the VM as ideal again. On Thu, Apr 1, 2021 at 4:08 PM MrAsanjar wrote: > Hi lads > I just got an email that IBM has reinstated the ppc64le VM. > > > On Mon, Mar 29

Re: PPC CI server failure

2021-04-01 Thread MrAsanjar
helping on this, Asanjar! > > > > Regards, > > > > Jun > > > > MrAsanjar 于2021年3月29日周一 上午10:18写道: > > > > > Hi old friends :) > > > We should have a ppc64le VM back online sometime this week. I'll keep > you > > > all posted. > > >

Re: PPC CI server failure

2021-03-28 Thread MrAsanjar
ease process? > Thanks! > > Best, > Evans > > Kengo Seki 於 2020年11月18日 週三 上午7:26寫道: > > > Thank you for checking, Evans and Amir! > > > > Kengo Seki > > > > On Wed, Nov 18, 2020 at 2:09 AM Evans Ye wrote: > > > > > > Thank you, Amir.

Re: PPC CI server failure

2020-11-17 Thread MrAsanjar
> Best, > Evans Ye > > > > MrAsanjar 於 2020年9月17日 週四 下午8:56寫道: > > > I have informed IBM management regarding the situation, waiting for a > > reply. > > > > On Thu, Sep 17, 2020 at 3:47 AM Evans Ye wrote: > > > > > Ok. Thanks for doing

Re: PPC CI server failure

2020-09-17 Thread MrAsanjar
gtop-trunk-packages > > * Bigtop-trunk-repos > > > > * Remove-All-Docker-Containers-Except-Nexus > > * Remove-Dangling-Docker-Images > > * Remove-Inactive-Containers > > > > Kengo Seki > > > > On Wed, Sep 16, 2020 at 7:35 PM Evans Ye wrote: > >

Re: PPC CI server failure

2020-09-15 Thread MrAsanjar
Hi Evans, Let me see what I can do. Give me 24 hr :) On Tue, Sep 15, 2020 at 10:51 AM Evans Ye wrote: > Yes. I think the action is correct. However [2] might be a different thing > for PPC integration in Hadoop. > > Amir, > Could you confirm? > > Kengo Seki 於 2020年9月14日 週一 下午9:56寫道: > >> Thank

Re: Happy new year!

2019-12-31 Thread MrAsanjar .
happy new year all. On Tue, Dec 31, 2019 at 4:02 PM Jay Vyas wrote: > Likewise everyone . > Let’s get together soon. > > Sent from my iPhone > > > On Dec 31, 2019, at 2:48 PM, Konstantin Boudnik wrote: > > > > Happy New Year, yall! It is great to see this project coming to its > 10th year > >

Re: What is the proper way to include prebuilt phantomjs?

2018-05-13 Thread MrAsanjar
Nice job Jun HE, Olaf, As I no longer have access to any ppc64le systems, will not be able to test/implement a similar patch. However, if given proper credential to the Bigtop ppc64le build system, I'll be glad to implement it. On Thu, May 10, 2018 at 3:38 AM, Olaf Flebbe

Re: [DISCUSS] Remove hue from bigtop

2018-04-11 Thread MrAsanjar
+1 On Wed, Apr 11, 2018 at 9:00 AM, Evans Ye wrote: > +1 > > Jun HE 於 2018年4月11日 週三,上午11:16寫道: > > > +1 > > > > 2018-04-11 3:05 GMT+08:00 Konstantin Boudnik : > > > > > About time. > > > +1 > > > -- > > > With regards, > > > Konstantin

Re: Hbase/Hue/oozie and others CI build failure

2018-02-14 Thread MrAsanjar .
Olaf, Most of these issues are caused by Hive upgrade from 1.x to 2.x i.e. https://issues.apache.org/jira/browse/BIGTOP-2986 https://issues.apache.org/jira/browse/BIGTOP-2987 On Wed, Feb 14, 2018 at 7:41 AM, Jun HE wrote: > Hi, Olaf, > > Thanks for detail description. >

Re: [VOTE] Release Bigtop version 1.2.1

2017-10-31 Thread MrAsanjar .
Oct 25, 2017 at 9:06 AM, Evans Ye <evan...@apache.org> > wrote: > > > > > > > > > That's great! The original deadline is October 29th, 2017 at noon > > PDT. > > > > > We can reset that based on your timeline for conducting the > testing. > > > > > &

Re: [VOTE] Release Bigtop version 1.2.1

2017-10-24 Thread MrAsanjar .
when is the deadline?! I would like to get my team verify Bigtop on ppc64le platform, however it wpn't be possible till next week, due to few other commitments. On Tue, Oct 24, 2017 at 9:12 AM, Evans Ye wrote: > This is the vote for release 1.2.1 of Apache Bigtop. > > It

Re: upgrading Ambari to version 2.5.2

2017-10-13 Thread MrAsanjar .
ok, will do On Tue, Oct 10, 2017 at 2:19 PM, Olaf Flebbe <o...@oflebbe.de> wrote: > Hi Amir, > > if you file a JIRA and doing a commit referencing the JIRA within the > commit subject, no objections. > > Olaf > > > Am 10.10.2017 um 15:53 schrieb MrAsanjar . <

upgrading Ambari to version 2.5.2

2017-10-10 Thread MrAsanjar .
Hi team, Before I commit to the work, is there any objection to upgrade Ambari from 2.5.0 to 2.5.2? There are multiple fixes in V2.5.2 for ppc64le platform that are needed. i.e. https://issues.apache.org/jira/browse/AMBARI-21054 https://issues.apache.org/jira/browse/AMBARI-20813

bigtop repo fails to initialize on Ubuntu 17.04

2017-07-27 Thread MrAsanjar .
Hi team, Enabling Bigtop 1.2.0 repository fails on Ubuntu 17.04, but works on 16.04 (there is however a warning). How to reproduce: 1) wget -O- http://archive.apache.org/dist/bigtop/bigtop-1.2.0/repos/GPG-KEY-bigtop | sudo apt-key add - 2) wget -O /etc/apt/sources.list.d/bigtop-1.2.0.list

Re: Bigtop CI is down

2017-07-20 Thread MrAsanjar .
ine to > re-enable it. > > 2017-07-21 1:22 GMT+08:00 MrAsanjar . <afsan...@gmail.com>: > > > Our admin has upgraded the Bigtop Power8 CI system, but it appears > Jenkins > > build has been disabled, > > https://ci.bigtop.apache.org/job/Bigtop-trunk-packages. Could we enable > > the > > build for a day, to test the upgrades. > > >

Bigtop CI is down

2017-07-20 Thread MrAsanjar .
Our admin has upgraded the Bigtop Power8 CI system, but it appears Jenkins build has been disabled, https://ci.bigtop.apache.org/job/Bigtop-trunk-packages. Could we enable the build for a day, to test the upgrades.

Re: Bigtop for Hadoop 2.7.4

2017-07-13 Thread MrAsanjar .
where is source for hadoop 2.7.4? can't find it in github. need it to verify JIRA https://issues.apache.org/jira/browse/HADOOP-13579 On Thu, Jul 13, 2017 at 7:52 PM, Konstantin Boudnik wrote: > On Thu, Jul 13, 2017 at 05:50PM, Konstantin Boudnik wrote: > > Certainly having an

Re: Crail as part of BigTop

2017-07-10 Thread MrAsanjar .
Thanks Cos, On Fri, Jul 7, 2017 at 3:39 PM, Konstantin Boudnik wrote: > This is a good example [1] of what we were referring to. > > Thanks, > Cos > > [1] https://issues.apache.org/jira/browse/BIGTOP-2283 > -- > Take care, > Konstantin (Cos) Boudnik > 2CAC 8312 4870 D885

Re: Who's in town for Dataworks Summit?

2017-06-07 Thread MrAsanjar .
+1 On Wed, Jun 7, 2017 at 12:19 PM, Evans Ye wrote: > +1 ! > > 2017-06-08 1:01 GMT+08:00 Roman Shaposhnik : > > > Hi! > > > > I know that Cos and I will be attending. Anyone else > > has definite travel plans for next week? Would be great > > to hang

Re: [DISCUSS] Bigtop 1.2.1 release

2017-05-28 Thread MrAsanjar .
Evans, +1 on the 1.2.1 release. I have it on my to-do list to investigate ppc64le build issues this week.. On Sun, May 28, 2017 at 8:14 AM, Arnaud Launay wrote: > Le Sun, May 28, 2017 at 06:54:53PM +0800, Evans Ye a écrit: > > Please feel free to throw your thoughts for

Re: Bigtop Lunch gathering @ Apache Big Data North America

2017-05-18 Thread MrAsanjar .
> >> >> > Am 28.03.2017 um 15:50 schrieb Konstantin Boudnik <c...@apache.org > >: > >> >> > > >> >> > I am not coming this year. Will miss yall guys! > >> >> > -- > >> >> > Take care, > >>

Re: Bigtop Ambari status?

2017-04-12 Thread MrAsanjar .
thanks, very helpful. On Wed, Apr 12, 2017 at 1:50 PM, Roman Shaposhnik <ro...@shaposhnik.org> wrote: > On Wed, Apr 12, 2017 at 10:40 AM, MrAsanjar . <afsan...@gmail.com> wrote: > > Hi > > What is the status of Bigtop Ambari 2.5? Is it ready for prime time? > &g

Bigtop Ambari status?

2017-04-12 Thread MrAsanjar .
Hi What is the status of Bigtop Ambari 2.5? Is it ready for prime time? I have been having multiple issues on both Fedora 25 and Ubuntu 16.04. On Fedroa 25, "ambari-server setup" command fails with below error Enter advanced database configuration [y/n] (n)? Configuring database... Default

Re: spark 1.6.x package in bigtop 1.2 repo

2017-04-11 Thread MrAsanjar .
e what's inside that package. But it seems to be out of > dependency. > > In general, your path of upgrade is important and worth to be document. > I think we can have an Upgrade guide for these issues. > > > 2017-04-12 2:55 GMT+08:00 MrAsanjar . <afsan...@gmail.com>:

Re: spark 1.6.x package in bigtop 1.2 repo

2017-04-11 Thread MrAsanjar .
ill packages spark1 to workaround some components compatibility issue. > I guess that's why you got 1.6.2 available from 1.2 repo. > > How you get these packages installed? > > 2017-04-12 0:53 GMT+08:00 MrAsanjar . <afsan...@gmail.com>: > > > Hi team, > > Could anyone

serious regression: spark-worker fails to start in production.

2017-04-11 Thread MrAsanjar .
Hi all, The failure is caused by BIGTOP-2490 that incorrectly assumes only puppet managed deployment !! Opened JIRA https://issues.apache.org/jira/browse/BIGTOP-2738

spark 1.6.x package in bigtop 1.2 repo

2017-04-11 Thread MrAsanjar .
Hi team, Could anyone explain why we have spark-extras , a spark 1.6 package, added to the ubuntu-16.04 repository for Bigtop 1.2? It should be all spark 2.1 packages and not 1.6. List of spark packages in Bigtop 1.2 repo: spark-core/stable,now 2.1.0-1 all [installed] spark-datanucleus/stable

Re: [VOTE] Release Bigtop version 1.2.0

2017-04-01 Thread MrAsanjar .
+1 Even, as Roman suggested, I believe x86 version of Ambari should function the same on ppc64le, but I have not tested this scenario yet. It important to note, x86 built Zeppelin and Tez passed the test. On Sat, Apr 1, 2017 at 12:39 AM, Konstantin Boudnik wrote: > One way of

N.America apachcon & bigtop meetup

2017-03-27 Thread MrAsanjar .
is there any plans for Bigtop meetups during NA ApacheCon conference in Miami?

Re: Releasing 1.2 for non-x86 architectures

2017-03-27 Thread MrAsanjar .
, Roman Shaposhnik <ro...@shaposhnik.org> wrote: > On Mon, Mar 27, 2017 at 10:05 AM, MrAsanjar . <afsan...@gmail.com> wrote: > > we need to be careful here, some components have build dependencies to > > other native components. Casing point, Zeppelin, Tez, and A

Re: what happened to ppc64le build?

2017-03-27 Thread MrAsanjar .
thanks Roman On Mon, Mar 27, 2017 at 12:18 PM, Roman Shaposhnik <ro...@shaposhnik.org> wrote: > We're using this URL now: >https://ci.bigtop.apache.org/view/Packages/job/Bigtop- > trunk-packages-by-jenkins/ > > On Mon, Mar 27, 2017 at 10:08 AM, MrAsanjar . <afsan...@

what happened to ppc64le build?

2017-03-27 Thread MrAsanjar .
HI team, I just realized the path to Bigtop builds for ppc64le is no longer valid. https://ci.bigtop.apache.org/job/Bigtop-trunk-packages

Re: Releasing 1.2 for non-x86 architectures

2017-03-27 Thread MrAsanjar .
we need to be careful here, some components have build dependencies to other native components. Casing point, Zeppelin, Tez, and Amabri have dependencies to frontend-maven-plugin that pulls in native NodeJS binary based on the build system. On Sat, Mar 25, 2017 at 2:04 PM, Roman Shaposhnik

bigtop CI issue

2017-02-17 Thread MrAsanjar .
guys, I had to disabled ubuntu-14.04 arm64 build to unblocked the bigtop build, it had been blocked since Jan 25th. Would someone investigate why ARM build system was not responding?

Re: gpdb question?

2017-01-19 Thread MrAsanjar .
it seems the gpdb source downloaded for the build is not from github master, check the config.guess timestamp msg: config.guess timestamp = 2011-05-11 uname -m = ppc64le uname -r = 4.4.0-34-generic uname -s = Linux uname -v = #53-Ubuntu SMP Wed Jul 27 16:04:07 UTC 2016 The new config.guess has

gpdb question?

2017-01-19 Thread MrAsanjar .
Hi all, Does anyone know how often gpdb release package updated ? The current gpdb release (v4.3.99.0) is missing PR https://github.com/greenplum-db/gpdb/pull/1554 that is required for build on both ppc64le and aarch64 architectures.

need help - ppc64le random build failures

2017-01-17 Thread MrAsanjar .
hi all, I would appreciate your help in understanding random build failures that have plagued Power builds in the last couple of weeks. Components are failing randomly without any changes to the code or build environment. However, they all share similar failure messages :

Re: Call for Release Manager

2017-01-10 Thread MrAsanjar .
Guys, I am on a business trip for the next 10 days, however would be glad to help as much as possible. What can I do (or break) ?

Re: [ANNOUNCE] Announcing Apache Spark 2.1.0

2017-01-02 Thread MrAsanjar .
if there is no objection, I will push patch in JIRA https://issues.apache.org/jira/browse/BIGTOP-2653 by the end of today (in 12 hrs) On Sun, Jan 1, 2017 at 6:39 PM, MrAsanjar . <afsan...@gmail.com> wrote: > Built the entire stack using spark 2.1 on ubuntu 16.04 without any > fa

Re: [ANNOUNCE] Announcing Apache Spark 2.1.0

2017-01-01 Thread MrAsanjar .
Built the entire stack using spark 2.1 on ubuntu 16.04 without any failure. Going to submit a patch shortly. On Dec 31, 2016 4:45 AM, "Evans Ye" <evan...@apache.org> wrote: > +1 > Spark 2.1 is more stable for production. Would be better to be included in > 1.2 releas

bigtop deployment with Ambari

2016-12-30 Thread MrAsanjar .
Has anyone installed bigtop stack using Ambari?

Re: [ANNOUNCE] Announcing Apache Spark 2.1.0

2016-12-30 Thread MrAsanjar .
working on it.. On Thu, Dec 29, 2016 at 12:07 PM, Roman Shaposhnik <ro...@shaposhnik.org> wrote: > On Thu, Dec 29, 2016 at 8:22 AM, MrAsanjar . <afsan...@gmail.com> wrote: > > team, > > It appears there have been many fixes and enhancement gone into spark > 2.1, &

Re: Major Updates

2016-12-30 Thread MrAsanjar .
; > > > Am 30.12.2016 um 17:55 schrieb MrAsanjar . <afsan...@gmail.com>: > > > > https://www.linkedin.com/pulse/installing-openjdk-8- > tomcat-debian-jessie-iga-made-muliarsa > > > > On Fri, Dec 30, 2016 at 10:50 AM, Olaf Flebbe <o...@oflebbe.de> wrote: >

Re: Major Updates

2016-12-30 Thread MrAsanjar .
https://www.linkedin.com/pulse/installing-openjdk-8-tomcat-debian-jessie-iga-made-muliarsa On Fri, Dec 30, 2016 at 10:50 AM, Olaf Flebbe wrote: > Hi, > > just to make sure that everyone notices: My question about handling JDK7 > vs. JDK8 raised concerns byArnaud Launay. He

Fwd: [ANNOUNCE] Announcing Apache Spark 2.1.0

2016-12-29 Thread MrAsanjar .
team, It appears there have been many fixes and enhancement gone into spark 2.1, specially adding Kafka 0.10.support. I propose to upgrade bigtop's Spark to 2.1. Any thoughts? -- Forwarded message -- From: Yin Huai Date: Thu, Dec 29, 2016 at 10:02 AM

merry xmas team

2016-12-25 Thread MrAsanjar .

Re: Removal of ubuntu 14.04

2016-12-23 Thread MrAsanjar .
+1 it would be easier to maintain the stack if we have less build platform to support. On Fri, Dec 23, 2016 at 4:16 PM, Roman Shaposhnik wrote: > I'd be +1 on getting rid of 14.04. > > Thanks, > Roman. > > On Fri, Dec 23, 2016 at 12:49 PM, Olaf Flebbe

Re: java 1.8

2016-12-16 Thread MrAsanjar .
I'm heading back home tomorrow, will start working on these issues again. BTW, thanks for your and Roman's helps in accelerating move to JAVA 8 and consequently Bigtop release 1.2.0 . On Sat, Dec 17, 2016 at 6:24 AM, MrAsanjar . <afsan...@gmail.com> wrote: > interesting, i got

Re: java 1.8

2016-12-16 Thread MrAsanjar .
me. > > Olaf > > > Am 16.12.2016 um 18:19 schrieb MrAsanjar . <afsan...@gmail.com>: > > > > yap .. I fixed kite issue by changing the jdk_version few weeks ago but > had > > regressions with centos6 > > > > On Sat, Dec 17, 2016 at 12:40 AM, Olaf

Re: java 1.8

2016-12-16 Thread MrAsanjar .
yap .. I fixed kite issue by changing the jdk_version few weeks ago but had regressions with centos6 On Sat, Dec 17, 2016 at 12:40 AM, Olaf Flebbe <o...@oflebbe.de> wrote: > Holy crap. > > Olaf > > > Am 16.12.2016 um 17:33 schrieb MrAsanjar . <afsan...@gmail.com&g

Re: java 1.8

2016-12-16 Thread MrAsanjar .
it is used in kite, oozie, and pig On Fri, Dec 16, 2016 at 11:15 PM, Olaf Flebbe <o...@oflebbe.de> wrote: > Hi, > > I doubt that the jdk within bigtop.bom does anything. You could even set > it to "java 10" > > Olaf > > > > Am 16.12.2016 um

Re: java 1.8

2016-12-16 Thread MrAsanjar .
+1 i am all for it :) however that would require change to jdk_version (1.7 to 1.8) in bigtop.bom. I was going to do that but in my initial testing broke centos6 and debian builds. On Fri, Dec 16, 2016 at 4:51 AM, Olaf Flebbe wrote: > Hi *, > > I found out that current

Fedora 25+JAVA 8 for x86

2016-12-08 Thread MrAsanjar .
Hi team, I am planing to enable Bigtop's Jenkins server to build the entire stack on Fedora 25+JAVA 8 for x86, as it was done for ppc64le architecture. Is there any objections? Note: As part of Bigtop's release 1.2.0 development plan, JAVA 8 will be the default JDK. Rest assured there will be

Re: New Committer Jonathan Kelly

2016-12-08 Thread MrAsanjar .
Congrats On Thu, Dec 8, 2016 at 12:40 AM, Evans Ye wrote: > Congrats and welcome, Jonathan! > > 2016-12-08 14:39 GMT+08:00 Olaf Flebbe : > > > The Project Management Committee (PMC) for Apache Bigtop has asked > > Jonathan Kelly > > to become a committer and

Re: Removing 1.0.1 release

2016-12-08 Thread MrAsanjar .
no objection.. On Wed, Dec 7, 2016 at 4:04 PM, Konstantin Boudnik wrote: > Enough time has passed for anyone to object, so I'm closing this release > tag > in JIRA right away. > > Cos > > On Mon, Nov 21, 2016 at 11:18AM, Konstantin Boudnik wrote: > > Guys, > > > > I see 1.0.1

Re: kafka <-> flume

2016-12-07 Thread MrAsanjar .
Olaf/Roman, Looking at what other distributions have done, it appears they have updated TestKafkaSink.java in Flume to be compatible with Kafka 1.x APIs. We either should do the same or disable build/packaging of Flume's testcases. On Wed, Dec 7, 2016 at 1:46 AM, MrAsanjar . <afsan...@gmail.

Re: kafka <-> flume

2016-12-06 Thread MrAsanjar .
wrote: > 0.10.1 then perhaps? > > Thanks, > Roman. > > On Sun, Dec 4, 2016 at 7:02 PM, MrAsanjar . <afsan...@gmail.com> wrote: > > the upgrade was done to resolve Kafka build failure caused by Spark 2.0.x > > and subsequent SCALA upgrades.. Kafka 0.10.0 supports

Re: New committer Kengo Seki

2016-12-06 Thread MrAsanjar .
Welcome aboard On Tue, Dec 6, 2016 at 7:43 PM, Roman Shaposhnik wrote: > Welcome to the club, indeed! > > On Tue, Dec 6, 2016 at 5:43 PM, 김영우 (YoungWoo Kim) > wrote: > > Congrats and welcome Kengo! > > > > - Youngwoo > > > > 2016. 12. 7. 오전 9:06에

Re: Hadoop 2.7.3 upgrade brook Giraph build ..

2016-12-06 Thread MrAsanjar .
I rather move to Hadoop 2.7.4, if the release day is near. On Tue, Dec 6, 2016 at 7:33 PM, Roman Shaposhnik wrote: > Soo what's the consensus here? > > Thanks, > Roman. > > On Wed, Nov 30, 2016 at 11:15 AM, Akira Ajisaka > wrote: > > Hi, > >

Re: kafka <-> flume

2016-12-04 Thread MrAsanjar .
the upgrade was done to resolve Kafka build failure caused by Spark 2.0.x and subsequent SCALA upgrades.. Kafka 0.10.0 supports the latest scala. Build error msg: Building project 'core' with Scala version 2.10.5 FAILURE: Build failed with an exception. * Where: Build file

the latest x86 build is bad

2016-12-03 Thread MrAsanjar .
Hi All, I am not sure if my last two patches have contributed to the failures, nevertheless x86 build is dead. Any thoughts? looks like a docker deamon error. https://ci.bigtop.apache.org/job/Bigtop-trunk-packages/364/ Error messages: Started by upstream project "Bigtop-trunk-packages

Re: Hadoop 2.7.3 upgrade brook Giraph build ..

2016-11-28 Thread MrAsanjar .
+1 on hadoop 3 development build.. On Mon, Nov 28, 2016 at 4:38 PM, Roman Shaposhnik wrote: > On Mon, Nov 28, 2016 at 11:10 AM, Olaf Flebbe wrote: > > Hi, > > > > I vote for patching Giraph according to GIRAPH-1112, since it will be a > future-proof (i.e.

Hadoop 2.7.3 upgrade brook Giraph build ..

2016-11-28 Thread MrAsanjar .
As part of Bigtop release 1.2 road-map, I upgraded hadoop to version 2.7.3 last week. Unfortunately it appears the recent changes (HADOOP-11252) in Hadoop 2.7.3 has broken source-level compatibility resulting in Apache Graph build-break. This issue has been reported by

Re: spark compile: solution ?

2016-11-24 Thread MrAsanjar .
+1 I agree with disabling ZincServer On Thu, Nov 24, 2016 at 12:03 PM, Olaf Flebbe wrote: > Hi, > > I think I got a clue why spark compile fails in our CI, but this may not > explain why compile fails for Ganesh. > > The compile job in CI is started with option > > docker run

Re: Bigtop v1.2.0

2016-11-21 Thread MrAsanjar .
sure On Mon, Nov 21, 2016 at 1:16 PM, Konstantin Boudnik <c...@apache.org> wrote: > There's a JIRA for the release work - BIGTOP-2282 > > Shall we move the conversation there? > > Cos > > On Mon, Nov 21, 2016 at 01:07PM, MrAsanjar . wrote: > > Hi all, s

Re: need help - zeppelin 0.6.2 installation fails

2016-11-21 Thread MrAsanjar .
please ignore, could not reproduce it on the new system.. must had been a bad download On Mon, Nov 21, 2016 at 11:48 AM, MrAsanjar . <afsan...@gmail.com> wrote: > Guys, latest zeppelin fails installation with below error: > Not sure if this is a debian packing issue, could

Bigtop v1.2.0

2016-11-21 Thread MrAsanjar .
Hi all, since Cos is finally back from his sabbatical leave, about TIME !!! lets discuss Bigtop release v1.2.0. My wish list is noted in *blue. *Please add your comments or wish list. *<< add Ambari support - major work, might be too late >>* alluxio1.0.1 apex

need help - zeppelin 0.6.2 installation fails

2016-11-21 Thread MrAsanjar .
Guys, latest zeppelin fails installation with below error: Not sure if this is a debian packing issue, could someone try it on centos or fedora system? sudo dpkg -i zeppelin_0.6.2-1_all.deb (Reading database ... 20834 files and directories currently installed.) Preparing to unpack

Re: Five build-breaks due to migration to Spark 2

2016-11-17 Thread MrAsanjar .
ith > > > the spark RPM build. Sorry about missing this the first time. > > > > > > As for dividing and conquering, unfortunately I can't really work on > > fixing > > > the other apps right now. :( > > > > > > As for Spark 2.0.2, yes, we can upg

Re: Five build-breaks due to migration to Spark 2

2016-11-17 Thread MrAsanjar .
could we upgrade to Spark 2.0.2, it looks like it was released few days ago.. is it stable enough? On Thu, Nov 17, 2016 at 7:02 PM, MrAsanjar . <afsan...@gmail.com> wrote: > Great, lets divide and concur . > I will do phoenix and hive.. going to open JIRAs for five components > &

Re: Five build-breaks due to migration to Spark 2

2016-11-17 Thread MrAsanjar .
on #1/3. We decided on > https://issues.apache.org/jira/browse/BIGTOP-2569 that it's best not to > have Spark 2 as "spark2", and I'd argue that it's best not to do that even > temporarily (option #3). > > ~ Jonathan > > On Thu, Nov 17, 2016 at 8:30 AM MrAsanjar . <afsan...@gmail.com&g

Five build-breaks due to migration to Spark 2

2016-11-17 Thread MrAsanjar .
Guys we have three choices: 1) Make spark 1.6.2 the default spark component and create a new spark2 component for spark 2.0.1 2) Upgrade All components to the versions that support Spark 2. 3) option 1 as a short term fix while gradually work on option 2 Your thoughts ?

Re: Bigtop Spark 2.0.1 installation Failure

2016-11-17 Thread MrAsanjar .
kevin, we could use your Ubuntu expertise here. https://issues.apache.org/jira/browse/BIGTOP-2588 On Wed, Nov 16, 2016 at 8:34 AM, MrAsanjar . <afsan...@gmail.com> wrote: > https://issues.apache.org/jira/browse/BIGTOP-2588 > > On Wed, Nov 16, 2016 at 8:30 AM, MrAsanjar . <

Re: Bigtop Spark 2.0.1 installation Failure

2016-11-15 Thread MrAsanjar .
https://issues.apache.org/jira/browse/BIGTOP-2588 On Wed, Nov 16, 2016 at 8:30 AM, MrAsanjar . <afsan...@gmail.com> wrote: > will do > > On Wed, Nov 16, 2016 at 8:25 AM, Olaf Flebbe <o...@oflebbe.de> wrote: > >> Hi Amir, >> >> please open a JI

Re: Bigtop Spark 2.0.1 installation Failure

2016-11-15 Thread MrAsanjar .
will do On Wed, Nov 16, 2016 at 8:25 AM, Olaf Flebbe <o...@oflebbe.de> wrote: > Hi Amir, > > please open a JIRA with this error message. That's clearly a packaging > issue. > > Greetings, > Olaf > > > > Am 16.11.2016 um 08:17 schrieb MrAsanjar . <afsan..

Bigtop Spark 2.0.1 installation Failure

2016-11-15 Thread MrAsanjar .
my team is reporting following failure during Spark 2.0.1 installation of debian packages, has anyone else encounter such failure? same procedure works with Spark 1.6.2. Platform is Ubuntu-16.04 home/guest/bigtop_cluster/pkg_spark-2.0.1 + sudo RUNLEVEL=1 dpkg -i spark-core_2.0.1-1_all.deb

spark 2.0 and charms

2016-11-14 Thread MrAsanjar .
Kevin, Could we modify spark charms to deploy spark 2.0 as well? Or is it hardcoded to install only from Bigtop v1.1.0 repository.

Re: Spark 2 and Zeppelin

2016-11-14 Thread MrAsanjar .
> > wrote: > > > Good point. I can probably contribute a patch for this upgrade. > > > > ~ Jonathan > > > > On Mon, Nov 14, 2016 at 10:12 AM MrAsanjar . <afsan...@gmail.com> wrote: > > > > Since bigtop spark is about to get upgraded to Spar

Spark 1.x family support

2016-11-14 Thread MrAsanjar .
I have added and enabled Jenkins build for the new spark1 (spark 1.6.2) component for ppc64le platform. I could do the same for x86 as well, any objections?

Thanks for your help

2016-11-12 Thread MrAsanjar .
Hi Olaf, I submitted the patch to keep spark 1.6.x family alive for the time being. https://issues.apache.org/jira/browse/BIGTOP-2582 , thanks for your guidance and patient :) What is the next step? How the new component will be add to the Jenkins build? I assumed it was automatic since it was

Re: Upgrade spark to 2.0.x (was Re: Upgrade spark to version 1.6.2)

2016-11-03 Thread MrAsanjar .
gt; > Am 03.11.2016 um 03:30 schrieb Roman Shaposhnik <ro...@shaposhnik.org>: > > > > FWIW: I can take it for a spin over the weekend. > > > > Thanks, > > Roman. > > > > On Wed, Nov 2, 2016 at 10:50 AM, MrAsanjar . <afsan...@gmail.com> wrote:

Upgrade spark to version 1.6.2

2016-11-02 Thread MrAsanjar .
Hi All, I have develop a patch https://issues.apache.org/jira/browse/BIGTOP-2565 that would upgrades the current Spark version from 1.5.1 to 1.6.2. I would greatly appreciate your feedback before I commit the patch. I do realize both Hive and Phoenix would require changes as well.

Re: X doesn't build on ppc64le

2016-11-02 Thread MrAsanjar .
Hi Roman, There are two long-term plans: 1) Build dependencies: Long term fix is to get these libraries (i.e. phatomjs and leveldbjni) into their communities, as we have done with frontend-maven-plugins and JRuby. 2) Apache Hadoop projects: Working with Hortonworks development team to contribute

adding "node" for ppc and arm64 arch

2016-10-26 Thread MrAsanjar .
Hi Roman, Would you please review patch https://issues.apache.org/jira/browse/BIGTOP-2558 before I commit it. It will have impact on your JIRA https://issues.apache.org/jira/browse/BIGTOP-2518

Re: need a mentor to contribute few patches

2016-09-21 Thread MrAsanjar .
Sorry for the incomplete email... Also, I am surprised that we don't have similar issues with ARM? How are we building zeppelin and tez for ARM architecture? On Wed, Sep 21, 2016 at 6:37 AM, MrAsanjar . <afsan...@gmail.com> wrote: > Hi Cos, > Sorry for a late reply, on the road again

  1   2   >