Re: PR 2670: Removing an old, unused NetApp plug-in

[Tutkowski, Mike]

Yeah, Paul, that JAR would no longer be needed.

> On May 23, 2018, at 1:01 PM, Paul Angus  wrote:
> 
> +1
> 
> There's a NetApp Jar in the nodist which is related I think - be nice to get 
> rid of that too.
> 
> paul.an...@shapeblue.com 
> www.shapeblue.com
> 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
> @shapeblue
> 
> 
> 
> 
> -Original Message-
> From: Tutkowski, Mike  
> Sent: 23 May 2018 19:53
> To: dev@cloudstack.apache.org
> Subject: PR 2670: Removing an old, unused NetApp plug-in
> 
> Hi everyone,
> 
> I opened the following PR today:
> 
> https://github.com/apache/cloudstack/pull/2670
> 
> There is an old, what we believe to be unused, NetApp plug-in in the 
> CloudStack codebase that I’d like to remove.
> 
> I’m sending this e-mail out for the following reasons:
> 
> 
> 1)   To see if, by chance, anyone is actually using this plug-in.
> 
> 2)   To direct any potential code reviewers to this PR, where I have 
> placed a couple questions about my commit.
> 
> To be absolutely clear here, this has nothing to do with any of the SolidFire 
> plug-ins (only an old NetApp plug-in that hasn’t been updated in years and is 
> probably not being used by anyone).
> 
> Thanks,
> Mike

Re: PR 2670: Removing an old, unused NetApp plug-in

[Tutkowski, Mike]

I actually have no idea, Rafael. Nor does there seem to be anyone remaining at 
NetApp who knows about that plug-in.

> On May 23, 2018, at 1:22 PM, Rafael Weingärtner  
> wrote:
> 
> Those APi methods that you are removing as well (AssociateLunCmd.java,
> CreateLunCmd.java, CreateVolumeOnFilerCmd.java,  CreateVolumePoolCmd.java,
> DeleteVolumePoolCmd.java, DestroyLunCmd.java, DestroyVolumeOnFilerCmd.java,
> DissociateLunCmd.java, ListLunsCmd.java, ListVolumePoolsCmd.java, and so
> on), are they ony used for this NetApp plugin? It seems a considerable
> number of external API methods being removed.
> 
> I also have another question. Are all of these methods broken? I mean, do
> they work?
> 
>> On Wed, May 23, 2018 at 4:13 PM, Will Stevens  wrote:
>> 
>> +1
>> 
>> On Wed, May 23, 2018, 3:03 PM Gabriel Beims Bräscher, <
>> gabr...@pcextreme.nl>
>> wrote:
>> 
>>> I am +1 on removing it.
>>> 
 On May 23, 2018 at 8:59 PM Paul Angus 
>> wrote:
 
 
 +1
 
 There's a NetApp Jar in the nodist which is related I think - be nice
>> to
>>> get rid of that too.
 
 paul.an...@shapeblue.com
 www.shapeblue.com
 53 Chandos Place, Covent Garden, London WC2N 4HSUK
 @shapeblue
 
 
 
 
 -Original Message-
 From: Tutkowski, Mike 
 Sent: 23 May 2018 19:53
 To: dev@cloudstack.apache.org
 Subject: PR 2670: Removing an old, unused NetApp plug-in
 
 Hi everyone,
 
 I opened the following PR today:
 
 https://github.com/apache/cloudstack/pull/2670
 
 There is an old, what we believe to be unused, NetApp plug-in in the
>>> CloudStack codebase that I’d like to remove.
 
 I’m sending this e-mail out for the following reasons:
 
 
 1) To see if, by chance, anyone is actually using this plug-in.
 
 2) To direct any potential code reviewers to this PR, where I have
>>> placed a couple questions about my commit.
 
 To be absolutely clear here, this has nothing to do with any of the
>>> SolidFire plug-ins (only an old NetApp plug-in that hasn’t been updated
>> in
>>> years and is probably not being used by anyone).
 
 Thanks,
 Mike
>>> 
>> 
> 
> 
> 
> -- 
> Rafael Weingärtner

Re: PR 2670: Removing an old, unused NetApp plug-in

[Rafael Weingärtner]

Those APi methods that you are removing as well (AssociateLunCmd.java,
CreateLunCmd.java, CreateVolumeOnFilerCmd.java,  CreateVolumePoolCmd.java,
DeleteVolumePoolCmd.java, DestroyLunCmd.java, DestroyVolumeOnFilerCmd.java,
DissociateLunCmd.java, ListLunsCmd.java, ListVolumePoolsCmd.java, and so
on), are they ony used for this NetApp plugin? It seems a considerable
number of external API methods being removed.

I also have another question. Are all of these methods broken? I mean, do
they work?

On Wed, May 23, 2018 at 4:13 PM, Will Stevens  wrote:

> +1
>
> On Wed, May 23, 2018, 3:03 PM Gabriel Beims Bräscher, <
> gabr...@pcextreme.nl>
> wrote:
>
> > I am +1 on removing it.
> >
> > > On May 23, 2018 at 8:59 PM Paul Angus 
> wrote:
> > >
> > >
> > > +1
> > >
> > > There's a NetApp Jar in the nodist which is related I think - be nice
> to
> > get rid of that too.
> > >
> > > paul.an...@shapeblue.com
> > > www.shapeblue.com
> > > 53 Chandos Place, Covent Garden, London WC2N 4HSUK
> > > @shapeblue
> > >
> > >
> > >
> > >
> > > -Original Message-
> > > From: Tutkowski, Mike 
> > > Sent: 23 May 2018 19:53
> > > To: dev@cloudstack.apache.org
> > > Subject: PR 2670: Removing an old, unused NetApp plug-in
> > >
> > > Hi everyone,
> > >
> > > I opened the following PR today:
> > >
> > > https://github.com/apache/cloudstack/pull/2670
> > >
> > > There is an old, what we believe to be unused, NetApp plug-in in the
> > CloudStack codebase that I’d like to remove.
> > >
> > > I’m sending this e-mail out for the following reasons:
> > >
> > >
> > > 1) To see if, by chance, anyone is actually using this plug-in.
> > >
> > > 2) To direct any potential code reviewers to this PR, where I have
> > placed a couple questions about my commit.
> > >
> > > To be absolutely clear here, this has nothing to do with any of the
> > SolidFire plug-ins (only an old NetApp plug-in that hasn’t been updated
> in
> > years and is probably not being used by anyone).
> > >
> > > Thanks,
> > > Mike
> >
>



-- 
Rafael Weingärtner

Re: PR 2670: Removing an old, unused NetApp plug-in

[Will Stevens]

+1

On Wed, May 23, 2018, 3:03 PM Gabriel Beims Bräscher, 
wrote:

> I am +1 on removing it.
>
> > On May 23, 2018 at 8:59 PM Paul Angus  wrote:
> >
> >
> > +1
> >
> > There's a NetApp Jar in the nodist which is related I think - be nice to
> get rid of that too.
> >
> > paul.an...@shapeblue.com
> > www.shapeblue.com
> > 53 Chandos Place, Covent Garden, London WC2N 4HSUK
> > @shapeblue
> >
> >
> >
> >
> > -Original Message-
> > From: Tutkowski, Mike 
> > Sent: 23 May 2018 19:53
> > To: dev@cloudstack.apache.org
> > Subject: PR 2670: Removing an old, unused NetApp plug-in
> >
> > Hi everyone,
> >
> > I opened the following PR today:
> >
> > https://github.com/apache/cloudstack/pull/2670
> >
> > There is an old, what we believe to be unused, NetApp plug-in in the
> CloudStack codebase that I’d like to remove.
> >
> > I’m sending this e-mail out for the following reasons:
> >
> >
> > 1) To see if, by chance, anyone is actually using this plug-in.
> >
> > 2) To direct any potential code reviewers to this PR, where I have
> placed a couple questions about my commit.
> >
> > To be absolutely clear here, this has nothing to do with any of the
> SolidFire plug-ins (only an old NetApp plug-in that hasn’t been updated in
> years and is probably not being used by anyone).
> >
> > Thanks,
> > Mike
>

RE: PR 2670: Removing an old, unused NetApp plug-in

[Gabriel Beims Bräscher]

I am +1 on removing it.

> On May 23, 2018 at 8:59 PM Paul Angus  wrote:
>
>
> +1
>
> There's a NetApp Jar in the nodist which is related I think - be nice to get 
> rid of that too.
>
> paul.an...@shapeblue.com 
> www.shapeblue.com
> 53 Chandos Place, Covent Garden, London WC2N 4HSUK
> @shapeblue
>
>
>
>
> -Original Message-
> From: Tutkowski, Mike 
> Sent: 23 May 2018 19:53
> To: dev@cloudstack.apache.org
> Subject: PR 2670: Removing an old, unused NetApp plug-in
>
> Hi everyone,
>
> I opened the following PR today:
>
> https://github.com/apache/cloudstack/pull/2670
>
> There is an old, what we believe to be unused, NetApp plug-in in the 
> CloudStack codebase that I’d like to remove.
>
> I’m sending this e-mail out for the following reasons:
>
>
> 1) To see if, by chance, anyone is actually using this plug-in.
>
> 2) To direct any potential code reviewers to this PR, where I have placed a 
> couple questions about my commit.
>
> To be absolutely clear here, this has nothing to do with any of the SolidFire 
> plug-ins (only an old NetApp plug-in that hasn’t been updated in years and is 
> probably not being used by anyone).
>
> Thanks,
> Mike

RE: PR 2670: Removing an old, unused NetApp plug-in

[Paul Angus]

+1

There's a NetApp Jar in the nodist which is related I think - be nice to get 
rid of that too.

paul.an...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue
  
 


-Original Message-
From: Tutkowski, Mike  
Sent: 23 May 2018 19:53
To: dev@cloudstack.apache.org
Subject: PR 2670: Removing an old, unused NetApp plug-in

Hi everyone,

I opened the following PR today:

https://github.com/apache/cloudstack/pull/2670

There is an old, what we believe to be unused, NetApp plug-in in the CloudStack 
codebase that I’d like to remove.

I’m sending this e-mail out for the following reasons:


1)   To see if, by chance, anyone is actually using this plug-in.

2)   To direct any potential code reviewers to this PR, where I have placed 
a couple questions about my commit.

To be absolutely clear here, this has nothing to do with any of the SolidFire 
plug-ins (only an old NetApp plug-in that hasn’t been updated in years and is 
probably not being used by anyone).

Thanks,
Mike

PR 2670: Removing an old, unused NetApp plug-in

[Tutkowski, Mike]

Hi everyone,

I opened the following PR today:

https://github.com/apache/cloudstack/pull/2670

There is an old, what we believe to be unused, NetApp plug-in in the CloudStack 
codebase that I’d like to remove.

I’m sending this e-mail out for the following reasons:


1)   To see if, by chance, anyone is actually using this plug-in.

2)   To direct any potential code reviewers to this PR, where I have placed 
a couple questions about my commit.

To be absolutely clear here, this has nothing to do with any of the SolidFire 
plug-ins (only an old NetApp plug-in that hasn’t been updated in years and is 
probably not being used by anyone).

Thanks,
Mike

Re: Can't build master

[Tutkowski, Mike]

Thanks, everyone!

> On May 23, 2018, at 3:37 AM, Rohit Yadav  wrote:
> 
> I've create this PR to skip the unit test for non-linux platforms:
> 
> https://github.com/apache/cloudstack/pull/2665
> 
> 
> 
> - Rohit
> 
> 
> 
> 
> 
> 
> From: Daan Hoogland 
> Sent: Wednesday, May 23, 2018 2:05:23 PM
> To: dev
> Subject: Re: Can't build master
> 
> mkisofs can be installed using brew indeed. It won't help out off the box
> though. I think it should not be used from a unit test but at best from an
> integration test. As it is an integration with an external tool. (look
> later)
> 
> 
> rohit.ya...@shapeblue.com 
> www.shapeblue.com
> 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
> @shapeblue
> 
> 
> 
>> On Wed, May 23, 2018 at 10:11 AM, Wido den Hollander  wrote:
>> 
>> 
>> 
>>> On 05/22/2018 08:58 PM, Tutkowski, Mike wrote:
>>> Hi Rohit,
>>> 
>>> I’ve tried a few things so far, but none seem to install genisoimage in
>> /usr/bin as the test indicates is required.
>>> 
>> 
>> genisoimage isn't a binary which is generated by CloudStack, you have to
>> install it.
>> 
>> Under Ubuntu Linux this would be:
>> 
>> $ apt install mkisofs
>> 
>> But I don't know how this works under MacOS, maybe using brew?
>> 
>> Wido
>> 
>>> From https://cwiki.apache.org/confluence/display/CLOUDSTACK/
>> Setting+Up+a+CloudStack+Development+Environment+on+Mac+OS+X, I’ve tried
>> these steps:
>>> 
>>> • sudo port install cdrtools; or using brew: brew install cdrtools
>> (could take a long time)
>>> 'brew install cdrtools' did not work for me on OSX 10.9.  However, 'brew
>> install dvdrtools' did work for me...
>>> • NOTE - If after the above steps, for any reason, mkisofs is still not
>> installed, download it from the net. One good link to get mkisofs for mac
>> is - http://www.helios.de/viewart.html?id=1000-en#download . Follow the
>> instructions in the section "Download HELIOS “mkisofs” tested binary
>> versions". Use the macosx86 binary if you're running mac os x on an intel
>> platform. After downloading the mkisofs binary, copy it over to
>> /usr/local/bin/.
>>> 
>>> I only use Mac OS X to build the code locally. I don’t actually run the
>> management server from this machine (I run it on Ubuntu).
>>> 
>>> For the time being at least, I can just use –DskipTests=true when
>> building on Mac OS X.
>>> 
>>> Talk to you later,
>>> Mike
>>> 
>>> On 5/22/18, 12:19 AM, "Rohit Yadav"  wrote:
>>> 
>>>Hi Mike,
>>> 
>>> 
>>>Is genisoimage or mkisofs available on osx? This is usually
>> installed at /usr/bin/ on CentOS6/CentOS7/Ubuntu Linux. Can you try brew or
>> something else to install it?
>>> 
>>>They are also used by injectkeys.sh/.py when the management server
>> starts. The change is part of a recent PR I did and added a unit test for
>> it where it tries to build a config drive ISO file. If genisoimage is not
>> availabe on OSX, we can add some environment check to the unit test to skip
>> on non-Linux environments.
>>> 
>>> 
>>>- Rohit
>>> 
>>>
>>> 
>>> 
>>> 
>>>
>>>From: Tutkowski, Mike 
>>>Sent: Tuesday, May 22, 2018 2:13:23 AM
>>>To: dev@cloudstack.apache.org
>>>Subject: Re: Can't build master
>>> 
>>>Just an FYI that this is on OS X Version 10.11.6.
>>> 
>>>From: "Tutkowski, Mike" 
>>>Date: Monday, May 21, 2018 at 2:42 PM
>>>To: "dev@cloudstack.apache.org" 
>>>Subject: Can't build master
>>> 
>>>Hi,
>>> 
>>>Did I miss an e-mail or something? I’m having trouble building
>> master (below).
>>> 
>>>Thanks!
>>>Mike
>>> 
>>>Running org.apache.cloudstack.storage.configdrive.
>> ConfigDriveBuilderTest
>>>log4j:WARN No appenders could be found for logger
>> (org.apache.cloudstack.storage.configdrive.ConfigDriveBuilder).
>>>log4j:WARN Please initialize the log4j system properly.
>>>log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig
>> for more info.
>>>Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed:
>> 0.296 sec <<< FAILURE! - in org.apache.cloudstack.storage.configdrive.
>> ConfigDriveBuilderTest
>>>
>>> testConfigDriveBuild(org.apache.cloudstack.storage.configdrive.ConfigDriveBuilderTest)
>> Time elapsed: 0.278 sec  <<< ERROR!
>>>com.cloud.utils.exception.CloudRuntimeException: Unable to create
>> iso file: i-x-y.iso due to java.io.IOException: Cannot run program
>> "/usr/bin/genisoimage": error=2, No such file or directory
>>>at java.lang.ProcessBuilder.
>> start(ProcessBuilder.java:1048)
>>>at com.cloud.utils.script.Script.
>> execute(Script.java:215)
>>>at com.cloud.utils.script.Script.
>> execute(Script.java:183)
>>>  

Re: ISO upload fails on 4.11

[Rafael Weingärtner]

It is a bug. It is fixed already and it is goind out in 4.11.1.0
https://github.com/apache/cloudstack/pull/2652

On Wed, May 23, 2018 at 1:49 AM, Glen Baars 
wrote:

> Hello Devs,
>
> It seems that cross zone ISO downloads are broken in 4.11. I have had a
> look at the github issues and can't see it listed. Is it fixed in the
> upcoming 4.11.1?
>
> Also, I see that there is a direct download option for ISO uploads, does
> this make sense? I understand its usage in templates.
>
> 2018-05-23 12:39:37,916 DEBUG [c.c.a.ApiServlet] 
> (qtp1401132667-554:ctx-cabc63ba)
> (logid:54b42f92) ===START===  103.4.132.4 -- GET
> command=registerIso=json=(x64)+Centos+7.5&
> displayText=(x64)+Centos+7.5=http%3A%2F%2Ftemplates.here.com
> %2FCentOS-7-x86_64-Minimal-1804.iso=-1&
> isextractable=false=true=false&
> osTypeId=4dd2aa12-2fdc-11e8-a2cf-000c29e4d402=
> true=false&_=1527050379358
>
> 2018-05-23 12:39:37,962 INFO  [c.c.a.ApiServer] 
> (qtp1401132667-554:ctx-cabc63ba
> ctx-c3c3bbf4) (logid:54b42f92) Please specify a valid zone.
>
> 2018-05-23 12:39:37,963 DEBUG [c.c.a.ApiServlet] 
> (qtp1401132667-554:ctx-cabc63ba
> ctx-c3c3bbf4) (logid:54b42f92) ===END===  103.4.132.4 -- GET
> command=registerIso=json=(x64)+Centos+7.5&
> displayText=(x64)+Centos+7.5=http%3A%2F%2Ftemplates. here.com
> %2FCentOS-7-x86_64-Minimal-1804.iso=-1&
> isextractable=false=true=false&
> osTypeId=4dd2aa12-2fdc-11e8-a2cf-000c29e4d402=
> true=false&_=1527050379358
>
>
> Kind regards,
> Glen Baars
> BackOnline Manager
>
> This e-mail is intended solely for the benefit of the addressee(s) and any
> other named recipient. It is confidential and may contain legally
> privileged or confidential information. If you are not the recipient, any
> use, distribution, disclosure or copying of this e-mail is prohibited. The
> confidentiality and legal privilege attached to this communication is not
> waived or lost by reason of the mistaken transmission or delivery to you.
> If you have received this e-mail in error, please notify us immediately.
>



-- 
Rafael Weingärtner

Re: 4.11.1 install feedback

[Rohit Yadav]

Rene, for testing purposes I've updated my temporarily files at:

http://lab.yadav.cloud/testing/4.11.1-pre-rc1/ (packages from latest 4.11)

http://lab.yadav.cloud/systemvmtemplates/4.11/


I'll stop using the above, we'll eventually share a different URL/location to 
share test artifacts for testing purposes.


- Rohit



From: Rene Moser 
Sent: Wednesday, May 23, 2018 1:48:47 PM
To: dev@cloudstack.apache.org
Subject: Re: 4.11.1 install feedback

Hi again

Regarding router: the router looks more stable (rohit lab version).
However, we still need to manually reboot it after first provisioning,
otherwise the management server does not get access by ssh.

Having a lot of fw rules and many VMs in an advanced network, still
takes a "hell of a time" to get the VR fully configured.

This is on VMware 6.5, I think, there is no automated testing for this
env right?

Regards
René

rohit.ya...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue
  
 

Re: Can't build master

[Rohit Yadav]

I've create this PR to skip the unit test for non-linux platforms:

https://github.com/apache/cloudstack/pull/2665



- Rohit






From: Daan Hoogland 
Sent: Wednesday, May 23, 2018 2:05:23 PM
To: dev
Subject: Re: Can't build master

mkisofs can be installed using brew indeed. It won't help out off the box
though. I think it should not be used from a unit test but at best from an
integration test. As it is an integration with an external tool. (look
later)


rohit.ya...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue
  
 

On Wed, May 23, 2018 at 10:11 AM, Wido den Hollander  wrote:

>
>
> On 05/22/2018 08:58 PM, Tutkowski, Mike wrote:
> > Hi Rohit,
> >
> > I’ve tried a few things so far, but none seem to install genisoimage in
> /usr/bin as the test indicates is required.
> >
>
> genisoimage isn't a binary which is generated by CloudStack, you have to
> install it.
>
> Under Ubuntu Linux this would be:
>
> $ apt install mkisofs
>
> But I don't know how this works under MacOS, maybe using brew?
>
> Wido
>
> > From https://cwiki.apache.org/confluence/display/CLOUDSTACK/
> Setting+Up+a+CloudStack+Development+Environment+on+Mac+OS+X, I’ve tried
> these steps:
> >
> > • sudo port install cdrtools; or using brew: brew install cdrtools
> (could take a long time)
> > 'brew install cdrtools' did not work for me on OSX 10.9.  However, 'brew
> install dvdrtools' did work for me...
> > • NOTE - If after the above steps, for any reason, mkisofs is still not
> installed, download it from the net. One good link to get mkisofs for mac
> is - http://www.helios.de/viewart.html?id=1000-en#download . Follow the
> instructions in the section "Download HELIOS “mkisofs” tested binary
> versions". Use the macosx86 binary if you're running mac os x on an intel
> platform. After downloading the mkisofs binary, copy it over to
> /usr/local/bin/.
> >
> > I only use Mac OS X to build the code locally. I don’t actually run the
> management server from this machine (I run it on Ubuntu).
> >
> > For the time being at least, I can just use –DskipTests=true when
> building on Mac OS X.
> >
> > Talk to you later,
> > Mike
> >
> > On 5/22/18, 12:19 AM, "Rohit Yadav"  wrote:
> >
> > Hi Mike,
> >
> >
> > Is genisoimage or mkisofs available on osx? This is usually
> installed at /usr/bin/ on CentOS6/CentOS7/Ubuntu Linux. Can you try brew or
> something else to install it?
> >
> > They are also used by injectkeys.sh/.py when the management server
> starts. The change is part of a recent PR I did and added a unit test for
> it where it tries to build a config drive ISO file. If genisoimage is not
> availabe on OSX, we can add some environment check to the unit test to skip
> on non-Linux environments.
> >
> >
> > - Rohit
> >
> > 
> >
> >
> >
> > 
> > From: Tutkowski, Mike 
> > Sent: Tuesday, May 22, 2018 2:13:23 AM
> > To: dev@cloudstack.apache.org
> > Subject: Re: Can't build master
> >
> > Just an FYI that this is on OS X Version 10.11.6.
> >
> > From: "Tutkowski, Mike" 
> > Date: Monday, May 21, 2018 at 2:42 PM
> > To: "dev@cloudstack.apache.org" 
> > Subject: Can't build master
> >
> > Hi,
> >
> > Did I miss an e-mail or something? I’m having trouble building
> master (below).
> >
> > Thanks!
> > Mike
> >
> > Running org.apache.cloudstack.storage.configdrive.
> ConfigDriveBuilderTest
> > log4j:WARN No appenders could be found for logger
> (org.apache.cloudstack.storage.configdrive.ConfigDriveBuilder).
> > log4j:WARN Please initialize the log4j system properly.
> > log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig
> for more info.
> > Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed:
> 0.296 sec <<< FAILURE! - in org.apache.cloudstack.storage.configdrive.
> ConfigDriveBuilderTest
> > 
> > testConfigDriveBuild(org.apache.cloudstack.storage.configdrive.ConfigDriveBuilderTest)
> Time elapsed: 0.278 sec  <<< ERROR!
> > com.cloud.utils.exception.CloudRuntimeException: Unable to create
> iso file: i-x-y.iso due to java.io.IOException: Cannot run program
> "/usr/bin/genisoimage": error=2, No such file or directory
> > at java.lang.ProcessBuilder.
> start(ProcessBuilder.java:1048)
> > at com.cloud.utils.script.Script.
> execute(Script.java:215)
> > at com.cloud.utils.script.Script.
> execute(Script.java:183)
> > at org.apache.cloudstack.storage.configdrive.
> ConfigDriveBuilder.buildConfigDrive(ConfigDriveBuilder.java:152)
> > at org.apache.cloudstack.storage.configdrive.
> 

Re: 4.11.1 install feedback

[Rohit Yadav]

Hi Rene,


About your login issue - if command.properties is not present in CloudStack's 
classpath for example, usually at /etc/cloudstack/management or somewhere in 
/usr/share/cloudstack-management/ path. The CloudStack upgrade logic has been 
simplified wrt dynamic roles and will automatically switch your env to use 
dynamic roles if commands.properties is missing:

https://github.com/apache/cloudstack/blob/4.11/engine/schema/src/com/cloud/upgrade/dao/Upgrade41000to41100.java#L65


I'm not sure exactly how the upgrade was tested - can you check either at your 
API logs why the login is failing and if the API is allowed for the login 
user/account from cloud.role_permission (select * from role_permissions where 
role_id=1; for admin user account).


You may also want to check for browser cache i.e. attempt using the UI in 
incognito mode. Are you able to reproduce failure by using cloudmonkey with 
login credentials (not apikey/secretkey)?


About the VR issue - a manual reboot should not be necessary after first 
provisioning, I would see that as a bug and perhaps a blocker. What we can do 
is look at your env, see systemd process chains (see what's blocking and 
causing blocking or failures?) and share our findings (or fix/PR) with the 
community.


After the VR is up, from vCenter client can you see where it is stuck and if it 
is able to start ssh. You can check for cloud-postinit service (systemctl 
status cloud-postinit). In the past I found and fixed an issue where it got 
stuck due to dependency issues around apache2 (killing or performing systemctl 
stop apache2 also fixed the issue, in my fix I made it stop+start without 
blocking the cloud-postinit process).


- Rohit






From: Rene Moser 
Sent: Wednesday, May 23, 2018 1:48:47 PM
To: dev@cloudstack.apache.org
Subject: Re: 4.11.1 install feedback

Hi again

Regarding router: the router looks more stable (rohit lab version).
However, we still need to manually reboot it after first provisioning,
otherwise the management server does not get access by ssh.

Having a lot of fw rules and many VMs in an advanced network, still
takes a "hell of a time" to get the VR fully configured.

This is on VMware 6.5, I think, there is no automated testing for this
env right?

Regards
René

rohit.ya...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue
  
 

Re: ACS 4.11 Domain router placeholder record.

[Daan Hoogland]

I am not sure what you mean. There are a lot of entities for which
'profile's are created but these are not records. A network is defined
before it is implemented, but I would expect a MAC address to be allocated
for the VR's NICs in those cases. I might overlook some situations, Glen.

On Tue, May 22, 2018 at 2:55 PM, Glen Baars 
wrote:

> Hello Daan,
>
> It seems that they are getting a similar result but from a different cause.
>
> Is a network suppose to have a placeholder record?
>
> Kind regards,
> Glen Baars
> -Original Message-
> From: Daan Hoogland 
> Sent: Tuesday, 22 May 2018 3:02 PM
> To: dev 
> Subject: Re: ACS 4.11 Domain router placeholder record.
>
> Glenn, this sounds like it is related to a bug that was just fixed;
> https://github.com/apache/cloudstack/pull/2653
> Did you do a AddNicToVMCmd manually or was it a consequential action as a
> result?
> When saying it is related I do not think it is the same.
>
> On Mon, May 21, 2018 at 6:21 AM, Glen Baars 
> wrote:
>
> > Hello Devs,
> >
> > I was just chasing down as issue with not being able to add a NIC to a
> VM.
> > Below is the relevant logs. I found that the NICs table's domain
> > router placeholder for this network had a NULL MAC address and this
> > was preventing new NICs from being added. When I added a MAC manually
> > to the domain routers placeholder record all started working.
> >
> > My question is, should the router router's placeholder NIC entry have
> > a MAC address? If so, none of mine do.
> > Not all of my networks have placeholder entries, why is that?
> > Should I be removing the placeholder entries?
> >
> > This seems to be almost the last issue we are facing from 4.3 -> 4.11
> > upgrade. It has been very successful. ( 400 ish vms, 6 Datacenters, 80
> > VRs )
> >
> >
> > 2018-05-21 11:48:16,423 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (qtp1401132667-595:ctx-310c59ef ctx-f99ddc35) (logid:51491bb7) submit
> > async job-83360, details: AsyncJobVO {id:83360, userId: 98, accountId:
> > 95,
> > instanceType: None, instanceId: null, cmd:
> > org.apache.cloudstack.api.command.user.vm.AddNicToVMCmd,
> > cmdInfo: {"virtualmachineid":"22fbba97-2bee-42f9-80db-4bcbaa0ba1fc","
> > response":"json","ctxUserId":"98","httpmethod":"GET","
> > networkid":"a3e01c87-042a-44c5-870d-8676143940ee","
> > ctxStartEventId":"2191577","ctxDetails":"{\"interface
> > com.cloud.vm.VirtualMachine\":\"22fbba97-2bee-42f9-80db-4bcbaa0ba1fc\"
> > ,\"interface
> > com.cloud.network.Network\":\"a3e01c87-042a-44c5-870d-8676143940ee\"}","
> > ctxAccountId":"95","cmdEventType":"NIC.CREATE","_":"1526874496277"},
> > cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0,
> > result: null, initMsid: 52242469890, completeMsid: null, lastUpdated:
> > null,
> > lastPolled: null,
> > created: null}
> >
> >
> > 2018-05-21 11:48:16,424 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (API-Job-Executor-1:ctx-dcdc8f3a job-83360) (logid:5254cc87) Executing
> > AsyncJobVO {id:83360, userId: 98, accountId: 95, instanceType: None,
> > instanceId: null, cmd:
> > org.apache.cloudstack.api.command.user.vm.AddNicToVMCmd,
> > cmdInfo: {"virtualmachineid":"22fbba97-2bee-42f9-80db-4bcbaa0ba1fc","
> > response":"json","ctxUserId":"98","httpmethod":"GET","
> > networkid":"a3e01c87-042a-44c5-870d-8676143940ee","
> > ctxStartEventId":"2191577","ctxDetails":"{\"interface
> > com.cloud.vm.VirtualMachine\":\"22fbba97-2bee-42f9-80db-4bcbaa0ba1fc\"
> > ,\"interface
> > com.cloud.network.Network\":\"a3e01c87-042a-44c5-870d-8676143940ee\"}","
> > ctxAccountId":"95","cmdEventType":"NIC.CREATE","_":"1526874496277"},
> > cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0,
> > result: null, initMsid: 52242469890, completeMsid: null, lastUpdated:
> > null,
> > lastPolled: null, created: null}
> > 2018-05-21 11:48:16,424 DEBUG [c.c.a.ApiServlet]
> > (qtp1401132667-595:ctx-310c59ef
> > ctx-f99ddc35) (logid:51491bb7) ===END===  103.4.132.4 -- GET  command=
> > addNicToVirtualMachine=json=22fbba97-
> > 2bee-42f9-80db-4bcbaa0ba1fc=a3e01c87-042a-44c5-
> > 870d-8676143940ee&_=1526874496277
> >
> >
> > 2018-05-21 11:48:16,474 ERROR [c.c.a.ApiAsyncJobDispatcher]
> > (API-Job-Executor-1:ctx-dcdc8f3a job-83360) (logid:5254cc87)
> > Unexpected exception while executing org.apache.cloudstack.api.
> > command.user.vm.AddNicToVMCmd
> > com.cloud.utils.exception.CloudRuntimeException: A NIC with this MAC
> > address exists for network: a3e01c87-042a-44c5-870d-8676143940ee
> > at com.cloud.vm.UserVmManagerImpl.addNicToVirtualMachine(
> > UserVmManagerImpl.java:1203)
> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > at sun.reflect.NativeMethodAccessorImpl.invoke(
> > NativeMethodAccessorImpl.java:62)
> > at sun.reflect.DelegatingMethodAccessorImpl.invoke(
> > DelegatingMethodAccessorImpl.java:43)
> > at 

Re: Can't build master

[Daan Hoogland]

mkisofs can be installed using brew indeed. It won't help out off the box
though. I think it should not be used from a unit test but at best from an
integration test. As it is an integration with an external tool. (look
later)

On Wed, May 23, 2018 at 10:11 AM, Wido den Hollander  wrote:

>
>
> On 05/22/2018 08:58 PM, Tutkowski, Mike wrote:
> > Hi Rohit,
> >
> > I’ve tried a few things so far, but none seem to install genisoimage in
> /usr/bin as the test indicates is required.
> >
>
> genisoimage isn't a binary which is generated by CloudStack, you have to
> install it.
>
> Under Ubuntu Linux this would be:
>
> $ apt install mkisofs
>
> But I don't know how this works under MacOS, maybe using brew?
>
> Wido
>
> > From https://cwiki.apache.org/confluence/display/CLOUDSTACK/
> Setting+Up+a+CloudStack+Development+Environment+on+Mac+OS+X, I’ve tried
> these steps:
> >
> > • sudo port install cdrtools; or using brew: brew install cdrtools
> (could take a long time)
> > 'brew install cdrtools' did not work for me on OSX 10.9.  However, 'brew
> install dvdrtools' did work for me...
> > • NOTE - If after the above steps, for any reason, mkisofs is still not
> installed, download it from the net. One good link to get mkisofs for mac
> is - http://www.helios.de/viewart.html?id=1000-en#download . Follow the
> instructions in the section "Download HELIOS “mkisofs” tested binary
> versions". Use the macosx86 binary if you're running mac os x on an intel
> platform. After downloading the mkisofs binary, copy it over to
> /usr/local/bin/.
> >
> > I only use Mac OS X to build the code locally. I don’t actually run the
> management server from this machine (I run it on Ubuntu).
> >
> > For the time being at least, I can just use –DskipTests=true when
> building on Mac OS X.
> >
> > Talk to you later,
> > Mike
> >
> > On 5/22/18, 12:19 AM, "Rohit Yadav"  wrote:
> >
> > Hi Mike,
> >
> >
> > Is genisoimage or mkisofs available on osx? This is usually
> installed at /usr/bin/ on CentOS6/CentOS7/Ubuntu Linux. Can you try brew or
> something else to install it?
> >
> > They are also used by injectkeys.sh/.py when the management server
> starts. The change is part of a recent PR I did and added a unit test for
> it where it tries to build a config drive ISO file. If genisoimage is not
> availabe on OSX, we can add some environment check to the unit test to skip
> on non-Linux environments.
> >
> >
> > - Rohit
> >
> > 
> >
> >
> >
> > 
> > From: Tutkowski, Mike 
> > Sent: Tuesday, May 22, 2018 2:13:23 AM
> > To: dev@cloudstack.apache.org
> > Subject: Re: Can't build master
> >
> > Just an FYI that this is on OS X Version 10.11.6.
> >
> > From: "Tutkowski, Mike" 
> > Date: Monday, May 21, 2018 at 2:42 PM
> > To: "dev@cloudstack.apache.org" 
> > Subject: Can't build master
> >
> > Hi,
> >
> > Did I miss an e-mail or something? I’m having trouble building
> master (below).
> >
> > Thanks!
> > Mike
> >
> > Running org.apache.cloudstack.storage.configdrive.
> ConfigDriveBuilderTest
> > log4j:WARN No appenders could be found for logger
> (org.apache.cloudstack.storage.configdrive.ConfigDriveBuilder).
> > log4j:WARN Please initialize the log4j system properly.
> > log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig
> for more info.
> > Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed:
> 0.296 sec <<< FAILURE! - in org.apache.cloudstack.storage.configdrive.
> ConfigDriveBuilderTest
> > 
> > testConfigDriveBuild(org.apache.cloudstack.storage.configdrive.ConfigDriveBuilderTest)
> Time elapsed: 0.278 sec  <<< ERROR!
> > com.cloud.utils.exception.CloudRuntimeException: Unable to create
> iso file: i-x-y.iso due to java.io.IOException: Cannot run program
> "/usr/bin/genisoimage": error=2, No such file or directory
> > at java.lang.ProcessBuilder.
> start(ProcessBuilder.java:1048)
> > at com.cloud.utils.script.Script.
> execute(Script.java:215)
> > at com.cloud.utils.script.Script.
> execute(Script.java:183)
> > at org.apache.cloudstack.storage.configdrive.
> ConfigDriveBuilder.buildConfigDrive(ConfigDriveBuilder.java:152)
> > at org.apache.cloudstack.storage.configdrive.
> ConfigDriveBuilderTest.testConfigDriveBuild(ConfigDriveBuilderTest.java:
> 56)
> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
> Method)
> > at sun.reflect.NativeMethodAccessorImpl.invoke(
> NativeMethodAccessorImpl.java:62)
> > at sun.reflect.DelegatingMethodAccessorImpl.invoke(
> DelegatingMethodAccessorImpl.java:43)
> > at 

Re: 4.11.1 install feedback

[Rene Moser]

Hi again

Regarding router: the router looks more stable (rohit lab version).
However, we still need to manually reboot it after first provisioning,
otherwise the management server does not get access by ssh.

Having a lot of fw rules and many VMs in an advanced network, still
takes a "hell of a time" to get the VR fully configured.

This is on VMware 6.5, I think, there is no automated testing for this
env right?

Regards
René

Re: Can't build master

[Wido den Hollander]

On 05/22/2018 08:58 PM, Tutkowski, Mike wrote:
> Hi Rohit,
> 
> I’ve tried a few things so far, but none seem to install genisoimage in 
> /usr/bin as the test indicates is required.
> 

genisoimage isn't a binary which is generated by CloudStack, you have to
install it.

Under Ubuntu Linux this would be:

$ apt install mkisofs

But I don't know how this works under MacOS, maybe using brew?

Wido

> From 
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/Setting+Up+a+CloudStack+Development+Environment+on+Mac+OS+X,
>  I’ve tried these steps:
> 
> • sudo port install cdrtools; or using brew: brew install cdrtools (could 
> take a long time)
> 'brew install cdrtools' did not work for me on OSX 10.9.  However, 'brew 
> install dvdrtools' did work for me...
> • NOTE - If after the above steps, for any reason, mkisofs is still not 
> installed, download it from the net. One good link to get mkisofs for mac is 
> - http://www.helios.de/viewart.html?id=1000-en#download . Follow the 
> instructions in the section "Download HELIOS “mkisofs” tested binary 
> versions". Use the macosx86 binary if you're running mac os x on an intel 
> platform. After downloading the mkisofs binary, copy it over to 
> /usr/local/bin/.
> 
> I only use Mac OS X to build the code locally. I don’t actually run the 
> management server from this machine (I run it on Ubuntu).
> 
> For the time being at least, I can just use –DskipTests=true when building on 
> Mac OS X.
> 
> Talk to you later,
> Mike
> 
> On 5/22/18, 12:19 AM, "Rohit Yadav"  wrote:
> 
> Hi Mike,
> 
> 
> Is genisoimage or mkisofs available on osx? This is usually installed at 
> /usr/bin/ on CentOS6/CentOS7/Ubuntu Linux. Can you try brew or something else 
> to install it?
> 
> They are also used by injectkeys.sh/.py when the management server 
> starts. The change is part of a recent PR I did and added a unit test for it 
> where it tries to build a config drive ISO file. If genisoimage is not 
> availabe on OSX, we can add some environment check to the unit test to skip 
> on non-Linux environments.
> 
> 
> - Rohit
> 
> 
> 
> 
> 
> 
> From: Tutkowski, Mike 
> Sent: Tuesday, May 22, 2018 2:13:23 AM
> To: dev@cloudstack.apache.org
> Subject: Re: Can't build master
> 
> Just an FYI that this is on OS X Version 10.11.6.
> 
> From: "Tutkowski, Mike" 
> Date: Monday, May 21, 2018 at 2:42 PM
> To: "dev@cloudstack.apache.org" 
> Subject: Can't build master
> 
> Hi,
> 
> Did I miss an e-mail or something? I’m having trouble building master 
> (below).
> 
> Thanks!
> Mike
> 
> Running org.apache.cloudstack.storage.configdrive.ConfigDriveBuilderTest
> log4j:WARN No appenders could be found for logger 
> (org.apache.cloudstack.storage.configdrive.ConfigDriveBuilder).
> log4j:WARN Please initialize the log4j system properly.
> log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for 
> more info.
> Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.296 sec 
> <<< FAILURE! - in 
> org.apache.cloudstack.storage.configdrive.ConfigDriveBuilderTest
> 
> testConfigDriveBuild(org.apache.cloudstack.storage.configdrive.ConfigDriveBuilderTest)
>   Time elapsed: 0.278 sec  <<< ERROR!
> com.cloud.utils.exception.CloudRuntimeException: Unable to create iso 
> file: i-x-y.iso due to java.io.IOException: Cannot run program 
> "/usr/bin/genisoimage": error=2, No such file or directory
> at 
> java.lang.ProcessBuilder.start(ProcessBuilder.java:1048)
> at com.cloud.utils.script.Script.execute(Script.java:215)
> at com.cloud.utils.script.Script.execute(Script.java:183)
> at 
> org.apache.cloudstack.storage.configdrive.ConfigDriveBuilder.buildConfigDrive(ConfigDriveBuilder.java:152)
> at 
> org.apache.cloudstack.storage.configdrive.ConfigDriveBuilderTest.testConfigDriveBuild(ConfigDriveBuilderTest.java:56)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native 
> Method)
> at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at 
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> at 
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> at 
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> at 
>