[ovirt-devel] Re: Error adding host to ovirt-engine in local development environment

Kaustav Majumder Fri, 13 Jul 2018 03:47:23 -0700

Hi,

Thanks for the script. Setting dev environment works fine. But were youable to add hosts to it?



On Friday 13 July 2018 03:26 AM, Greg Sheremeta wrote:

Forgive me for being slightly off topic -- I made an ansible role tosetup an engine dev environment. It works for me with the fc28 --> el7setup (well, as of a few weeks ago).

https://github.com/gregsheremeta/ovirt-engine-devel

It installs all the dependencies for you. Hope it helps. My goal wasto get some community interest / help in maintaining a shared stand-upscript / role.


Best wishes,
Greg

On Thu, Jul 12, 2018 at 8:34 AM Yedidyah Bar David <[email protected]<mailto:[email protected]>> wrote:


    On Thu, Jul 12, 2018 at 3:26 PM, Kaustav Majumder
    <[email protected] <mailto:[email protected]>> wrote:

        Hi,

        I installed python2-ovirt-host-deploy too but its the same
        error. Will install clean f27 on my system  and try on that.


    If it's because you are interested in re-adding fedora/dnf/python3
    support, then fine, thanks! Gal is currently working on that, also
    Yuval and me a bit.

    If you just want to get something working, it's easier to use el7
    for now.


        On Thursday 12 July 2018 05:51 PM, Yedidyah Bar David wrote:

        On Thu, Jul 12, 2018 at 2:22 PM, Kaustav Majumder
        <[email protected] <mailto:[email protected]>> wrote:

            Hi,

            I checked the symlinks and it was broken in mine too. I
            have manually changed them to point to python2.7.


        Did you try installing python2-ovirt-host-deploy?

            localhost in
            /usr/share/ovirt-host-deploy/interface-3/pythonlib ○ → ls -l
            total 4
            lrwxrwxrwx. 1 root root 45 Jun 24 15:29 otopi ->
            ../../../../lib/python3.6/site-packages/otopi
            lrwxrwxrwx. 1 root root 60 Jul 12 16:34 ovirt_host_deploy
            ->
            ../../../../../lib/python2.7/site-packages/ovirt_host_deploy
            lrwxrwxrwx. 1 root root 58 Jul 12 16:34 ovirt_host_mgmt
            -> ../../../../../lib/python2.7/site-packages/ovirt_host_mgmt

            Now when I am trying to run bin/engine-setup. It is
            giving the following error

            bin/engine-setup
            ***L:ERROR Internal error: No module named 'M2Crypto'


        I do not follow. It worked for you in the past? What changed
        since then?

            Also tried the following:

            1.install python3.6 . setup in alternatives

            2. installed ovirt python 3.6 dependecies
            (otopi,ovirt_host_deploy,ovirt_host_mgmt)

            3.Fixed symlinks

            4. Tried running bin/engine-setup

            Giving the error as:

             bin/engine-setup
            ***L:ERROR Internal error: No module named 'M2Crypto'





            On Thursday 12 July 2018 12:31 PM, Yedidyah Bar David wrote:

            On Wed, Jul 11, 2018 at 4:54 PM, Kaustav Majumder<[email protected]> 
<mailto:[email protected]>  wrote:

            Hi,

            I installed python2-otopi rpm in the host and then when I try to add host it 
gives the following error--> An error has occurred during installation of 
Host10.70.43.129 <http://10.70.43.129>: Internal error: No module named 
ovirt_host_deploy.

            I  am getting the same error when I manually copy the tar and run 
in the host.

            error log -->https://pastebin.com/4RYZd1js

            Am I missing some dependencies in my dev env?


            On Wednesday 11 July 2018 07:10 PM, Yuval Turgeman wrote:

            It looks like you don't have python3 installed, so otopi falls back 
to /bin/python which is python2, but the python2 otopi module is not installed 
- try to install the python2-otopi rpm and see if it works for you.

            This should not be needed on the _host_.

            Perhaps you need them on the engine machine. Didn't check, but it
            makes sense. Please try, on the engine machine:

            1. Install all relevant python2 packages (otopi, ovirt-host-deploy, 
?)
            2. rm /var/cache/ovirt-engine/ovirt-host-deploy.tar
            3. Then try to add the host

            Thanks,
            Yuval.

            On Wed, Jul 11, 2018 at 4:13 PM, Kaustav Majumder<[email protected]> 
<mailto:[email protected]>  wrote:

            Hi,

            'pythonlib' directory is empty.Is it something to do with that?

            Yes, that's the problem. No idea why exactly, I still didn't try 
that
            myself. Please check:

            ls -l /usr/share/ovirt-host-deploy/interface-3/pythonlib

            Both before and after installing python2 packages as suggested 
above.

            Now tried these on an fc28 machine, and I get:

            [pythonlib]# ls -l
            total 0
            lrwxrwxrwx. 1 root root 45 Jun 24 12:59 otopi ->
            ../../../../lib/python3.6/site-packages/otopi
            lrwxrwxrwx. 1 root root 57 Jun 24 12:59 ovirt_host_deploy ->
            ../../../../lib/python3.6/site-packages/ovirt_host_deploy
            lrwxrwxrwx. 1 root root 55 Jun 24 12:59 ovirt_host_mgmt ->
            ../../../../lib/python3.6/site-packages/ovirt_host_mgmt

            [pythonlib]# rpm -qf *
            
ovirt-host-deploy-common-1.8.0-0.0.master.20180624095611.git827d6d1.fc28.noarch
            
ovirt-host-deploy-common-1.8.0-0.0.master.20180624095611.git827d6d1.fc28.noarch
            
ovirt-host-deploy-common-1.8.0-0.0.master.20180624095611.git827d6d1.fc28.noarch

            Where the two latter links are dead. This is because I did only 'dnf
            install ovirt-engine', which does not carry (for now)
            python3-ovirt-host-deploy.

            It seems (mainly thinking out loud, also adding Yuval) that this is 
the process:

            1. You install either py2 or py3 otopi+host-deploy on the engine 
(or both)
            2. The engine creates an otopi bundle:
            2.1. It copies the plugins from the common path/pkg, which is 
always installed.
            2.2. It copies the library files from the python lib of the python
            that otopi chose to run, on the _engine_. If you have python3, it 
will
            be python3 files. If 2, 2. In your case, you ran 3, but (perhaps?)
            pythonlib is empty, need to check why.
            2.3. So the bundle contains python-version-specific files in
            pythonlib, but this in theory should not be a big concern:
            3. Engine copies the bundle to the host, untars, and runs.
            4. If on the host otopi chooses a different python than the one used
            to create the bundle, pythonlib will include wrong binary 
(.pyc/.pyo)
            files (at least in wrong locations), but the text/source files 
should
            still be available, if all goes well.

            Yuval - does this sound like the plan we (vaguely) had?

            (Kaustav - please "reply all" - it's much easier to follow a
            conversation this way. Thanks)

            Also, perhaps open a bug about this. Still not sure what's the best
            option. Some I can think of:

            1. Just ignore this case. Assume that engine and host machines use
            same python, and developers that want to test something else will 
need
            to install the relevant other packages.

            2. Make the engine require both py2 and py3 packages. Not sure this
            makes much sense, need to think about it. We also need to continue
            support the engine on el7, where we do not have py3 by default (and
            probably do not want to install it). So perhaps do this only on
            fedora.

            3. Something else? E.g. check for any available python and use that?
            That's not very easy for now, as the above links are packaged, 
meaning
            created during building/packaging time, not run time, so then we 
still
            do not know which python will actually be available.

            On Wednesday 11 July 2018 06:30 PM, Kaustav Majumder wrote:

            Hi,

            The output of sh -x otopi -->https://pastebin.com/WeeCJYdk

            tar in the attachment


            On Wednesday 11 July 2018 06:14 PM, Yedidyah Bar David wrote:

            On Wed, Jul 11, 2018 at 10:21 AM, Kaustav Majumder<[email protected]> 
<mailto:[email protected]>  wrote:

            Hi,

            Following are the versions

            otopi-1.8.0-0.0.master.20180704073752.git9eed7fe.fc28

            
ovirt-host-deploy-common-1.8.0-0.0.master.20180624095611.git827d6d1.fc28.noarch
            python2-ovirt-host-deploy-1.8.0-0.0.master.20180624095611.gi
            <http://0-0.0.master.20180624095611.gi>t827d6d1.fc28.noarch

            I copied the tar to the  host  and when I am trying to install its 
giving the following error

            [root@dhcp43-133 ~]# ./ovirt-host-deploy
            ***L:ERROR: Python is required but missing

            Can you please try running, from the same directory on the host, 
'sh -x otopi' ?

            Also, can you please share the bundle tar file?

            Thanks,

            On Wednesday 11 July 2018 11:04 AM, Yedidyah Bar David wrote:

            On Tue, Jul 10, 2018 at 1:24 PM, Kaustav Majumder<[email protected]> 
<mailto:[email protected]>  wrote:

            Hi,

            I am trying to setup ovirt engine dev environment in my local 
Fedora 28 machine.

            Do you want to use fedora 28 specifically? Or just get a dev env 
working? If latter, it's currently easier to use el7.

            I have followed this guide 
->https://gerrit.ovirt.org/gitweb?p=ovirt-engine.git;a=blob_plain;f=README.adoc;hb=HEAD

            When I am trying to add a new host (Centos 7) ,it is failing with 
the following error.


            [35eb76d9] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host 
10.70.43.157. Connected to host 10.70.43.157 with SSH key fingerprint: 
SHA256:rZfUGylVh3PLqfH2Siey0+CA9RUctK2ITQ2UGtV5ggA.
            2018-07-10 15:47:50,447+05 INFO  [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] Installation of 
10.70.43.157. Executing command via SSH umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX 
\"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x 
&&  "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True < 
/home/kaustavmajumder/work/ovirt-engine-builds/07-07/var/cache/ovirt-engine/ovirt-host-deploy.tar
            2018-07-10 15:47:50,447+05 INFO  
[org.ovirt.engine.core.utils.archivers.tar.CachedTar] 
(EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] Tarball 
'/home/kaustavmajumder/work/ovirt-engine-builds/07-07/var/cache/ovirt-engine/ovirt-host-deploy.tar'
 refresh
            2018-07-10 15:47:50,471+05 INFO  [org.ovirt.engine.core.uutils.ssh.SSHDialog] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] SSH execute '[email protected] 
<mailto:[email protected]>' 'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" 
> /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x &&  
"${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True'
            2018-07-10 15:47:50,676+05 ERROR 
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) 
[35eb76d9] EVENT_ID: VDS_INSTALL_IN_PROGRESS_ERROR(511), An error has occurred during 
installation of Host10.70.43.157 <http://10.70.43.157>: Python is required but 
missing.
            2018-07-10 15:47:50,685+05 ERROR 
[org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [35eb76d9] 
Error during deploy dialog
            2018-07-10 15:47:50,686+05 ERROR [org.ovirt.engine.core.uutils.ssh.SSHDialog] (EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] SSH error running [email protected] 
<mailto:[email protected]>:'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > 
/dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x &&  
"${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True': IOException: Command returned failure code 1 during SSH session '[email protected] 
<mailto:[email protected]>'
            2018-07-10 15:47:50,690+05 ERROR 
[org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] 
(EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] Error during host 
10.70.43.157 install
            2018-07-10 15:47:50,697+05 ERROR 
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] 
(EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] EVENT_ID: 
VDS_INSTALL_IN_PROGRESS_ERROR(511), An error has occurred during installation of 
Host10.70.43.157 <http://10.70.43.157>: Command returned failure code 1 during SSH 
session '[email protected] <mailto:[email protected]>'.
            2018-07-10 15:47:50,698+05 ERROR 
[org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] 
(EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] Error during host 
10.70.43.157 install, preferring first exception: Unexpected connection 
termination
            2018-07-10 15:47:50,698+05 ERROR 
[org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] 
(EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] Host installation 
failed for host '3a52f700-a1d3-47b0-9518-f7f94231a874', '10.70.43.157': 
Unexpected connection termination
            2018-07-10 15:47:50,700+05 INFO  
[org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] 
(EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] START, 
SetVdsStatusVDSCommand(HostName = 10.70.43.157, 
SetVdsStatusVDSCommandParameters:{hostId='3a52f700-a1d3-47b0-9518-f7f94231a874',
 status='InstallFailed', nonOperationalReason='NONE', 
stopSpmFailureLogged='false', maintenanceReason='null'}), log id: 48d6c653
            2018-07-10 15:47:50,704+05 INFO  
[org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] 
(EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] FINISH, 
SetVdsStatusVDSCommand, return: , log id: 48d6c653
            2018-07-10 15:47:50,710+05 ERROR 
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] 
(EE-ManagedThreadFactory-engine-Thread-4188) [35eb76d9] EVENT_ID: 
VDS_INSTALL_FAILED(505), Host 10.70.43.157 installation failed. Unexpected 
connection termination.


            I have tried installing it several times and it has failed.

            Which versions of otopi and ovirt-host-deploy do you have?

            Can you install otopi on the host and run it? Does it work?

            You can also try copying and running the host-deploy bundle 
manually to the host. It's on the engine machine in /var/cache/ovirt-engine. 
Copy it to the host, untar in some directory, and run from inside it:

            $PWD/ovirt-host-deploy

            Best regards,
            --
            Didi


            _______________________________________________
            Devel mailing list [email protected] <mailto:[email protected]>
            To unsubscribe send an email [email protected] 
<mailto:[email protected]>
            Privacy Statement:https://www.ovirt.org/site/privacy-policy/
            oVirt Code of 
Conduct:https://www.ovirt.org/community/about/community-guidelines/
            List 
Archives:https://lists.ovirt.org/archives/list/[email protected]/message/2VVLZDOWS32H7IP5JQBJZCUTABWTKZOC/


            --

            Kaustav Majumder

            Associate Software Engineer

            Red Hat India PVT LTD.

            [email protected] <mailto:[email protected]>     M: 
08981884037     IM: IRC: kmajumder

            TRIED. TESTED. TRUSTED.
            @redhatway   @redhatinc   @redhatsnaps

            _______________________________________________
            Devel mailing list [email protected] <mailto:[email protected]>
            To unsubscribe send an email [email protected] 
<mailto:[email protected]>
            Privacy Statement:https://www.ovirt.org/site/privacy-policy/
            oVirt Code of 
Conduct:https://www.ovirt.org/community/about/community-guidelines/
            List 
Archives:https://lists.ovirt.org/archives/list/[email protected]/message/MMMDGQ7Y6AWR2D7WCWQ4I66O5R5N5KSA/

            --
            Didi


            _______________________________________________
            Devel mailing list [email protected] <mailto:[email protected]>
            To unsubscribe send an email [email protected] 
<mailto:[email protected]>
            Privacy Statement:https://www.ovirt.org/site/privacy-policy/
            oVirt Code of 
Conduct:https://www.ovirt.org/community/about/community-guidelines/
            List 
Archives:https://lists.ovirt.org/archives/list/[email protected]/message/7RAM4B3PUM2SD27EZCLJMKKS3UPO7JXZ/


            --

            Kaustav Majumder

            Associate Software Engineer

            Red Hat India PVT LTD.

            [email protected] <mailto:[email protected]>     M: 
08981884037     IM: IRC: kmajumder

            TRIED. TESTED. TRUSTED.
            @redhatway   @redhatinc   @redhatsnaps


            _______________________________________________
            Devel mailing list [email protected] <mailto:[email protected]>
            To unsubscribe send an email [email protected] 
<mailto:[email protected]>
            Privacy Statement:https://www.ovirt.org/site/privacy-policy/
            oVirt Code of 
Conduct:https://www.ovirt.org/community/about/community-guidelines/
            List 
Archives:https://lists.ovirt.org/archives/list/[email protected]/message/EZXFRA5YKHYMKLAJVHJB7VRBYI4WTRV6/


            --

            Kaustav Majumder

            Associate Software Engineer

            Red Hat India PVT LTD.

            [email protected] <mailto:[email protected]>     M: 
08981884037     IM: IRC: kmajumder

            TRIED. TESTED. TRUSTED.
            @redhatway   @redhatinc   @redhatsnaps

            _______________________________________________
            Devel mailing list [email protected] <mailto:[email protected]>
            To unsubscribe send an email [email protected] 
<mailto:[email protected]>
            Privacy Statement:https://www.ovirt.org/site/privacy-policy/
            oVirt Code of 
Conduct:https://www.ovirt.org/community/about/community-guidelines/
            List 
Archives:https://lists.ovirt.org/archives/list/[email protected]/message/OPPX3VMACC5YMJLINTEVNL3BLQKASQF4/

            _______________________________________________
            Devel mailing list [email protected] <mailto:[email protected]>
            To unsubscribe send an email [email protected] 
<mailto:[email protected]>
            Privacy Statement:https://www.ovirt.org/site/privacy-policy/
            oVirt Code of 
Conduct:https://www.ovirt.org/community/about/community-guidelines/
            List 
Archives:https://lists.ovirt.org/archives/list/[email protected]/message/HCXHSJBQ6QBD76DYBVYCU35GZJHHTELK/


            --

            Kaustav Majumder

            Associate Software Engineer

            Red Hat India PVT LTD.

            [email protected] <mailto:[email protected]>     M: 
08981884037     IM: IRC: kmajumder

            TRIED. TESTED. TRUSTED.
            @redhatway   @redhatinc   @redhatsnaps

            _______________________________________________
            Devel mailing list [email protected] <mailto:[email protected]>
            To unsubscribe send an email [email protected] 
<mailto:[email protected]>
            Privacy Statement:https://www.ovirt.org/site/privacy-policy/
            oVirt Code of 
Conduct:https://www.ovirt.org/community/about/community-guidelines/
            List 
Archives:https://lists.ovirt.org/archives/list/[email protected]/message/YJ6DYKVBJ43QAN6HI5PFRJTQTBKMBBAX/

--

            Kaustav Majumder

            Associate Software Engineer

            Red Hat India PVT LTD. <https://www.redhat.com>

            [email protected] <mailto:[email protected]> M:
            08981884037 <tel:08981884037> IM: IRC: kmajumder

            <https://red.ht/sig>  
            TRIED. TESTED. TRUSTED. <https://redhat.com/trusted>

            @redhatway <https://twitter.com/redhatway> @redhatinc
            <https://instagram.com/redhatinc> @redhatsnaps
            <https://snapchat.com/add/redhatsnaps>

--Didi

--

        Kaustav Majumder

        Associate Software Engineer

        Red Hat India PVT LTD. <https://www.redhat.com>

        [email protected] <mailto:[email protected]> M:
        08981884037 <tel:08981884037> IM: IRC: kmajumder

        <https://red.ht/sig>      
        TRIED. TESTED. TRUSTED. <https://redhat.com/trusted>

        @redhatway <https://twitter.com/redhatway> @redhatinc
        <https://instagram.com/redhatinc> @redhatsnaps
        <https://snapchat.com/add/redhatsnaps>

--Didi

    _______________________________________________
    Devel mailing list -- [email protected] <mailto:[email protected]>
    To unsubscribe send an email to [email protected]
    <mailto:[email protected]>
    Privacy Statement: https://www.ovirt.org/site/privacy-policy/
    oVirt Code of Conduct:
    https://www.ovirt.org/community/about/community-guidelines/
    List Archives:
    
https://lists.ovirt.org/archives/list/[email protected]/message/ZGNJMCI2QTLYDALFE7E36OJS6O5WPKI5/



--

GREG SHEREMETA

SENIOR SOFTWARE ENGINEER - TEAM LEAD - RHV UX

Red Hat NA

<https://www.redhat.com/>

[email protected] <mailto:[email protected]> IRC: gshereme

<https://red.ht/sig>


--

Kaustav Majumder

Associate Software Engineer

Red Hat India PVT LTD. <https://www.redhat.com>

[email protected] <mailto:[email protected]> M: 08981884037<tel:08981884037> IM: IRC: kmajumder


<https://red.ht/sig>      
TRIED. TESTED. TRUSTED. <https://redhat.com/trusted>

@redhatway <https://twitter.com/redhatway> @redhatinc<https://instagram.com/redhatinc> @redhatsnaps<https://snapchat.com/add/redhatsnaps>

_______________________________________________
Devel mailing list -- [email protected]
To unsubscribe send an email to [email protected]
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/[email protected]/message/CUJWGCYGLVCA5XETK6QLM5OZ4D6OZGHR/

[ovirt-devel] Re: Error adding host to ovirt-engine in local development environment

Reply via email to