Re: [OpenStack-Infra] Failed to SSH login into the gerrit(Too many concurrent connections )

2019-08-25 Thread Rikimaru Honjo

Hi Clark,

On 2019/08/24 6:07, Clark Boylan wrote:

On Fri, Aug 23, 2019, at 9:40 AM, Rikimaru Honjo wrote:

Hello,

I have my zuulv3 instance for 3rd party CI.

I stopped & restarted it several times to test my configuration
yesterday.
As aresult, my zuulv3 instance started to fail to connect the
gerrit(review.opendev.org).
The following error was occurred at that time.


Received disconnect from 104.130.246.32 port 29418:12: Too many concurrent 
connections (64) - max. allowed: 64


I tried to run ssh command[1] manually. It was also failed by same reason.
And, I also tried it on other machine. The result was the same.

How can I resolve this issue?


There is only one user with 64 connections currently so I am going to assume 
this is your third party CI user (it is NTT SystemFault MasakariIntegration 
CI). I've gone ahead and closed all 64 existing connections in Gerrit.


Thank you for closing ssh connections!
I can connect now.


This is typically caused by ssh clients that don't properly close their ssh 
connection with gerrit. At one point this happened because of a bug in Zuul. 
That bug has long since been fixed; you should ensure that you are running an 
up to date version of zuul and paramiko to avoid this. Firewalls that timeout 
connections may also cause this to happen.


OK.
I haven't updated zuul for a long time. I try to update it.


Also for future debugging it helps to get the client name and/or ID so that we 
can be sure we are identifying the correct accounts and connections on the 
Gerrit side of things.


It sounds great.

Best regards,



[1]
e.g. "gerrit stream-events",  "git-upload-pack "

Best regards,
--
_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/
Rikimaru Honjo
E-mail:honjo.rikim...@ntt-tx.co.jp


___
OpenStack-Infra mailing list
OpenStack-Infra@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-infra



--
_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/
Rikimaru Honjo
E-mail:honjo.rikim...@ntt-tx.co.jp


___
OpenStack-Infra mailing list
OpenStack-Infra@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-infra

[OpenStack-Infra] Failed to SSH login into the gerrit(Too many concurrent connections )

2019-08-23 Thread Rikimaru Honjo

Hello,

I have my zuulv3 instance for 3rd party CI.

I stopped & restarted it several times to test my configuration yesterday.
As aresult, my zuulv3 instance started to fail to connect the 
gerrit(review.opendev.org).
The following error was occurred at that time.


Received disconnect from 104.130.246.32 port 29418:12: Too many concurrent 
connections (64) - max. allowed: 64


I tried to run ssh command[1] manually. It was also failed by same reason.
And, I also tried it on other machine. The result was the same.

How can I resolve this issue?

[1]
e.g. "gerrit stream-events",  "git-upload-pack "

Best regards,
--
_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/
Rikimaru Honjo
E-mail:honjo.rikim...@ntt-tx.co.jp



___
OpenStack-Infra mailing list
OpenStack-Infra@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-infra

[OpenStack-Infra] Failed to SSH login into the gerrit(Too many concurrent connections )

2019-08-22 Thread Rikimaru Honjo

Hello,

I have my zuulv3 instance for 3rd party CI.

I stopped & restarted it several times to test my configuration yesterday.
As aresult, my zuulv3 instance started to fail to connect the 
gerrit(review.opendev.org).
The following error was occurred at that time.


Received disconnect from 104.130.246.32 port 29418:12: Too many concurrent 
connections (64) - max. allowed: 64


I tried to run ssh command[1] manually. It was also failed by same reason.
And, I also tried it on other machine. The result was the same.

How can I resolve this issue?

[1]
e.g. "gerrit stream-events",  "git-upload-pack "

Best regards,
--
_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/
Rikimaru Honjo
E-mail:honjo.rikim...@ntt-tx.co.jp



___
OpenStack-Infra mailing list
OpenStack-Infra@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-infra

[OpenStack-Infra] Can you add my CI account to Third-Party CI group?

2018-11-26 Thread Rikimaru Honjo

Hello,

I prepared a third party CI for masakari project.
And, it is already enabled.

https://wiki.openstack.org/wiki/ThirdPartySystems/NTT_SystemFault_MasakariIntegration_CI

Can you add the following account to Third-Party CI group[1]?

NTT SystemFault MasakariIntegration CI: masakari.integration.t...@gmail.com

[1]https://review.openstack.org/#/admin/groups/270

Best Regards,
--
_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/
Rikimaru Honjo
E-mail:honjo.rikim...@po.ntt-tx.co.jp



___
OpenStack-Infra mailing list
OpenStack-Infra@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-infra

Re: [OpenStack-Infra] How to display the result of tests on the upper right of a gerrit page

2018-08-21 Thread Rikimaru Honjo

Hi Mikhail,

Thank you for replying!

On 2018/08/22 2:20, Mikhail Medvedev wrote:

On Sat, Aug 18, 2018 at 2:06 AM, Rikimaru Honjo
 wrote:


Hello,

I have a question about third-party CI.

I'm preparing my third-party CI. So I read the following document.

https://docs.openstack.org/infra/system-config/third_party.html

But, I couldn't understand how to display the result of tests in the
upper right of a gerrit page.


Hi,

The table on the gerrit page is created by the script:
https://github.com/openstack-infra/system-config/blob/d148f5f8efe9b66329600b445e9a6f4f46223896/modules/openstack_project/files/gerrit/hideci.js
. It parses all the comments posted on a patch to generate the list.
For your third-party CI to be listed on that table it should post a
comment adhering to a certain format. Press the "Toggle CI" to see
other CI comments for examples of formatting.

I got it.
I confirm the comment format of my CI.





e.g.
I'd like to display the result of tests like IBM PowerKVM CI,INFINIDAT CI...
of this page:
https://review.openstack.org/#/c/593202/1

Should I add my CI account to -ci group?


For your CI to be able to post a comment and to be added to the table
it does not have to be added to -ci group. You only need to
add your CI to -ci group to vote +/-1 Verified on the
project's changes. The Verified vote would show up at the top, e.g.
"Verified +1 Zuul".

What is the name of the third-party CI you are setting up? I can add
it to the email filter list
https://review.openstack.org/#/admin/groups/270

My third-party CI is "Networking-spp Integration CI".
This is the wiki page about it.
https://wiki.openstack.org/wiki/ThirdPartySystems/Networking-spp_Integration_CI



Best regards,
--
_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/
Rikimaru Honjo
E-mail:honjo.rikim...@po.ntt-tx.co.jp


___
OpenStack-Infra mailing list
OpenStack-Infra@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-infra


--
Mikhail Medvedev
IBM



--
_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/
Rikimaru Honjo
E-mail:honjo.rikim...@po.ntt-tx.co.jp




___
OpenStack-Infra mailing list
OpenStack-Infra@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-infra

[OpenStack-Infra] How to display the result of tests on the upper right of a gerrit page

2018-08-18 Thread Rikimaru Honjo

Hello,

I have a question about third-party CI.

I'm preparing my third-party CI. So I read the following document.

https://docs.openstack.org/infra/system-config/third_party.html

But, I couldn't understand how to display the result of tests in the
upper right of a gerrit page.

e.g.
I'd like to display the result of tests like IBM PowerKVM CI,INFINIDAT CI...
of this page:
https://review.openstack.org/#/c/593202/1

Should I add my CI account to -ci group?

Best regards,
--
_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/
Rikimaru Honjo
E-mail:honjo.rikim...@po.ntt-tx.co.jp


___
OpenStack-Infra mailing list
OpenStack-Infra@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-infra

Re: [OpenStack-Infra] How do I add a third party CI by ZuulV3?

2018-07-11 Thread Rikimaru Honjo

Hello Clark,

On 2018/07/12 0:25, Clark Boylan wrote:

On Mon, Jul 9, 2018, at 3:31 AM, Rikimaru Honjo wrote:

Hello Clark,

Thank you for your information.
But, sorry, I have some additional questions.

On 2018/07/07 1:11, Clark Boylan wrote:

On Fri, Jul 6, 2018, at 1:49 AM, Rikimaru Honjo wrote:

Hello,

I'd like to add a third party CI of networking-spp project.[1]
But, I have some question about it.
I'd appreciate it if you give information.

My wishes are the following:

* I'd like to run my test on my environment.
 Because my test requires special environment.
* I'm planning that check new patch-sets and run my test by ZuulV3.

So I built ZuulV3 and nodepool on my environment, and pushed .zuul.yaml
to gerrit.[2]

But, the following error was returned.
Should I add settings of my third party CI to project-config in this case?
If it is "Yes", is there documents about the way?

I confirmed <https://docs.openstack.org/infra/system-config/third_party.html>,
but there was no information for ZuulV3.


Zuul encountered a syntax error while parsing its configuration in the
repo openstack/networking-spp on branch master.  The error was:

Pipelines may not be defined in untrusted repos, they may only be
defined in config repos.



[1]
https://github.com/openstack/networking-spp

[2]
https://review.openstack.org/#/c/580561/1


The Zuul config in the projects that OpenStack Infra hosts apply to the 
OpenStack Zuul instance. Certain aspects of this config must be defined in a 
trusted repo to protect this instance from unintended (or even malicious) 
updates in the repos we host. The error you ran into is a case of this.

In particular pipelines define when and how zuul should run jobs so we don't 
want anyone to be able to update that without review in central trusted config.

As for how to do this for third party CI, your Zuul would need to have its own 
trusted config (for the same reasons as above, but protecting your Zuul 
instance not ours). That config will have pipelines defined. If the project is 
comfortable with it you can define the jobs and playbooks and roles for third 
party CI in the upstream project. Then you would select to run those jobs in 
your Zuul's local config and report the results back to Gerrit from there.


In this case, should I add a part of my settings to openstack-infra/
project-config?


No you will need to host your own trusted repo.

I got it.
 



Or if the upstream project wants to keep that data out of tree you can 
configure all of it in your Zuul config locally. One drawback to hosting the 
job config upstream would be that changes to the job config can be made without 
gating them and ensuring that they work (because third party CI can only vote 
+/-1). This problem is likely less of an issue if reviewers respect the third 
party CI results.


In this case, should I put config-projects on local environment and
report the test results to review.openstack.org?
But, in my understanding, "config-projects" in tenant.yaml should be put
under the source of the connection which is the target of reporting.
If my understanding is correct, I think that config-projects can not be
prepared locally.


It can be prepared locally using the git driver, 
https://zuul-ci.org/docs/zuul/admin/drivers/git.html . This is probably the 
simplest way to start then you can consider hosting your config on a Gerrit or 
Github at a later time. Chances are if this is a simple setup that the git 
driver may work long term.

Thank you for suggesting.
I readjust my settings according to the policy.




I think to start I would mostly keep what you've done, but move the pipeline 
definitions and project config that says what jobs to run into your Zuul's 
config.



http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-infra


___
OpenStack-Infra mailing list
OpenStack-Infra@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-infra




Best regards,
--
_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/
Rikimaru Honjo
E-mail:honjo.rikim...@po.ntt-tx.co.jp


___
OpenStack-Infra mailing list
OpenStack-Infra@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-infra

Re: [OpenStack-Infra] How do I add a third party CI by ZuulV3?

2018-07-09 Thread Rikimaru Honjo

Hello Clark,

Thank you for your information.
But, sorry, I have some additional questions.

On 2018/07/07 1:11, Clark Boylan wrote:

On Fri, Jul 6, 2018, at 1:49 AM, Rikimaru Honjo wrote:

Hello,

I'd like to add a third party CI of networking-spp project.[1]
But, I have some question about it.
I'd appreciate it if you give information.

My wishes are the following:

* I'd like to run my test on my environment.
Because my test requires special environment.
* I'm planning that check new patch-sets and run my test by ZuulV3.

So I built ZuulV3 and nodepool on my environment, and pushed .zuul.yaml
to gerrit.[2]

But, the following error was returned.
Should I add settings of my third party CI to project-config in this case?
If it is "Yes", is there documents about the way?

I confirmed <https://docs.openstack.org/infra/system-config/third_party.html>,
but there was no information for ZuulV3.


Zuul encountered a syntax error while parsing its configuration in the
repo openstack/networking-spp on branch master.  The error was:

   Pipelines may not be defined in untrusted repos, they may only be
   defined in config repos.



[1]
https://github.com/openstack/networking-spp

[2]
https://review.openstack.org/#/c/580561/1


The Zuul config in the projects that OpenStack Infra hosts apply to the 
OpenStack Zuul instance. Certain aspects of this config must be defined in a 
trusted repo to protect this instance from unintended (or even malicious) 
updates in the repos we host. The error you ran into is a case of this.

In particular pipelines define when and how zuul should run jobs so we don't 
want anyone to be able to update that without review in central trusted config.

As for how to do this for third party CI, your Zuul would need to have its own 
trusted config (for the same reasons as above, but protecting your Zuul 
instance not ours). That config will have pipelines defined. If the project is 
comfortable with it you can define the jobs and playbooks and roles for third 
party CI in the upstream project. Then you would select to run those jobs in 
your Zuul's local config and report the results back to Gerrit from there.


In this case, should I add a part of my settings to 
openstack-infra/project-config?


Or if the upstream project wants to keep that data out of tree you can 
configure all of it in your Zuul config locally. One drawback to hosting the 
job config upstream would be that changes to the job config can be made without 
gating them and ensuring that they work (because third party CI can only vote 
+/-1). This problem is likely less of an issue if reviewers respect the third 
party CI results.


In this case, should I put config-projects on local environment and report the 
test results to review.openstack.org?
But, in my understanding, "config-projects" in tenant.yaml should be put under 
the source of the connection which is the target of reporting.
If my understanding is correct, I think that config-projects can not be 
prepared locally.


I think to start I would mostly keep what you've done, but move the pipeline 
definitions and project config that says what jobs to run into your Zuul's 
config.

Hope this helps,
Clark

___
OpenStack-Infra mailing list
OpenStack-Infra@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-infra




--
_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/
Rikimaru Honjo
E-mail:honjo.rikim...@po.ntt-tx.co.jp




___
OpenStack-Infra mailing list
OpenStack-Infra@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-infra

[OpenStack-Infra] How do I add a third party CI by ZuulV3?

2018-07-06 Thread Rikimaru Honjo

Hello,

I'd like to add a third party CI of networking-spp project.[1]
But, I have some question about it.
I'd appreciate it if you give information.

My wishes are the following:

* I'd like to run my test on my environment.
  Because my test requires special environment.
* I'm planning that check new patch-sets and run my test by ZuulV3.

So I built ZuulV3 and nodepool on my environment, and pushed .zuul.yaml
to gerrit.[2]

But, the following error was returned.
Should I add settings of my third party CI to project-config in this case?
If it is "Yes", is there documents about the way?

I confirmed <https://docs.openstack.org/infra/system-config/third_party.html>,
but there was no information for ZuulV3.


Zuul encountered a syntax error while parsing its configuration in the
repo openstack/networking-spp on branch master.  The error was:

  Pipelines may not be defined in untrusted repos, they may only be
  defined in config repos.



[1]
https://github.com/openstack/networking-spp

[2]
https://review.openstack.org/#/c/580561/1

Best regards,
--
_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/
Rikimaru Honjo
E-mail:honjo.rikim...@po.ntt-tx.co.jp


___
OpenStack-Infra mailing list
OpenStack-Infra@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-infra

Re: [OpenStack-Infra] How does Zuulv3 distinguish "Build successful" or failure?

2018-06-25 Thread Rikimaru Honjo

Hello Tobias,

Thank you for great information!


Zuul ignores non-voting jobs for the overall build result. By declaring your
job non-voting you tell zuul that you don't care about the build result of that
job.

OK, I got it.

Best regards,

On 2018/06/25 20:06, tobias.hen...@bmw.de wrote:

Hi,

On 25.06.18, 12:52, "Rikimaru Honjo"  wrote:

 Hello,
 
 Sorry, I have a new question about Zuul V3.

 (Perhaps this is my last question...)
 
 I created my job of ZuulV3.

 And I deliberately failed my job to test my settings.
 
 As a result, a message like this was reported to gerrit.
 
 -

 Patch Set 1:
 Build successful.
 * foo-bar-tempest-test http://localhost:8000/421/1/20180625101836 : 
FAILURE in 7m 06s (non-voting)
 -
 
 "FAILURE" is OK. This is same as my expectation.

 Because this job was deliberately failed by me.
 
 But, "Build successful." was different from my expectation.

 How does Zuulv3 distinguish "Build successful" or failure?
 (Should I register the result to a specific variable in playbook?)

Zuul ignores non-voting jobs for the overall build result. By declaring your
job non-voting you tell zuul that you don't care about the build result of that
job.
 
 Best regards,

 --
 _/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/
 Rikimaru Honjo
 E-mail:honjo.rikim...@po.ntt-tx.co.jp
 


- Tobias






--
_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/
Rikimaru Honjo
E-mail:honjo.rikim...@po.ntt-tx.co.jp




___
OpenStack-Infra mailing list
OpenStack-Infra@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-infra

[OpenStack-Infra] How does Zuulv3 distinguish "Build successful" or failure?

2018-06-25 Thread Rikimaru Honjo

Hello,

Sorry, I have a new question about Zuul V3.
(Perhaps this is my last question...)

I created my job of ZuulV3.
And I deliberately failed my job to test my settings.

As a result, a message like this was reported to gerrit.

-
Patch Set 1:
Build successful.
* foo-bar-tempest-test http://localhost:8000/421/1/20180625101836 : FAILURE in 
7m 06s (non-voting)
-  


"FAILURE" is OK. This is same as my expectation.
Because this job was deliberately failed by me.

But, "Build successful." was different from my expectation.
How does Zuulv3 distinguish "Build successful" or failure?
(Should I register the result to a specific variable in playbook?)

Best regards,
--
_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/
Rikimaru Honjo
E-mail:honjo.rikim...@po.ntt-tx.co.jp


___
OpenStack-Infra mailing list
OpenStack-Infra@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-infra

Re: [OpenStack-Infra] How can I get the each node's IP address?

2018-06-20 Thread Rikimaru Honjo

Hello Jeremy,

Thank you for the information!

On 2018/06/20 21:47, Jeremy Stanley wrote:

On 2018-06-20 17:16:52 +0900 (+0900), Rikimaru Honjo wrote:

I installed Zuul v3 and Nodepool in my environment.

In the old Nodepool, I could get sub node's IP address from
/etc/nodepool/sub_nodes. But, this file has been removed.

How can I get each node's IP address when using multiple nodes in
my job?

I'd like to use Controller node's IP address for Compute nodes. I
read the following document. But I couldn't find the describe
about my question. https://docs.openstack.org/infra/zuul/


The official URL for Zuul's documentation these days is
https://zuul-ci.org/docs/ (both URLs serve the same content for now
though) and the relevant section is
https://zuul-ci.org/docs/zuul/user/jobs.html?highlight=inventory#job-variables

Oh, sorry.
I had misunderstood the official URL.


Confusion is understandable as the documentation doesn't dive into
the particular variables Ansible supplies and isn't written as a
guide for migrating from Zuul v2 to v3. That information which used
to be written to /etc/nodepool can now be inferred from the Ansible
inventory and is exposed as host vars for use in jobs. As an
example, here's how the OpenStack community recreated the old Zuul
v2 /etc/nodepool files with Ansible in their Zuul v3 deployment for
transitional purposes:

https://git.openstack.org/cgit/openstack-infra/openstack-zuul-jobs/tree/playbooks/legacy/pre.yaml?id=842f241#n8

This is very useful for me.
I could understand how to get IP address and other information.


Of course, in Zuul v3 you no longer need to stash these values in
files on the nodes because you can simply reference the variables
directly in your job definitions.

Also, there is a specific discussion list for Zuul these days, you
might prefer to use in the future:

http://lists.zuul-ci.org/cgi-bin/mailman/listinfo/zuul-discuss

I got it.
Thank you for your suggestions.




___
OpenStack-Infra mailing list
OpenStack-Infra@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-infra



Best regards,
--
_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/
Rikimaru Honjo
E-mail:honjo.rikim...@po.ntt-tx.co.jp


___
OpenStack-Infra mailing list
OpenStack-Infra@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-infra

[OpenStack-Infra] How can I get the each node's IP address?

2018-06-20 Thread Rikimaru Honjo

Hello,

I installed Zuul v3 and Nodepool in my environment.

In the old Nodepool, I could get sub node's IP address from 
/etc/nodepool/sub_nodes.
But, this file has been removed.

How can I get each node's IP address when using multiple nodes in my job?

I'd like to use Controller node's IP address for Compute nodes.
I read the following document. But I couldn't find the describe about my 
question.
https://docs.openstack.org/infra/zuul/

Best regards,
--
_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/
Rikimaru Honjo
E-mail:honjo.rikim...@po.ntt-tx.co.jp



___
OpenStack-Infra mailing list
OpenStack-Infra@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-infra

Re: [OpenStack-Infra] How do I run "zuul_return" if tests are failed on Zuul v3?

2017-11-12 Thread Rikimaru Honjo

I give some supplementary additional explanation to my question.

On 2017/11/08 18:49, Rikimaru Honjo wrote:

Hello,

* I'm using Zuul v3 ver.2.5.3.dev1585.

I created a job which runs following two tasks for zuul v3.[1]

1. Run tests on remote host which is created by Nodepool.
    (In this time, "hosts" value is "all".)
2. Run zuul_return on localhost where is zuul-executor.
    And, submit a URL of logs specified as "log_url" attribute to gerrit.
    (In this time, "hosts" value is "localhost".)

In this case, task 2 won't be run if task 1 is failed.
And, the below URL will be submitted to gerrit.


The pseudocode is this:

# task-1
- hosts: all
  tasks:
- command: "Run tests"
  register: result
  ignore_errors: True

- command: "Process after testing"
# task-2
- hosts: localhost
  tasks:
- zuul_return:
  [...]
  when: result.rc == 1

In this case, the "result" value of task-1 is not passed to task-2.
So I'm planning to save "result" value to a local file.
Are there any other solutions?


finger:///e8ce4c7f627a43689dd9ad4ecc43c881

How do you run "zuul_return" if the test task will be failed?

P.S.
If I specified "ignore_errors:True" in task 1, task2 was run even if
task1 was failed.
But, the submitted result was "SUCCESS" in this case.

[1]
I refered the following suggestion.
http://lists.openstack.org/pipermail/openstack-infra/2017-October/005646.html


--
_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/
Rikimaru Honjo
E-mail:honjo.rikim...@po.ntt-tx.co.jp


___
OpenStack-Infra mailing list
OpenStack-Infra@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-infra

[OpenStack-Infra] How do I run "zuul_return" if tests are failed on Zuul v3?

2017-11-08 Thread Rikimaru Honjo

Hello,

* I'm using Zuul v3 ver.2.5.3.dev1585.

I created a job which runs following two tasks for zuul v3.[1]

1. Run tests on remote host which is created by Nodepool.
   (In this time, "hosts" value is "all".)
2. Run zuul_return on localhost where is zuul-executor.
   And, submit a URL of logs specified as "log_url" attribute to gerrit.
   (In this time, "hosts" value is "localhost".)

In this case, task 2 won't be run if task 1 is failed.
And, the below URL will be submitted to gerrit.

finger:///e8ce4c7f627a43689dd9ad4ecc43c881

How do you run "zuul_return" if the test task will be failed?

P.S.
If I specified "ignore_errors:True" in task 1, task2 was run even if
task1 was failed.
But, the submitted result was "SUCCESS" in this case.

[1]
I refered the following suggestion.
http://lists.openstack.org/pipermail/openstack-infra/2017-October/005646.html
--
_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/
Rikimaru Honjo
E-mail:honjo.rikim...@po.ntt-tx.co.jp



___
OpenStack-Infra mailing list
OpenStack-Infra@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-infra

Re: [OpenStack-Infra] Zuul v3 questions

2017-10-31 Thread Rikimaru Honjo

Hello James,

On 2017/10/31 0:56, James E. Blair wrote:

Rikimaru Honjo <honjo.rikim...@po.ntt-tx.co.jp> writes:


I confirmed the below PPA, but my version is the latest.

https://launchpad.net/~ansible/+archive/ubuntu/bubblewrap

Should I use ubuntu higher than 16.04...?


We are running on 16.04.  But it looks like this is the PPA we're using:

deb http://ppa.launchpad.net/openstack-ci-core/bubblewrap/ubuntu xenial main

Thank you so much, I could use "--die-with-parent" option with bubblewrap
suggested by you.

And, my 3rd problem has also been solved by the above bubblewrap!

My 3rd problem:
Setup module of ansible took long time when zuul ran jobs. 
 

Hopefully there will be a backport soon and we can stop using it.

-Jim



--
_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/
Rikimaru Honjo
E-mail:honjo.rikim...@po.ntt-tx.co.jp




___
OpenStack-Infra mailing list
OpenStack-Infra@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-infra

Re: [OpenStack-Infra] Zuul v3 questions (was: Re: [openstack-dev] Update on Zuul v3 Migration - and what to do about issues)

2017-10-30 Thread Rikimaru Honjo

Hello James,

Thank you for replying!

On 2017/10/28 7:17, James E. Blair wrote:

Rikimaru Honjo <honjo.rikim...@po.ntt-tx.co.jp> writes:


Hello,

(Can I still use this thread?)


In the future, you may want to start a new thread on
openstack-infra@lists.openstack.org for general Zuul questions.

I've changed the CC list and subject of this message to redirect the
conversation there.


Excuse me, I'm trying to run Zuul v3 in my environment, and I have three
question about it.
I'd appreciate it if anyone helps.

My environment)
I use feature/zuulv3 branch, and version is 2.5.3.dev1374.


We have not released Zuul v3 yet and we don't recommend that folks use
it yet unless they want to contribute to developing it.  Installation
and configuration is currently more difficult than we would like, and
the code base is still rapidly changing.  We will send out announcements
when it is ready for general use (including OpenStack third-party CI).
This may or may not apply to you, but I wanted to reiterate it for
anyone else reading.  Thanks for trying it out.  :)

Thank you for explaining.
I understood the status of zuul v3.


Q1)
"Unknown option --die-with-parent" error was occurred when zuul ran job.
Is there requirement of bubblewrap version?

I used bubblewrap 0.1.7-1~16.04~ansible.
If I removed "--die-with-parent" from zuul/driver/bubblewrap/__init__.py,
above error wouldn't occurred.


You will need a newer version of bubblewrap.  Attempting to run with an
older one will cause Zuul not to behave as expected.  I believe
OpenStack-infra uses a PPA with a more recent version.

I confirmed the below PPA, but my version is the latest.

https://launchpad.net/~ansible/+archive/ubuntu/bubblewrap

Should I use ubuntu higher than 16.04...?


Q2)
When I specified "zuul_return" in playbook, the below error was occurred
on remote host.

KeyError: 'ZUUL_JOBDIR'

Should I write a playbook to set a environment variable "ZUUL_JOBDIR"?


I believe that zuul_return is only expected to work on the executor, so
you may need to delegate this play to 'localhost' to ensure it does not
run on the remote node.


Q3)
Setup module of ansible took long time when zuul ran jobs.
My job was succeeded if I extended timeout from 60 to 120 by modifying
runAnsibleSetup() in zuul/executor/server.py.

But, if I run same job directly(by own), it was finished soon.
Do you have any knowledge about it?


I'm not sure about this.  It might be related to the persistent SSH
connections which are constructed by the setup task and then used by
later playbook invocations.  I'd start by correcting the bubblewrap
issue and see if this changes.

OK, I watch your work.
Thanks.


P.S.
Is there a constructed VM image or ansible for running zuul v3...?


Not yet, but we hope to have something like that before release.

-Jim



--
_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/
Rikimaru Honjo
E-mail:honjo.rikim...@po.ntt-tx.co.jp




___
OpenStack-Infra mailing list
OpenStack-Infra@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-infra