Pushed one line fix directly to mtt repo. Tested to work with and without
section support. Thanks, -- Noah
commit 6c86b7e9405f6470b49ddbbd8da9ea0fcaf533f0
Author: Noah van Dresser <daniel.n.van.dres...@intel.com>
Date: Wed Sep 7 11:55:31 2016 -0700
Bug fix for NoneType error after --sections and --skip-sections support was
added.
Signed-off-by: Noah van Dresser <daniel.n.van.dres...@intel.com>
From: mtt-devel [mailto:mtt-devel-boun...@lists.open-mpi.org] On Behalf Of Van
Dresser, Daniel N
Sent: Wednesday, September 07, 2016 11:41 AM
To: Development list for the MPI Testing Tool <mtt-devel@lists.open-mpi.org>
Subject: Re: [MTT devel] reporter error using pyclient
No, mtt python client tip of the tree is broken. Looking into it now….
You can change line 534 to “if 0:” to work around the issue until we have a fix.
> /home/test/jenkins/mtt/pylib/System/TestDef.py(534)configTest()
-> if 0 != len(sections) and not skip:
(Pdb) c
Traceback (most recent call last):
File "/home/test/jenkins/mtt/pyclient/pymtt.py", line 247, in <module>
testDef.configTest()
File "/home/test/jenkins/mtt/pylib/System/TestDef.py", line 534, in configTest
if 0 != len(sections) and not skip:
TypeError: object of type 'NoneType' has no len()
From: mtt-devel [mailto:mtt-devel-boun...@lists.open-mpi.org] On Behalf Of Josh
Hursey
Sent: Wednesday, September 07, 2016 11:10 AM
To: Development list for the MPI Testing Tool
<mtt-devel@lists.open-mpi.org<mailto:mtt-devel@lists.open-mpi.org>>
Subject: Re: [MTT devel] reporter error using pyclient
I ran with the Perl client and it worked fine.
I'm struggling to get a valid .ini file for the python client to test further.
I keep getting internal NoneType errors in the python client, which probably
(hopefully) means that the .ini is not quite correct. Can you send me a simple,
valid pyclient .ini file to run? The ones in mtt/sample/python do not seem to
be current.
On Fri, Sep 2, 2016 at 9:37 AM, r...@open-mpi.org<mailto:r...@open-mpi.org>
<r...@open-mpi.org<mailto:r...@open-mpi.org>> wrote:
I tried converting all the stdout/stderr input to single strings using a
“join”, and now I’m getting a different error - looks like we are failing to
get a submit id?
<<<<<<<---------------- Raw Output (Start) ---------------->>>>>>
<!DOCTYPE html PUBLIC
"-//W3C//DTD XHTML 1.0 Transitional//EN"
"http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd";>
<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8"></meta>
<title>500 Internal Server Error</title>
<style type="text/css">
#powered_by {
margin-top: 20px;
border-top: 2px solid black;
font-style: italic;
}
#traceback {
color: red;
}
</style>
</head>
<body>
<h2>500 Internal Server Error</h2>
<p>The server encountered an unexpected condition which prevented it
from fulfilling the request.</p>
<pre id="traceback">Traceback (most recent call last):
File
"/nfs/data/osl/www/mtt.open-mpi.org/mtt-modern/server/php/cherrypy/src/env/lib/python2.6/site-packages/cherrypy/_cprequest.py<http://mtt.open-mpi.org/mtt-modern/server/php/cherrypy/src/env/lib/python2.6/site-packages/cherrypy/_cprequest.py>",
line 670, in respond
response.body = self.handler()
File
"/nfs/data/osl/www/mtt.open-mpi.org/mtt-modern/server/php/cherrypy/src/env/lib/python2.6/site-packages/cherrypy/lib/encoding.py<http://mtt.open-mpi.org/mtt-modern/server/php/cherrypy/src/env/lib/python2.6/site-packages/cherrypy/lib/encoding.py>",
line 217, in __call__
self.body = self.oldhandler(*args, **kwargs)
File
"/nfs/data/osl/www/mtt.open-mpi.org/mtt-modern/server/php/cherrypy/src/env/lib/python2.6/site-packages/cherrypy/lib/jsontools.py<http://mtt.open-mpi.org/mtt-modern/server/php/cherrypy/src/env/lib/python2.6/site-packages/cherrypy/lib/jsontools.py>",
line 63, in json_handler
value = cherrypy.serving.request._json_inner_handler(*args, **kwargs)
File
"/nfs/data/osl/www/mtt.open-mpi.org/mtt-modern/server/php/cherrypy/src/env/lib/python2.6/site-packages/cherrypy/_cpdispatch.py<http://mtt.open-mpi.org/mtt-modern/server/php/cherrypy/src/env/lib/python2.6/site-packages/cherrypy/_cpdispatch.py>",
line 60, in __call__
return self.callable(*self.args, **self.kwargs)
File
"/nfs/data/osl/www/mtt.open-mpi.org/mtt-modern/server/php/cherrypy/src/webapp/dispatchers.py<http://mtt.open-mpi.org/mtt-modern/server/php/cherrypy/src/webapp/dispatchers.py>",
line 318, in POST
submit_info = self._db.get_submit_id(data['metadata'])
File
"/nfs/data/osl/www/mtt.open-mpi.org/mtt-modern/server/php/cherrypy/src/webapp/db_pgv3.py<http://mtt.open-mpi.org/mtt-modern/server/php/cherrypy/src/webapp/db_pgv3.py>",
line 234, in get_submit_id
submit_id = self._select_insert("submit", "submit_id", fields, values)
File
"/nfs/data/osl/www/mtt.open-mpi.org/mtt-modern/server/php/cherrypy/src/webapp/db_pgv3.py<http://mtt.open-mpi.org/mtt-modern/server/php/cherrypy/src/webapp/db_pgv3.py>",
line 183, in _select_insert
cursor.execute( select_stmt, values )
InternalError: current transaction is aborted, commands ignored until end of
transaction block
</pre>
<div id="powered_by">
<span>
Powered by <a href="http://www.cherrypy.org";>CherryPy 5.1.0</a>
</span>
</div>
</body>
</html>
<<<<<<<---------------- Raw Output (End ) ---------------->>>>>>
On Aug 29, 2016, at 9:03 AM, Josh Hursey
<jjhur...@open-mpi.org<mailto:jjhur...@open-mpi.org>> wrote:
Looking at the cherrypy server log it looks like the error is related to this:
"result_stderr": [
"Option middleware is not supported"
],
This value was set to an array instead of string.
result_stdout is coming through fine as a string, but it looks like you are
submitting the result_stderr as an array still. The server treats both of those
keys the same, so it must be on the python client side.
I don't think the server requires a MPI Install phase. It's listed as an
optional field for the test_build/test_run phases. If you don't submit an MPI
Install phase it might not show up in the MTT Reporter's default view, but
that's the same with the Perl client configured to use an already installed
build.
On Fri, Aug 26, 2016 at 9:40 PM, r...@open-mpi.org<mailto:r...@open-mpi.org>
<r...@open-mpi.org<mailto:r...@open-mpi.org>> wrote:
Hmmm...Hey Josh - is it possible that your server is requiring an MPI_Install
phase? We don’t have one since we just build and then set the path accordingly
- is it complaining about missing data for an install phase?
On Aug 26, 2016, at 7:33 PM, r...@open-mpi.org<mailto:r...@open-mpi.org> wrote:
Okay, I cleaned things up some more and got a little bit further - now hitting
an error in the server?
<<<<<<<---------------- Payload (End ) -------------------------->>>>>>
INFO:requests.packages.urllib3.connectionpool:Resetting dropped connection:
mtt.open-mpi.org<http://mtt.open-mpi.org/>
DEBUG:requests.packages.urllib3.connectionpool:"POST /submit/cpy/api/submit
HTTP/1.1" 500 2535
<<<<<<<---------------- Response -------------------------->>>>>>
Result: 500: text/html;charset=utf-8
{'content-length': '2535', 'set-cookie':
'session_id=1b3f3c3df893e673e072430844afe27b4389be71; expires=Sat, 27 Aug 2016
03:31:28 GMT; Path=/', 'server': 'CherryPy/5.1.0', 'connection': 'close',
'allow': 'POST', 'date': 'Sat, 27 Aug 2016 02:31:28 GMT',
'access-control-allow-origin': '*', 'content-type': 'text/html;charset=utf-8'}
Internal Server Error
<<<<<<<---------------- Raw Output (Start) ---------------->>>>>>
<!DOCTYPE html PUBLIC
"-//W3C//DTD XHTML 1.0 Transitional//EN"
"http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd";>
<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8"></meta>
<title>500 Internal Server Error</title>
<style type="text/css">
#powered_by {
margin-top: 20px;
border-top: 2px solid black;
font-style: italic;
}
#traceback {
color: red;
}
</style>
</head>
<body>
<h2>500 Internal Server Error</h2>
<p>The server encountered an unexpected condition which prevented it
from fulfilling the request.</p>
<pre id="traceback">Traceback (most recent call last):
File
"/nfs/data/osl/www/mtt.open-mpi.org/mtt-modern/server/php/cherrypy/src/env/lib/python2.6/site-packages/cherrypy/_cprequest.py<http://mtt.open-mpi.org/mtt-modern/server/php/cherrypy/src/env/lib/python2.6/site-packages/cherrypy/_cprequest.py>",
line 670, in respond
response.body = self.handler()
File
"/nfs/data/osl/www/mtt.open-mpi.org/mtt-modern/server/php/cherrypy/src/env/lib/python2.6/site-packages/cherrypy/lib/encoding.py<http://mtt.open-mpi.org/mtt-modern/server/php/cherrypy/src/env/lib/python2.6/site-packages/cherrypy/lib/encoding.py>",
line 217, in __call__
self.body = self.oldhandler(*args, **kwargs)
File
"/nfs/data/osl/www/mtt.open-mpi.org/mtt-modern/server/php/cherrypy/src/env/lib/python2.6/site-packages/cherrypy/lib/jsontools.py<http://mtt.open-mpi.org/mtt-modern/server/php/cherrypy/src/env/lib/python2.6/site-packages/cherrypy/lib/jsontools.py>",
line 63, in json_handler
value = cherrypy.serving.request._json_inner_handler(*args, **kwargs)
File
"/nfs/data/osl/www/mtt.open-mpi.org/mtt-modern/server/php/cherrypy/src/env/lib/python2.6/site-packages/cherrypy/_cpdispatch.py<http://mtt.open-mpi.org/mtt-modern/server/php/cherrypy/src/env/lib/python2.6/site-packages/cherrypy/_cpdispatch.py>",
line 60, in __call__
return self.callable(*self.args, **self.kwargs)
File
"/nfs/data/osl/www/mtt.open-mpi.org/mtt-modern/server/php/cherrypy/src/webapp/dispatchers.py<http://mtt.open-mpi.org/mtt-modern/server/php/cherrypy/src/webapp/dispatchers.py>",
line 333, in POST
value = self._db.insert_mpi_install(submit_info['submit_id'],
data['metadata'], entry)
File
"/nfs/data/osl/www/mtt.open-mpi.org/mtt-modern/server/php/cherrypy/src/webapp/db_pgv3.py<http://mtt.open-mpi.org/mtt-modern/server/php/cherrypy/src/webapp/db_pgv3.py>",
line 641, in insert_mpi_install
fields, values)
File
"/nfs/data/osl/www/mtt.open-mpi.org/mtt-modern/server/php/cherrypy/src/webapp/db_pgv3.py<http://mtt.open-mpi.org/mtt-modern/server/php/cherrypy/src/webapp/db_pgv3.py>",
line 183, in _select_insert
cursor.execute( select_stmt, values )
ProgrammingError: operator does not exist: text = text[]
LINE 3: ... merge_stdout_stderr = E'false' AND result_stderr = ARRAY[E'...
^
HINT: No operator matches the given name and argument type(s). You might need
to add explicit type casts.
</pre>
<div id="powered_by">
<span>
Powered by <a
href="http://www.cherrypy.org<http://www.cherrypy.org/>">CherryPy 5.1.0</a>
</span>
</div>
</body>
</html>
<<<<<<<---------------- Raw Output (End ) ---------------->>>>>>
On Aug 26, 2016, at 2:01 PM, r...@open-mpi.org<mailto:r...@open-mpi.org> wrote:
That appears to resolve the connection issue:
<<<<<<<---------------- Payload (End ) -------------------------->>>>>>
INFO:requests.packages.urllib3.connectionpool:Resetting dropped connection:
mtt.open-mpi.org<http://mtt.open-mpi.org/>
DEBUG:requests.packages.urllib3.connectionpool:"POST /submit/cpy/api/submit
HTTP/1.1" 200 90
<<<<<<<---------------- Response -------------------------->>>>>>
Result: 200: application/json
{'content-length': '90', 'set-cookie':
'session_id=df54fbc661acdd2cdda5e5ee74de3b62e1fac8e5; expires=Fri, 26 Aug 2016
22:00:12 GMT; Path=/', 'server': 'CherryPy/5.1.0', 'connection': 'close',
'allow': 'POST', 'date': 'Fri, 26 Aug 2016 21:00:12 GMT',
'access-control-allow-origin': '*', 'content-type': 'application/json'}
OK
<<<<<<<---------------- Raw Output (Start) ---------------->>>>>>
{"status": -2, "status_message": "[DB PG V3] (mpi_install) Missing field:
compiler_name"}
<<<<<<<---------------- Raw Output (End ) ---------------->>>>>>
Looks like we are still missing some fields, though...
On Aug 26, 2016, at 1:36 PM, Josh Hursey
<jjhur...@open-mpi.org<mailto:jjhur...@open-mpi.org>> wrote:
Try this for the url:
url = https://mtt.open-mpi.org/submit/cpy/api
I'm looking back at one of my testing scripts and that's what I was using.
On Fri, Aug 26, 2016 at 2:11 PM, r...@open-mpi.org<mailto:r...@open-mpi.org>
<r...@open-mpi.org<mailto:r...@open-mpi.org>> wrote:
FWIW: the extra “/“ is inserted in the IUDatabase reporter plugin. Removing it
didn’t make any difference
Must be something on the server side, I fear
On Aug 26, 2016, at 12:08 PM, r...@open-mpi.org<mailto:r...@open-mpi.org> wrote:
BTW: here is my .ini snippet
[Reporter:IUdatabase]
plugin = IUDatabase
realm = OMPI
username = intel
pwfile = /home/common/mttpwd.txt
platform = bend-rsh
hostname = rhc00[1-2]
url = https://mtt.open-mpi.org/submit/cpy/
email = r...@open-mpi.org<mailto:r...@open-mpi.org>
So it looks like the CherryPi server is adding a /submit to the end, and that
might be the issue?
On Aug 26, 2016, at 12:07 PM, r...@open-mpi.org<mailto:r...@open-mpi.org> wrote:
Even though I can get there with the browser, I do still hit this error:
<<<<<<<---------------- Raw Output (Start) ---------------->>>>>>
<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">
<html><head>
<title>404 Not Found</title>
</head><body>
<h1>Not Found</h1>
<p>The requested URL /submit/cpy//submit was not found on this server.</p>
<hr>
<address>Apache/2.2.15 (Red Hat) Server at
mtt.open-mpi.org<http://mtt.open-mpi.org/> Port 443</address>
</body></html>
<<<<<<<---------------- Raw Output (End ) ---------------->>>>>>
It looks to me like the URL isn’t correctly set - yes?
On Aug 26, 2016, at 7:10 AM, r...@open-mpi.org<mailto:r...@open-mpi.org> wrote:
I checked it with my browser and got the expected return message
On Aug 25, 2016, at 1:46 PM, Josh Hursey
<jjhur...@open-mpi.org<mailto:jjhur...@open-mpi.org>> wrote:
Can you send me the portion of the ini script that you are using?
Can you access this site via the browser (you will need your login credentials):
https://mtt.open-mpi.org/submit/cpy/api/
It should return:
{"status": 0, "status_message": "Success"}
On Thu, Aug 25, 2016 at 3:01 PM, Howard Pritchard
<hpprit...@gmail.com<mailto:hpprit...@gmail.com>> wrote:
HI Josh,
That doesn't seem to help:
<<<<<<<---------------- Payload (End ) -------------------------->>>>>>
INFO:requests.packages.urllib3.connectionpool:Starting new HTTPS connection
(1): mtt.open-mpi.org<http://mtt.open-mpi.org/>
/Users/hpp/.virtualenvs/mtt_py3/lib/python2.7/site-packages/requests/packages/urllib3/util/ssl_.py:315:
SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name
Indication) extension to TLS is not available on this platform. This may cause
the server to present an incorrect TLS certificate, which can cause validation
failures. For more information, see
https://urllib3.readthedocs.org/en/latest/security.html#snimissingwarning.
SNIMissingWarning
/Users/hpp/.virtualenvs/mtt_py3/lib/python2.7/site-packages/requests/packages/urllib3/util/ssl_.py:120:
InsecurePlatformWarning: A true SSLContext object is not available. This
prevents urllib3 from configuring SSL appropriately and may cause certain SSL
connections to fail. For more information, see
https://urllib3.readthedocs.org/en/latest/security.html#insecureplatformwarning.
InsecurePlatformWarning
/Users/hpp/.virtualenvs/mtt_py3/lib/python2.7/site-packages/requests/packages/urllib3/connectionpool.py:791:
InsecureRequestWarning: Unverified HTTPS request is being made. Adding
certificate verification is strongly advised. See:
https://urllib3.readthedocs.org/en/latest/security.html
InsecureRequestWarning)
DEBUG:requests.packages.urllib3.connectionpool:"POST /submit/cpy//serial
HTTP/1.1" 404 300
<<<<<<<---------------- Response -------------------------->>>>>>
Result: 404: text/html; charset=iso-8859-1
{'Date': 'Thu, 25 Aug 2016 19:58:41 GMT', 'Content-Length': '300',
'Content-Type': 'text/html; charset=iso-8859-1', 'Connection': 'close',
'Server': 'Apache/2.2.15 (Red Hat)'}
Not Found
<<<<<<<---------------- Raw Output (Start) ---------------->>>>>>
<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">
<html><head>
<title>404 Not Found</title>
</head><body>
<h1>Not Found</h1>
<p>The requested URL /submit/cpy/serial was not found on this server.</p>
<hr>
<address>Apache/2.2.15 (Red Hat) Server at
mtt.open-mpi.org<http://mtt.open-mpi.org/> Port 443</address>
</body></html>
2016-08-23 10:54 GMT-06:00 Josh Hursey
<jjhur...@open-mpi.org<mailto:jjhur...@open-mpi.org>>:
For the CherryPy submission you need to change the url to:
https://mtt.open-mpi.org/submit/cpy/
This is so we can have the old PHP version and the CherryPy version running
concurrently. Give that a try.
I checked and the server is still running.
On Tue, Aug 23, 2016 at 10:53 AM, Howard Pritchard
<hpprit...@gmail.com<mailto:hpprit...@gmail.com>> wrote:
HI Folks,
More info, grokking the IUdatabase python code and modified my input I seem to
get to something, but then the http request to the database times out:
Hmm....okay I turned off my vpn and things got further but it looks like
there's nothing
at mtt.open-org:
<<<<<<<---------------- Response -------------------------->>>>>>
Result: 404: text/html; charset=iso-8859-1
{'Date': 'Fri, 19 Aug 2016 17:38:49 GMT', 'Content-Length': '296',
'Content-Type': 'text/html; charset=iso-8859-1', 'Connection': 'close',
'Server': 'Apache/2.2.15 (Red Hat)'}
Not Found
<<<<<<<---------------- Raw Output (Start) ---------------->>>>>>
<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">
<html><head>
<title>404 Not Found</title>
</head><body>
<h1>Not Found</h1>
<p>The requested URL /submit//serial was not found on this server.</p>
<hr>
<address>Apache/2.2.15 (Red Hat) Server at
mtt.open-mpi.org<http://mtt.open-mpi.org/> Port 443</address>
</body></html>
Any ideas on how to proceed?
_______________________________________________
mtt-devel mailing list
mtt-devel@lists.open-mpi.org<mailto:mtt-devel@lists.open-mpi.org>
https://rfd.newmexicoconsortium.org/mailman/listinfo/mtt-devel
--
Josh Hursey
IBM Spectrum MPI Developer
_______________________________________________
mtt-devel mailing list
mtt-devel@lists.open-mpi.org<mailto:mtt-devel@lists.open-mpi.org>
https://rfd.newmexicoconsortium.org/mailman/listinfo/mtt-devel
_______________________________________________
mtt-devel mailing list
mtt-devel@lists.open-mpi.org<mailto:mtt-devel@lists.open-mpi.org>
https://rfd.newmexicoconsortium.org/mailman/listinfo/mtt-devel
--
Josh Hursey
IBM Spectrum MPI Developer
_______________________________________________
mtt-devel mailing list
mtt-devel@lists.open-mpi.org<mailto:mtt-devel@lists.open-mpi.org>
https://rfd.newmexicoconsortium.org/mailman/listinfo/mtt-devel
_______________________________________________
mtt-devel mailing list
mtt-devel@lists.open-mpi.org<mailto:mtt-devel@lists.open-mpi.org>
https://rfd.newmexicoconsortium.org/mailman/listinfo/mtt-devel
_______________________________________________
mtt-devel mailing list
mtt-devel@lists.open-mpi.org<mailto:mtt-devel@lists.open-mpi.org>
https://rfd.newmexicoconsortium.org/mailman/listinfo/mtt-devel
_______________________________________________
mtt-devel mailing list
mtt-devel@lists.open-mpi.org<mailto:mtt-devel@lists.open-mpi.org>
https://rfd.newmexicoconsortium.org/mailman/listinfo/mtt-devel
--
Josh Hursey
IBM Spectrum MPI Developer
_______________________________________________
mtt-devel mailing list
mtt-devel@lists.open-mpi.org<mailto:mtt-devel@lists.open-mpi.org>
https://rfd.newmexicoconsortium.org/mailman/listinfo/mtt-devel
_______________________________________________
mtt-devel mailing list
mtt-devel@lists.open-mpi.org<mailto:mtt-devel@lists.open-mpi.org>
https://rfd.newmexicoconsortium.org/mailman/listinfo/mtt-devel
_______________________________________________
mtt-devel mailing list
mtt-devel@lists.open-mpi.org<mailto:mtt-devel@lists.open-mpi.org>
https://rfd.newmexicoconsortium.org/mailman/listinfo/mtt-devel
_______________________________________________
mtt-devel mailing list
mtt-devel@lists.open-mpi.org<mailto:mtt-devel@lists.open-mpi.org>
https://rfd.newmexicoconsortium.org/mailman/listinfo/mtt-devel
--
Josh Hursey
IBM Spectrum MPI Developer
_______________________________________________
mtt-devel mailing list
mtt-devel@lists.open-mpi.org<mailto:mtt-devel@lists.open-mpi.org>
https://rfd.newmexicoconsortium.org/mailman/listinfo/mtt-devel
_______________________________________________
mtt-devel mailing list
mtt-devel@lists.open-mpi.org<mailto:mtt-devel@lists.open-mpi.org>
https://rfd.newmexicoconsortium.org/mailman/listinfo/mtt-devel
--
Josh Hursey
IBM Spectrum MPI Developer
_______________________________________________
mtt-devel mailing list
mtt-devel@lists.open-mpi.org
https://rfd.newmexicoconsortium.org/mailman/listinfo/mtt-devel
