Differential D425

use openqa-python client instead of subprocess calling
ClosedPublic
Actions

Authored by garretraziel on Jul 9 2015, 11:42 AM.

Details

Reviewers
adamwill
jskladan
Commits
rOPENQA5a0a80859fcb: use openqa-python client instead of subprocess calling
rOPENQA25a024c46723: use openqa-python client instead of subprocess calling
Summary

Since adamw created Python client for OpenQA, we
can use it instead of calling Perl in subprocess. It simplyfies
usage and special code for running in Docker is no longer needed.
This version requires user to create configuration file either
in /etc/openqa/client.conf or in ~/.config/openqa/client.conf
with the same KEY and SECRET as in host machine.

To execute jobs in Docker, just specify correct server and
port (probably [localhost:8080]) in configuration file.

Only problem remains with self-signed certificate. It's
necessary to either disable SSL cert verifying, import
self-signed certificate or use HTTP instead of HTTPS in Docker,
see https://github.com/os-autoinst/openQA-python-client/pull/1.

Test Plan

Tested on running tests for compose F22 Final RC1.

Diff Detail

Repository
rOPENQA fedora_openqa
Lint
Automatic diff as part of commit; lint not applicable.
Unit
Automatic diff as part of commit; unit tests not applicable.
garretraziel retitled this revision from to use openqa-python client instead of subprocess calling.Jul 9 2015, 11:42 AM
garretraziel updated this object.
garretraziel edited the test plan for this revision. (Show Details)
garretraziel added reviewers: adamwill, jskladan.
jskladan accepted this revision.Jul 9 2015, 11:44 AM
This revision is now accepted and ready to land.Jul 9 2015, 11:44 AM
adamwill added a comment.Jul 9 2015, 2:38 PM

Looks fine, we should probably add info on installing the Python client into the installation guide too.

Closed by commit rOPENQA25a024c46723: use openqa-python client instead of subprocess calling (authored by Garret Raziel <boloomka@gmail.com>). · Explain WhyJul 10 2015, 8:43 AM
This revision was automatically updated to reflect the committed changes.

Revision Contents

Diff 1127

View Options

InstallGuide.txt

Show First 20 Lines • Show All 147 Lines • ▼ Show 20 Line(s)
148 148​
149# Do this as geekotest user 149​# Do this as geekotest user
150sudo su - geekotest 150​sudo su - geekotest
151 151​
152mkdir WIKITCMS; cd WIKITCMS 152​mkdir WIKITCMS; cd WIKITCMS
153git clone https://www.happyassassin.net/cgit/wikitcms 153​git clone https://www.happyassassin.net/cgit/wikitcms
154git clone https://www.happyassassin.net/cgit/relval 154​git clone https://www.happyassassin.net/cgit/relval
155git clone https://www.happyassassin.net/cgit/fedfind 155​git clone https://www.happyassassin.net/cgit/fedfind
156​git clone https://github.com/os-autoinst/openQA-python-client.git
156 157​
157cd fedfind; sudo python setup.py install 158​cd fedfind; sudo python setup.py install
158cd ../wikitcms; sudo python setup.py install 159​cd ../wikitcms; sudo python setup.py install
159cd ../relval; sudo python setup.py install 160​cd ../relval; sudo python setup.py install
161​cd ../openQA-python-client; sudo python setup.py install
160 162​
161# check whether relval works by running: 163​# check whether relval works by running:
162relval 164​relval
163 165​
164# set-up a credentials file for the geekotest user 166​# set-up a credentials file for the geekotest user
165mkdir ~/.fedora 167​mkdir ~/.fedora
166echo "fas_username fas_password" > ~/.fedora/credentials 168​echo "fas_username fas_password" > ~/.fedora/credentials
167 169​
168=== Get the actual tools === 170​=== Get the actual tools ===
169 171​
170cd 172​cd
171git clone https://bitbucket.org/rajcze/openqa_fedora_tools 173​git clone https://bitbucket.org/rajcze/openqa_fedora_tools
172 174​
173# set-up cronjob as geekotest 175​# set-up cronjob as geekotest
174crontab -e 176​crontab -e
175## insert following: 00 * * * * /PATH/TO/THE/openqa_fedora_tools/tools/openqa_trigger/openqa_trigger.py current 177​## insert following: 00 * * * * /PATH/TO/THE/openqa_fedora_tools/tools/openqa_trigger/openqa_trigger.py current
View Options

tools/openqa_trigger/openqa_trigger.py

1#!/usr/bin/env python 1​#!/usr/bin/env python
2 2​
3import json 3​import json
4import re ​
5import urlgrabber 4​import urlgrabber
6import os.path 5​import os.path
7import sys 6​import sys
8import subprocess ​
9import argparse 7​import argparse
10import datetime 8​import datetime
11import logging 9​import logging
12# We can at least find images and run OpenQA jobs without wikitcms 10​# We can at least find images and run OpenQA jobs without wikitcms
13try: 11​try:
14 import wikitcms.wiki 12​ import wikitcms.wiki
15except ImportError: 13​except ImportError:
16 wikitcms = None 14​ wikitcms = None
17import fedfind.release 15​import fedfind.release
18 16​
17​from openqa_client.client import OpenQA_Client
19from report_job_results import report_results 18​from report_job_results import report_results
20 19​
21PERSISTENT = "/var/tmp/openqa_watcher.json" 20​PERSISTENT = "/var/tmp/openqa_watcher.json"
22ISO_PATH = "/var/lib/openqa/factory/iso/" 21​ISO_PATH = "/var/lib/openqa/factory/iso/"
23RUN_COMMAND = "/var/lib/openqa/script/client isos post " \ ​
24 "ISO=%s DISTRI=fedora VERSION=rawhide FLAVOR=%s ARCH=%s BUILD=%s" ​
25DOCKER_COMMAND = "docker exec %s " + RUN_COMMAND ​
26ARCHES = ['i386', 'x86_64'] 22​ARCHES = ['i386', 'x86_64']
27 23​
28 24​
29class TriggerException(Exception): 25​class TriggerException(Exception):
30 pass 26​ pass
31 27​
32 28​
33# read last tested version from file 29​# read last tested version from file
Show All 30 Lines58 if not os.path.isfile(filename):
64 # Icky hack around a urlgrabber bug: 60​ # Icky hack around a urlgrabber bug:
65 # https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=715416 61​ # https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=715416
66 urlgrabber.urlgrab(image.url.replace('https', 'http'), filename) 62​ urlgrabber.urlgrab(image.url.replace('https', 'http'), filename)
67 else: 63​ else:
68 logging.info("%s already exists", filename) 64​ logging.info("%s already exists", filename)
69 return isoname 65​ return isoname
70 66​
71 67​
72def run_openqa_jobs(isoname, flavor, arch, build, docker_container): 68​def run_openqa_jobs(client, isoname, flavor, arch, build):
73 """# run OpenQA 'isos' job on selected isoname, with given arch 69​ """# run OpenQA 'isos' job on selected isoname, with given arch
74 and a version string. If provided, use docker container docker_container 70​ and a version string. **NOTE**: the version passed to OpenQA as
75 that includes OpenQA WebUI. **NOTE**: the version passed to OpenQA as ​
76 BUILD and is parsed back into the 'relval report-auto' arguments 71​ BUILD and is parsed back into the 'relval report-auto' arguments
77 by report_job_results.py; it is expected to be in the form of a 72​ by report_job_results.py; it is expected to be in the form of a
78 3-tuple on which join('_') has been run, and the three elements 73​ 3-tuple on which join('_') has been run, and the three elements
79 will be passed as --release, --compose and --milestone. Returns 74​ will be passed as --release, --compose and --milestone. Returns
80 list of job IDs. 75​ list of job IDs.
81 """ 76​ """
82 if docker_container: 77​ logging.info("sending jobs on OpenQA")
83 command = DOCKER_COMMAND % (docker_container, isoname, flavor, arch, build) ​
84 else: ​
85 command = RUN_COMMAND % (isoname, flavor, arch, build) ​
86 ​
87 logging.info("executing: %s", command) ​
88 78​
89 # starts OpenQA jobs 79​ # starts OpenQA jobs
90 output = subprocess.check_output(command.split()) 80​ params = {
91 81​ 'ISO': isoname,
92 logging.debug("command executed") 82​ 'DISTRI': 'fedora',
93 83​ 'VERSION': 'rawhide', # TODO
94 # read ids from OpenQA to wait for 84​ 'FLAVOR': flavor,
95 r = re.compile(r'ids => \[(?P<from>\d+)( \.\. (?P<to>\d+))?\]') 85​ 'ARCH': arch,
96 match = r.search(output) 86​ 'BUILD': build
97 if match and match.group('to'): 87​ }
98 from_i = int(match.group('from')) 88​ output = client.openqa_request('POST', 'isos', params)
99 to_i = int(match.group('to')) + 1 89​
100 logging.info("planned jobs: %d to %d", from_i, to_i - 1) 90​ logging.debug("executed")
101 return range(from_i, to_i) 91​ logging.info("planned jobs: %s", output["ids"])
102 elif match: ​
103 job_id = int(match.group('from')) ​
104 logging.info("planned job: %d", job_id) ​
105 return [job_id] ​
106 else: ​
107 logging.info("no planned jobs") ​
108 return [] ​
109 92​
93​ return output["ids"]
110 94​
111def jobs_from_current(wiki, docker_container): 95​
96​def jobs_from_current(wiki, client):
112 """Schedule jobs against the 'current' release validation event 97​ """Schedule jobs against the 'current' release validation event
113 (according to wikitcms) if we have not already. Returns a tuple, 98​ (according to wikitcms) if we have not already. Returns a tuple,
114 first value is the job list, second is the current event. 99​ first value is the job list, second is the current event.
115 """ 100​ """
116 if not wiki: 101​ if not wiki:
117 logging.warning("python-wikitcms is required for current validation event discovery.") 102​ logging.warning("python-wikitcms is required for current validation event discovery.")
118 return ([], None) 103​ return ([], None)
119 last_versions, json_parsed = read_last() 104​ last_versions, json_parsed = read_last()
120 currev = wiki.current_event 105​ currev = wiki.current_event
121 logging.info("current event: %s", currev.version) 106​ logging.info("current event: %s", currev.version)
122 runarches = [] 107​ runarches = []
123 for arch in ARCHES: 108​ for arch in ARCHES:
124 last_version = last_versions.get(arch, None) 109​ last_version = last_versions.get(arch, None)
125 if last_version and last_version >= currev.sortname: 110​ if last_version and last_version >= currev.sortname:
126 logging.info("skipped: %s: %s is newer or equal to %s", 111​ logging.info("skipped: %s: %s is newer or equal to %s",
127 arch, last_version, currev.sortname) 112​ arch, last_version, currev.sortname)
128 else: 113​ else:
129 runarches.append(arch) 114​ runarches.append(arch)
130 logging.debug("%s will be tested in version %s", arch, currev.sortname) 115​ logging.debug("%s will be tested in version %s", arch, currev.sortname)
131 json_parsed[arch] = currev.sortname 116​ json_parsed[arch] = currev.sortname
132 117​
133 jobs = [] 118​ jobs = []
134 119​
135 try: 120​ try:
136 jobs = jobs_from_fedfind(currev.ff_release, runarches, docker_container) 121​ jobs = jobs_from_fedfind(currev.ff_release, client, runarches)
137 logging.info("planned jobs: %s", jobs) 122​ logging.info("planned jobs: %s", jobs)
138 123​
139 # write info about latest versions 124​ # write info about latest versions
140 f = open(PERSISTENT, "w") 125​ f = open(PERSISTENT, "w")
141 f.write(json.dumps(json_parsed)) 126​ f.write(json.dumps(json_parsed))
142 f.close() 127​ f.close()
143 logging.debug("written info about newest version") 128​ logging.debug("written info about newest version")
144 except TriggerException as e: 129​ except TriggerException as e:
145 logging.error("cannot run jobs: %s", e) 130​ logging.error("cannot run jobs: %s", e)
146 131​
147 return (jobs, currev) 132​ return (jobs, currev)
148 133​
149 134​
150def jobs_from_fedfind(ff_release, arches=ARCHES, docker_container=None): 135​def jobs_from_fedfind(ff_release, client, arches=ARCHES):
151 """Given a fedfind.Release object, find the ISOs we want and run 136​ """Given a fedfind.Release object, find the ISOs we want and run
152 jobs on them. arches is an iterable of arches to run on, if not 137​ jobs on them. arches is an iterable of arches to run on, if not
153 specified, we'll use our constant. 138​ specified, we'll use our constant.
154 """ 139​ """
155 # Find currently-testable images for our arches. 140​ # Find currently-testable images for our arches.
156 jobs = [] 141​ jobs = []
157 queries = ( 142​ queries = (
158 fedfind.release.Query('imagetype', ('boot', 'live')), 143​ fedfind.release.Query('imagetype', ('boot', 'live')),
Show All 39 Lines172 for img in okimgs:
198 if score > bestscore: 183​ if score > bestscore:
199 bestimg = img 184​ bestimg = img
200 bestscore = score 185​ bestscore = score
201 if not bestimg: 186​ if not bestimg:
202 logging.warn("no universal tests image found for %s", arch) 187​ logging.warn("no universal tests image found for %s", arch)
203 continue 188​ continue
204 logging.info("running universal tests for %s with %s", arch, bestimg.desc) 189​ logging.info("running universal tests for %s with %s", arch, bestimg.desc)
205 isoname = download_image(bestimg) 190​ isoname = download_image(bestimg)
206 job_ids = run_openqa_jobs(isoname, 'universal', arch, build, docker_container) 191​ job_ids = run_openqa_jobs(client, isoname, 'universal', arch, build)
207 jobs.extend(job_ids) 192​ jobs.extend(job_ids)
208 193​
209 # Now schedule per-image jobs. 194​ # Now schedule per-image jobs.
210 for image in images: 195​ for image in images:
211 isoname = download_image(image) 196​ isoname = download_image(image)
212 flavor = '_'.join((image.payload, image.imagetype)) 197​ flavor = '_'.join((image.payload, image.imagetype))
213 job_ids = run_openqa_jobs(isoname, flavor, image.arch, build, docker_container) 198​ job_ids = run_openqa_jobs(client, isoname, flavor, image.arch, build)
214 jobs.extend(job_ids) 199​ jobs.extend(job_ids)
215 return jobs 200​ return jobs
216 201​
217 202​
218# SUB-COMMAND FUNCTIONS 203​# SUB-COMMAND FUNCTIONS
219 204​
220 205​
221def run_current(args, wiki): 206​def run_current(args, client, wiki):
222 """run OpenQA for current release validation event, if we have 207​ """run OpenQA for current release validation event, if we have
223 not already done it. 208​ not already done it.
224 """ 209​ """
225 logging.info("running on current release") 210​ logging.info("running on current release")
226 jobs, _ = jobs_from_current(wiki, args.docker_container) 211​ jobs, _ = jobs_from_current(wiki, client)
227 # wait for jobs to finish and display results 212​ # wait for jobs to finish and display results
228 if jobs: 213​ if jobs:
229 logging.info("waiting for jobs: %s", jobs) 214​ logging.info("waiting for jobs: %s", jobs)
230 report_results(jobs) 215​ report_results(jobs, client)
231 logging.debug("finished") 216​ logging.debug("finished")
232 sys.exit() 217​ sys.exit()
233 218​
234 219​
235def run_compose(args, wiki=None): 220​def run_compose(args, client, wiki=None):
236 """run OpenQA on a specified compose, optionally reporting results 221​ """run OpenQA on a specified compose, optionally reporting results
237 if a matching wikitcms ValidationEvent is found by relval/wikitcms 222​ if a matching wikitcms ValidationEvent is found by relval/wikitcms
238 """ 223​ """
239 # get the fedfind release object 224​ # get the fedfind release object
240 try: 225​ try:
241 logging.debug("querying fedfind on specific compose: %s %s %s", args.release, 226​ logging.debug("querying fedfind on specific compose: %s %s %s", args.release,
242 args.milestone, args.compose) 227​ args.milestone, args.compose)
243 ff_release = fedfind.release.get_release(release=args.release, milestone=args.milestone, 228​ ff_release = fedfind.release.get_release(release=args.release, milestone=args.milestone,
244 compose=args.compose) 229​ compose=args.compose)
245 except ValueError as err: 230​ except ValueError as err:
246 logging.critical("compose %s %s %s was not found", args.release, args.milestone, 231​ logging.critical("compose %s %s %s was not found", args.release, args.milestone,
247 args.compose) 232​ args.compose)
248 sys.exit(err[0]) 233​ sys.exit(err[0])
249 234​
250 logging.info("running on compose: %s", ff_release.version) 235​ logging.info("running on compose: %s", ff_release.version)
251 jobs = [] 236​ jobs = []
252 try: 237​ try:
253 if args.arch: 238​ if args.arch:
254 jobs = jobs_from_fedfind(ff_release, [args.arch], args.docker_container) 239​ jobs = jobs_from_fedfind(ff_release, client, [args.arch])
255 else: 240​ else:
256 jobs = jobs_from_fedfind(ff_release, docker_container=args.docker_container) 241​ jobs = jobs_from_fedfind(ff_release, client)
257 except TriggerException as e: 242​ except TriggerException as e:
258 logging.error("cannot run jobs: %s", e) 243​ logging.error("cannot run jobs: %s", e)
259 logging.info("planned jobs: %s", jobs) 244​ logging.info("planned jobs: %s", jobs)
260 if args.submit_results: 245​ if args.submit_results:
261 report_results(jobs) 246​ report_results(jobs, client)
262 logging.debug("finished") 247​ logging.debug("finished")
263 sys.exit() 248​ sys.exit()
264 249​
265 250​
266def run_all(args, wiki=None): 251​def run_all(args, client, wiki=None):
267 """Do everything we can: test current validation event compose if 252​ """Do everything we can: test current validation event compose if
268 it's new, amd test both Rawhide and Branched nightlies if they 253​ it's new, amd test both Rawhide and Branched nightlies if they
269 exist and aren't the same as the 'current' compose. 254​ exist and aren't the same as the 'current' compose.
270 """ 255​ """
271 skip = '' 256​ skip = ''
272 logging.info("running all") 257​ logging.info("running all")
273 258​
274 # Run for 'current' validation event. 259​ # Run for 'current' validation event.
275 logging.debug("running for current") 260​ logging.debug("running for current")
276 (jobs, currev) = jobs_from_current(wiki, args.docker_container) 261​ (jobs, currev) = jobs_from_current(wiki, client)
277 logging.info("jobs from current validation event: %s", jobs) 262​ logging.info("jobs from current validation event: %s", jobs)
278 263​
279 utcdate = datetime.datetime.utcnow() 264​ utcdate = datetime.datetime.utcnow()
280 if args.yesterday: 265​ if args.yesterday:
281 utcdate = utcdate - datetime.timedelta(days=1) 266​ utcdate = utcdate - datetime.timedelta(days=1)
282 if currev and currev.compose == utcdate.strftime('%Y%m%d'): 267​ if currev and currev.compose == utcdate.strftime('%Y%m%d'):
283 # Don't schedule tests for the same compose as both "today's 268​ # Don't schedule tests for the same compose as both "today's
284 # nightly" and "current validation event" 269​ # nightly" and "current validation event"
285 skip = currev.milestone 270​ skip = currev.milestone
286 logging.debug("skipping %s because it's both today's and current validation event", skip) 271​ logging.debug("skipping %s because it's both today's and current validation event", skip)
287 272​
288 # Run for day's Rawhide nightly (if not same as current event.) 273​ # Run for day's Rawhide nightly (if not same as current event.)
289 if skip.lower() != 'rawhide': 274​ if skip.lower() != 'rawhide':
290 try: 275​ try:
291 logging.debug("running for rawhide") 276​ logging.debug("running for rawhide")
292 rawhide_ffrel = fedfind.release.get_release(release='Rawhide', compose=utcdate) 277​ rawhide_ffrel = fedfind.release.get_release(release='Rawhide', compose=utcdate)
293 rawjobs = jobs_from_fedfind(rawhide_ffrel, docker_container=args.docker_container) 278​ rawjobs = jobs_from_fedfind(rawhide_ffrel, client)
294 logging.info("jobs from rawhide %s: %s", rawhide_ffrel.version, rawjobs) 279​ logging.info("jobs from rawhide %s: %s", rawhide_ffrel.version, rawjobs)
295 jobs.extend(rawjobs) 280​ jobs.extend(rawjobs)
296 except ValueError as err: 281​ except ValueError as err:
297 logging.error("rawhide image discovery failed: %s", err) 282​ logging.error("rawhide image discovery failed: %s", err)
298 except TriggerException as e: 283​ except TriggerException as e:
299 logging.error("cannot run jobs: %s", e) 284​ logging.error("cannot run jobs: %s", e)
300 285​
301 # Run for day's Branched nightly (if not same as current event.) 286​ # Run for day's Branched nightly (if not same as current event.)
302 # We must guess a release for Branched, fedfind cannot do so. Best 287​ # We must guess a release for Branched, fedfind cannot do so. Best
303 # guess we can make is the same as the 'current' validation event 288​ # guess we can make is the same as the 'current' validation event
304 # compose (this is why we have jobs_from_current return currev). 289​ # compose (this is why we have jobs_from_current return currev).
305 if skip.lower() != 'branched': 290​ if skip.lower() != 'branched':
306 try: 291​ try:
307 logging.debug("running for branched") 292​ logging.debug("running for branched")
308 branched_ffrel = fedfind.release.get_release(release=currev.release, 293​ branched_ffrel = fedfind.release.get_release(release=currev.release,
309 milestone='Branched', compose=utcdate) 294​ milestone='Branched', compose=utcdate)
310 branchjobs = jobs_from_fedfind(branched_ffrel, docker_container=args.docker_container) 295​ branchjobs = jobs_from_fedfind(branched_ffrel, client)
311 logging.info("jobs from %s: %s", branched_ffrel.version, branchjobs) 296​ logging.info("jobs from %s: %s", branched_ffrel.version, branchjobs)
312 jobs.extend(branchjobs) 297​ jobs.extend(branchjobs)
313 except ValueError as err: 298​ except ValueError as err:
314 logging.error("branched image discovery failed: %s", err) 299​ logging.error("branched image discovery failed: %s", err)
315 except TriggerException as e: 300​ except TriggerException as e:
316 logging.error("cannot run jobs: %s", e) 301​ logging.error("cannot run jobs: %s", e)
317 if jobs: 302​ if jobs:
318 logging.info("waiting for jobs: %s", jobs) 303​ logging.info("waiting for jobs: %s", jobs)
319 report_results(jobs) 304​ report_results(jobs, client)
320 logging.debug("finished") 305​ logging.debug("finished")
321 sys.exit() 306​ sys.exit()
322 307​
323 308​
324if __name__ == "__main__": 309​if __name__ == "__main__":
325 test_help = "Operate on the staging wiki (for testing)" 310​ test_help = "Operate on the staging wiki (for testing)"
326 parser = argparse.ArgumentParser(description=( 311​ parser = argparse.ArgumentParser(description=(
327 "Run OpenQA tests for a release validation test event.")) 312​ "Run OpenQA tests for a release validation test event."))
Show All 34 Lines345 parser_all = subparsers.add_parser(
362 "and today's Rawhide and Branched nightly's (if found). 'Today' is " 347​ "and today's Rawhide and Branched nightly's (if found). 'Today' is "
363 "calculated for the UTC time zone, no matter the system timezone.") 348​ "calculated for the UTC time zone, no matter the system timezone.")
364 parser_all.add_argument( 349​ parser_all.add_argument(
365 '-y', '--yesterday', help="Run on yesterday's nightlies, not today's", 350​ '-y', '--yesterday', help="Run on yesterday's nightlies, not today's",
366 required=False, action='store_true') 351​ required=False, action='store_true')
367 parser_all.set_defaults(func=run_all) 352​ parser_all.set_defaults(func=run_all)
368 353​
369 parser.add_argument( 354​ parser.add_argument(
370 '-d', '--docker-container', help="If given, run tests using " ​
371 "specified docker container") ​
372 parser.add_argument( ​
373 '-t', '--test', help=test_help, required=False, action='store_true') 355​ '-t', '--test', help=test_help, required=False, action='store_true')
374 parser.add_argument( 356​ parser.add_argument(
375 '-f', '--log-file', help="If given, log into specified file. When not provided, stdout" 357​ '-f', '--log-file', help="If given, log into specified file. When not provided, stdout"
376 " is used", required=False) 358​ " is used", required=False)
377 parser.add_argument( 359​ parser.add_argument(
378 '-l', '--log-level', help="Specify log level to be outputted", required=False) 360​ '-l', '--log-level', help="Specify log level to be outputted", required=False)
379 parser.add_argument('-i', '--iso-directory', help="Directory for downloading isos, default" 361​ parser.add_argument('-i', '--iso-directory', help="Directory for downloading isos, default"
380 " is %s" % PERSISTENT, required=False) 362​ " is %s" % PERSISTENT, required=False)
Show All 22 Lines384 if wikitcms:
403 wiki = wikitcms.wiki.Wiki(('https', 'stg.fedoraproject.org'), '/w/') 385​ wiki = wikitcms.wiki.Wiki(('https', 'stg.fedoraproject.org'), '/w/')
404 else: 386​ else:
405 logging.warn("wikitcms not found, reporting to wiki disabled") 387​ logging.warn("wikitcms not found, reporting to wiki disabled")
406 else: 388​ else:
407 if wikitcms: 389​ if wikitcms:
408 wiki = wikitcms.wiki.Wiki(('https', 'fedoraproject.org'), '/w/') 390​ wiki = wikitcms.wiki.Wiki(('https', 'fedoraproject.org'), '/w/')
409 else: 391​ else:
410 logging.warn("wikitcms not found, reporting to wiki disabled") 392​ logging.warn("wikitcms not found, reporting to wiki disabled")
411 args.func(args, wiki) 393​
394​ client = OpenQA_Client() # uses first server from ~/.config/openqa/client.conf
395​
396​ args.func(args, client, wiki)
View Options

tools/openqa_trigger/report_job_results.py

1import requests ​
2import argparse 1​import argparse
3import sys 2​import sys
4import time 3​import time
5import logging 4​import logging
6import conf_test_suites 5​import conf_test_suites
7 6​
8from operator import attrgetter 7​from operator import attrgetter
8​from openqa_client.client import OpenQA_Client
9from wikitcms.wiki import Wiki, ResTuple 9​from wikitcms.wiki import Wiki, ResTuple
10 10​
11API_ROOT = "http://localhost/api/v1" ​
12SLEEPTIME = 60 11​SLEEPTIME = 60
13logger = logging.getLogger(__name__) 12​logger = logging.getLogger(__name__)
14 13​
15 14​
16def get_passed_testcases(job_ids): 15​def get_passed_testcases(job_ids, client):
17 """ 16​ """
18 job_ids ~ list of int (job ids) 17​ job_ids ~ list of int (job ids)
19 Returns ~ list of str - names of passed testcases 18​ Returns ~ list of str - names of passed testcases
20 """ 19​ """
21 running_jobs = dict([(job_id, "%s/jobs/%s" % (API_ROOT, job_id)) for job_id in job_ids]) 20​ running_jobs = dict([(job_id, "jobs/%s" % job_id) for job_id in job_ids])
22 logger.info("running jobs: %s", running_jobs) 21​ logger.info("running jobs: %s", running_jobs)
23 finished_jobs = {} 22​ finished_jobs = {}
24 23​
25 while running_jobs: 24​ while running_jobs:
26 for job_id, url in running_jobs.items(): 25​ for job_id, url in running_jobs.items():
27 job_state = requests.get(url).json()['job'] 26​ output = client.openqa_request('GET', url)
27​ job_state = output['job']
28 if job_state['state'] == 'done': 28​ if job_state['state'] == 'done':
29 logger.info("job %s is done", job_id) 29​ logger.info("job %s is done", job_id)
30 finished_jobs[job_id] = job_state 30​ finished_jobs[job_id] = job_state
31 del running_jobs[job_id] 31​ del running_jobs[job_id]
32 if running_jobs: 32​ if running_jobs:
33 time.sleep(SLEEPTIME) 33​ time.sleep(SLEEPTIME)
34 logger.info("all jobs finished") 34​ logger.info("all jobs finished")
35 35​
36 passed_testcases = set() 36​ passed_testcases = set()
37 for job_id in job_ids: 37​ for job_id in job_ids:
38 job = finished_jobs[job_id] 38​ job = finished_jobs[job_id]
39 if job['result'] =='passed': 39​ if job['result'] == 'passed':
40 (release, milestone, compose) = job['settings']['BUILD'].split('_') 40​ (release, milestone, compose) = job['settings']['BUILD'].split('_')
41 testsuite = job['settings']['TEST'] 41​ testsuite = job['settings']['TEST']
42 arch = job['settings']['ARCH'] 42​ arch = job['settings']['ARCH']
43 flavor = job['settings']['FLAVOR'] 43​ flavor = job['settings']['FLAVOR']
44 44​
45 for testcase in conf_test_suites.TESTSUITES[testsuite]: 45​ for testcase in conf_test_suites.TESTSUITES[testsuite]:
46 # each 'testsuite' is a list using testcase names to indicate which Wikitcms tests have 46​ # each 'testsuite' is a list using testcase names to indicate which Wikitcms tests have
47 # passed if this job passes. Each testcase name is the name of a dict in the TESTCASES 47​ # passed if this job passes. Each testcase name is the name of a dict in the TESTCASES
48 # dict-of-dicts which more precisely identifies the 'test instance' (when there is more 48​ # dict-of-dicts which more precisely identifies the 'test instance' (when there is more
49 # than one for a testcase) and environment for which the result should be filed. 49​ # than one for a testcase) and environment for which the result should be filed.
50 uniqueres = conf_test_suites.TESTCASES[testcase] 50​ uniqueres = conf_test_suites.TESTCASES[testcase]
51 testname = '' 51​ testname = ''
52 if 'name_cb' in uniqueres: 52​ if 'name_cb' in uniqueres:
53 testname = uniqueres['name_cb'](flavor) 53​ testname = uniqueres['name_cb'](flavor)
54 env = arch if uniqueres['env'] == '$RUNARCH$' else uniqueres['env'] 54​ env = arch if uniqueres['env'] == '$RUNARCH$' else uniqueres['env']
55 result = ResTuple( 55​ result = ResTuple(
56 testtype=uniqueres['type'], release=release, milestone=milestone, compose=compose, 56​ testtype=uniqueres['type'], release=release, milestone=milestone, compose=compose,
57 testcase=testcase, section=uniqueres['section'], testname=testname, env=env, status='pass', 57​ testcase=testcase, section=uniqueres['section'], testname=testname, env=env, status='pass',
58 bot=True) 58​ bot=True)
59 passed_testcases.add(result) 59​ passed_testcases.add(result)
60 60​
61 return sorted(list(passed_testcases), key=attrgetter('testcase')) 61​ return sorted(list(passed_testcases), key=attrgetter('testcase'))
62 62​
63def report_results(job_ids, verbose=False, report=True): 63​def report_results(job_ids, client, verbose=False, report=True):
64 passed_testcases = get_passed_testcases(job_ids) 64​ passed_testcases = get_passed_testcases(job_ids, client)
65 if verbose: 65​ if verbose:
66 for restup in passed_testcases: 66​ for restup in passed_testcases:
67 print restup 67​ print restup
68 logger.info("passed testcases: %s", passed_testcases) 68​ logger.info("passed testcases: %s", passed_testcases)
69 69​
70 if report: 70​ if report:
71 if verbose: 71​ if verbose:
72 print "Reporting test passes:" 72​ print "Reporting test passes:"
Show All 18 Lines88 else:
91 logger.warning("no reporting is done") 91​ logger.warning("no reporting is done")
92 92​
93if __name__ == "__main__": 93​if __name__ == "__main__":
94 parser = argparse.ArgumentParser(description="Evaluate per-testcase results from OpenQA job runs") 94​ parser = argparse.ArgumentParser(description="Evaluate per-testcase results from OpenQA job runs")
95 parser.add_argument('jobs', type=int, nargs='+') 95​ parser.add_argument('jobs', type=int, nargs='+')
96 parser.add_argument('--report', default=False, action='store_true') 96​ parser.add_argument('--report', default=False, action='store_true')
97 97​
98 args = parser.parse_args() 98​ args = parser.parse_args()
99 report_results(args.jobs, verbose=True, report=args.report) 99​ client = OpenQA_Client() # uses first server from ~/.config/openqa/client.conf
100​ report_results(args.jobs, client, verbose=True, report=args.report)