Differential D775

Improve --libvirt default experience
ClosedPublic
Actions

Authored by jskladan on Mar 14 2016, 9:44 AM.

Details

Reviewers
kparal
tflink
Group Reviewers
libtaskotron
Maniphest Tasks
T739: improve --libvirt default experience
Commits
rLTRN8c640bcef264: Improve --libvirt default experience
Summary

Set force_imageurl to True by default. And added instructions
on using disposable clients (via --libvirt) to the readme.

File-name convetions for base images in imagesdir are described
both in config, and code.

Test Plan

Unit tests run OK

Diff Detail

Repository
rLTRN libtaskotron
Lint
Automatic diff as part of commit; lint not applicable.
Unit
Automatic diff as part of commit; unit tests not applicable.
jskladan retitled this revision from to Improve --libvirt default experience.Mar 14 2016, 9:44 AM
jskladan updated this object.
jskladan edited the test plan for this revision. (Show Details)
jskladan added a reviewer: libtaskotron.
kparal added a subscriber: kparal.Mar 14 2016, 12:27 PM

I just found out that the original code from 3ba67bd98ce didn't work at all, it crashed like this:

[libtaskotron] 11:39:02 ERROR   Was expecting to find instance taskotron-20160314_113902_585744 but it does not already exist
Traceback (most recent call last):
  File "/home/kparal/devel/taskotron/libtaskotron/libtaskotron/minion.py", line 213, in execute
    task_vm.teardown()
  File "/home/kparal/devel/taskotron/libtaskotron/libtaskotron/ext/disposable/vm.py", line 187, in teardown
    tc_instance = self._check_existing_instance(should_exist=True)
  File "/home/kparal/devel/taskotron/libtaskotron/libtaskotron/ext/disposable/vm.py", line 109, in _check_existing_instance
    " already exist".format(self.instancename))
TaskotronRemoteError: Was expecting to find instance taskotron-20160314_113902_585744 but it does not already exist
[libtaskotron] 11:39:02 CRITICAL Traceback (most recent call last):
  File "/home/kparal/devel/taskotron/env_taskotron/bin/runtask", line 9, in <module>
    load_entry_point('libtaskotron==0.4.4', 'console_scripts', 'runtask')()
  File "/home/kparal/devel/taskotron/libtaskotron/libtaskotron/main.py", line 163, in main
    overlord.start()
  File "/home/kparal/devel/taskotron/libtaskotron/libtaskotron/overlord.py", line 93, in start
    runner.execute()
  File "/home/kparal/devel/taskotron/libtaskotron/libtaskotron/minion.py", line 186, in execute
    task_vm.prepare()
  File "/home/kparal/devel/taskotron/libtaskotron/libtaskotron/ext/disposable/vm.py", line 123, in prepare
    tc_image = self._prepare_image()
  File "/home/kparal/devel/taskotron/libtaskotron/libtaskotron/ext/disposable/vm.py", line 70, in _prepare_image
    arch=config.get_config().disposable_arch
  File "/home/kparal/devel/taskotron/libtaskotron/libtaskotron/ext/disposable/vm.py", line 234, in get_latest
    return "file://" + os.path.join(imagesdir, latest_metadata['filename'])
  File "/home/kparal/devel/taskotron/env_taskotron/lib64/python2.7/posixpath.py", line 70, in join
    elif path == '' or path.endswith('/'):
AttributeError: 'NoneType' object has no attribute 'endswith'

It no longer crashes now, but can you please check the problem has really been fixed and will not appear at some other time? (include unit tests if possible, thanks)

conf/taskotron.yaml.example
120

Could we please go back to YYYYMMDD, unless there's a strong opposition? I listed the reasons in https://phab.qadevel.cloud.fedoraproject.org/rLTRN3ba67bd98cec29303bb10d2ea873ce044318f962 .

libtaskotron/ext/disposable/vm.py
54–55

This debug printout is confusing, because it claims it will download an image even if we later decide we will not download it, but use ImageFinder instead. Move it into the if clause?

66

Another debug printout here would also be nice, so that we know which image got picked.

readme.rst
160–161

Maybe also add this?

If you store these images in ``/var/lib/taskotron/images``, adhere to their naming conventions 
and set ``force_imageurl=False`` in ``taskotron.yaml``, we will find the latest one available
automatically for you and you don't need to update the ``imageurl`` option regularly.
jskladan added inline comments.Mar 14 2016, 1:51 PM
conf/taskotron.yaml.example
120

Nope, sorry, too much hassle, especially during freeze, as this also needs changes in the scripts around imagefactory. I'll create a ticket for it though

libtaskotron/ext/disposable/vm.py
66

I'll just move the first one, it will then work as expected

readme.rst
160–161

Sounds good.

kparal requested changes to this revision.Mar 14 2016, 3:02 PM
kparal added a reviewer: kparal.

Looks good, just the one variable needs correcting.

libtaskotron/ext/disposable/vm.py
71

Doesn't work, because you're using img_url, but printing self.imageurl. The latter one doesn't seem to be used anywhere else, just erase it into oblivion?

readme.rst
150
`Setting up Testcloud`_ section

will make a hyperlink and nicely format it

This revision now requires changes to proceed.Mar 14 2016, 3:02 PM
jskladan added inline comments.Mar 14 2016, 3:26 PM
libtaskotron/ext/disposable/vm.py
71

that's what I get for doing three things at once *sigh* I bow before your might and wisdom!

readme.rst
150

cool!

jskladan updated this revision to Diff 1989.Mar 14 2016, 3:29 PM
  • I bow before you, for you are the root
kparal accepted this revision.Mar 14 2016, 3:44 PM
This revision is now accepted and ready to land.Mar 14 2016, 3:44 PM
tflink accepted this revision.Mar 14 2016, 4:48 PM
tflink added a reviewer: tflink.

overall, LGTM. minor nits in the docs

readme.rst
178

Would it be worth noting that that settings.py would only be found by the user running testcloud or is that obvious enough?

Also, the user will need to be added to the testcloud group.

jskladan added inline comments.Mar 15 2016, 9:06 AM
readme.rst
178

Would it be worth noting that that settings.py would only be found by the user running testcloud or is that obvious enough?

I have a slow morning - just to be sure, you mean that the configuration will only be valid for the user, which sets the config file - i.e. that other users, or system services, won't be able to get to the config, and will most probably fail to use --libvirt, as the ssh-authorized-keys needs to be set in order for it to work?
Is there a better way/path to configure it?

Also, the user will need to be added to the testcloud group.

Are you sure? I'm not in the group, and it works fine.

kparal added inline comments.Mar 15 2016, 11:48 AM
readme.rst
178

I think let's just say "~/.config/testcloud/settings.py or /etc/testcloud/settings.py" and it's obvious enough.

Are you sure? I'm not in the group, and it works fine.

Yes, the same situation here. However, I'm in the libvirt group, which might grant needed privileges.

jskladan added inline comments.Mar 15 2016, 12:01 PM
readme.rst
178

I'm in qemu, mock, docker, FWIW

Closed by commit rLTRN8c640bcef264: Improve --libvirt default experience (authored by Josef Skladanka <jskladan@redhat.com>). · Explain WhyMar 16 2016, 6:33 AM
This revision was automatically updated to reflect the committed changes.

Revision Contents

Diff 1997

View Options

conf/taskotron.yaml.example

Show First 20 Lines • Show All 110 Lines • ▼ Show 20 Line(s)
111 111​
112## The location of artifacts produced by checks 112​## The location of artifacts produced by checks
113#artifactsdir: /var/lib/taskotron/artifacts 113​#artifactsdir: /var/lib/taskotron/artifacts
114 114​
115## The location of cached files downloaded by Taskotron 115​## The location of cached files downloaded by Taskotron
116#cachedir: /var/cache/taskotron 116​#cachedir: /var/cache/taskotron
117 117​
118## The location of images for disposable clients 118​## The location of images for disposable clients
119​## File names need to adhere to the naming standard of:
120​## YYMMDD_HHMM-fedora-RELEASE-FLAVOR-ARCH.(qcow2|raw|img)
kparalUnsubmitted
Not Done

Could we please go back to YYYYMMDD, unless there's a strong opposition? I listed the reasons in https://phab.qadevel.cloud.fedoraproject.org/rLTRN3ba67bd98cec29303bb10d2ea873ce044318f962 .

jskladanAuthorUnsubmitted
Not Done

Nope, sorry, too much hassle, especially during freeze, as this also needs changes in the scripts around imagefactory. I'll create a ticket for it though

121​## For example:
122​## 160301_1030-fedora-23-taskotron_cloud-x86_64.img
123​## Variables disposable_(release|flavor|arch) set in this config file
124​## define what kind of image is looked for.
125​## The newest (by YYMMDD_HHMM) image of the respective R-F-A is used.
119#imagesdir: /var/lib/taskotron/images 126​#imagesdir: /var/lib/taskotron/images
120 127​
121## If set to True, image from imageurl will be used instead of the latest image from imagesdir 128​## If set to False, latest image from imagesdir will be used instead of one at imageurl
122## [default: False] 129​## [default: True]
123#force_imageurl: False 130​#force_imageurl: True
124 131​
125## Url of an image to download and use for disposable client, if force_imageurl was set 132​## Url of an image to download and use for disposable client, if force_imageurl was set
126#imageurl: http://download.fedoraproject.org/pub/fedora/linux/releases/23/Cloud/x86_64/Images/Fedora-Cloud-Base-23-20151030.x86_64.qcow2 133​#imageurl: http://download.fedoraproject.org/pub/fedora/linux/releases/23/Cloud/x86_64/Images/Fedora-Cloud-Base-23-20151030.x86_64.qcow2
127 134​
128## Temporary options to define release/flavor/arch for the disposable images discovery 135​## Temporary options to define release/flavor/arch for the disposable images discovery
129#disposable_release: 23 136​#disposable_release: 23
130#disposable_flavor: taskotron_cloud 137​#disposable_flavor: taskotron_cloud
131#disposable_arch: x86_64 138​#disposable_arch: x86_64
Show All 32 Lines
View Options

libtaskotron/config_defaults.py

Show First 20 Lines • Show All 73 Lines • ▼ Show 20 Line(s)31class Config(object):
74 logdir = '/var/log/taskotron' #: 74​ logdir = '/var/log/taskotron' #:
75 client_taskdir = '/var/tmp/taskotron/taskdir' #: 75​ client_taskdir = '/var/tmp/taskotron/taskdir' #:
76 artifactsdir = '/var/lib/taskotron/artifacts' #: 76​ artifactsdir = '/var/lib/taskotron/artifacts' #:
77 cachedir = '/var/cache/taskotron' #: 77​ cachedir = '/var/cache/taskotron' #:
78 imagesdir = '/var/lib/taskotron/images' #: 78​ imagesdir = '/var/lib/taskotron/images' #:
79 imageurl = 'http://download.fedoraproject.org/pub/fedora/linux/'\ 79​ imageurl = 'http://download.fedoraproject.org/pub/fedora/linux/'\
80 'releases/23/Cloud/x86_64/Images/Fedora-Cloud-'\ 80​ 'releases/23/Cloud/x86_64/Images/Fedora-Cloud-'\
81 'Base-23-20151030.x86_64.qcow2' #: 81​ 'Base-23-20151030.x86_64.qcow2' #:
82 force_imageurl = False #: 82​ force_imageurl = True #:
83 disposable_release = '23' #: 83​ disposable_release = '23' #:
84 disposable_flavor = 'taskotron_cloud' #: 84​ disposable_flavor = 'taskotron_cloud' #:
85 disposable_arch = 'x86_64' #: 85​ disposable_arch = 'x86_64' #:
86 86​
87 minion_repos = [ 87​ minion_repos = [
88 'https://copr.fedorainfracloud.org/coprs/tflink/taskotron/repo/fedora-23/' 88​ 'https://copr.fedorainfracloud.org/coprs/tflink/taskotron/repo/fedora-23/'
89 'tflink-taskotron-fedora-23.repo'] #: 89​ 'tflink-taskotron-fedora-23.repo'] #:
90 90​
91 log_level_stream = 'INFO' #: 91​ log_level_stream = 'INFO' #:
▲ Show 20 Lines • Show All 43 Lines • Show Last 20 Lines
View Options

libtaskotron/ext/disposable/vm.py

Show All 22 Lines
23 23​
24class TestCloudMachine(object): 24​class TestCloudMachine(object):
25 '''Launch virtual machines with TestCloud and prepare them for executing 25​ '''Launch virtual machines with TestCloud and prepare them for executing
26 tasks (install packages etc.)''' 26​ tasks (install packages etc.)'''
27 27​
28 def __init__(self, uuid): 28​ def __init__(self, uuid):
29 ''':param uuid: unicode string uuid for the task being executed''' 29​ ''':param uuid: unicode string uuid for the task being executed'''
30 30​
31 # this should be temporary and go away once we have better image ​
32 # finding and discovery. ​
33 self.imageurl = config.get_config().imageurl ​
34 ​
35 #: name of the testcloud instance spawned for this task 31​ #: name of the testcloud instance spawned for this task
36 self.instancename = 'taskotron-{}'.format(uuid) 32​ self.instancename = 'taskotron-{}'.format(uuid)
37 33​
38 #: username to use when connecting to the virtual machine 34​ #: username to use when connecting to the virtual machine
39 self.username = 'root' 35​ self.username = 'root'
40 36​
41 #: password for user on the remote machine 37​ #: password for user on the remote machine
42 self.password = 'passw0rd' 38​ self.password = 'passw0rd'
43 39​
44 #: ip address of the remote machine (only set after prepared and spawned successfully) 40​ #: ip address of the remote machine (only set after prepared and spawned successfully)
45 self.ipaddr = None 41​ self.ipaddr = None
46 42​
47 #: uuid of the task which spawned this instance 43​ #: uuid of the task which spawned this instance
48 self.uuid = uuid 44​ self.uuid = uuid
49 45​
50 #: hostname to use for spawned instance - based on username of current user 46​ #: hostname to use for spawned instance - based on username of current user
51 self.hostname = 'taskotron-%s' % getpass.getuser() 47​ self.hostname = 'taskotron-%s' % getpass.getuser()
52 48​
53 def _prepare_image(self): 49​ def _prepare_image(self):
54 '''Use testcloud to prepare an image for local booting 50​ '''Use testcloud to prepare an image for local booting
55 :raises TaskotronImageNotFoundError: when base image of the required type is not found 51​ :raises TaskotronImageNotFoundError: when base image of the required type is not found
56 :raises TaskotronImageError: for errors in preparing the image with testcloud 52​ :raises TaskotronImageError: for errors in preparing the image with testcloud
57 ''' 53​ '''
58 54​
59 log.debug("preparing image {} for task {}".format(self.imageurl, self.uuid)) ​
60 tc_image = None 55​ tc_image = None
kparalUnsubmitted
Not Done

This debug printout is confusing, because it claims it will download an image even if we later decide we will not download it, but use ImageFinder instead. Move it into the if clause?

61 56​
62 try: 57​ try:
63 if config.get_config().force_imageurl: 58​ if config.get_config().force_imageurl:
64 img_url = config.get_config().imageurl 59​ img_url = config.get_config().imageurl
65 else: 60​ else:
66 # FIXME: release/flavor/arch should be provided from formula (?) 61​ # FIXME: release/flavor/arch should be provided from formula (?)
67 img_url = ImageFinder.get_latest( 62​ img_url = ImageFinder.get_latest(
68 release=config.get_config().disposable_release, 63​ release=config.get_config().disposable_release,
69 flavor=config.get_config().disposable_flavor, 64​ flavor=config.get_config().disposable_flavor,
70 arch=config.get_config().disposable_arch 65​ arch=config.get_config().disposable_arch
71 ) 66​ )
kparalUnsubmitted
Not Done

Another debug printout here would also be nice, so that we know which image got picked.

jskladanAuthorUnsubmitted
Not Done

I'll just move the first one, it will then work as expected

72 except exc.TaskotronImageNotFoundError, e: 67​ except exc.TaskotronImageNotFoundError, e:
73 log.error(e) 68​ log.error(e)
74 raise 69​ raise
75 70​
71​ log.debug("Preparing image {} for task {}".format(img_url, self.uuid))
kparalUnsubmitted
Not Done

Doesn't work, because you're using img_url, but printing self.imageurl. The latter one doesn't seem to be used anywhere else, just erase it into oblivion?

jskladanAuthorUnsubmitted
Not Done

that's what I get for doing three things at once *sigh* I bow before your might and wisdom!

72​
76 try: 73​ try:
77 tc_image = image.Image(img_url) 74​ tc_image = image.Image(img_url)
78 tc_image.prepare() 75​ tc_image.prepare()
79 except TestcloudImageError, e: 76​ except TestcloudImageError, e:
80 log.error(e) 77​ log.error(e)
81 raise exc.TaskotronImageError("There was an error while preparing the " 78​ raise exc.TaskotronImageError("There was an error while preparing the "
82 "testcloud image", e) 79​ "testcloud image", e)
83 80​
▲ Show 20 Lines • Show All 136 Lines • ▼ Show 20 Line(s)212 def get_latest(cls, release, flavor, arch='x86_64', imagesdir=None):
220 :param imagesdir: absolute path to directory containing the images, path from config is 217​ :param imagesdir: absolute path to directory containing the images, path from config is
221 used if None 218​ used if None
222 :param arch: architecture of the image 219​ :param arch: architecture of the image
223 220​
224 :return: file:// url of the latest image available 221​ :return: file:// url of the latest image available
225 :raises TaskotronImageError: if no such image for given release and flavor was found 222​ :raises TaskotronImageError: if no such image for given release and flavor was found
226 """ 223​ """
227 224​
225​ if not imagesdir:
226​ imagesdir = config.get_config().imagesdir
227​
228 latest_metadata = cls.get_latest_metadata(release, flavor, arch, imagesdir) 228​ latest_metadata = cls.get_latest_metadata(release, flavor, arch, imagesdir)
229 229​
230 if not latest_metadata: 230​ if not latest_metadata:
231 raise exc.TaskotronImageNotFoundError('No image for release %s, flavor %s, arch %s.' % 231​ raise exc.TaskotronImageNotFoundError(
232 (release, flavor, arch)) 232​ 'No image for release %s, flavor %s, arch %s in %s' %
233​ (release, flavor, arch, imagesdir))
233 else: 234​ else:
234 return "file://" + os.path.join(imagesdir, latest_metadata['filename']) 235​ return "file://" + os.path.join(imagesdir, latest_metadata['filename'])
235 236​
236 @classmethod 237​ @classmethod
237 def get_latest_metadata(cls, release, flavor, arch='x86_64', imagesdir=None): 238​ def get_latest_metadata(cls, release, flavor, arch='x86_64', imagesdir=None):
238 """Search for the most recent image available on the system. 239​ """Search for the most recent image available on the system.
239 240​
240 :param release: release of the image (e.g. ``23``) 241​ :param release: release of the image (e.g. ``23``)
241 :param flavor: flavor of the image (e.g. ``minimal``) 242​ :param flavor: flavor of the image (e.g. ``minimal``)
242 :param imagesdir: absolute path to directory containing the images, path from config is 243​ :param imagesdir: absolute path to directory containing the images, path from config is
243 used if None 244​ used if None
244 :param arch: arch of the image (e.g. 'x86_64') 245​ :param arch: arch of the image (e.g. 'x86_64')
245 246​
246 :return: metadata of the most recent image 247​ :return: metadata of the most recent image
247 :rtype: dict {'date': str, 'version': str, 'release': str, 'arch': str, 'filename': str} 248​ :rtype: dict {'date': str, 'version': str, 'release': str, 'arch': str, 'filename': str}
248 """ 249​ """
249 250​
250 release = str(release) 251​ release = str(release)
252​ # The pattern is: YYMMDD_HHMM-fedora-RELEASE-FLAVOR-ARCH.(qcow2|raw|img)
253​ # For example: 160301_1030-fedora-23-taskotron_cloud-x86_64.img
251 pattern = re.compile(r'^([0-9]{6}_[0-9]{4})-fedora-(.*?)-(.*?)-(.*?)\.(qcow2|raw|img)$') 254​ pattern = re.compile(r'^([0-9]{6}_[0-9]{4})-fedora-(.*?)-(.*?)-(.*?)\.(qcow2|raw|img)$')
252 255​
253 images = [] 256​ images = []
254 for filename in cls.get_all_filenames(imagesdir): 257​ for filename in cls.get_all_filenames(imagesdir):
255 m = pattern.match(filename) 258​ m = pattern.match(filename)
256 if m: 259​ if m:
257 images.append({'timestamp': m.group(1), 260​ images.append({'timestamp': m.group(1),
258 'release': m.group(2), 261​ 'release': m.group(2),
Show All 9 Lines
View Options

readme.rst

Show First 20 Lines • Show All 134 Lines • ▼ Show 20 Line(s)
135``/var/tmp/``, run rpmlint on the downloaded rpms and print output in YAML format 135​``/var/tmp/``, run rpmlint on the downloaded rpms and print output in YAML format
136to stdout. 136​to stdout.
137 137​
138Example:: 138​Example::
139 139​
140 runtask -i xchat-2.8.8-21.fc20 -t koji_build -a x86_64 task-rpmlint/rpmlint.yml 140​ runtask -i xchat-2.8.8-21.fc20 -t koji_build -a x86_64 task-rpmlint/rpmlint.yml
141 141​
142 142​
143​Using Disposable Clients for Task Execution
144​===========================================
145​
146​When executing the task on the local machine is not desirable, you can use the
147​disposable client feature - a new virtual machine is spawned from a base image
148​and the task is executed in the VM.
149​
150​Note: you need to setup Testcloud first refer to `Setting up Testcloud`_
kparalUnsubmitted
Not Done
`Setting up Testcloud`_ section

will make a hyperlink and nicely format it

jskladanAuthorUnsubmitted
Not Done

cool!

151​
152​To use the feature, just add ``--libvirt`` parameter ot the runtask command::
153​
154​ runtask --libvirt -i xchat-2.8.8-21.fc20 -t koji_build -a x86_64 task-rpmlint/rpmlint.yml
155​
156​By default, a base image defined by the ``imageurl`` option in ``taskotron.yaml``
157​config file is used. You can provide your own base image by changing the
158​``imageurl`` value (use ``file://`` URL to point to a local file).
159​
160​We also provide `updated base images at <https://tflink.fedorapeople.org/taskotron/taskotron-cloud/images/>_`
161​(note that the image needs to be uncompressed before use).
kparalUnsubmitted
Not Done

Maybe also add this?

If you store these images in ``/var/lib/taskotron/images``, adhere to their naming conventions 
and set ``force_imageurl=False`` in ``taskotron.yaml``, we will find the latest one available
automatically for you and you don't need to update the ``imageurl`` option regularly.
jskladanAuthorUnsubmitted
Not Done

Sounds good.

162​
163​If you store these images in ``/var/lib/taskotron/images``, adhere to their
164​naming conventions and set ``force_imageurl=False`` in ``taskotron.yaml``,
165​we will find the latest one available automatically for you and you don't need
166​to update the ``imageurl`` option regularly.
167​
168​
169​Setting up Testcloud
170​--------------------
171​
172​Fedora 23 or newer is required for Testcloud to work.
173​
174​Install testcloud::
175​
176​ dnf install testcloud
177​
178​Configure ssh key for Testcloud to use (the private key must be passwordless).
tflinkUnsubmitted
Not Done

Would it be worth noting that that settings.py would only be found by the user running testcloud or is that obvious enough?

Also, the user will need to be added to the testcloud group.

jskladanAuthorUnsubmitted
Not Done

Would it be worth noting that that settings.py would only be found by the user running testcloud or is that obvious enough?

I have a slow morning - just to be sure, you mean that the configuration will only be valid for the user, which sets the config file - i.e. that other users, or system services, won't be able to get to the config, and will most probably fail to use --libvirt, as the ssh-authorized-keys needs to be set in order for it to work?
Is there a better way/path to configure it?

Also, the user will need to be added to the testcloud group.

Are you sure? I'm not in the group, and it works fine.

kparalUnsubmitted
Not Done

I think let's just say "~/.config/testcloud/settings.py or /etc/testcloud/settings.py" and it's obvious enough.

Are you sure? I'm not in the group, and it works fine.

Yes, the same situation here. However, I'm in the libvirt group, which might grant needed privileges.

jskladanAuthorUnsubmitted
Not Done

I'm in qemu, mock, docker, FWIW

179​Edit ``~/.config/testcloud/settings.py`` or ``/etc/testcloud/settings.py`` and
180​insert the respective public key in the place of the ``$SSH PUBKEY HERE$``
181​string::
182​
183​ USER_DATA = """#cloud-config
184​ users:
185​ - default
186​ - name: root
187​ password: %s
188​ chpasswd: { expire: False }
189​ ssh-authorized-keys:
190​ - $SSH PUBKEY HERE$
191​ """
192​
143Running the Test Suite 193​Running the Test Suite
144====================== 194​======================
145 195​
146You can run the included test suite of unit and functional tests. 196​You can run the included test suite of unit and functional tests.
147From the root checkout directory, execute:: 197​From the root checkout directory, execute::
148 198​
149 py.test testing/ 199​ py.test testing/
150 200​
▲ Show 20 Lines • Show All 60 Lines • Show Last 20 Lines