Differential D716

adjust wiki reporting for upgrade test changes
ClosedPublic
Actions

Authored by adamwill on Jan 12 2016, 12:26 AM.

Details

Reviewers
garretraziel
jskladan
Commits
rOPENQA569330219e3f: adjust wiki reporting for upgrade test changes
Summary

As discussed on the mailing list, the upgrade test cases were
rejigged on the wiki; the 'N' tests are now called 'current'
and there are now 'N-1' tests called 'previous'. This adjusts
the openQA wiki reporting configuration to match. It's needed
or else 'N' upgrade test results from openQA will be recorded
in the wiki next to the 'N-1' test cases.

Test Plan

Test wiki reporting for an event where both sets
of upgrade tests were run, ensure the correct ResTupes are
generated for the correct openQA jobs.

Diff Detail

Repository
rOPENQA fedora_openqa
Lint
Automatic diff as part of commit; lint not applicable.
Unit
Automatic diff as part of commit; unit tests not applicable.
adamwill retitled this revision from to adjust wiki reporting for upgrade test changes.Jan 12 2016, 12:26 AM
adamwill updated this object.
adamwill edited the test plan for this revision. (Show Details)
adamwill added reviewers: jskladan, garretraziel.
jskladan accepted this revision.Jan 12 2016, 10:12 AM

I'd rather see something more self-explanatory than upgrade_2_... but I missed that in D679, so I'm in no position to complain here :)

BTW, does this mean that all the upgrade_2_... testsuites were not being reported until now?

This revision is now accepted and ready to land.Jan 12 2016, 10:12 AM
garretraziel accepted this revision.Jan 12 2016, 12:11 PM

Looks OK.

adamwill added a comment.Jan 12 2016, 3:55 PM
In D716#13636, @jskladan wrote:

I'd rather see something more self-explanatory than upgrade_2_... but I missed that in D679, so I'm in no position to complain here :)

BTW, does this mean that all the upgrade_2_... testsuites were not being reported until now?

We could rename *all* the upgrade tests so we have upgrade_previous and upgrade_current just like the test case names, I guess.

Yes, it does mean that, because up till now there was nowhere to report them - we didn't have the Wikitcms test cases, I only just added them. This was mentioned when the tests were added.

Closed by commit rOPENQA569330219e3f: adjust wiki reporting for upgrade test changes (authored by adamwill). · Explain WhyJan 12 2016, 5:28 PM
This revision was automatically updated to reflect the committed changes.

Revision Contents

Diff 1848

View Options

fedora_openqa_schedule/conf_test_suites.py

Show First 20 Lines • Show All 172 Lines • ▼ Show 20 Line(s)171 "QA:Testcase_partitioning_custom_no_swap": {
173 "env": "$BOOTMETHOD$", 173​ "env": "$BOOTMETHOD$",
174 "type": "Installation", 174​ "type": "Installation",
175 }, 175​ },
176 "QA:Testcase_Kickstart_Hd_Device_Path_Ks_Cfg": { 176​ "QA:Testcase_Kickstart_Hd_Device_Path_Ks_Cfg": {
177 "section": "Kickstart", 177​ "section": "Kickstart",
178 "env": "Result", 178​ "env": "Result",
179 "type": "Installation", 179​ "type": "Installation",
180 }, 180​ },
181​ "QA:Testcase_upgrade_dnf_current_minimal": {
182​ "section": "Upgrade",
183​ "env": "x86",
184​ "type": "Installation",
185​ },
186​ "QA:Testcase_upgrade_dnf_current_workstation": {
187​ "section": "Upgrade",
188​ "env": "x86",
189​ "type": "Installation",
190​ },
191​ "QA:Testcase_upgrade_dnf_current_any": {
192​ "section": "Upgrade",
193​ "env": "$BOOTMETHOD$",
194​ "type": "Installation",
195​ },
181 "QA:Testcase_upgrade_dnf_previous_minimal": { 196​ "QA:Testcase_upgrade_dnf_previous_minimal": {
182 "section": "Upgrade", 197​ "section": "Upgrade",
183 "env": "x86", 198​ "env": "x86",
184 "type": "Installation", 199​ "type": "Installation",
185 }, 200​ },
186 "QA:Testcase_upgrade_dnf_previous_workstation": { 201​ "QA:Testcase_upgrade_dnf_previous_workstation": {
187 "section": "Upgrade", 202​ "section": "Upgrade",
188 "env": "x86", 203​ "env": "x86",
▲ Show 20 Lines • Show All 158 Lines • ▼ Show 20 Line(s)356 "server_software_raid": [
347 ], 362​ ],
348 "server_kickstart_hdd": [ 363​ "server_kickstart_hdd": [
349 "QA:Testcase_install_to_VirtIO", 364​ "QA:Testcase_install_to_VirtIO",
350 "QA:Testcase_Anaconda_user_creation", 365​ "QA:Testcase_Anaconda_user_creation",
351 "QA:Testcase_kickstart_user_creation", 366​ "QA:Testcase_kickstart_user_creation",
352 "QA:Testcase_Kickstart_Hd_Device_Path_Ks_Cfg", 367​ "QA:Testcase_Kickstart_Hd_Device_Path_Ks_Cfg",
353 ], 368​ ],
354 "upgrade_minimal_64bit": [ 369​ "upgrade_minimal_64bit": [
370​ "QA:Testcase_upgrade_dnf_current_minimal",
371​ "QA:Testcase_upgrade_dnf_current_any",
372​ ],
373​ "upgrade_desktop_64bit": [
374​ "QA:Testcase_upgrade_dnf_current_workstation",
375​ "QA:Testcase_upgrade_dnf_current_any",
376​ ],
377​ "upgrade_minimal_32bit": [
378​ "QA:Testcase_upgrade_dnf_current_minimal",
379​ "QA:Testcase_upgrade_dnf_current_any",
380​ ],
381​ "upgrade_desktop_32bit": [
382​ "QA:Testcase_upgrade_dnf_current_workstation",
383​ "QA:Testcase_upgrade_dnf_current_any",
384​ ],
385​ "upgrade_2_minimal_64bit": [
355 "QA:Testcase_upgrade_dnf_previous_minimal", 386​ "QA:Testcase_upgrade_dnf_previous_minimal",
356 "QA:Testcase_upgrade_dnf_previous_any", 387​ "QA:Testcase_upgrade_dnf_previous_any",
357 ], 388​ ],
358 "upgrade_desktop_64bit": [ 389​ "upgrade_2_desktop_64bit": [
359 "QA:Testcase_upgrade_dnf_previous_workstation", 390​ "QA:Testcase_upgrade_dnf_previous_workstation",
360 "QA:Testcase_upgrade_dnf_previous_any", 391​ "QA:Testcase_upgrade_dnf_previous_any",
361 ], 392​ ],
362 "upgrade_minimal_32bit": [ 393​ "upgrade_2_minimal_32bit": [
363 "QA:Testcase_upgrade_dnf_previous_minimal", 394​ "QA:Testcase_upgrade_dnf_previous_minimal",
364 "QA:Testcase_upgrade_dnf_previous_any", 395​ "QA:Testcase_upgrade_dnf_previous_any",
365 ], 396​ ],
366 "upgrade_desktop_32bit": [ 397​ "upgrade_2_desktop_32bit": [
367 "QA:Testcase_upgrade_dnf_previous_workstation", 398​ "QA:Testcase_upgrade_dnf_previous_workstation",
368 "QA:Testcase_upgrade_dnf_previous_any", 399​ "QA:Testcase_upgrade_dnf_previous_any",
369 ], 400​ ],
370 "server_btrfs": [ 401​ "server_btrfs": [
371 "QA:Testcase_install_to_VirtIO", 402​ "QA:Testcase_install_to_VirtIO",
372 "QA:Testcase_partitioning_custom_btrfs", 403​ "QA:Testcase_partitioning_custom_btrfs",
373 "QA:Testcase_Anaconda_User_Interface_Graphical", 404​ "QA:Testcase_Anaconda_User_Interface_Graphical",
374 "QA:Testcase_Anaconda_user_creation", 405​ "QA:Testcase_Anaconda_user_creation",
▲ Show 20 Lines • Show All 76 Lines • Show Last 20 Lines