Differential D693

add missing default_install tests to templates
ClosedPublic
Actions

Authored by garretraziel on Dec 16 2015, 12:49 PM.

Details

Reviewers
adamwill
jskladan
Commits
rOPENQATESTS0d710e3ee9be: add missing default_install tests to templates
Summary

This adds missing default_install tests to templates - we've missed
KDE live and Server DVD on UEFI for some reason and Workstation netinst was
missing. After this, we should have all non-optional tests from "Default
boot and install" section covered.

Test Plan

Try to load templates. Hopefully, we will be able to test
reporting once we will have all images built - a lot of them are missing now
and I am unable to run tests on F23 RC10 (it is stuck on "Cheking for compose" forever).

Diff Detail

Repository
rOPENQATESTS os-autoinst-distri-fedora
Lint
Automatic diff as part of commit; lint not applicable.
Unit
Automatic diff as part of commit; unit tests not applicable.
garretraziel retitled this revision from to add missing default_install tests to templates.Dec 16 2015, 12:49 PM
garretraziel updated this object.
garretraziel edited the test plan for this revision. (Show Details)
garretraziel added reviewers: adamwill, jskladan.
adamwill added a comment.EditedDec 16 2015, 5:37 PM

So on the Workstation netinst - my understanding was it wasn't an official deliverable and the Workstation SIG didn't want to support it, but OTOH it's listed at https://getfedora.org/en/workstation/download/ , so I'm not sure what's going on there. Testing it can't hurt, I guess. I think some of the others were left out as a trade-off to try and preserve test resources, but we have more capacity now so hopefully adding them will be OK.

"I am unable to run tests on F23 RC10 (it is stuck on "Cheking for compose" forever)."

As you mentioned in D692 this needs adjusting for the changes made there.

That's because RC10 doesn't exist any more: check https://dl.fedoraproject.org/pub/alt/stage/ , it's been cleaned out. You could try running on F23 Final with just '--release 23', but it won't be able to submit the results to the wiki.

adamwill requested changes to this revision.Dec 16 2015, 5:38 PM
This revision now requires changes to proceed.Dec 16 2015, 5:38 PM
garretraziel added a comment.Dec 17 2015, 11:33 AM

Yup, I was able to run those tests, but I wanted to try whether they will get reported, but oh well, there shouldn't (the s-word!) be any problems anyway.

garretraziel updated this revision to Diff 1807.Dec 17 2015, 12:10 PM

merge with current develop

adamwill accepted this revision.Dec 19 2015, 5:57 AM

Sure, should be OK. I'll check whether the reporting stuff is all lined up next week, but with my recent change there's at least no chance it can break reporting of any *other* results.

This revision is now accepted and ready to land.Dec 19 2015, 5:57 AM
Closed by commit rOPENQATESTS0d710e3ee9be: add missing default_install tests to templates (authored by garretraziel). · Explain WhyDec 22 2015, 8:41 AM
This revision was automatically updated to reflect the committed changes.

Revision Contents

PathPackages
Mtemplates (75 lines)

Diff 1818

View Options

templates

Show First 20 Lines • Show All 56 Lines • ▼ Show 20 Line(s)56 product => {
57 arch => "x86_64", 57​ arch => "x86_64",
58 distri => "fedora", 58​ distri => "fedora",
59 flavor => "server_dvd", 59​ flavor => "server_dvd",
60 version => "*", 60​ version => "*",
61 }, 61​ },
62 test_suite => { name => "default_install" }, 62​ test_suite => { name => "default_install" },
63 }, 63​ },
64 { 64​ {
65​ machine => { name => "uefi" },
66​ prio => 11,
67​ product => {
68​ arch => "x86_64",
69​ distri => "fedora",
70​ flavor => "server_dvd",
71​ version => "*",
72​ },
73​ test_suite => { name => "default_install" },
74​ },
75​ {
65 machine => { name => "64bit" }, 76​ machine => { name => "64bit" },
66 prio => 10, 77​ prio => 10,
67 product => { 78​ product => {
68 arch => "x86_64", 79​ arch => "x86_64",
69 distri => "fedora", 80​ distri => "fedora",
70 flavor => "generic_boot", 81​ flavor => "generic_boot",
71 version => "*", 82​ version => "*",
72 }, 83​ },
Show All 11 Lines86 {
84 test_suite => { name => "default_install" }, 95​ test_suite => { name => "default_install" },
85 }, 96​ },
86 { 97​ {
87 machine => { name => "64bit" }, 98​ machine => { name => "64bit" },
88 prio => 15, 99​ prio => 15,
89 product => { 100​ product => {
90 arch => "x86_64", 101​ arch => "x86_64",
91 distri => "fedora", 102​ distri => "fedora",
103​ flavor => "workstation_boot",
104​ version => "*",
105​ },
106​ test_suite => { name => "default_install" },
107​ },
108​ {
109​ machine => { name => "uefi" },
110​ prio => 16,
111​ product => {
112​ arch => "x86_64",
113​ distri => "fedora",
114​ flavor => "workstation_boot",
115​ version => "*",
116​ },
117​ test_suite => { name => "default_install" },
118​ },
119​ {
120​ machine => { name => "64bit" },
121​ prio => 15,
122​ product => {
123​ arch => "x86_64",
124​ distri => "fedora",
125​ flavor => "kde_live",
126​ version => "*",
127​ },
128​ test_suite => { name => "default_install" },
129​ },
130​ {
131​ machine => { name => "uefi" },
132​ prio => 16,
133​ product => {
134​ arch => "x86_64",
135​ distri => "fedora",
92 flavor => "kde_live", 136​ flavor => "kde_live",
93 version => "*", 137​ version => "*",
94 }, 138​ },
95 test_suite => { name => "default_install" }, 139​ test_suite => { name => "default_install" },
96 }, 140​ },
97 { 141​ {
98 machine => { name => "64bit" }, 142​ machine => { name => "64bit" },
99 prio => 50, 143​ prio => 50,
▲ Show 20 Lines • Show All 523 Lines • ▼ Show 20 Line(s)658 {
623 test_suite => { name => "default_install" }, 667​ test_suite => { name => "default_install" },
624 }, 668​ },
625 { 669​ {
626 machine => { name => "64bit" }, 670​ machine => { name => "64bit" },
627 prio => 17, 671​ prio => 17,
628 product => { 672​ product => {
629 arch => "i386", 673​ arch => "i386",
630 distri => "fedora", 674​ distri => "fedora",
675​ flavor => "workstation_boot",
676​ version => "*",
677​ },
678​ test_suite => { name => "default_install" },
679​ },
680​ {
681​ machine => { name => "64bit" },
682​ prio => 17,
683​ product => {
684​ arch => "i386",
685​ distri => "fedora",
631 flavor => "kde_live", 686​ flavor => "kde_live",
632 version => "*", 687​ version => "*",
633 }, 688​ },
634 test_suite => { name => "default_install" }, 689​ test_suite => { name => "default_install" },
635 }, 690​ },
636 { 691​ {
637 machine => { name => "64bit" }, 692​ machine => { name => "64bit" },
638 prio => 32, 693​ prio => 32,
▲ Show 20 Lines • Show All 186 Lines • ▼ Show 20 Line(s)875 {
825 settings => [ 880​ settings => [
826 { key => "CANNED", value => "1" } 881​ { key => "CANNED", value => "1" }
827 ], 882​ ],
828 version => "*", 883​ version => "*",
829 }, 884​ },
830 { 885​ {
831 arch => "x86_64", 886​ arch => "x86_64",
832 distri => "fedora", 887​ distri => "fedora",
888​ flavor => "workstation_boot",
889​ name => "",
890​ settings => [
891​ { key => "DESKTOP", value => "gnome" }
892​ ],
893​ version => "*",
894​ },
895​ {
896​ arch => "x86_64",
897​ distri => "fedora",
833 flavor => "workstation_live", 898​ flavor => "workstation_live",
834 name => "", 899​ name => "",
835 settings => [ 900​ settings => [
836 { key => "LIVE", value => "1" }, 901​ { key => "LIVE", value => "1" },
837 { key => "DESKTOP", value => "gnome" } 902​ { key => "DESKTOP", value => "gnome" }
838 ], 903​ ],
839 version => "*", 904​ version => "*",
840 }, 905​ },
▲ Show 20 Lines • Show All 42 Lines • ▼ Show 20 Line(s)944 {
883 name => "", 948​ name => "",
884 settings => [ 949​ settings => [
885 ], 950​ ],
886 version => "*", 951​ version => "*",
887 }, 952​ },
888 { 953​ {
889 arch => "i386", 954​ arch => "i386",
890 distri => "fedora", 955​ distri => "fedora",
956​ flavor => "workstation_boot",
957​ name => "",
958​ settings => [
959​ { key => "DESKTOP", value => "gnome" }
960​ ],
961​ version => "*",
962​ },
963​ {
964​ arch => "i386",
965​ distri => "fedora",
891 flavor => "workstation_live", 966​ flavor => "workstation_live",
892 name => "", 967​ name => "",
893 settings => [ 968​ settings => [
894 { key => "LIVE", value => "1" }, 969​ { key => "LIVE", value => "1" },
895 { key => "DESKTOP", value => "gnome" } 970​ { key => "DESKTOP", value => "gnome" }
896 ], 971​ ],
897 version => "*", 972​ version => "*",
898 }, 973​ },
▲ Show 20 Lines • Show All 276 Lines • Show Last 20 Lines