From Fedora Project Wiki

m (internal link cleaning)
Line 152: Line 152:
! User
! User
! Profile
! Profile
! [http://fedoraproject.org/wiki/QA:Testcase_base_startup Base startup]
! [[QA:Testcase_base_startup|Base startup]]
! [http://fedoraproject.org/wiki/QA:Testcase_base_system_logging System logging]
! [[QA:Testcase_base_system_logging|System logging]]
! [http://fedoraproject.org/wiki/QA:Testcase_Services_start Services start]
! [http://fedoraproject.org/wiki/QA:Testcase_Services_start Services start]
! [http://fedoraproject.org/wiki/QA:Testcase_base_selinux SELinux]
! [[QA:Testcase_base_selinux|SELinux]]
! [http://fedoraproject.org/wiki/QA:Testcase_base_service_manipulation Service manipulation]
! [http://fedoraproject.org/wiki/QA:Testcase_base_service_manipulation Service manipulation]
! References
! References
Line 294: Line 294:
! User
! User
! Profile
! Profile
! [http://fedoraproject.org/wiki/User:Roshi/QA/AtomicTests/Atomic_Image_Boots Image boots]
! [[User:Roshi/QA/AtomicTests/Atomic_Image_Boots|Image boots]]
! [http://fedoraproject.org/wiki/User:Roshi/QA/AtomicTests/Atomic_Upgrade Upgrade works]
! [[User:Roshi/QA/AtomicTests/Atomic_Upgrade|Upgrade works]]
! [http://fedoraproject.org/wiki/User:Roshi/QA/AtomicTests/Atomic_Rollback Rollback works]
! [http://fedoraproject.org/wiki/User:Roshi/QA/AtomicTests/Atomic_Rollback Rollback works]
! References
! References
Line 457: Line 457:
! User
! User
! Profile
! Profile
! [http://fedoraproject.org/wiki/QA/Draft/Testcase_Vagrant_eth0_naming eth0 naming]
! [[QA/Draft/Testcase_Vagrant_eth0_naming|eth0 naming]]
! References
! References



Revision as of 15:41, 18 September 2016

Fedora Test Day
Fedora Cloud Test day

Date 2016-05-10
Time all day

Website QA/Test Days
IRC #fedora-test-day (webirc)
Mailing list test


Can't make the date?
If you come to this page before or after the test day is completed, your testing is still valuable, and you can use the information on this page to test, file any bugs you find at Bugzilla, and add your results to the results section. If this page is more than a month old when you arrive here, please check the current schedule and see if a similar but more recent Test Day is planned or has already happened.

What to test?

Today's installment of Fedora Test Day will focus on Cloud, Atomic Host images for Fedora 24.

Who's available

The following cast of characters will be available testing, workarounds, bug fixes, and general discussion ...

Prerequisite for Test Day

You will require at least a system with libvirt/kvm installed. Having access to any Openstack or other Cloud IAAS system where you can upload an image will be even better.

Download the images from below links

List of AMIs

Image Name AMI id Destination Virt type Vol type
Fedora-Cloud-Base-24-20160509.n.1.x86_64 ami-639de403 EC2 (us-west-1) paravirtual standard
Fedora-Cloud-Base-24-20160509.n.1.x86_64 ami-d6d7fbb5 EC2 (ap-southeast-2) hvm standard
Fedora-Cloud-Base-24-20160509.n.1.x86_64 ami-7c31dc11 EC2 (us-east-1) hvm standard
Fedora-Cloud-Base-24-20160509.n.1.x86_64 ami-f9d1fd9a EC2 (ap-southeast-2) hvm gp2
Fedora-Cloud-Base-24-20160509.n.1.x86_64 ami-5d9be23d EC2 (us-west-1) hvm standard
Fedora-Cloud-Base-24-20160509.n.1.x86_64 ami-2bfa074b EC2 (us-west-2) paravirtual gp2
Fedora-Cloud-Base-24-20160509.n.1.x86_64 ami-36855355 EC2 (ap-southeast-1) paravirtual gp2
Fedora-Cloud-Base-24-20160509.n.1.x86_64 ami-6d36db00 EC2 (us-east-1) hvm gp2
Fedora-Cloud-Base-24-20160509.n.1.x86_64 ami-12c4297d EC2 (eu-central-1) paravirtual gp2
Fedora-Cloud-Base-24-20160509.n.1.x86_64 ami-a307e3c2 EC2 (ap-northeast-1) paravirtual standard
Fedora-Cloud-Base-24-20160509.n.1.x86_64 ami-bb9de4db EC2 (us-west-1) hvm gp2
Fedora-Cloud-Base-24-20160509.n.1.x86_64 ami-643db408 EC2 (sa-east-1) paravirtual standard
Fedora-Cloud-Base-24-20160509.n.1.x86_64 ami-5e27ae32 EC2 (sa-east-1) hvm standard
Fedora-Cloud-Base-24-20160509.n.1.x86_64 ami-7f00e41e EC2 (ap-northeast-1) hvm standard
Fedora-Cloud-Base-24-20160509.n.1.x86_64 ami-4fe76d3c EC2 (eu-west-1) paravirtual standard
Fedora-Cloud-Base-24-20160509.n.1.x86_64 ami-42835521 EC2 (ap-southeast-1) hvm gp2
Fedora-Cloud-Base-24-20160509.n.1.x86_64 ami-45815726 EC2 (ap-southeast-1) hvm standard
Fedora-Cloud-Base-24-20160509.n.1.x86_64 ami-fcd0fc9f EC2 (ap-southeast-2) paravirtual gp2
Fedora-Cloud-Base-24-20160509.n.1.x86_64 ami-a237dacf EC2 (us-east-1) paravirtual standard
Fedora-Cloud-Base-24-20160509.n.1.x86_64 ami-3636db5b EC2 (us-east-1) paravirtual gp2
Fedora-Cloud-Base-24-20160509.n.1.x86_64 ami-2398e143 EC2 (us-west-1) paravirtual gp2
Fedora-Cloud-Base-24-20160509.n.1.x86_64 ami-863fdbe7 EC2 (ap-northeast-1) paravirtual gp2
Fedora-Cloud-Base-24-20160509.n.1.x86_64 ami-3b38b157 EC2 (sa-east-1) paravirtual gp2
Fedora-Cloud-Base-24-20160509.n.1.x86_64 ami-18fa706b EC2 (eu-west-1) hvm gp2
Fedora-Cloud-Base-24-20160509.n.1.x86_64 ami-f2c62b9d EC2 (eu-central-1) hvm standard
Fedora-Cloud-Base-24-20160509.n.1.x86_64 ami-c9e16bba EC2 (eu-west-1) paravirtual gp2
Fedora-Cloud-Base-24-20160509.n.1.x86_64 ami-5c27ae30 EC2 (sa-east-1) hvm gp2
Fedora-Cloud-Base-24-20160509.n.1.x86_64 ami-f3c72a9c EC2 (eu-central-1) hvm gp2
Fedora-Cloud-Base-24-20160509.n.1.x86_64 ami-8ed2feed EC2 (ap-southeast-2) paravirtual standard
Fedora-Cloud-Base-24-20160509.n.1.x86_64 ami-823edae3 EC2 (ap-northeast-1) hvm gp2
Fedora-Cloud-Base-24-20160509.n.1.x86_64 ami-a5f508c5 EC2 (us-west-2) paravirtual standard
Fedora-Cloud-Base-24-20160509.n.1.x86_64 ami-fce66c8f EC2 (eu-west-1) hvm standard
Fedora-Cloud-Base-24-20160509.n.1.x86_64 ami-2e82544d EC2 (ap-southeast-1) paravirtual standard
Fedora-Cloud-Base-24-20160509.n.1.x86_64 ami-9dfa07fd EC2 (us-west-2) hvm gp2
Fedora-Cloud-Base-24-20160509.n.1.x86_64 ami-27c62b48 EC2 (eu-central-1) paravirtual standard
Fedora-Cloud-Base-24-20160509.n.1.x86_64 ami-a4fa07c4 EC2 (us-west-2) hvm standard


Here's a chunk which is commonly used for most Test Days. Replace XX with whatever Fedora release is pending:

How to test?

  • Boot the images on a cloud system, or on Vagrant or using testcloud on a local system.
  • Execute the tests.

Run the tests

Visit the result page and click on the column title links to see the tests that need to be run: most column titles are links to a specific test case. Follow the instructions there, then enter your results by clicking the Enter result button for the test.

Exploratory testing

If you run out of test cases, congratulations! But that's not the end! You can still help out by playing around with the tool in whatever ways you can think of: try out all the things you can find, and try writing different Fedora images with it. If you have systems with different Windows versions, try running the tool on all of them. Get creative! Any problems you find please file a bug, or report to the IRC channel.

Reporting bugs

If you have problems with any of the tests, report a bug to Bugzilla. If you are unsure about exactly how to file the report or what other information to include, just ask on IRC and we will help you.

IRC Channel name: #fedora-cloud, #fedora-test-day
Server: Freenode

Test Results

Please enter your results on the result page. The results will be transferred here after the Test Day is finished.

Basic Tests

User Profile Base startup System logging Services start SELinux Service manipulation References
ashutoshbhakare Openstack
Pass pass
[1]
Pass pass
Pass pass
Fail fail
[2]
Pass pass
[3]
  1. Cloud Image
  2. RHBZ #1335149 Cloud Image failed
  3. Cloud Base Image
chandankumar OpenStack [ OS1 public ]
Pass pass
[1]
Pass pass
[2]
Pass pass
[3]
Pass pass
[4]
Pass pass
[5]
  1. [1.] Fedora Cloud Image
  2. [2.] Fedora Cloud Image
  3. [3.] Fedora Cloud Image
  4. [4.] Fedora Cloud Image
  5. [5.] Fedora Cloud Image
coremodule Base Install
Pass pass
coremodule testcloud
Pass pass
[1]
  1. [1]Cloud Image
dustymabe EC2 m3.medium ami-6d36db00
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
ganeshkadam local kvm/libvirt
Pass pass
[1]
Pass pass
[2]
Pass pass
[3]
Pass pass
[4]
Pass pass
[5]
Pass pass
[6]
Pass pass
[7]
Pass pass
[8]
Pass pass
[9]
Pass pass
[10]
  1. Fedora-Atomic image
  2. Cloud-Base image
  3. Atomic-image
  4. Cloud-Based image
  5. Atomic-image
  6. Cloud-Based image
  7. Atomic-image
  8. Cloud-Based image
  9. Atomic-image
  10. Cloud-Based image
jberkus jberkus
Pass pass
[1]
Pass pass
[2]
Fail fail
[3]
Pass pass
[4]
Pass pass
[5]
  1. Atomic Host image running on AWS us-west-2
  2. Atomic Host image running on AWS us-west-2
  3. Atomic Host running on AWS us-west-2 Two services failed to start: UNIT LOAD ACTIVE SUB DESCRIPTION var-lib-nfs-rpc_pipefs.mount loaded failed failed RPC Pipe File System kube-controller-manager.service loaded failed failed Kubernetes Controller Manager While the second is an Atomic test, the first is not.
  4. Atomic Host on AWS us-west-2
  5. Atomic Host on AWS us-west-2
jsedlak
Pass pass
[1]
Pass pass
[2]
Pass pass
[3]
Pass pass
[4]
Pass pass
[5]
  1. Atomic image
  2. Atomic image
  3. Atomic image
  4. Atomic image
  5. Atomic image
kushal Openstack (Fedora Infra)
Pass pass
[1]
Pass pass
[2]
Pass pass
Pass pass
[3]
Pass pass
[4]
Pass pass
[5]
Pass pass
[6]
Pass pass
[7]
Pass pass
[8]
Pass pass
[9]
Pass pass
[10]
  1. Cloud base image
  2. Atomic image
  3. Cloud base image
  4. Atomic image
  5. Cloud base image
  6. Atomic image
  7. Cloud base image
  8. Atomic image
  9. Cloud base image
  10. Atomic image
lbrabec testcloud
Pass pass
[1]
Pass pass
[2]
Pass pass
[3]
Pass pass
[4]
Pass pass
[5]
  1. cloud and atomic
  2. cloud and atomic
  3. cloud and atomic
  4. cloud and atomic
  5. cloud and atomic
satya4ever Openstack
Pass pass
[1]
Pass pass
[2]
Pass pass
[3]
Pass pass
[4]
Pass pass
[5]
Pass pass
[6]
Pass pass
[7]
Pass pass
[8]
Pass pass
[9]
Pass pass
[10]
  1. Atomic Host Image
  2. Cloud Image QCOW2
  3. Atomic image
  4. Cloud base image
  5. Cloud base image
  6. Atomic image
  7. Atomic image
  8. Cloud base image
  9. Atomic image
  10. Cloud base image
sumantrom testcloud
Pass pass
[1]
Pass pass
[2]
Pass pass
[3]
Pass pass
[4]
Pass pass
[5]
  1. Cloud base Image
  2. Cloud base image
  3. Cloud base
  4. Cloud base
  5. Cloud base
suraj353 Openstack
Pass pass
[1]
Pass pass
[2]
Pass pass
[3]
Pass pass
[4]
Pass pass
[5]
Pass pass
[6]
Pass pass
[7]
Pass pass
[8]
Pass pass
[9]
Pass pass
[10]
  1. 2. Atomic image
  2. Cloud base image
  3. Cloud base image
  4. Atomic image
  5. Atomic image
  6. Cloud base image
  7. Cloud base image
  8. Atomic image
  9. Atomic image
  10. Cloud base image

Atomic Tests

User Profile Image boots Upgrade works Rollback works References
jberkus jberkus
Pass pass
[1]
  1. Atomic Host on AWS us-west-2
jsedlak
Pass pass
Fail fail
[1]
  1. RHBZ #1330318
kushal Openstack (Fedora Infra)
Pass pass
[1]
Fail fail
[2]
  1. Atomic image
  2. RHBZ #1330318 Atomic image (known issue)
lbrabec testcloud
Pass pass
Fail fail
[1]
  1. RHBZ #1330318
satya4ever Openstack
Pass pass
[1]
Fail fail
[2]
  1. Atomic image
  2. RHBZ #1330318 #1330318
suraj353 Openstack
Pass pass
[1]
Fail fail
[2]
  1. Atomic image
  2. #1330318

Docker tests

User Profile Docker install Docker storage setup Docker daemon References
ganeshkadam local kvm/libvirt
Pass pass
[1]
Pass pass
[2]
  1. Atomic-image
  2. Atomic-image
kushal Openstack (Fedora Infra)
Pass pass
[1]
Pass pass
[2]
Pass pass
[3]
Pass pass
[4]
Pass pass
[5]
Pass pass
[6]
  1. Cloud base image
  2. Atomic image
  3. Atomic image
  4. Atomic image
  5. Cloud base image
  6. Atomic image
lbrabec testcloud
Pass pass
[1]
Pass pass
[2]
Pass pass
[3]
  1. cloud and atomic
  2. cloud and atomic
  3. cloud and atomic
satya4ever Openstack
Pass pass
[1]
Pass pass
[2]
Pass pass
[3]
Pass pass
[4]
Pass pass
[5]
Pass pass
[6]
  1. Cloud base image
  2. Atomic image
  3. Cloud base image
  4. Atomic image
  5. Cloud base image
  6. Atomic image
sumantrom testcloud
Pass pass
[1]
Pass pass
[2]
Pass pass
[3]
  1. Cloud base Image
  2. Cloud Base
  3. Cloud Base Image
suraj353 Openstack
Pass pass
[1]
Pass pass
[2]
Pass pass
[3]
Pass pass
[4]
Pass pass
[5]
Pass pass
[6]
  1. Cloud base image
  2. Atomic image
  3. Cloud base image
  4. Atomic image
  5. Cloud base image
  6. Atomic image

More Atomic related tests

User Profile Atomic command Atomic read only mounts Atomic root mount Atomic tmp mount Atomic tmp writable Atomic journal written References
ganeshkadam local kvm/libvirt
Fail fail
[1]
Pass pass
[2]
Pass pass
[3]
Pass pass
[4]
Pass pass
[5]
  1. Atomic-image
  2. Atomic-image
  3. Atomic-image
  4. Atomic-image
  5. Atomic-image
kushal Openstack (Fedora Infra)
Fail fail
[1]
Pass pass
[2]
Pass pass
[3]
Pass pass
[4]
Pass pass
[5]
  1. RHBZ #1334588 Atomic image, it is failing with a system error.
  2. Atomic image
  3. Atomic image
  4. Atomic image
  5. Atomic image
lbrabec testcloud
Fail fail
[1]
Pass pass
Pass pass
Pass pass
Pass pass
  1. RHBZ #1334588
suraj353 Openstack
Fail fail
[1]
Pass pass
[2]
Pass pass
[3]
Pass pass
[4]
Pass pass
[5]
  1. #1334588,
  2. Atomic image
  3. Atomic image
  4. Atomic image
  5. Atomic image

Vagrant test

User Profile eth0 naming References