TripleO periodic job failures analysis 2017-07-10

NameIdNotes
periodic-tripleo-ci-centos-7-ovb-fakeha-caserver 06-03 - dc9aee8
  • http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-fakeha-caserver/dc9aee8/logs/overcloud-controller-0/var/log/heat/heat-engine.txt.gz
    ERROR heat.engine.resource [req-fb6a4029-b4b2-43da-aaed-43a46d3ade7c - demo - - -] Resource type OS::Nova::KeyPair unavailable: ClientException: Unknown Error (HTTP 503)
  • http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-fakeha-caserver/dc9aee8/logs/undercloud/var/log/ironic/deploy/f1cfcf3c-3d6c-4c44-90ba-fdb689e4ae77_3c157a9e-5b61-42df-ba3a-8a99180650ad_2017-06-30-07:18:25.tar.gz
    cloud-init[706]: 2017-06-30 07:16:38,319 - util.py[WARNING]: Failed loading yaml blob
    TypeError: Yaml load allows (<type 'dict'>,) root types, but got str instead
periodic-tripleo-ci-centos-7-ovb-ha-ocata-oooq 07-01 - 626698c
  • One of the configured repositories failed (centos rt)
periodic-tripleo-ci-centos-7-ovb-ha-oooq 07-06 - 825766d
  • Error: Execution of '/bin/yum -d 0 -e 0 -y install openstack-kolla' returned 1
periodic-tripleo-ci-centos-7-ovb-ha-oooq 07-05 - 63eeda4
  • Error: Execution of '/bin/yum -d 0 -e 0 -y install openstack-kolla' returned 1
periodic-tripleo-ci-centos-7-ovb-nonha-tempest-oooq-ocata 07-06 - 4b51aec
  • http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-nonha-tempest-oooq-ocata/4b51aec/logs/oooq/overcloud-controller-0/var/log/neutron/server.log.txt.gz
    ERROR oslo_db.sqlalchemy.exc_filters InternalError: (1305, u'SAVEPOINT sa_savepoint_2 does not exist')
    Details: There are routers attached to this network that depend on this policy for access.
    ERROR oslo_db.api NeutronDbObjectDuplicateEntry: Failed to create a duplicate QosBandwidthLimitRule: for attribute(s) ['qos_policy_id'] with value(s) 0575afa7-6ea6-4917-87ce-7f4a2d21cede
    ERROR neutron.plugins.ml2.ovo_rpc [req-948f0ca8-0402-4654-ac68-0da8a07faa35 70c201cdbba6483c8f13acdde54e1d52 79b1c4e11a644a658e2777060083c69e - - -] This handler is supposed to handle AFTER events, as in 'AFTER it's committed', not BEFORE. Offending resource event: security_group, after_create. Location:
    ERROR oslo_messaging.rpc.server IpAddressGenerationFailure: No more IP addresses available on network 79d23d2f-626b-4136-9f2b-6e9987d20115.
    INFO neutron.api.v2.resource [req-1a32a40d-3ed3-41b7-97e4-8e961035f898 0c350f6ad9444034afe7710263259dc6 95532d5c3ab9492c96a57f1fe80b6a2f - - -] create failed (client error): Invalid input for sub_ports. Reason: A valid port UUID must be specified.
  • http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-nonha-tempest-oooq-ocata/4b51aec/logs/oooq/undercloud/home/jenkins/tempest_output.log.txt.gz
    oslo_config.cfg.NoSuchOptError: no such option api_v2_admin in group [identity-feature-enabled]
  • http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-nonha-tempest-oooq-ocata/4b51aec/logs/oooq/overcloud-novacompute-0/var/log/nova/nova-compute.log.txt.gz
    ERROR nova.compute.manager [instance: 80f406b4-8185-4caf-85e6-bfc4f94eef51] raise exception.BDMNotFound(id=self.id)
    WARNING nova.compute.manager [req-7624eb80-c580-4cf5-85ed-ff9553170ec7 - - - - -] While synchronizing instance power states, found 4 instances in the database and 3 instances on the hypervisor.
    ERROR nova.compute.manager Stderr: u"qemu-img: Could not open '/var/lib/nova/instances/f458b71e-a403-40c4-bddb-26ea065ff7c1/disk': Could not open '/var/lib/nova/instances/f458b71e-a403-40c4-bddb-26ea065ff7c1/disk': No such file or directory
  • http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-nonha-tempest-oooq-ocata/4b51aec/logs/oooq/undercloud/var/log/extra/logstash.txt.gz
    grubby fatal error: unable to find a suitable template
  • http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-nonha-tempest-oooq-ocata/4b51aec/logs/oooq/undercloud/home/jenkins/tempest/results.subunit.gz
    Body: {"NeutronError": {"message": "Illegal subnetpool update : subnetpool 267a4b75-26a9-4a53-8387-400a8288f109 cannot be updated when associated with shared address scope adfa2563-3b5d-4699-8bb4-651133b0ad0b.", "type": "IllegalSubnetPoolUpdate", "detail": ""}}
  • http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-nonha-tempest-oooq-ocata/4b51aec/logs/oooq/overcloud-controller-0/var/log/journal.txt.gz
    neutron-server[29741]: /usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py:430: SAWarning: An exception raised during a Session persistence operation cannot be raised due to an additional ROLLBACK exception; the exception is: (pymysql.err.InternalError) (1213, u'Deadlock found when trying to get lock; try restarting transaction') [SQL: u'INSERT INTO ipallocations (port_id, ip_address, subnet_id, network_id) VALUES (%(port_id)s, %(ip_address)s, %(subnet_id)s, %(network_id)s)'] [parameters: {'network_id': u'72a64a5b-9617-4523-be90-60affbfb9e72', 'subnet_id': '58ea172a-2317-426c-993f-5e1bcc361de6', 'ip_address': '2003::f816:3eff:fe44:b575', 'port_id': u'34b5edf9-6568-48e8-815c-7276c6bd1f62'}]
    neutron-server[29741]: "the exception is: %s" % captured_exception)
  • http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-nonha-tempest-oooq-ocata/4b51aec/logs/oooq/overcloud-novacompute-0/var/log/neutron/openvswitch-agent.log.txt.gz
    WARNING oslo.service.loopingcall [-] Function 'neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.OVSNeutronAgent._report_state' run outlasted interval by 6.31 sec
  • http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-nonha-tempest-oooq-ocata/4b51aec/logs/oooq/undercloud/var/log/ironic/deploy/6a0d3e1c-6290-43ca-a6a3-80c3bc6628c1_40279c3a-1845-4595-b6ec-d64779e40fff_2017-07-05-07:09:30.tar.gz
    chronyd[234]: Received KoD RATE from 108.61.73.243, burst sampling stopped
  • http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-nonha-tempest-oooq-ocata/4b51aec/logs/oooq/undercloud/var/log/neutron/server.log.txt.gz
    DEBUG neutron.db.agents_db [req-c96711f8-a498-4f31-82c5-396edb69a4a1 - - - - -] Stale message received with timestamp: 2017-07-05T06:56:46.828016. Skipping processing because it's older than the server start timestamp: 2017-07-05T06:56:51.240107 report_state /usr/lib/python2.7/site-packages/neutron/db/agents_db.py:455
periodic-tripleo-ci-centos-7-ovb-updates 07-06 - b196f7e
  • http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-updates/b196f7e/logs/undercloud/var/log/undercloud_install.txt.gz
    Error: Execution of '/bin/yum -d 0 -e 0 -y install openstack-kolla' returned 1: Transaction check error:
    file /usr/lib/python2.7/site-packages/docker_pycreds-0.2.1-py2.7.egg-info/requires.txt from install of python2-docker-pycreds-0.2.1-4.el7.noarch conflicts with file from package python-docker-pycreds-1.10.6-1.el7.noarch
periodic-tripleo-ci-centos-7-ovb-updates 07-03 - 69b19dc
  • http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-updates/69b19dc/logs/postci.txt.gz
    CommandError: An error occurred during rendering /usr/share/openstack-dashboard/openstack_dashboard/templates/_stylesheets.html: Error evaluating expression:
    $cursor-disabled
    Unit httpd.service entered failed state.
periodic-tripleo-ci-centos-7-scenario001-multinode-oooq 06-28 - 522befc
  • http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-scenario001-multinode-oooq/522befc/logs/undercloud/var/log/postci.txt.gz
    deploy_stderr: |
    yum install -y jq python-ipaddr openstack-puppet-modules os-net-config openvswitch 'python-heat-agent*' openstack-selinux
    http://mirror.regionone.osic-cloud1.openstack.org/centos/7/updates/x86_64/Packages/policycoreutils-python-2.5-11.el7_3.x86_64.rpm: [Errno 14] curl#18 - "transfer closed with 5727 bytes remaining to read"
periodic-tripleo-ci-centos-7-scenario002-multinode-oooq 07-06 - 5f68669
  • http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-scenario002-multinode-oooq/5f68669/logs/undercloud/home/jenkins/undercloud_install.log.txt.gz
    Error: Execution of '/bin/yum -d 0 -e 0 -y install openstack-kolla' returned 1: Transaction check error:
    file /usr/lib/python2.7/site-packages/docker_pycreds-0.2.1-py2.7.egg-info/requires.txt from install of python2-docker-pycreds-0.2.1-4.el7.noarch conflicts with file from package python-docker-pycreds-1.10.6-1.el7.noarch