PSARC 2015/110 OpenStack service updates for Juno
PSARC 2014/302 oslo.messaging - OpenStack RPC and notifications
PSARC 2014/303 concurrent.futures - high-level Python interface for asynchronous execution
PSARC 2014/304 networkx - Python module for complex networks
PSARC 2014/305 taskflow - Python module for task execution
PSARC 2014/329 pycadf - Python interface for CADF (cloud auditing)
PSARC 2014/330 posix_ipc - POSIX IPC primitives for Python
PSARC 2014/331 oauthlib - Python implementation of OAuth request-signing logic
PSARC 2015/058 oslo - OpenStack common libraries (context, db, i18n, middleware, serialization, utils, vmware)
PSARC 2015/059 glance_store - Glance storage library
PSARC 2015/060 ipaddr - an IPv4/IPv6 manipulation library in Python
PSARC 2015/061 simplegeneric - single-dispatch generic Python functions
PSARC 2015/062 wsme - Web Services Made Easy
PSARC 2015/063 retrying - General purpose Python retrying library
PSARC 2015/065 osprofiler - an OpenStack cross-project profiling library
PSARC 2015/066 OpenStack client for Sahara (Hadoop as a Service)
PSARC 2015/067 keystonemiddleware - Middleware for OpenStack Identity
PSARC 2015/068 pyScss - Compiler for the SCSS flavor of the Sass language
PSARC 2015/069 django-pyscss - pyScss support for Django
PSARC 2015/073 barbicanclient - OpenStack client for Barbican (Key Management)
PSARC 2015/074 pysendfile - Python interface to sendfile
PSARC 2015/097 ldappool - a connection pool for python-ldap
PSARC 2015/098 rfc3986 - URI reference validation module for Python
PSARC 2015/102 iniparse - python .ini file parsing module
20667775 OpenStack service updates for Juno (Umbrella)
18615101 Horizon should prevent network, subnet, and port names with hyphens in them
18772068 instance failed to launch with NoValidHost but no reason
18887457 openstack shouldn't deliver .po files
18905324 hostname.xml should set config/ignore_dhcp_hostname = true
18961031 Duplicate names for role-create and user-create are allowed
19015363 Users should not be allowed to attempt to create volumes when quota exceed
19050335 user appears logged in but unauthorised after horizon reboot
19144215 Instance manipulation buttons greyed out after all instances terminated
19249066 heat stack-preview doesn't appear to do anything
19313272 Need bottom slidebar in horizon for small browser windows
19462265 The Python module oslo.messaging should be added to Userland
19462397 The Python module futures should be added to Userland
19476604 The Python module networkx should be added to Userland
19476953 The Python module taskflow should be added to Userland
19519227 The Python module pycadf should be added to Userland
19582394 The Python module posix_ipc should be added to Userland
19598430 The Python module oauthlib should be added to Userland
19815780 nova package should have dependencies on brand-solaris and brand-solaris-kz
19883623 Image snapshots are missing 'instance_uuid' property
19887874 horizon should set up apache log rotation
19987962 Cinder lists additional volumes attached to instance with linuxy device names
20027791 horizon should be migrated to Apache 2.4
20164815 The Python module django-pyscss should be added to Userland
20173049 The Python module retrying should be added to Userland
20174489 The Python module WSME should be added to Userland
20176001 The Python module keystonemiddleware should be added to Userland
20182039 The Python module pysendfile should be added to Userland
20200162 The Python module pyScss should be added to Userland
20222184 horizon doesn't send start request on shutdown instance
20312312 The Python module python-saharaclient should be added to Userland
20514287 wrong vnic label name used for dhcp vnic in evs
20596802 The Python module oslo.middleware should be added to Userland
20596803 The Python module barbicanclient should be added to Userland
20596804 The Python module oslo.context should be added to Userland
20596805 The Python module iniparse should be added to Userland
20596806 The Python module oslo.vmware should be added to Userland
20596807 The Python module osprofiler should be added to Userland
20596808 The Python module oslo.i18n should be added to Userland
20596809 The Python module oslo.utils should be added to Userland
20596811 The Python module ipaddr should be added to Userland
20596812 The Python module glance_store should be added to Userland
20596813 The Python module oslo.serialization should be added to Userland
20596814 The Python module oslo.db should be added to Userland
20596815 The Python module simplegeneric should be added to Userland
20602690 The Python module ldappool should be added to Userland
20602722 The Python module rfc3986 should be added to Userland
20638369 compilemessages.py requires GNU msgfmt without calling gmsgfmt
20715741 cinder 2014.2.2
20715742 glance 2014.2.2
20715743 heat 2014.2.2
20715744 horizon 2014.2.2
20715745 keystone 2014.2.2
20715746 neutron 2014.2.2
20715747 nova 2014.2.2
20715748 swift 2.2.2
20715749 alembic 0.7.4
20715750 amqp 1.4.6
20715751 boto 2.34.0
20715752 ceilometerclient 1.0.12
20715753 cinderclient 1.1.1
20715754 cliff 1.9.0
20715756 django 1.4.19
20715757 django_compressor 1.4
20715758 django_openstack_auth 1.1.9
20715759 eventlet 0.15.2
20715761 glanceclient 0.15.0
20715762 greenlet 0.4.5
20715763 heatclient 0.2.12
20715764 keystoneclient 1.0.0
20715765 kombu 3.0.7
20715766 mysql 1.2.5
20715767 netaddr 0.7.13
20715769 netifaces 0.10.4
20715770 neutronclient 2.3.10
20715771 novaclient 2.20.0
20715772 oslo.config 1.6.0
20715773 py 1.4.26
20715774 pyflakes 0.8.1
20715775 pytest 2.6.4
20715776 pytz 2014.10
20715777 requests 2.6.0
20715778 simplejson 3.6.5
20715779 six 1.9.0
20715780 sqlalchemy-migrate 0.9.1
20715781 sqlalchemy 0.9.8
20715782 stevedore 1.2.0
20715783 swiftclient 2.3.1
20715784 tox 1.8.1
20715785 troveclient 1.0.8
20715786 virtualenv 12.0.7
20715787 websockify 0.6.0
#!/usr/bin/python2.6
# Copyright (c) 2015, Oracle and/or its affiliates. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License"); you may
# not use this file except in compliance with the License. You may obtain
# a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
# WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
# License for the specific language governing permissions and limitations
# under the License.
from ConfigParser import NoOptionError
from datetime import datetime
import errno
import glob
import os
import shutil
from subprocess import check_call, Popen, PIPE
import sys
import time
import traceback
import iniparse
import smf_include
import sqlalchemy
NEUTRON_CONF_MAPPINGS = {
# Deprecated group/name
('DEFAULT', 'rabbit_durable_queues'): ('DEFAULT', 'amqp_durable_queues'),
('rpc_notifier2', 'topics'): ('DEFAULT', 'notification_topics'),
('DEFAULT', 'matchmaker_ringfile'): ('matchmaker_ring', 'ringfile'),
# As of Juno, EVS now uses the standard quota driver
('quotas', 'quota_driver'): (None, None)
}
DHCP_AGENT_MAPPINGS = {
# Deprecated group/name
('DEFAULT', 'dnsmasq_dns_server'): ('DEFAULT', 'dnsmasq_dns_servers'),
}
EVS_PLUGIN_MAPPINGS = {
# No longer referenced by the service
('DATABASE', 'sql_connection'): (None, None),
}
def update_mapping(section, key, mapping):
""" look for deprecated variables and, if found, convert it to the new
section/key.
"""
if (section, key) in mapping:
print "Deprecated value found: [%s] %s" % (section, key)
section, key = mapping[(section, key)]
if section is None and key is None:
print "Removing from configuration"
else:
print "Updating to: [%s] %s" % (section, key)
return section, key
def alter_mysql_tables(engine):
""" Convert MySQL tables to use utf8
"""
import MySQLdb
for _none in range(5):
try:
db = MySQLdb.connect(host=engine.url.host,
user=engine.url.username,
passwd=engine.url.password,
db=engine.url.database)
break
except MySQLdb.OperationalError as err:
# mysql is not ready. sleep for 2 more seconds
time.sleep(2)
else:
print "Unable to connect to MySQL: %s" % err
print ("Please verify MySQL is properly configured and online "
"before using svcadm(1M) to clear this service.")
sys.exit(smf_include.SMF_EXIT_ERR_FATAL)
cursor = db.cursor()
cursor.execute("ALTER DATABASE %s CHARACTER SET = 'utf8'" %
engine.url.database)
cursor.execute("ALTER DATABASE %s COLLATE = 'utf8_general_ci'" %
engine.url.database)
cursor.execute("SHOW tables")
res = cursor.fetchall()
if res:
cursor.execute("SET foreign_key_checks = 0")
for item in res:
cursor.execute("ALTER TABLE %s.%s CONVERT TO "
"CHARACTER SET 'utf8', COLLATE 'utf8_general_ci'"
% (engine.url.database, item[0]))
cursor.execute("SET foreign_key_checks = 1")
db.commit()
db.close()
def modify_conf(old_file, mapping=None):
""" Copy over all uncommented options from the old configuration file. In
addition, look for deprecated section/keys and convert them to the new
section/key.
"""
new_file = old_file + '.new'
# open the previous version
old = iniparse.ConfigParser()
old.readfp(open(old_file))
# open the new version
new = iniparse.ConfigParser()
try:
new.readfp(open(new_file))
except IOError as err:
if err.errno == errno.ENOENT:
# The upgrade did not deliver a .new file so, return
print "%s not found - continuing with %s" % (new_file, old_file)
return
else:
raise
print "\nupdating %s" % old_file
# walk every single section for uncommented options
default_items = set(old.items('DEFAULT'))
for section in old.sections() + ['DEFAULT']:
# DEFAULT items show up in every section so remove them
if section != 'DEFAULT':
section_items = set(old.items(section)) - default_items
else:
section_items = default_items
for key, value in section_items:
# keep a copy of the old value
oldvalue = value
if mapping is not None:
section, key = update_mapping(section, key, mapping)
if section is None and key is None:
# option is deprecated so continue
continue
if not new.has_section(section):
if section != 'DEFAULT':
new.add_section(section)
# print to the log when a value for the same section.key is
# changing to a new value
try:
new_value = new.get(section, key)
if new_value != value and '%SERVICE' not in new_value:
print "Changing [%s] %s:\n- %s\n+ %s" % \
(section, key, oldvalue, new_value)
print
except NoOptionError:
# the new configuration file does not have this option set so
# just continue
pass
# Only copy the old value to the new conf file if the entry doesn't
# exist or if it contains '%SERVICE'
if not new.has_option(section, key) or \
'%SERVICE' in new.get(section, key):
new.set(section, key, value)
# copy the old conf file to a backup
today = datetime.now().strftime("%Y%m%d%H%M%S")
shutil.copy2(old_file, old_file + '.' + today)
# copy the new conf file in place
with open(old_file, 'wb+') as fh:
new.write(fh)
def start():
# pull out the current version of config/upgrade-id
p = Popen(['/usr/bin/svcprop', '-p', 'config/upgrade-id',
os.environ['SMF_FMRI']], stdout=PIPE, stderr=PIPE)
curr_ver, _err = p.communicate()
curr_ver = curr_ver.strip()
# extract the openstack-upgrade-id from the pkg
p = Popen(['/usr/bin/pkg', 'contents', '-H', '-t', 'set', '-o', 'value',
'-a', 'name=openstack.upgrade-id',
'pkg:/cloud/openstack/neutron'], stdout=PIPE, stderr=PIPE)
pkg_ver, _err = p.communicate()
pkg_ver = pkg_ver.strip()
if curr_ver == pkg_ver:
# No need to upgrade
sys.exit(smf_include.SMF_EXIT_OK)
# look for any .new files
if glob.glob('/etc/neutron/*.new'):
# the versions are different, so perform an upgrade
# modify the configuration files
modify_conf('/etc/neutron/api-paste.ini')
modify_conf('/etc/neutron/dhcp_agent.ini', DHCP_AGENT_MAPPINGS)
modify_conf('/etc/neutron/l3_agent.ini')
modify_conf('/etc/neutron/neutron.conf', NEUTRON_CONF_MAPPINGS)
modify_conf('/etc/neutron/plugins/evs/evs_plugin.ini',
EVS_PLUGIN_MAPPINGS)
config = iniparse.RawConfigParser()
config.read('/etc/neutron/neutron.conf')
# In certain cases the database section does not exist and the
# default database chosen is sqlite.
if config.has_section('database'):
db_connection = config.get('database', 'connection')
engine = sqlalchemy.create_engine(db_connection)
# migrate EVS to Neutron db
if engine.url.username != '%SERVICE_USER%':
check_call(['/usr/lib/neutron/evs-neutron-migration'])
print "EVS to Neutron migration complete"
if engine.url.drivername == 'mysql':
alter_mysql_tables(engine)
print "altered character set to utf8 in neutron tables"
check_call(['/usr/bin/neutron-db-manage', '--config-file',
'/etc/neutron/neutron.conf', '--config-file',
'/etc/neutron/plugins/evs/evs_plugin.ini', 'stamp',
'juno'])
# update the current version
check_call(['/usr/sbin/svccfg', '-s', os.environ['SMF_FMRI'], 'setprop',
'config/upgrade-id', '=', pkg_ver])
check_call(['/usr/sbin/svccfg', '-s', os.environ['SMF_FMRI'], 'refresh'])
sys.exit(smf_include.SMF_EXIT_OK)
if __name__ == '__main__':
os.putenv('LC_ALL', 'C')
try:
smf_include.smf_main()
except Exception as err:
print 'Unknown error: %s' % err
print
traceback.print_exc(file=sys.stdout)
sys.exit(smf_include.SMF_EXIT_ERR_FATAL)