tools/gen-components
author Mike Sullivan <Mike.Sullivan@Oracle.COM>
Wed, 30 Mar 2016 10:07:29 -0700
changeset 5679 d91b8121bb2a
parent 5406 5ac656f02914
child 5682 94c0ca64c022
permissions -rwxr-xr-x
Sync with build 96.1.
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
3770
ca450a806cc1 20440888 Userland python tools should migrate to 2.7
John Beck <John.Beck@Oracle.COM>
parents: 2150
diff changeset
     1
#!/usr/bin/python2.7
1048
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
     2
#
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
     3
# CDDL HEADER START
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
     4
#
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
     5
# The contents of this file are subject to the terms of the
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
     6
# Common Development and Distribution License (the "License").
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
     7
# You may not use this file except in compliance with the License.
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
     8
#
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
     9
# You can obtain a copy of the license at usr/src/OPENSOLARIS.LICENSE
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    10
# or http://www.opensolaris.org/os/licensing.
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    11
# See the License for the specific language governing permissions
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    12
# and limitations under the License.
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    13
#
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    14
# When distributing Covered Code, include this CDDL HEADER in each
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    15
# file and include the License file at usr/src/OPENSOLARIS.LICENSE.
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    16
# If applicable, add the following below this CDDL HEADER, with the
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    17
# fields enclosed by brackets "[]" replaced with your own identifying
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    18
# information: Portions Copyright [yyyy] [name of copyright owner]
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    19
#
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    20
# CDDL HEADER END
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    21
#
5406
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
    22
# Copyright (c) 2012, 2016, Oracle and/or its affiliates. All rights reserved.
1048
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    23
#
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    24
#
1061
757624619bb3 15922912 Auto-generation of Userland gate list - Phase 4
Rich Burridge <rich.burridge@oracle.com>
parents: 1058
diff changeset
    25
# gen_components
2140
ba3091d7e9b6 19775104 Multiple TPNO's not being correctly displayed on Userland gatelist webpage
Rich Burridge <rich.burridge@oracle.com>
parents: 1205
diff changeset
    26
# A simple script to generate (on stdout), the component.html web page
ba3091d7e9b6 19775104 Multiple TPNO's not being correctly displayed on Userland gatelist webpage
Rich Burridge <rich.burridge@oracle.com>
parents: 1205
diff changeset
    27
# found at: http://userland.us.oracle.com/component-lists/s12.html
1048
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    28
#
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    29
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    30
import getopt
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    31
import os
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    32
import sys
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    33
5406
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
    34
from subprocess import Popen, PIPE
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
    35
1048
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    36
debug = False
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    37
1063
ce6e2ed3767e 15924689 Auto-generation of Userland gate list - Phase 5
Rich Burridge <rich.burridge@oracle.com>
parents: 1061
diff changeset
    38
# Hashtable of RE's, RM's and Teams keyed by component path.
1053
accc15fa8762 15878378 Auto-generation of Userland gate list - Phase 2
Rich Burridge <rich.burridge@oracle.com>
parents: 1048
diff changeset
    39
owners = {}
accc15fa8762 15878378 Auto-generation of Userland gate list - Phase 2
Rich Burridge <rich.burridge@oracle.com>
parents: 1048
diff changeset
    40
1048
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    41
# Initial HTML for the generated web page.
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    42
preamble = """
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    43
<html>
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    44
<head>
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    45
    <style type='text/css' media='screen'>
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    46
        @import '/css/demo_table.css';
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    47
        @import '/css/ColVis.css';
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    48
        @import '/css/ColReorder.css';
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    49
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    50
            tr.even:hover,  tr.even:hover td.sorting_1 ,
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    51
            tr.odd:hover,  tr.odd:hover td.sorting_1 {
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    52
                            background-color: gold;
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    53
            }
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    54
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    55
    </style>
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    56
    <script type='text/javascript' src='js/jquery.js'></script>
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    57
    <script type='text/javascript' src='js/jquery.dataTables.js'></script>
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    58
    <script type='text/javascript' src='js/ColReorder.js'></script>
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    59
    <script type='text/javascript' src='js/ColVis.js'></script>
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    60
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    61
    <script>
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    62
        $(document).ready(function() {
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    63
            $('#components').dataTable({
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    64
                "sDom": 'C<"clear">Rlfrtip',
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    65
                bPaginate: true,
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    66
                bFilter: true,
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    67
                bSort: true,
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    68
                iDisplayLength: -1,
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    69
                aLengthMenu: [ [ 10, 50, -1], [ 10, 50, 'All'] ]
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    70
            });
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    71
        });
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    72
    </script>
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    73
</head>
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    74
<body>
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    75
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    76
<h1>Userland Components</h1>
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    77
<p>
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    78
<table align='center' id='components'>
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    79
<thead>
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    80
<tr>
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    81
    <th>Component</th>
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    82
    <th>Version</th>
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    83
    <th>Gate Path</th>
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    84
    <th>Package(s)</th>
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    85
    <th>ARC Case(s)</th>
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    86
    <th>License(s)</th>
1061
757624619bb3 15922912 Auto-generation of Userland gate list - Phase 4
Rich Burridge <rich.burridge@oracle.com>
parents: 1058
diff changeset
    87
    <th>TPNO</th>
1058
34d7aaa03423 15886624 Auto-generation of Userland gate list - Phase 3
Rich Burridge <rich.burridge@oracle.com>
parents: 1053
diff changeset
    88
    <th>BugDB</th>
1053
accc15fa8762 15878378 Auto-generation of Userland gate list - Phase 2
Rich Burridge <rich.burridge@oracle.com>
parents: 1048
diff changeset
    89
    <th>RE</th>
accc15fa8762 15878378 Auto-generation of Userland gate list - Phase 2
Rich Burridge <rich.burridge@oracle.com>
parents: 1048
diff changeset
    90
    <th>RM</th>
1063
ce6e2ed3767e 15924689 Auto-generation of Userland gate list - Phase 5
Rich Burridge <rich.burridge@oracle.com>
parents: 1061
diff changeset
    91
    <th>Team</th>
1048
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    92
</tr>
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    93
</thead>
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    94
<tbody>
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    95
"""
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    96
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    97
# Final HTML for the generated web page.
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    98
postamble = """
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
    99
</tr>
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   100
</tbody>
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   101
</table>
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   102
</body>
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   103
</html>
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   104
"""
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   105
5406
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   106
# Get a complete list of package names for the repo associated with this
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   107
# Userland workspace.
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   108
def get_package_list(repo, build_version):
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   109
    names = []
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   110
    cmd = "pkgrepo list -H -s %s" % repo
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   111
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   112
    if debug:
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   113
        print >> sys.stderr, "get_package_list: command: `%s`" % cmd
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   114
    lines = os.popen(cmd).readlines()
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   115
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   116
    for line in lines:
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   117
        tokens = line.split()
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   118
        if tokens[2] != 'o' and tokens[2] != 'r':
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   119
            n = tokens[2].find(build_version)
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   120
            name = tokens[1] + "@" + tokens[2][:n]
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   121
            if debug:
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   122
                print >> sys.stderr, "get_package_list: name: ", name
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   123
            names.append(name)
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   124
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   125
    if debug:
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   126
        print >> sys.stderr, "get_package_list: names: ", names
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   127
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   128
    return names
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   129
1063
ce6e2ed3767e 15924689 Auto-generation of Userland gate list - Phase 5
Rich Burridge <rich.burridge@oracle.com>
parents: 1061
diff changeset
   130
# Return a hashtable of RE's, RM's and Teams keyed by component path.
1053
accc15fa8762 15878378 Auto-generation of Userland gate list - Phase 2
Rich Burridge <rich.burridge@oracle.com>
parents: 1048
diff changeset
   131
def read_owners(owners_file):
accc15fa8762 15878378 Auto-generation of Userland gate list - Phase 2
Rich Burridge <rich.burridge@oracle.com>
parents: 1048
diff changeset
   132
    if debug:
accc15fa8762 15878378 Auto-generation of Userland gate list - Phase 2
Rich Burridge <rich.burridge@oracle.com>
parents: 1048
diff changeset
   133
        print >> sys.stderr, "Reading %s" % owners_file
accc15fa8762 15878378 Auto-generation of Userland gate list - Phase 2
Rich Burridge <rich.burridge@oracle.com>
parents: 1048
diff changeset
   134
    try:
accc15fa8762 15878378 Auto-generation of Userland gate list - Phase 2
Rich Burridge <rich.burridge@oracle.com>
parents: 1048
diff changeset
   135
        fin = open(owners_file, 'r')
accc15fa8762 15878378 Auto-generation of Userland gate list - Phase 2
Rich Burridge <rich.burridge@oracle.com>
parents: 1048
diff changeset
   136
        lines = fin.readlines()
accc15fa8762 15878378 Auto-generation of Userland gate list - Phase 2
Rich Burridge <rich.burridge@oracle.com>
parents: 1048
diff changeset
   137
        fin.close()
accc15fa8762 15878378 Auto-generation of Userland gate list - Phase 2
Rich Burridge <rich.burridge@oracle.com>
parents: 1048
diff changeset
   138
    except:
accc15fa8762 15878378 Auto-generation of Userland gate list - Phase 2
Rich Burridge <rich.burridge@oracle.com>
parents: 1048
diff changeset
   139
        if debug:
accc15fa8762 15878378 Auto-generation of Userland gate list - Phase 2
Rich Burridge <rich.burridge@oracle.com>
parents: 1048
diff changeset
   140
            print >> sys.stderr, "Unable to read owners file: %s" % owners_file
accc15fa8762 15878378 Auto-generation of Userland gate list - Phase 2
Rich Burridge <rich.burridge@oracle.com>
parents: 1048
diff changeset
   141
accc15fa8762 15878378 Auto-generation of Userland gate list - Phase 2
Rich Burridge <rich.burridge@oracle.com>
parents: 1048
diff changeset
   142
    owners = {}
accc15fa8762 15878378 Auto-generation of Userland gate list - Phase 2
Rich Burridge <rich.burridge@oracle.com>
parents: 1048
diff changeset
   143
    for line in lines:
accc15fa8762 15878378 Auto-generation of Userland gate list - Phase 2
Rich Burridge <rich.burridge@oracle.com>
parents: 1048
diff changeset
   144
        line = line[:-1]
1063
ce6e2ed3767e 15924689 Auto-generation of Userland gate list - Phase 5
Rich Burridge <rich.burridge@oracle.com>
parents: 1061
diff changeset
   145
        component, re, rm, team = line.split("|")
ce6e2ed3767e 15924689 Auto-generation of Userland gate list - Phase 5
Rich Burridge <rich.burridge@oracle.com>
parents: 1061
diff changeset
   146
        owners[component] = [ re, rm, team ]
1053
accc15fa8762 15878378 Auto-generation of Userland gate list - Phase 2
Rich Burridge <rich.burridge@oracle.com>
parents: 1048
diff changeset
   147
accc15fa8762 15878378 Auto-generation of Userland gate list - Phase 2
Rich Burridge <rich.burridge@oracle.com>
parents: 1048
diff changeset
   148
    return owners
accc15fa8762 15878378 Auto-generation of Userland gate list - Phase 2
Rich Burridge <rich.burridge@oracle.com>
parents: 1048
diff changeset
   149
1048
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   150
# Return a sorted list of the directories containing one or more .p5m files.
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   151
def find_p5m_dirs(workspace):
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   152
    p5m_dirs = []
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   153
    for dir, _, files in os.walk(workspace + "/components"):
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   154
        for file in files:
5406
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   155
            if dir.endswith("meta-packages/developer-opensolaris-userland"):
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   156
                continue;
2150
1acc968ac0d9 19807306 Userland gatelist shouldn't show entry for the "Package History" component
Rich Burridge <rich.burridge@oracle.com>
parents: 2140
diff changeset
   157
            if dir.endswith("meta-packages/history"):
1acc968ac0d9 19807306 Userland gatelist shouldn't show entry for the "Package History" component
Rich Burridge <rich.burridge@oracle.com>
parents: 2140
diff changeset
   158
                continue;
1048
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   159
            if file.endswith(".p5m"):
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   160
                p5m_dirs.append(dir)
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   161
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   162
    return sorted(list(set(p5m_dirs)))
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   163
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   164
# Write out the initial HTML for the components.html web page.
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   165
def write_preamble():
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   166
    print preamble
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   167
1063
ce6e2ed3767e 15924689 Auto-generation of Userland gate list - Phase 5
Rich Burridge <rich.burridge@oracle.com>
parents: 1061
diff changeset
   168
# Return the RE,  RM and Team for this component.
ce6e2ed3767e 15924689 Auto-generation of Userland gate list - Phase 5
Rich Burridge <rich.burridge@oracle.com>
parents: 1061
diff changeset
   169
def get_owner(p5m_dir):
ce6e2ed3767e 15924689 Auto-generation of Userland gate list - Phase 5
Rich Burridge <rich.burridge@oracle.com>
parents: 1061
diff changeset
   170
    result = [ "Unknown", "Unknown", "Unknown" ]
1053
accc15fa8762 15878378 Auto-generation of Userland gate list - Phase 2
Rich Burridge <rich.burridge@oracle.com>
parents: 1048
diff changeset
   171
    component_path = ""
accc15fa8762 15878378 Auto-generation of Userland gate list - Phase 2
Rich Burridge <rich.burridge@oracle.com>
parents: 1048
diff changeset
   172
    started = False
accc15fa8762 15878378 Auto-generation of Userland gate list - Phase 2
Rich Burridge <rich.burridge@oracle.com>
parents: 1048
diff changeset
   173
    tokens = p5m_dir.split("/")
accc15fa8762 15878378 Auto-generation of Userland gate list - Phase 2
Rich Burridge <rich.burridge@oracle.com>
parents: 1048
diff changeset
   174
    for token in tokens:
accc15fa8762 15878378 Auto-generation of Userland gate list - Phase 2
Rich Burridge <rich.burridge@oracle.com>
parents: 1048
diff changeset
   175
        if started:
accc15fa8762 15878378 Auto-generation of Userland gate list - Phase 2
Rich Burridge <rich.burridge@oracle.com>
parents: 1048
diff changeset
   176
            component_path += token + "/"
accc15fa8762 15878378 Auto-generation of Userland gate list - Phase 2
Rich Burridge <rich.burridge@oracle.com>
parents: 1048
diff changeset
   177
        if token == "components":
accc15fa8762 15878378 Auto-generation of Userland gate list - Phase 2
Rich Burridge <rich.burridge@oracle.com>
parents: 1048
diff changeset
   178
            started = True
accc15fa8762 15878378 Auto-generation of Userland gate list - Phase 2
Rich Burridge <rich.burridge@oracle.com>
parents: 1048
diff changeset
   179
    component_path = component_path[:-1]
accc15fa8762 15878378 Auto-generation of Userland gate list - Phase 2
Rich Burridge <rich.burridge@oracle.com>
parents: 1048
diff changeset
   180
    if component_path in owners:
1063
ce6e2ed3767e 15924689 Auto-generation of Userland gate list - Phase 5
Rich Burridge <rich.burridge@oracle.com>
parents: 1061
diff changeset
   181
        result = owners[component_path]
1053
accc15fa8762 15878378 Auto-generation of Userland gate list - Phase 2
Rich Burridge <rich.burridge@oracle.com>
parents: 1048
diff changeset
   182
    if debug:
accc15fa8762 15878378 Auto-generation of Userland gate list - Phase 2
Rich Burridge <rich.burridge@oracle.com>
parents: 1048
diff changeset
   183
        print >> sys.stderr, "Component path: ", component_path,
1063
ce6e2ed3767e 15924689 Auto-generation of Userland gate list - Phase 5
Rich Burridge <rich.burridge@oracle.com>
parents: 1061
diff changeset
   184
        print >> sys.stderr, "RE, RM, Team: ", result
5406
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   185
1063
ce6e2ed3767e 15924689 Auto-generation of Userland gate list - Phase 5
Rich Burridge <rich.burridge@oracle.com>
parents: 1061
diff changeset
   186
    return result
1053
accc15fa8762 15878378 Auto-generation of Userland gate list - Phase 2
Rich Burridge <rich.burridge@oracle.com>
parents: 1048
diff changeset
   187
1048
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   188
# Generate an HTML table entry for all the information for the component
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   189
# in the given directory. This generates a file called 'component-report'
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   190
# under the components build directory.
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   191
def gen_reports(workspace, component_dir):
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   192
    if debug:
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   193
        print >> sys.stderr, "Processing %s" % component_dir
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   194
1063
ce6e2ed3767e 15924689 Auto-generation of Userland gate list - Phase 5
Rich Burridge <rich.burridge@oracle.com>
parents: 1061
diff changeset
   195
    re, rm, team = get_owner(component_dir)
1048
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   196
    makefiles = "-f Makefile -f %s/make-rules/component-report" % workspace
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   197
    targets = "clean component-hook"
1063
ce6e2ed3767e 15924689 Auto-generation of Userland gate list - Phase 5
Rich Burridge <rich.burridge@oracle.com>
parents: 1061
diff changeset
   198
    template = "cd %s; "
ce6e2ed3767e 15924689 Auto-generation of Userland gate list - Phase 5
Rich Burridge <rich.burridge@oracle.com>
parents: 1061
diff changeset
   199
    template += "RESPONSIBLE_ENGINEER='%s' "
ce6e2ed3767e 15924689 Auto-generation of Userland gate list - Phase 5
Rich Burridge <rich.burridge@oracle.com>
parents: 1061
diff changeset
   200
    template += "RESPONSIBLE_MANAGER='%s' "
ce6e2ed3767e 15924689 Auto-generation of Userland gate list - Phase 5
Rich Burridge <rich.burridge@oracle.com>
parents: 1061
diff changeset
   201
    template += "TEAM='%s' "
ce6e2ed3767e 15924689 Auto-generation of Userland gate list - Phase 5
Rich Burridge <rich.burridge@oracle.com>
parents: 1061
diff changeset
   202
    template += "gmake COMPONENT_HOOK='gmake %s component-report' %s"
2140
ba3091d7e9b6 19775104 Multiple TPNO's not being correctly displayed on Userland gatelist webpage
Rich Burridge <rich.burridge@oracle.com>
parents: 1205
diff changeset
   203
    cmd = template % (component_dir, re, rm, team, makefiles, targets)
1048
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   204
1053
accc15fa8762 15878378 Auto-generation of Userland gate list - Phase 2
Rich Burridge <rich.burridge@oracle.com>
parents: 1048
diff changeset
   205
    if debug:
accc15fa8762 15878378 Auto-generation of Userland gate list - Phase 2
Rich Burridge <rich.burridge@oracle.com>
parents: 1048
diff changeset
   206
        print >> sys.stderr, "gen_reports: command: `%s`" % cmd
1048
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   207
    lines = os.popen(cmd).readlines()
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   208
5406
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   209
# The package name(s) in the component-report files will be incorrectly
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   210
# generated if there was a <whatever>VER.p5m file in the component
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   211
# directory. For those components we've got to use the package names
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   212
# from the repo associated with this Userland workspace.
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   213
def fix_reports(p5m_dirs, package_names):
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   214
    for p5m_dir in p5m_dirs:
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   215
        cmd = "ls %s/*VER.p5m" % p5m_dir
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   216
        p = Popen(cmd, shell=True, stdin=PIPE, stdout=PIPE, stderr=PIPE,
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   217
                  close_fds=True)
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   218
        output = p.stdout.read()
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   219
        if output.find(".p5m") == -1:
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   220
            continue
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   221
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   222
        report = "%s/build/component-report" % p5m_dir
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   223
        with open(report, 'r') as fin:
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   224
            lines = fin.readlines()
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   225
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   226
        fixed = False
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   227
        td_count = 0
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   228
        report = "%s/build/component-report" % p5m_dir
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   229
        fout = open(report, 'w')
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   230
        for line in lines:
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   231
            if not fixed and td_count == 4 and line.startswith("</td>"):
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   232
                fixed = True
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   233
            elif not fixed and td_count == 4:
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   234
                n = line.rfind("[email protected]")
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   235
                if n != -1:
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   236
                    if debug:
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   237
                        print >> sys.stderr, "FIX: %s" % line
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   238
                    broken_pkg_name = line[:n]
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   239
                    for package_name in package_names:
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   240
                        if package_name.startswith(broken_pkg_name):
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   241
                            line = "%s<br>\n" % package_name
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   242
                            fout.write(line)
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   243
                else:
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   244
                    fout.write(line)
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   245
                continue
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   246
            elif line.startswith("<td>"):
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   247
                td_count += 1
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   248
            fout.write(line)
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   249
        fout.close()
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   250
1048
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   251
# Collect all the .../build/component-report files and write them to stdout.
1053
accc15fa8762 15878378 Auto-generation of Userland gate list - Phase 2
Rich Burridge <rich.burridge@oracle.com>
parents: 1048
diff changeset
   252
def write_reports(p5m_dirs, owners_file):
1048
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   253
    for p5m_dir in p5m_dirs:
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   254
        report = "%s/build/component-report" % p5m_dir
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   255
        if debug:
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   256
            print >> sys.stderr, "Reading %s" % report
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   257
        try:
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   258
            fin = open(report, 'r')
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   259
            lines = fin.readlines()
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   260
            fin.close()
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   261
            sys.stdout.writelines(lines)
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   262
        except:
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   263
            if debug:
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   264
                print >> sys.stderr, "Unable to read: %s" % report
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   265
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   266
# Write out the final HTML for the components.html web page.
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   267
def write_postamble():
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   268
    print postamble
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   269
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   270
# Write out a usage message showing valid options to this script.
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   271
def usage():
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   272
    print  >> sys.stderr, \
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   273
"""
5406
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   274
Usage:
1139
2fe2a52488cb 16245054 Auto-generation of Userland gate list - Phase 6
Rich Burridge <rich.burridge@oracle.com>
parents: 1063
diff changeset
   275
      gen-components [OPTION...]
1048
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   276
5406
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   277
-b, --build-version
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   278
      Build version script to look for (and strip off) from package FMRIs.
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   279
1048
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   280
-d, --debug
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   281
      Turn on debugging
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   282
1053
accc15fa8762 15878378 Auto-generation of Userland gate list - Phase 2
Rich Burridge <rich.burridge@oracle.com>
parents: 1048
diff changeset
   283
-o, --owners
accc15fa8762 15878378 Auto-generation of Userland gate list - Phase 2
Rich Burridge <rich.burridge@oracle.com>
parents: 1048
diff changeset
   284
      Location of a file containing a list of RE's /RM's per component
accc15fa8762 15878378 Auto-generation of Userland gate list - Phase 2
Rich Burridge <rich.burridge@oracle.com>
parents: 1048
diff changeset
   285
5406
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   286
-r, --repo
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   287
      Repo containing the packages associated with this Userland workspace
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   288
1048
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   289
-w --workspace
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   290
      Location of the Userland workspace
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   291
"""
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   292
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   293
    sys.exit(1)
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   294
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   295
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   296
if __name__ == "__main__":
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   297
    workspace = os.getenv('WS_TOP')
1139
2fe2a52488cb 16245054 Auto-generation of Userland gate list - Phase 6
Rich Burridge <rich.burridge@oracle.com>
parents: 1063
diff changeset
   298
    owners_file = "/net/userland.us.oracle.com/gates/private/RE-RM-list.txt"
5406
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   299
    repo = "http://userland.us.oracle.com:10004/"
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   300
    build_version = "-5.12.0.0.0"
1048
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   301
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   302
    try:
5406
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   303
        opts, args = getopt.getopt(sys.argv[1:], "b:do:r:w:",
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   304
            [ "build-version=", "debug", "owners=", "repo=", "workspace=" ])
1048
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   305
    except getopt.GetoptError, err:
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   306
        print str(err)
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   307
        usage()
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   308
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   309
    for opt, arg in opts:
5406
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   310
        if opt in [ "-b", "--build-version" ]:
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   311
            build_version = arg
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   312
        elif opt in [ "-d", "--debug" ]:
1053
accc15fa8762 15878378 Auto-generation of Userland gate list - Phase 2
Rich Burridge <rich.burridge@oracle.com>
parents: 1048
diff changeset
   313
            debug = True
accc15fa8762 15878378 Auto-generation of Userland gate list - Phase 2
Rich Burridge <rich.burridge@oracle.com>
parents: 1048
diff changeset
   314
        elif opt in [ "-o", "--owners" ]:
accc15fa8762 15878378 Auto-generation of Userland gate list - Phase 2
Rich Burridge <rich.burridge@oracle.com>
parents: 1048
diff changeset
   315
            owners_file = arg
5406
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   316
        elif opt in [ "-r", "--repo" ]:
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   317
            repo = arg
1053
accc15fa8762 15878378 Auto-generation of Userland gate list - Phase 2
Rich Burridge <rich.burridge@oracle.com>
parents: 1048
diff changeset
   318
        elif opt in [ "-w", "--workspace" ]:
1048
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   319
            workspace = arg
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   320
        else:
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   321
            assert False, "unknown option"
5406
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   322
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   323
    package_names = get_package_list(repo, build_version)
1053
accc15fa8762 15878378 Auto-generation of Userland gate list - Phase 2
Rich Burridge <rich.burridge@oracle.com>
parents: 1048
diff changeset
   324
    owners = read_owners(owners_file)
1048
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   325
    write_preamble()
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   326
    p5m_dirs = find_p5m_dirs(workspace)
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   327
    for p5m_dir in p5m_dirs:
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   328
        gen_reports(workspace, p5m_dir)
5406
5ac656f02914 22666618 Userland gate list package names are wrong if component has a whateverVER.p5m
Rich Burridge <rich.burridge@oracle.com>
parents: 3770
diff changeset
   329
    fix_reports(p5m_dirs, package_names)
1053
accc15fa8762 15878378 Auto-generation of Userland gate list - Phase 2
Rich Burridge <rich.burridge@oracle.com>
parents: 1048
diff changeset
   330
    write_reports(p5m_dirs, owners_file)
1048
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   331
    write_postamble()
e82fa02a4d16 15863968 Auto-generation of Userland gate list - Phase 1.
Rich Burridge <rich.burridge@oracle.com>
parents:
diff changeset
   332
    sys.exit(0)