From Fedora Project Wiki
I am currently working to create some basic metrics to report on the activities on the BugZappers. My approach is to use the python-bugzilla package as much as possible.
Tools You Will Need
- The python-bugzilla package. (Try 'yum install python-bugzilla'
- The modified bugzilla CLI to add the --summary option. I suggest saving this as ~/bin/bzilla (only because that is what I have done)
Proposed Metrics
| Description | Status | Comments/Notes/Reference |
|---|---|---|
| # of Bugs 'Triaged' in the last xx days | DONE | See: [1] |
| # of Bugs 'Triaged' in the last xx days by Current Status | DONE | bzilla query --from-url='https://bugzilla.redhat.com/buglist.cgi?chfieldto=Now&query_format=advanced&chfield=keywords&chfieldfrom=-90d&chfieldvalue=Triaged&classification=Fedora&product=Fedora' --summary bug_status |
| # of Bugs 'Triaged' in the last xx days by Component | DONE | bzilla query --from-url='https://bugzilla.redhat.com/buglist.cgi?chfieldto=Now&query_format=advanced&chfield=keywords&chfieldfrom=-90d&chfieldvalue=Triaged&classification=Fedora&product=Fedora' --summary component |
| # of Bugs 'Triaged' in the last xx days by Triager | In Process | I am working on a patch to add the ability to query/display the bug history data via XMLRPC to the python-bugzilla package. This metric will provide the list of known active BugZappers. |
| # of 'Triaged' bugs CLOSED in last xx Days | DONE | See: [2] |
| # of 'Triaged' bugs CLOSED in last xx Days by Resolution | DONE | bzilla query --from-url='https://bugzilla.redhat.com/buglist.cgi?keywords=Triaged&chfieldto=Now&query_format=advanced&chfield=bug_status&keywords_type=allwords&chfieldfrom=-90d&chfieldvalue=CLOSED&bug_status=CLOSED&classification=Fedora&product=Fedora' --summary resolution |
| # of 'Triaged' bugs CLOSED in last xx Days by # of days since Triaged flag was set | PENDING | To know if/how 'Triaging' is impacting the life expectancy of bugs. (Need a better definition. How about 'Average number of days from Triaged to CLOSED by resolution for 'Triaged' bugs CLOSED in last xx days') |
| List of 'Triaged' bugs currently marked as NEEDINFO | PENDING | This should generally be an empty list. Bugs showing up here could be an indicator of poor Triaging. See: [3] (Is this useful. Remove?) |
| # of bugs CLOSED by BugZappers in last xx days | PENDING | Need a list of BugZappers |
| # of bugs CLOSED by BugZappers in last xx days by BugZapper | PENDING | Need a list of BugZappers |
| # of bugs CLOSED by BugZappers in last xx days by Resolution | PENDING | Need a list of BugZappers |
Additional Thoughts/Questions
- Q:Who are the BugZappers? A:BugZappers = Members of he Triagers group in FAS. But since this is not easy to scrape (and may included inactive persons) I am going to use the following definition. BugZappers = BugZilla users that have used the 'Triaged' flag in the previous 90 days.
- Eventually, these metrics should probably come from a SQL query. Pulling all this data via XMLRPC could be slow.
- Pretty graphs could be created showing how these metrics change (or don't) over time.
- What other metrics should we be tracking?
- Should these metric be limited to bugs where Product=Fedora & Classification=Fedora?
Current Metrics as of June 28, 2010
Bugs 'Triaged' in the last 60 Days: 229
Summary of Bugs 'Triaged' in the last 60 days by Current Status:
ASSIGNED - 54
CLOSED - 40
MODIFIED - 1
NEW - 132
ON_QA - 2
Summary of Bugs 'Triaged' in the last 60 days by Component:
PackageKit - 19
amarok - 2
anaconda - 1
banshee - 1
compiz - 2
compiz-fusion - 1
digikam - 1
epiphany - 1
evince - 1
evolution - 3
fedora-bookmarks - 1
firefox - 30
gcc - 1
glib2 - 1
glob2 - 1
gnome-desktop - 1
gnome-panel - 1
gnome-session - 1
initscripts - 4
java-1.6.0-openjdk - 1
k3b - 1
kcm-gtk - 1
kde-plasma-networkmanagement - 2
kdeaccessibility - 1
kdebase - 1
kdebase-workspace - 1
kdegraphics - 1
kdenetwork - 1
kdepim - 3
kdeutils - 1
kernel - 2
knetworkmanager - 2
libX11 - 2
libXfixes - 1
libdrm - 1
libtiff - 2
livecd-tools - 1
me-tv - 1
mesa - 2
phonon - 1
pixman - 1
preupgrade - 1
seamonkey - 4
strigi - 6
sugar - 1
system-config-display - 1
system-config-users - 1
thunderbird - 5
xine-lib - 2
xine-ui - 1
xorg-x11-drv-ati - 26
xorg-x11-drv-evdev - 1
xorg-x11-drv-intel - 22
xorg-x11-drv-nouveau - 24
xorg-x11-drv-radeonhd - 1
xorg-x11-drv-sis - 1
xorg-x11-drv-synaptics - 1
xorg-x11-drv-vmmouse - 3
xorg-x11-drv-vmware - 1
xorg-x11-drv-wacom - 6
xorg-x11-server - 12
xulrunner - 1
yum - 1
zlib - 4
# of 'Triaged' bugs CLOSED in last 60 Days: 476
Summary of 'Triaged' bugs CLOSED in last 60 Days by Resolution:
CANTFIX - 4
CURRENTRELEASE - 21
DEFERRED - 1
DUPLICATE - 23
ERRATA - 71
INSUFFICIENT_DATA - 53
NEXTRELEASE - 15
NOTABUG - 13
RAWHIDE - 147
UPSTREAM - 5
WONTFIX - 101
WORKSFORME - 22