|
|
| Line 1: |
Line 1: |
| I am currently working to create some basic metrics to report on the activities on the [[BugZappers]]. My approach is to use the [https://fedorahosted.org/python-bugzilla/ python-bugzilla] package as much as possible.
| | If you are looking for the BugZappers/Triage Metrics, they have been moved to [[BugZappers/Metrics]]. |
|
| |
|
| == Tools You Will Need==
| | The discussion regarding those metrics and how how to generate them has been moved to [[Talk:BugZappers/Metrics]]. |
| * The [https://fedorahosted.org/python-bugzilla/ python-bugzilla] package. (Try 'yum install python-bugzilla'
| |
| * [http://therabers.com/fedora/python-bugzilla/bzilla The modified bugzilla CLI] to add the --summary option. I suggest saving this as ~/bin/bzilla (only because that is what I have done)
| |
| | |
| == Proposed Metrics ==
| |
| {|
| |
| ! Description !! Status !! Comments/Notes/Reference
| |
| |-
| |
| |# of Bugs 'Triaged' in the last xx days || DONE || See: [https://bugzilla.redhat.com/buglist.cgi?cmdtype=dorem&remaction=run&namedcmd=BugsTriaged-Last30Day&sharer_id=273090]
| |
| |-
| |
| |# of Bugs 'Triaged' in the last xx days by Current Status || DONE || bzilla query --from-url='https://bugzilla.redhat.com/buglist.cgi?chfieldto=Now&query_format=advanced&chfield=keywords&chfieldfrom=-90d&chfieldvalue=Triaged&classification=Fedora&product=Fedora' --summary bug_status
| |
| |-
| |
| |# of Bugs 'Triaged' in the last xx days by Component || DONE || bzilla query --from-url='https://bugzilla.redhat.com/buglist.cgi?chfieldto=Now&query_format=advanced&chfield=keywords&chfieldfrom=-90d&chfieldvalue=Triaged&classification=Fedora&product=Fedora' --summary component
| |
| |-
| |
| |# of Bugs 'Triaged' in the last xx days by Triager || In Process || I am working on a patch to add the ability to query/display the bug history data via XMLRPC to the python-bugzilla package. This metric will provide the list of known active BugZappers.
| |
| |-
| |
| |# of 'Triaged' bugs CLOSED in last xx Days || DONE || See: [https://bugzilla.redhat.com/buglist.cgi?keywords=Triaged&chfieldto=Now&query_format=advanced&chfield=bug_status&keywords_type=allwords&chfieldfrom=-90d&chfieldvalue=CLOSED&bug_status=CLOSED&classification=Fedora&product=Fedora]
| |
| |-
| |
| |# of 'Triaged' bugs CLOSED in last xx Days by Resolution || DONE || bzilla query --from-url='https://bugzilla.redhat.com/buglist.cgi?keywords=Triaged&chfieldto=Now&query_format=advanced&chfield=bug_status&keywords_type=allwords&chfieldfrom=-90d&chfieldvalue=CLOSED&bug_status=CLOSED&classification=Fedora&product=Fedora' --summary resolution
| |
| |-
| |
| |# of 'Triaged' bugs CLOSED in last xx Days by # of days since Triaged flag was set || PENDING || To know if/how 'Triaging' is impacting the life expectancy of bugs. (Need a better definition. How about 'Average number of days from Triaged to CLOSED by resolution for 'Triaged' bugs CLOSED in last xx days')
| |
| |-
| |
| |List of 'Triaged' bugs currently marked as NEEDINFO || PENDING || This should generally be an empty list. Bugs showing up here could be an indicator of poor Triaging. See: [https://bugzilla.redhat.com/buglist.cgi?type0-1-0=allwords&field0-1-0=flagtypes.name&field0-0-0=flagtypes.name&classification=Fedora&query_format=advanced&value0-1-0=Triaged&bug_status=NEW&bug_status=ASSIGNED&bug_status=MODIFIED&bug_status=ON_DEV&type0-0-0=allwords&value0-0-0=NEEDINFO&product=Fedora] (Is this useful. Remove?)
| |
| |-
| |
| |# of bugs CLOSED by BugZappers in last xx days || PENDING || Need a list of BugZappers
| |
| |-
| |
| |# of bugs CLOSED by BugZappers in last xx days by BugZapper|| PENDING ||Need a list of BugZappers
| |
| |-
| |
| |# of bugs CLOSED by BugZappers in last xx days by Resolution|| PENDING ||Need a list of BugZappers
| |
| |}
| |
| | |
| == Additional Thoughts/Questions ==
| |
| * Q:Who are the BugZappers? A:BugZappers = Members of he Triagers group in FAS. But since this is not easy to scrape (and may included inactive persons) I am going to use the following definition. BugZappers = BugZilla users that have used the 'Triaged' flag in the previous 90 days.
| |
| * Eventually, these metrics should probably come from a SQL query. Pulling all this data via XMLRPC could be slow.
| |
| * Pretty graphs could be created showing how these metrics change (or don't) over time.
| |
| * What other metrics should we be tracking?
| |
| * Should these metric be limited to bugs where Product=Fedora & Classification=Fedora?
| |
| | |
| | |
| == Triage Metrics as of July 6, 2010==
| |
| ===Who are the BugZappers===
| |
| AKA People that have used the 'triaged' flag in the last 90 days (and how many times they have used it)
| |
| {|
| |
| ! # of bug 'Triaged' !! User
| |
| |-
| |
| | 132|| mcepl@redhat.com
| |
| |-
| |
| | 64|| campbecg@fedoraproject.org
| |
| |-
| |
| | 29|| smparrish@gmail.com
| |
| |-
| |
| | 28|| rdieter@math.unl.edu
| |
| |-
| |
| | 25|| awilliam@redhat.com
| |
| |-
| |
| | 14|| rivanvx@gmail.com
| |
| |-
| |
| | 9|| thomasj@fedoraproject.org
| |
| |-
| |
| | 8|| iarlyy@gmail.com
| |
| |-
| |
| | 7|| jeff.raber@gmail.com
| |
| |-
| |
| | 4|| luigi.3010@gmail.com
| |
| |-
| |
| | 4|| drjohnson1@gmail.com
| |
| |-
| |
| | 2|| aamuuninen@gmx.de
| |
| |-
| |
| | 1|| tcpip4000@fedoraproject.org
| |
| |-
| |
| | 1|| nsoranzo@tiscali.it
| |
| |-
| |
| | 1|| fdc-bz@fcami.net
| |
| |-
| |
| | 1|| david.r@ultracar.co.uk
| |
| |-
| |
| | 1|| benjavalero@gmail.com
| |
| |-
| |
| |}
| |
| === Bugs 'Triaged' in the last 90 Days: 331===
| |
| | |
| {|
| |
| ! Current Status !! Number !! Percentage
| |
| |-
| |
| |ASSIGNED || 86 || 26%
| |
| |-
| |
| | CLOSED || 84 ||25%
| |
| |-
| |
| | MODIFIED || 1|| 0.3%
| |
| |-
| |
| | NEW || 156|| 47%
| |
| |-
| |
| | ON_QA || 4|| 1%
| |
| |-
| |
| |}
| |
| | |
| ===Summary of Bugs 'Triaged' in the last 90 days by Component:===
| |
| NetworkManager - 1
| |
| PackageKit - 19
| |
| abrt - 2
| |
| amarok - 2
| |
| anaconda - 1
| |
| banshee - 1
| |
| compiz - 3
| |
| compiz-fusion - 1
| |
| digikam - 1
| |
| easytag - 1
| |
| epiphany - 9
| |
| esc - 1
| |
| evince - 2
| |
| evolution - 3
| |
| fedora-bookmarks - 2
| |
| firefox - 42
| |
| gc - 1
| |
| gcc - 1
| |
| glib2 - 1
| |
| glibc - 4
| |
| glob2 - 1
| |
| gnome-desktop - 1
| |
| gnome-packagekit - 1
| |
| gnome-panel - 1
| |
| gnome-power-manager - 1
| |
| gnome-session - 1
| |
| gpgme - 1
| |
| gstreamer-plugins-good - 1
| |
| initscripts - 8
| |
| iptables - 1
| |
| java-1.6.0-openjdk - 1
| |
| k3b - 2
| |
| kcm-gtk - 1
| |
| kde-plasma-networkmanagement - 2
| |
| kdeaccessibility - 1
| |
| kdebase - 1
| |
| kdebase-workspace - 3
| |
| kdegraphics - 1
| |
| kdelibs - 1
| |
| kdenetwork - 1
| |
| kdepim - 3
| |
| kdeutils - 1
| |
| kernel - 3
| |
| knetworkmanager - 2
| |
| libX11 - 2
| |
| libXfixes - 1
| |
| libdrm - 1
| |
| libtiff - 2
| |
| lighttpd - 1
| |
| livecd-tools - 1
| |
| me-tv - 1
| |
| mesa - 2
| |
| pixman - 2
| |
| preupgrade - 2
| |
| quodlibet - 1
| |
| seamonkey - 4
| |
| selinux-policy - 1
| |
| strigi - 8
| |
| sugar - 1
| |
| system-config-display - 1
| |
| system-config-users - 1
| |
| system-setup-keyboard - 1
| |
| thunderbird - 15
| |
| xine-lib - 2
| |
| xine-ui - 1
| |
| xorg-x11-drv-ati - 33
| |
| xorg-x11-drv-evdev - 3
| |
| xorg-x11-drv-intel - 29
| |
| xorg-x11-drv-nouveau - 35
| |
| xorg-x11-drv-nv - 1
| |
| xorg-x11-drv-radeonhd - 1
| |
| xorg-x11-drv-sis - 1
| |
| xorg-x11-drv-synaptics - 2
| |
| xorg-x11-drv-vmmouse - 4
| |
| xorg-x11-drv-vmware - 1
| |
| xorg-x11-drv-wacom - 7
| |
| xorg-x11-font-utils - 1
| |
| xorg-x11-server - 18
| |
| xorg-x11-xinit - 1
| |
| xulrunner - 1
| |
| yum - 1
| |
| zlib - 3
| |
| | |
| ===# of 'Triaged' bugs CLOSED in last 90 Days: 625===
| |
| CANTFIX - 6
| |
| CURRENTRELEASE - 36
| |
| DEFERRED - 2
| |
| DUPLICATE - 35
| |
| ERRATA - 119
| |
| INSUFFICIENT_DATA - 57
| |
| NEXTRELEASE - 21
| |
| NOTABUG - 19
| |
| RAWHIDE - 185
| |
| UPSTREAM - 14
| |
| WONTFIX - 105
| |
| WORKSFORME - 26
| |
