Symbian developer community

 
Home > Wiki > Bug Tracker Metrics Guidelines
wiki

Bug Tracker Metrics Guidelines

From Symbian Developer Community

Jump to: navigation, search

Contents

Introduction

Bug Tracker Metrics is the tool for creating and running trend queries & metrics against the Symbian Foundation Bug Tracker database.

Bug Tracker Metrics extends trend reporting functionality in Bug Tracker, which is Symbian Foundation's implementation of Bugzilla.

Bug Tracker Metrics is Symbian Foundation's implementation of BugzillaMetrics, another open source tool.

Bug Tracker Metrics Tool Access
The tool is accessible at http://developer.symbian.org/bugtracker_metrics/ to anyone with a Symbian Foundation username & password.

What Bug Tracker Metrics Does

Bug Tracker Metrics provides:

  • Graphical definition of queries (drop-down lists)...


  • XML definition for more complex queries...


  • Two separate groups of reports: My Queries, which can be user-defined or Symbian Foundation-defined...

...and Common Metrics, which are defined by Symbian Foundation

  • ... as well as the ability to keep query definitions Private or make them Public

Bug Tracker Metrics Output

Bug Tracker Metrics results are initially in chart format, either line chart or stacked chart...



Bug Tracker Metrics Export Formats

Charts can be exported in JPEG fomat. Result data can be exported in Excel and HTML file formats. The HTML format result tables contain links back to Bug Tracker, listing the actual bugs that are behind the result figures...

The latest version of the tool allows you to save a static url associated with the result chart, so that you can easily refer to a result chart and its data.

Query Types

There are four basic types of query specification, each one counting in a different way.

  1. Count Events
    This counts events, for example the number of times any bugs have changed from NEW status to ASSIGNED status.
  2. Count Until
    This counts events until another event, for example the number of times any bugs have had comments added until they changed to RESOLVED status.
  3. Interval Length
    This measures the interval between two events, for example the interval between the creation of bugs and the point they change to RESOLVED status.
  4. Residence Time
    This measures the time of residence in a particular state, until a particular event, for example the time of residence of bugs in the NEW status until they are RESOLVED. Note that if bugs are switched from ASSIGNED back to NEW, this measure will add up each period of residence in the NEW status, until they change to RESOLVED status.

Publishing Formats

Any user can define and save queries in graphical format or in XML format. Generally, XML format is used for more complex queries and combinations of charts. A query defined in graphical format can also be viewed in XML format. However, if a change is made to a query definition in its XML view, the change can only be saved in XML format.

Queries can be saved as Public (i.e. visible to all users) or Private (i.e. visible only to that user).

Queries can only be promoted to the Common Metrics tab by the Bug Tracker Metrics administrator. A Common Metric is visible to all users but:

  • the definition is only visible in XML format
  • any changes to the definition can only be saved as a query in XML format

Symbian Foundation Standard Queries

Symbian Foundation has defined a number of standard queries via the Quality Metrics Working Group. These have been saved in Bug Tracker Metrics to the list of Queries with names that are prefixed 'SF'. In addition, one of the queries has been promoted to the Common Metrics tab.

The logical definitions underlying these queries can be found in Metric Definitions.

Symbian Foundation has made a number of changes in Bug Tracker from the standard implementation of Bugzilla. For this reason, many of the Common Metrics and Queries supplied by BugzillaMetrics do not work properly with the Bug Tracker database. So, for the moment, they have been removed from the lists of available Metrics and Queries.

What You Need To Remember

Symbian Foundation has introduced a new severity value to Bug Tracker called Feature. For the moment, in order to create queries that select only bugs (i.e. to exclude enhancements and Features) you need to select the four severity values which apply to bugs (i.e. critical, major, normal, minor).

Symbian Foundation is providing Bugzilla tracking functionality for "Incubation Projects" that aren't formally part of the platform yet. For the moment, the mechanism to do this is to have a separate classification value in Bug Tracker. In order to create queries that select only bugs which are part of the platform, you need to exclude this classification.

Detailed User Guide

A detailed user guide for BugzillaMetrics can be found in the "vanilla" Bugzilla Metrics guide

Retrieved from "http://developer.symbian.org/wiki/index.php/Bug_Tracker_Metrics_Guidelines"

Comments

Sign in to comment…