--- title: "Product Quality Measures for Testing" description: "This article deals with the Product Quality Measures for testing" author: "Uttam Misra" published: 2010-07-23 updated: 2020-03-17 canonical: https://www.mindstick.com/articles/109/product-quality-measures-for-testing category: "testing" tags: ["testing"] reading_time: 4 minutes --- # Product Quality Measures for Testing ##### This article deals with the Product Quality Measures for testing - [Customer satisfaction](https://www.mindstick.com/blog/11919/how-ai-can-help-businesses-to-increase-customer-satisfaction) index - Delivered defect quantities - Responsiveness (turnaround time) to users - Product volatility - Defect ratios - Defect removal efficiency - Complexity of delivered product - Test coverage - Cost of defects - Costs of quality activities - Re-work - Reliability and Metrics for Evaluating Application [System Testing](https://www.mindstick.com/blog/504/difference-between-system-testing-end-to-end-testing). ##### Customer satisfaction index - This index is surveyed before product delivery and after product delivery.The following are analyzed: - Number of system enhancement requests per year - Number of maintenance fix requests per year - User friendliness: call volume to [customer service](https://answers.mindstick.com/qa/105105/how-to-enhance-customer-service-with-mobile-technology) hotline - User friendliness: training time per new user - Number of product recalls or fix releases ([software vendors](https://answers.mindstick.com/qa/115991/how-can-you-benchmark-qms-reporting-capabilities-across-software-vendors-to-ensure-the-chosen-system)) - Number of production re-runs (in-house information systems groups) ##### Delivered defect quantities They are normalized per function point (or per LOC) at product delivery (first 3 months or first year of operation) or Ongoing (per year of operation) by level of severity, by category or cause, e.g.: requirements defect, design defect, code defect, [documentation](https://answers.mindstick.com/qa/30462/what-is-documentation)/on-line help defect, defect introduced by fixes, etc. ##### Responsiveness (turnaround time) to users - Turnaround time for defect fixes, by level of severity - Time for minor vs. major enhancements; actual vs. planned elapsed time ##### Product volatility Ratio of maintenance fixes (to repair the system & bring it into compliance with specifications), vs. enhancement requests (requests by users to enhance or change [functionality](https://www.mindstick.com/blog/136/using-watermark-functionality-in-textbox-by-jquery)) ##### Defect ratios - Defects found after product delivery per function point. - Defects found after product delivery per LOC - Pre-delivery defects: annual post-delivery defects - Defects per function point of the system modifications ##### Defect removal efficiency - Number of post-release defects (found by clients in field operation), categorized by level of severity - Ratio of defects found internally prior to release (via inspections and testing), as a percentage of all defects - All defects include defects found internally plus externally (by customers) in the first year after product delivery ##### Complexity of delivered product - McCabe's [cyclomatic complexity](https://www.mindstick.com/interview/583/what-is-cyclomatic-complexity) counts across the system - Halstead’s measure - Card's design complexity measures - Predicted defects and maintenance costs, based on complexity measures ##### Test coverage - Breadth of functional coverage - Percentage of paths, branches or conditions that were actually tested - Percentage by criticality level: perceived level of risk of paths - The ratio of the number of detected faults to the number of predicted faults. ##### Cost of defects - Business losses per defect that occurs during operation - Business interruption costs; costs of work-around - Lost sales and lost goodwill - Litigation costs resulting from defects - Annual [maintenance cost](https://answers.mindstick.com/qa/94486/which-car-brand-has-the-highest-and-lowest-maintenance-cost) (per function point) - Annual operating cost (per function point) - Measurable damage to your boss's career ##### Costs of quality activities - Costs of reviews, inspections and [preventive measures](https://answers.mindstick.com/qa/115612/what-preventive-measures-help-in-reducing-the-risk-of-infectious-viral-diseases) - Costs of test planning and preparation - Costs of test execution, defect tracking, version and change control - Costs of diagnostics, debugging and fixing - Costs of tools and tool support - Costs of test case library maintenance - Costs of testing & QA education associated with the product - Costs of monitoring and oversight by the QA organization (if separate from the development and test [organizations](https://yourviews.mindstick.com/view/84018/why-should-b2b-organizations-use-content-marketing)) ##### Re-work - Re-work effort (hours, as a percentage of the original coding hours) - Re-worked LOC (source lines of code, as a percentage of the total delivered LOC) - Re-worked software components (as a percentage of the total delivered components) ##### Reliability - Availability (percentage of time a system is available, versus the time the system is needed to be available) - Mean time between failure (MTBF). - Man time to repair (MTTR) - Reliability ratio (MTBF / MTTR) - Number of product recalls or fix releases - Number of production re-runs as a ratio of production runs --- Original Source: https://www.mindstick.com/articles/109/product-quality-measures-for-testing Copyright © MindStick Software Pvt. Ltd. This Markdown version is provided for developers, AI systems, and offline reading.