The Problem with Consumer Reports Testing

October 13, 2013 3 min read

A man holding his hand in a

How to Answer the comment “Consumer Reports says XYZ brand was rated the best”? Even though this is from 2007 it still shows the problem with Consumer Reports test Results.

In response to many requests from architects and specifiers throughout the United States, MPI (Master Painters Institute) acquired the 2007 report from “Consumer Reports” on paint.

MPI then sent out “mystery shoppers” in Washington State to purchase the top five products listed as by Consumer Reports as “CR Quick Recommendations” and “Best for high-traffic areas.” The products obtained, and tested, were those identified by Consumer Reports.

“High scores for staining and scrubbing, and resisted gloss changes.”

  • “Behr CR Best Buy”
  • “Kilz CR Best Buy”
  • "Valspar"
  • “True Value CR Best Buy”
  • “Dutch Boy CR Best Buy”

It has been the position of MPI, as well as major specifiers and users, that paint products formulated for the consumer or DIY markets have different pros and cons from those products specified for commercial and institutional market segments where performance and durability are of much more concern than aspects such as application properties and spatter resistance.


MPI has requested information on test methods and the ‘weighting’ of characteristics from Consumer Reports – all without success. On the other hand, the test methods used by MPI are published and are either ASTM, or those approved by major users such as the paint experts at Navy Facilities, Army Corps of Engineers, GSA, etc.. MPI paint standards replaced GSA-maintained U.S. Paint Specifications in 2000. The MPI paint standards are used by both the U.S. and Canadian Governments.


The “high-traffic” areas in both the master guide specification (UFGS) for all Department of Defense facilities (e.g. Navy, Air Force, Army, and Marine military facilities, NASA, etc.) and the master guide specification used by the American Institute of Architects MasterSpec® call for paints in an MPI category entitled “High-performance Architectural Latex”. The UFGS says for “High Traffic Areas”. The AIA MasterSpec® says “High-Performance architectural latex systems are used in interior locations subject to high traffic.”


Although some specifiers would prefer a higher gloss and sheen than the “low-luster” used by Consumer Reports for “high-traffic” areas, MPI used the category for MPI Gloss Level 2 in order to provide an apples-to-apples comparison with that listed by Consumer Reports (even though the 5 listed were all not the same gloss and sheen). That category is MPI #138 (High-Performance Architectural Latex – Gloss Level 2).


Summary


Only 1 of the 5 passed qualification tests for performance contained in the test standards and protocol for MPI #138. Some failed cleanability or burnish resistance, or scrub ability, etc.


For reference, MPI’s minimum number of scrub cycles for this standard is 3000, but 1 of the 5 Consumer Reports “Best for high-traffic areas” products actually failed by film breakthrough observed as early as 319 cycles.


That only 1 of the top 5 of Consumers Reports “Best for high-traffic areas” paints passed the MPI performance standards does not indicate that the products tested are not good paint products, but it does indicate that the performance and durability standards needed for commercial projects are somewhat more stringent. Until accepted performance test methods are adopted by any consumer product testing, perhaps professional specifiers of commercial products should avoid DIY paint recommendations for commercial and institutional projects.



Also in Our Blog

Color Trends 2022 Palette is available at Gleco Paint in Easton, Scranton & Mt. Pocono, PA.
Coming of Sage: The 2022 Color of the Year is… OCTOBER MIST 1495

October 13, 2021 2 min read

Grounded but with a dreamlike quality, October Mist 1495 – a gently shaded, uplifting sage green – has been selected as Benjamin Moore’s Color of the Year for 2022.
Read More
October Mist 1495 is available at Gleco Paint in Easton, Scranton & Mt. Pocono, PA.
OCTOBER MIST: MEET THE COLOR OF THE YEAR 2022

October 13, 2021 1 min read

Make room for creativity with October Mist 1495, Benjamin Moore’s Color of the Year for 2022. October Mist is part of the Color Trends 2022 palette, a collection that reflects the positivity we want to see and feel in the colors we choose to surround ourselves with.
Read More
YES, YOUR HOME CAN WEAR WHITE AFTER LABOR DAY (SO GET OVER IT!)
YES, YOUR HOME CAN WEAR WHITE AFTER LABOR DAY (SO GET OVER IT!)

August 30, 2021 2 min read

The old school thinking that you can’t wear white after Labour Day is as silly as believing you can’t drink coffee on days that end in Y. And we simply don’t want to live in a world where either is true.
Read More