The Problem with Consumer Reports Testing

October 13, 2013 3 min read

A man holding his hand in a

How to Answer the comment “Consumer Reports says XYZ brand was rated the best”? Even though this is from 2007 it still shows the problem with Consumer Reports test Results.

In response to many requests from architects and specifiers throughout the United States, MPI (Master Painters Institute) acquired the 2007 report from “Consumer Reports” on paint.

MPI then sent out “mystery shoppers” in Washington State to purchase the top five products listed as by Consumer Reports as “CR Quick Recommendations” and “Best for high-traffic areas.” The products obtained, and tested, were those identified by Consumer Reports.

“High scores for staining and scrubbing, and resisted gloss changes.”

  • “Behr CR Best Buy”
  • “Kilz CR Best Buy”
  • "Valspar"
  • “True Value CR Best Buy”
  • “Dutch Boy CR Best Buy”

It has been the position of MPI, as well as major specifiers and users, that paint products formulated for the consumer or DIY markets have different pros and cons from those products specified for commercial and institutional market segments where performance and durability are of much more concern than aspects such as application properties and spatter resistance.


MPI has requested information on test methods and the ‘weighting’ of characteristics from Consumer Reports – all without success. On the other hand, the test methods used by MPI are published and are either ASTM, or those approved by major users such as the paint experts at Navy Facilities, Army Corps of Engineers, GSA, etc.. MPI paint standards replaced GSA-maintained U.S. Paint Specifications in 2000. The MPI paint standards are used by both the U.S. and Canadian Governments.


The “high-traffic” areas in both the master guide specification (UFGS) for all Department of Defense facilities (e.g. Navy, Air Force, Army, and Marine military facilities, NASA, etc.) and the master guide specification used by the American Institute of Architects MasterSpec® call for paints in an MPI category entitled “High-performance Architectural Latex”. The UFGS says for “High Traffic Areas”. The AIA MasterSpec® says “High-Performance architectural latex systems are used in interior locations subject to high traffic.”


Although some specifiers would prefer a higher gloss and sheen than the “low-luster” used by Consumer Reports for “high-traffic” areas, MPI used the category for MPI Gloss Level 2 in order to provide an apples-to-apples comparison with that listed by Consumer Reports (even though the 5 listed were all not the same gloss and sheen). That category is MPI #138 (High-Performance Architectural Latex – Gloss Level 2).


Summary


Only 1 of the 5 passed qualification tests for performance contained in the test standards and protocol for MPI #138. Some failed cleanability or burnish resistance, or scrub ability, etc.


For reference, MPI’s minimum number of scrub cycles for this standard is 3000, but 1 of the 5 Consumer Reports “Best for high-traffic areas” products actually failed by film breakthrough observed as early as 319 cycles.


That only 1 of the top 5 of Consumers Reports “Best for high-traffic areas” paints passed the MPI performance standards does not indicate that the products tested are not good paint products, but it does indicate that the performance and durability standards needed for commercial projects are somewhat more stringent. Until accepted performance test methods are adopted by any consumer product testing, perhaps professional specifiers of commercial products should avoid DIY paint recommendations for commercial and institutional projects.



Also in Our Blog

Benjamin Moore 2023 Color of the Year palette available at Gleco Paint
2023 Color Trends Turn Heads

October 13, 2022 2 min read

Discover the eight exceptional hues each selected for their distinct presence and personality, all of them sure to push creative buttons and design boundaries while inspiring greater color confidence.
Read More
Benjamin Moore Color of the Year 2023: Raspberry Blush 2008-30 at Gleco Paint
Benjamin Moore Color of the Year 2023: Raspberry Blush 2008-30

October 12, 2022 2 min read

Bold is BACK, baby! Benjamin Moore has made a brazen statement by choosing the charismatic Raspberry Blush 2008-30 as its 2023 Color of the Year.
Read More
YES, YOUR HOME CAN WEAR WHITE AFTER LABOR DAY (SO GET OVER IT!)
YES, YOUR HOME CAN WEAR WHITE AFTER LABOR DAY (SO GET OVER IT!)

September 01, 2022 2 min read

The old school thinking that you can’t wear white after Labour Day is as silly as believing you can’t drink coffee on days that end in Y. And we simply don’t want to live in a world where either is true.
Read More