The Problem with Consumer Reports Testing

October 13, 2013 3 min read

A man holding his hand in a

How to Answer the comment “Consumer Reports says XYZ brand was rated the best”? Even though this is from 2007 it still shows the problem with Consumer Reports test Results.

In response to many requests from architects and specifiers throughout the United States, MPI (Master Painters Institute) acquired the 2007 report from “Consumer Reports” on paint.

MPI then sent out “mystery shoppers” in Washington State to purchase the top five products listed as by Consumer Reports as “CR Quick Recommendations” and “Best for high-traffic areas.” The products obtained, and tested, were those identified by Consumer Reports.

“High scores for staining and scrubbing, and resisted gloss changes.”

  • “Behr CR Best Buy”
  • “Kilz CR Best Buy”
  • "Valspar"
  • “True Value CR Best Buy”
  • “Dutch Boy CR Best Buy”

It has been the position of MPI, as well as major specifiers and users, that paint products formulated for the consumer or DIY markets have different pros and cons from those products specified for commercial and institutional market segments where performance and durability are of much more concern than aspects such as application properties and spatter resistance.


MPI has requested information on test methods and the ‘weighting’ of characteristics from Consumer Reports – all without success. On the other hand, the test methods used by MPI are published and are either ASTM, or those approved by major users such as the paint experts at Navy Facilities, Army Corps of Engineers, GSA, etc.. MPI paint standards replaced GSA-maintained U.S. Paint Specifications in 2000. The MPI paint standards are used by both the U.S. and Canadian Governments.


The “high-traffic” areas in both the master guide specification (UFGS) for all Department of Defense facilities (e.g. Navy, Air Force, Army, and Marine military facilities, NASA, etc.) and the master guide specification used by the American Institute of Architects MasterSpec® call for paints in an MPI category entitled “High-performance Architectural Latex”. The UFGS says for “High Traffic Areas”. The AIA MasterSpec® says “High-Performance architectural latex systems are used in interior locations subject to high traffic.”


Although some specifiers would prefer a higher gloss and sheen than the “low-luster” used by Consumer Reports for “high-traffic” areas, MPI used the category for MPI Gloss Level 2 in order to provide an apples-to-apples comparison with that listed by Consumer Reports (even though the 5 listed were all not the same gloss and sheen). That category is MPI #138 (High-Performance Architectural Latex – Gloss Level 2).


Summary


Only 1 of the 5 passed qualification tests for performance contained in the test standards and protocol for MPI #138. Some failed cleanability or burnish resistance, or scrub ability, etc.


For reference, MPI’s minimum number of scrub cycles for this standard is 3000, but 1 of the 5 Consumer Reports “Best for high-traffic areas” products actually failed by film breakthrough observed as early as 319 cycles.


That only 1 of the top 5 of Consumers Reports “Best for high-traffic areas” paints passed the MPI performance standards does not indicate that the products tested are not good paint products, but it does indicate that the performance and durability standards needed for commercial projects are somewhat more stringent. Until accepted performance test methods are adopted by any consumer product testing, perhaps professional specifiers of commercial products should avoid DIY paint recommendations for commercial and institutional projects.


Leave a comment


Also in Our Blog

A living room with a light red ombre painted accent wall, with a  beige couch and burgundy and pink pillows, on a light grey floor with a light pink area rug.
3 Unique Painting Ideas for your Living Room

August 29, 2019 3 min read

The living room is exactly what it sounds like – it is a place within your home where you will spend the most time in. You use your living room for all sorts of activities like entertaining friends and family, reading your favorite book...
Read More
Grey couch in front of a dark black wall with floral wallpaper.
5 Genius Wallpaper Hacks

July 05, 2019 3 min read

While some may believe that wallpaper is a trend of the past, it can be used in a variety of innovative and modern ways to truly enhance any space in your home! At Gleco Paint Stores we offer special order wallpaper from the nation’s top wallpaper...
Read More
How to Prepare the Outside of Your Home for Summer
How to Prepare the Outside of Your Home for Summer

June 13, 2019 3 min read

Say “hasta la vista” to the dreary winter and “hola” to the upcoming sunny summer! It’s about that time of year to spend most of our days outside enjoying the sun and soaking in some Vitamin D. Summer is the best time to...
Read More