The Problem with Consumer Reports Testing

October 13, 2013 3 min read

A man holding his hand in a

How to Answer the comment “Consumer Reports says XYZ brand was rated the best”? Even though this is from 2007 it still shows the problem with Consumer Reports test Results.

In response to many requests from architects and specifiers throughout the United States, MPI (Master Painters Institute) acquired the 2007 report from “Consumer Reports” on paint.

MPI then sent out “mystery shoppers” in Washington State to purchase the top five products listed as by Consumer Reports as “CR Quick Recommendations” and “Best for high-traffic areas.” The products obtained, and tested, were those identified by Consumer Reports.

“High scores for staining and scrubbing, and resisted gloss changes.”

  • “Behr CR Best Buy”
  • “Kilz CR Best Buy”
  • "Valspar"
  • “True Value CR Best Buy”
  • “Dutch Boy CR Best Buy”

It has been the position of MPI, as well as major specifiers and users, that paint products formulated for the consumer or DIY markets have different pros and cons from those products specified for commercial and institutional market segments where performance and durability are of much more concern than aspects such as application properties and spatter resistance.


MPI has requested information on test methods and the ‘weighting’ of characteristics from Consumer Reports – all without success. On the other hand, the test methods used by MPI are published and are either ASTM, or those approved by major users such as the paint experts at Navy Facilities, Army Corps of Engineers, GSA, etc.. MPI paint standards replaced GSA-maintained U.S. Paint Specifications in 2000. The MPI paint standards are used by both the U.S. and Canadian Governments.


The “high-traffic” areas in both the master guide specification (UFGS) for all Department of Defense facilities (e.g. Navy, Air Force, Army, and Marine military facilities, NASA, etc.) and the master guide specification used by the American Institute of Architects MasterSpec® call for paints in an MPI category entitled “High-performance Architectural Latex”. The UFGS says for “High Traffic Areas”. The AIA MasterSpec® says “High-Performance architectural latex systems are used in interior locations subject to high traffic.”


Although some specifiers would prefer a higher gloss and sheen than the “low-luster” used by Consumer Reports for “high-traffic” areas, MPI used the category for MPI Gloss Level 2 in order to provide an apples-to-apples comparison with that listed by Consumer Reports (even though the 5 listed were all not the same gloss and sheen). That category is MPI #138 (High-Performance Architectural Latex – Gloss Level 2).


Summary


Only 1 of the 5 passed qualification tests for performance contained in the test standards and protocol for MPI #138. Some failed cleanability or burnish resistance, or scrub ability, etc.


For reference, MPI’s minimum number of scrub cycles for this standard is 3000, but 1 of the 5 Consumer Reports “Best for high-traffic areas” products actually failed by film breakthrough observed as early as 319 cycles.


That only 1 of the top 5 of Consumers Reports “Best for high-traffic areas” paints passed the MPI performance standards does not indicate that the products tested are not good paint products, but it does indicate that the performance and durability standards needed for commercial projects are somewhat more stringent. Until accepted performance test methods are adopted by any consumer product testing, perhaps professional specifiers of commercial products should avoid DIY paint recommendations for commercial and institutional projects.


Leave a comment

Comments will be approved before showing up.


Also in Our Blog

Vinyl Siding Transformation
Vinyl Siding Transformation

June 17, 2020 2 min read

While you might be hesitant to consider painting your siding, if it’s done right, painting it will give you up to 10 years of stunning results –at a fraction of the price of new siding. Most homeowners are motivated to paint their vinyl siding because the colour has become dated. The washed out yellow or pale blue that looked great twenty years ago – would look outstanding in a more modern taupe, warm gray or tan.
Read More
Making an Entrance: Home Updates to Tackle This Weekend
Making an Entrance: Home Updates to Tackle This Weekend

June 17, 2020 2 min read

Weekends are a treasured time to spend catching up on chores or relaxing with friends and family, but they’re also the perfect time to tackle some of those small projects that will make your space more functional and inviting. Updating your front door with paint and hardware is a simple and impactful project that can be completed over a long weekend.
Read More
Feng Shui: Attract Positivity By Painting Your Front Door
Feng Shui: Attract Positivity By Painting Your Front Door

June 17, 2020 2 min read

Your front door is so much more than an entranceway – it’s a chance for your home to make a statement and say, “Hello, world!” What really speaks volumes is a fresh coat of curb appeal. Go bold with the paint colour of your front door and life instantly becomes more interesting.   
Read More