Cue stage lights.

Pre-roll curtains.

AnnouncerIn tonight’s performance, the role of the National Retail Federation will be played by CNBC


Yesterday morning, CNBC announced yesterday that "Americans plan to spend an average $839 during the holiday season, up 17.6% from last year, the survey says."

That may be technically true — that’s what they said they plan on spending — but as any good behavioral economist will tell you, what people say they are going to do, and what they actually do are often worlds apart.

Blame it on Fox Business. With competition heating up, we now have a race to put forth the most cheerleading happy talk either station can muster.

As we have so painstakingly detailed in these pages over the past few years, consumers — indeed, Humans in general — are notoriously bad at forecasting even their own behavior. These surveys are classic examples.

The mother of all survey abusers are the National Retail Federation. Each holiday season, this group polls a group of shoppers, and declares that spending will be up by some outlandish amount. Each year, this survey driven forecast is proven to be wildly wrong.

In 2005, based on a survey on Black Friday and Saturday, the NRF forecast a 22% rise in holiday shopping gains for the Thanksgiving Weekend. The results were off that 22% gain by an order of magnitude: Up just 1%. The WSJ eventually ran a piece dissecting the methodology: Holiday Sales Numbers Don’t Add Up

We saw the same foolishness resurface again in 2006, with an 18.9% sales increase forecast  (More Bad Data from the NRF?). Of course, the reality was nowhere near that, with sales gains below 5% (How Good Were Retail Sales Really?). And of course, back-to-school-season was another opportunity to repeat the error: There They Go Again: NRF Redux.    


If you want to know how much people THINK they are going to spend, you can ask them. 

If you want to know how much people ACTUALLY SPENT, count the cash register receipts. 

As history has proven again and again, there is little correlation between the two.


Surprise! Americans Set to Open Wallets This Holiday
CNBC.com  15 Oct 2007 | 08:48 AM ET

Category: Consumer Spending, Data Analysis, Economy, Financial Press, Retail

Please use the comments to demonstrate your own ignorance, unfamiliarity with empirical data and lack of respect for scientific knowledge. Be sure to create straw men and argue against things I have neither said nor implied. If you could repeat previously discredited memes or steer the conversation into irrelevant, off topic discussions, it would be appreciated. Lastly, kindly forgo all civility in your discourse . . . you are, after all, anonymous.

14 Responses to “Repeat After Me: Spending Surveys Are Meaningless”

  1. blam says:

    22 % in 2005, 18.9 % in 2006, 17.6 % in 2007

    Come on Barry give them some credit. They are getting closer and they have resisted adding a second decimal place !

  2. X says:

    Not only this report on CNBC yesterday, but what about the idiot real estate agent acting the part of David Lereah?

  3. Mike says:

    As the Guiness commercial says “brilliant!”

  4. dblwyo says:

    Thanks for pointing this out. Kasriel at Northen Trust dissects this report very nicely in last week’s “Week in Review” ( http://tinyurl.com/3conf4 ) – worth your time. What he finds is that once you set aside the inflation-bumped food & energy plus autos sales were not robust at all.
    My own take with pretty pics and everything is similar: http://tinyurl.com/2vfwej.
    Better yet the recent numbers continue a long-standing downtrend where the best that can be said is that the downward pressures, which have not seen much impact from housing yet, is flattening. Which still doesn’t argue for a very positive outlook.
    There’s a broader issues here in that Retail is not the only industry facing severe pressure: http://tinyurl.com/2soyxq

  5. Justin says:

    I’m starting to believe that’s why I love this game – the difference between psychology and reality. Now if I can only get my timing down! lol

  6. JustAGuy says:

    Wouldn’t it be pleasant if the nightly newscasts told us this too? You know, like this:

    “Americans plan to spend an average $839 during the holiday season, up 17.6% from last year, the survey says. It should be noted that this same survey forecast 22 % in 2005 but the actual results were 1%, and a forecast of 18.9 % in 2006 but the actual results were less than 5%. So stay tuned.”

  7. Groty says:

    Apparently, NRF’s 1.6 million retail establishment member’s don’t rely on the survey. If they did, they would have been overstocked to the rafter in prior years, resulting in huge markdowns, promotions, margin compression, etc. in subsequent quarters to move the excess inventory.

    So if NRF members aren’t using the survey results to help them make inventory investment decisions, the purpose of the survey is to use it as just another marketing tool intended to influence consumer buying behavior?

  8. cm says:

    Perhaps it’s a PR gimmick and the point is to provide a “reference” for what you should spend?

  9. Al Czervik says:

    I planned to buy a lotta things – when I still had a job.

  10. jopo says:

    the 17.6% clearly reflecting how much more it will cost getting to and from the mall….

    $839 is the new $500

  11. Norman says:

    Maybe the year-to-year change in their expected X-mas spending plans would give a clue as to consumers’ state of mind.

  12. Al Czervik says:

    Or maybe it means that, on average, they are still about $839 below the credit limit on their last credit card.

  13. Aaron says:

    Completely agree with your statement on this. There is nothing more worthless than these spending surveys. They really think the American shopper knows how much they will spend going into the holiday shopping season?

  14. rebound says:

    JustAGuy is SPOT ON. Reporting “the number” is just shoveling useless data … in effect parroting it. Putting “the number” in context helps provide actual information … which I thought was supposed to be the primary “product” cranked out by so called journalists. Right now is seems like there are simply mouth pieces (or glam pieces of ass) in front of teleprompters … which act as if they have umbilical chords tied to RSS feeds from wire services.

    Is this a market failure … or is there simply not enough demand for quality information … and therefore businesses are actually efficiently delivering the crap which customers demand?