COVID-19 RESOURCES AND INFORMATION: See the Atlanta Fed's list of publications, information, and resources; listen to our Pandemic Response webinar series.

About


The Atlanta Fed's macroblog provides commentary and analysis on economic topics including monetary policy, macroeconomic developments, inflation, labor economics, and financial issues.

Authors for macroblog are Dave Altig, John Robertson, and other Atlanta Fed economists and researchers.

Comment Standards:
Comments are moderated and will not appear until the moderator has approved them.

Please submit appropriate comments. Inappropriate comments include content that is abusive, harassing, or threatening; obscene, vulgar, or profane; an attack of a personal nature; or overtly political.

In addition, no off-topic remarks or spam is permitted.

May 12, 2020

Challenges in Nowcasting GDP Growth

Real gross domestic product (GDP) declined at an annualized rate of 4.8 percent in the first quarter, according to the first estimate from the U.S. Bureau of Economic Analysis (BEA), 3.8 percentage points more than the decline anticipated by the Atlanta Fed's final GDPNow model projection. Why was the error, which was easily the model's largest on record for final GDPNow forecasts, so big? Chart 1 looks at GDPNow's forecast errors since the model went live in mid-2014 and breaks them down into forecast errors for the various subcomponents' contributions to GDP growth. 

Chart 1: Real-Time GDPNow Forecast Errors of Real GDP Growth and Component Contributions Right before Advance Release

The clear culprit is the fact that the GDPNow model did not anticipate the record 9.5 percent monthly decline (not annualized) in real services consumption in March. At that time, GDPNow had March services data available only for electricity and natural gas use and purchased meals and beverages, as well as revised February data for net foreign travel. If the model would have correctly forecasted the March growth rate in services consumption for the subcomponents besides these, it would have actually slightly overstated the first-quarter decline in real consumer spending. (I should note that because of the timing and impact of last quarter's social distancing efforts stemming from COVID-19, the BEA used data outside of the scope of its routine procedures to estimate part of services spending in March—in particular, data about private credit card transactions for health care and recreation services.)

By design, GDPNow is a purely model-based prediction method as opposed to the models of some private forecasters, who were able to incorporate developments related to COVID-19 into their April forecasts for first-quarter GDP growth in a way that GDPNow did not and could not. As a result, their GDP predictions turned out to be relatively more accurate. For example, the consensus forecast of first-quarter GDP from the Wall Street Journal Economic Forecasting Survey in the first full week of April was a decline of 3.3 percent, and the CNBC Rapid Update survey late in the week prior to the GDP release anticipated a decline in GDP of 5.3 percent. Private forecasts will continue to be able to use news developments and high-frequency or nonstandard data sources (such as initial unemployment claims and OpenTable restaurant dining data) in a way that GDPNow and similar nowcasting models do not. The New York Fed's recently introduced Weekly Economic Index combines a set of weekly indicators into a single index with units comparable to four-quarter GDP growth, but it does not actually nowcast quarterly GDP growth.

Around the time of recessions, macroeconomic projections from professional forecasters tend to be less accurate and show more dispersion than during nonrecessionary periods. And though the National Bureau of Economic Research has not identified a 2020 business cycle peak, recent GDP forecasts show much more dispersion than they did during, or close to, past recessions. Chart 2 shows the difference between the top 10 and bottom 10 average forecasts of real GDP growth (for both the current quarter and one quarter ahead) in the Blue Chip Economics Indicators survey administered in the middle month of each quarter since 1991.

Chart 2: Difference between Top 10 and Bottom 10 Average Forecasts of Quarterly Real GDP Growth in Blue Chip Economic Indicators

The top 10/bottom 10 difference for current-quarter GDP forecasts in the May 2020 survey is clearly much larger than around past recessions. In fact, it's larger than the difference between the highest and lowest quarterly growth rate of GDP after 1983, around the time economists date the onset of the Great Moderation—in reference to the decline in macroeconomic volatility—in the mid-1980s. Prior to the May 8 employment release, GDPNow was more optimistic about second-quarter GDP growth than most private forecasters were, but after the model forecast was revised down from a decline of 17.6 percent to a decline of 34.9 percent on the heels of that report, it fell more in line with the others.

The dispersion in the forecasts for GDP in the third quarter of 2020 is even starker. The optimistic forecasters project 2020:Q3 growth to be well above the highest rate on record (15.7 percent in 1950:Q1), and the pessimistic forecasters project contracting GDP. Of course, we will not be able to determine how accurate forecasts of second- and third-quarter GDP growth are until later in the year. Nevertheless, the wide range of forecasts implies that at least some forecasters' GDP projections will be wildly off by historical standards. As St. Louis Fed economist Michael McCracken recently noted, what the late Yankees catcher Yogi Berra said is more true than ever: "It's tough to make predictions, especially about the future." Berra's wisdom also will also apply to producing accurate and reliable economic forecasts for some time to come.

February 13, 2018

GDPNow's Forecast: Why Did It Spike Recently?

If you felt whipsawed by GDPNow recently, it's understandable. On February 1, the Atlanta Fed's GDPNow model estimate of first-quarter real gross domestic product (GDP) growth surged from 4.2 percent to 5.4 percent (annualized rates) after a manufacturing report from the Institute for Supply Management. GDPNow's estimate then fell to 4.0 percent on February 2 after the employment report from the U.S. Bureau of Labor Statistics. GDPNow displayed a similar undulating pattern early in the forecast cycle for fourth-quarter GDP growth.

What accounted for these sawtooth patterns? The answer lies in the treatment of the ISM manufacturing release. To forecast the yet-to-be released monthly GDP source data apart from inventories, GDPNow uses an indicator of growth in economic activity from a statistical model called a dynamic factor model. The factor is estimated from 127 monthly macroeconomic indicators, many of which are used to estimate the Chicago Fed National Activity Index (CFNAI). Indices like these can be helpful for forecasting macroeconomic data, as demonstrated here  and here.

Perhaps not surprisingly, the CFNAI and the GDPNow factor are highly correlated, as the red and blue lines in the chart below indicate. Both indices, which are normalized to have an average of 0 and a standard deviation of 1, are usually lower in recessions than expansions.

A major difference in the indices is how yet-to-be-released values are handled for months in the recent past that have reported values for some, but not all, of the source data. For example, on February 2, January 2018 values had been released for data from the ISM manufacturing and employment reports but not from the industrial production or retail sales reports. The CFNAI is released around the end of each month when about two-thirds of the 85 indicators used to construct it have reported values for the previous month. For the remaining indicators, the Chicago Fed fills in statistical model forecasts for unreported values. In contrast, the GDPNow factor is updated continuously and extended a month after each ISM manufacturing release. On the dates of the ISM releases, around 17 of the 127 indicators GDPNow uses have reported values for the previous month, with six coming from the ISM manufacturing report.

Chart-01-of-01-factor-model-estimates-of-growth-in-us-economic-activity

[ Enlarge ]

For months with partially missing data, GDPNow updates its factor with an approach similar to the one used in a 2008 paper by economists Domenico Giannone, Lucrezia Reichlin and David Small. That paper describes a dynamic factor model used to nowcast GDP growth similar to the one that generates the New York Fed's staff nowcast of GDP growth. In the Atlanta Fed's GDPNow factor model, the last month of ISM manufacturing data have large weights when calculating the terminal factor value right after the ISM report. These ISM weights decrease significantly after the employment report, when about 50 of the indicators have reported values for the last month of data.

In the above figure, we see that the January 2018 GDPNow factor reading was 1.37 after the February 1 ISM release, the strongest reading since 1994 and well above either its forecasted value of 0.42 prior to the ISM release or its estimated value of 0.43 after the February 2 employment release. The aforementioned rise and decline in the GDPNow forecast of first-quarter growth is largely a function of the rise and decline in the January 2018 estimates of the dynamic factor.

Although the January 2018 reading of 59.2 for the composite ISM purchasing managers index (PMI) was higher than any reading from 2005 to 2016, it was little different than either a consensus forecast from professional economists (58.8) or the forecast from a simple model (58.9) that uses the strong reading in December 2017 (59.3). Moreover, it was well above the reading the GDPNow dynamic factor model was expecting (54.5).

A possible shortcoming of the GDPNow factor model is that it does not account for the previous month's forecast errors when forecasting the 127 indicators. For example, the predicted composite ISM PMI reading of 54.4 in December 2017 was nearly 5 points lower than the actual value. For this discussion, let's adjust GDPNow's factor model to account for these forecast errors and consider a forecast evaluation period with revised current vintage data after 1999. Then, the average absolute error of the 85–90 day-ahead adjusted model forecasts of GDP growth after ISM manufacturing releases (1.40 percentage points) is lower than the average absolute forecast error on those same dates for the standard version of GDPNow (1.49 percentage points). Moreover, the forecasts using the adjusted factor model are significantly more accurate than the GDPNow forecasts, according to a standard statistical test . If we decide to incorporate adjustments to GDPNow's factor model, we will do so at an initial forecast of quarterly GDP growth and note the change here .

Would the adjustment have made a big difference in the initial first-quarter GDP forecast? The February 1 GDP growth forecast of GDPNow with the adjusted factor model was "only" 4.7 percent. Its current (February 9) forecast of first-quarter GDP growth was the same as the standard version of GDPNow: 4.0 percent. These estimates are still much higher than both the recent trend in GDP growth and the median forecast of 3.0 percent from the Philadelphia Fed's Survey of Professional Forecasters (SPF).

Most of the difference between the GDPNow and SPF forecasts of GDP growth is the result of inventories. GDPNow anticipates inventories will contribute 1.2 percentage points to first-quarter growth, and the median SPF projection implies an inventory contribution of only 0.4 percentage points. It's not unusual to see some disagreement between these inventory forecasts and it wouldn't be surprising if one—or both—of them turn out to be off the mark.



November 6, 2017

Building a Better Model: Introducing Changes to GDPNow

Among the frequently asked questions on GDPNow's web page is this one:

Is any judgment used to adjust the forecasts? Our answer:

No. Once the GDPNow model begins forecasting GDP growth for a particular quarter, the code will not be adjusted until after the "advance" estimate. If we improve the model over time, we will roll out changes right after the "advance" estimate so that forecasts for the subsequent quarter use a fixed methodology for their entire evolution.

This macroblog post enumerates a number of minor changes to GDPNow that were implemented on October 30, when it began forecasting fourth-quarter real gross domestic product (GDP) growth. Here is a summary of the changes, intended to improve the accuracy of the GDP subcomponent forecasts:

  1. Services personal consumption expenditures (PCE). Use industrial production of electric and gas utilities to nowcast real PCE on electricity and natural gas. Use international trade data on travel services to forecast revisions to related PCE travel data.
  2. Real business equipment investment. Use/forecast data from the advance U.S. Census Bureau reports on durable manufacturing  and international trade in goods  that, previously, hadn't been utilized until the full reports on manufacturing  and/or international trade .
  3. Real nonresidential structures investment. Replace a discontinued seasonally adjusted producer price index for "Steel mill products: Steel pipe and tube" with a nonseasonally adjusted version. The index is used to construct a price deflator for private monthly nonresidential construction spending.
  4. Real residential investment. Use employment data for production and nonsupervisory employees of residential remodelers to help forecast real investment in residential improvements.
  5. Real change in private inventories. Use published monthly inventory levels in the U.S. Bureau of Economic Analysis's underlying detail tables 1BU and 1BUC after the third-release GDP estimate from the prior quarter to estimate inventory levels for a number of industries in the first month of the quarter forecasted by GDPNow.
  6. Federal, state, and local government spending. Forecast investment in intellectual property products for these subcomponents using autoregression models.

The first three columns of the following table decompose the official estimate of the third-quarter real GDP growth rate, and forecasts of the growth rate from the discontinued and modified versions of GDPNow, into percentage point contributions from the subcomponents of GDP.

As the table shows, the methodological changes did not have much of an impact on the final third-quarter subcomponent forecasts—apart from inventory investment, where the modifications lowered the contribution to growth from 0.80 percentage points to 0.60 percentage points—or on their accuracy. Nevertheless, the topline GDP forecast of the modified model (2.3 percent) was less accurate than the previous version (2.5 percent). In the discontinued version of GDPNow, an overestimate of the inventory investment contribution to growth partly canceled out underestimated contributions from each of net exports, government spending, and nonresidential fixed investment.

In the modified version, the inventory contribution was also underestimated and did not cancel out these other errors. The last two columns of the table show that all of the subcomponent errors of the modified model were at least as small as their historical average for the discontinued version. However, the topline GDP forecast was less accurate than average because of less cancellation of the subcomponent errors than usual. We hope that the cancellation of subcomponent errors in the modified model will be more similar to the historical average in the discontinued version in the future.

Although the methodological changes could have more of an impact than the table suggests, we do not expect them to have a substantial impact in general. For example, on October 30, the discontinued version of GDPNow projected 3.0 percent GDP growth in the fourth quarter, which was little different from the modified model forecast of 2.9 percent growth. We provide a more detailed explanation of the changes to GDPNow here . Going forward, this same document will document any further changes to the model and when we made them.

May 22, 2017

GDPNow's Second Quarter Forecast: Is It Too High?

Real gross domestic product (GDP) growth slowed from a 2 percent pace in 2016 to an annual rate of 0.7 percent in the first quarter of 2017. The Federal Open Market Committee viewed this slowdown in growth "as likely to be transitory," according to its last statement.

Indeed, current quarter GDP forecasting models maintained by the Federal Reserve Banks of New York, St. Louis, and Atlanta have been pointing toward stronger second quarter growth (2.3 percent, 2.6 percent and 4.1 percent, as reported on their respective websites on May 19, 2017).

The Atlanta Fed's model—GDPNow—is at the high end of this range and is also high relative to other professional forecasts. The median forecast for second quarter real GDP growth in the May Survey of Professional Forecasters (SPF) was 3.1 percent, for instance, and recent forecasts from Blue Chip Publication surveys displayed on our GDPNow page show some divergence from our model as well.

We encourage—and frequently receive—feedback on our GDPNow tool, and some users have suggested that our forecast for second quarter growth is too high. In fact, some empirical evidence supports that view. The evidence considered here correlates differences between consensus Blue Chip Economic Indicators Survey and GDPNow forecasts for growth about 80 days before the first GDP release with the GDPNow forecast errors (see the chart below).

A note about the chart: The horizontal axis shows the difference between the Blue Chip consensus forecasts and GDPNow's forecast. The vertical axis measures the 80-day-ahead GDPNow forecast error, defined as the difference between the first published estimate of real GDP growth and the GDPNow forecast at the time of the mid-quarter Blue Chip survey.

As the chart shows, there is a positive relationship between the Blue Chip-GDPNow discrepancy and the GDPNow forecast error. A simple linear regression would predict that the GDPNow forecast of 3.7 percent growth on May 5 was too high by nearly 1.0 percentage point. Moreover, the chart suggests that there has been a bias in GDPNow forecasts since the fourth quarter of 2015 of between 0.9 and 2.0 percentage points at the time of these mid-quarter Blue Chip surveys. If you are inclined to think the GDPNow forecast for second quarter growth is a bit too high, then this evidence will not change your mind.

Given this evidence, you might think that putting relatively little stock in the GDPNow forecast at this point in the quarter would be prudent. Indeed, if we calculate the weighted average of the historical Blue Chip consensus and GDPNow forecasts that produced the most accurate forecast of the first estimate of real GDP growth, then the optimal weight of the GDPNow forecast lies somewhere between 0.34 and 0.55 (see the chart below). The weight depends on the number of days until the first GDP release.

For example, the optimal weight of 0.55 on GDPNow about 54 days before the first GDP release means that 0.55 times the GDPNow forecast plus 0.45 times Blue Chip consensus survey forecast has been more accurate, on average, than any other weighted average of the two forecasts. The lowest weight on GDPNow corresponds to forecasts made about 83 days before the first GDP release—the time when GDPNow's bean-counting algorithms have the least amount of source data to work with.

A weighted average of the Blue Chip consensus and GDPNow forecasts at that time would put the GDP forecast about 0.6 to 0.7 percentage points below the current GDPNow forecast. However, the confidence bands around these estimates are wide, so the positive weight placed on GDPNow early in the quarter could just be the result of chance.

Let's cut to the chase—why, exactly, is the GDPNow forecast for second quarter GDP growth so high? The details of the GDPNow forecast provide some clues. We can compare the GDPNow forecasts of GDP components with those from the SPF. (The Blue Chip forecast does not provide detail on all the GDP components.) The following table translates the median SPF forecasts into contributions to second quarter real GDP growth. These contributions are shown alongside GDPNow's forecasted contributions as well as the average contributions to real GDP growth over the prior four quarters.

Clearly, more than half of the difference between the GDP growth forecasts from GDPNow and the SPF is due to inventories. For both forecasts, inventory investment also accounts for over half of the pickup in second quarter growth from the trailing four-quarter average.

A macroblog post I wrote last year showed that the growth-forecast contribution of mid-quarter inventory investment produced roughly equivalent accuracy in the SPF and GDPNow models, but it was much less accurate than the contribution forecasts of the other GDP components. Based on experience, we can't be confident that either forecast of inventory investment is likely to be very accurate or that one is likely to be much more accurate than another.

With very little hard data in hand for the second quarter for most of the GDP components—and for inventories in particular—we will continue to closely monitor if the data are as strong as GDPNow is anticipating or if they hew more closely to other forecasts. Check back with us to see.