Keywords
COVID-19, cost, COVID-19 treatments, COVID-19 therapies, economics, business restrictions, consumer spending, unemployment claims, hospital utilization
This article is included in the Coronavirus (COVID-19) collection.
COVID-19, cost, COVID-19 treatments, COVID-19 therapies, economics, business restrictions, consumer spending, unemployment claims, hospital utilization
COVID’s most notable impact has been illness and the loss of life, but the pandemic has also imposed a substantial societal cost. The economy has grabbed headlines, as cumulative losses during just the first two quarters of 2020 amounted to between 1 and 7% of annual GDP across the globe, and approximately 3% of annual GDP in the United States.1 Other societal costs include reduced care for health conditions other than COVID,2,3 although that impact may have been largely limited to the initial several months of the pandemic.4 Finally, evidence suggests that lost in-person schooling will permanently diminish economic opportunities for today’s students; moreover, the impact is greatest for students from the most disadvantaged backgrounds.5
The pandemic’s economic costs suggest that COVID-19 medical interventions could confer societal benefits exceeding the value of their health benefits.6 Based on stock market movements in apparent response to positive news about vaccines in development, for example, one analysis estimated a pandemic-ending therapy to be worth between 5 and 15% of total wealth.7 In the United States alone, that result implies a value ranging from $6 to $17 trillion.8
Assessing the societal value of COVID therapies that have a less dramatic impact on the population as a whole, such as antiviral treatments9 and monoclonal antibodies,10 presents a distinct challenge. These therapies do not directly address population disease transmission and therefore have less potential to return life to “normal”. Instead, they aim to prevent progression to severe disease or speed recovery.
We hypothesize that these clinical benefits, if the data hold up, nonetheless confer a societal benefit by diminishing the need for government-imposed restrictions on economic activity designed to increase social distancing. By “flattening the curve”, economic restrictions and other distancing measures aim in part to prevent the health care system from becoming overwhelmed.11,12 The link between hospital utilization in particular and government-imposed restrictions seems evident in headlines from late 2020. For example, one headline noted, “If NY hospitals get overwhelmed, state could shut down again, Cuomo says”.13 Another stated, “California’s Governor Warns of ‘Drastic Action’ as Hospitals Near Crisis”.14 A December 3 executive order outlined economic restrictions in California when a region’s free intensive care unit capacity dropped below 15% – including a ban on hotel stays for out-of-state guests, suspension of indoor dining at restaurants, and a 20% capacity limit on retail establishments.15 When Massachusetts governor, Charlie Baker, loosened business restrictions toward the end of January 2021, he identified a drop in COVID hospitalizations as a key factor informing his decision.16
Because high hospital utilization levels trigger restrictions, therapies that reduce hospitalizations or hospital length of stay can also reduce the need for restrictions. This paper’s aim is to estimate the cost of these restrictions and hence the potential value conferred by COVID-19 therapies that help avert hospital admissions by preventing progression to severe disease or that speed recovery.
To assess the cost of government-imposed economic restrictions, we combined high frequency economic data, information on the pandemic’s progression (case incidence and mortality), and information about when state governments imposed and lifted restrictions on business activities. Rather than including data from spring, 2020, when the pandemic’s initial onslaught increased unemployment claims and reduced consumer spending to an extent unrepresentative of subsequent periods during the pandemic,17,18 we instead focused on the fall and winter of 2020-2021. All of the analysis was conducted in R v4.0.3, utilizing the R nlme package for regression analysis (R package: nlme, RRID:SCR_015655).
Descriptive statistics: We report the number of observations, mean, and standard deviation for all outcome quantities and all explanatory variables. We stratify the data by the level of regulatory measures in place during that week. As described below (see Data), we classify each U.S. state during each week as either “mostly closed” due to government-imposed activity restrictions, or as not “mostly closed.”
Base case analysis: We used regression to predict the influence of restrictions on consumer spending and weekly initial unemployment claims. We controlled for daily COVID case count, COVID mortality, and the change in these two rates over the preceding two weeks. More formally, we developed three sets of models, one set for each of three outcomes:1 percent change since January, 2020 in total seasonally adjusted consumer spending,2 percent change in seasonally adjusted consumer spending on restaurants and accommodations since January, 2020, and3 weekly unemployment claims (not seasonally adjusted) as a percent of the 2019 US workforce.
Our base case regression specification models each outcome as,
+,
where the subscript denotes the week and the superscript denotes one of the 50 U.S. states (and Washington, D.C. for the initial unemployment claims). Explanatory variables included (a binary variable indicating if state was “mostly closed” during week ; see data sources below); and , which refer to state-specific, population-normalized daily case incidence and mortality; and and , which refer to state-specific, population-normalized changes in these values over the last two weeks. We included the COVID case and mortality rates, and their rate of change to address the possibility that reduced economic activity may in part be due to voluntary disengagement from the economy in response to reports of higher rates of COVID illness and death.
All regressions are linear mixed models that account for nesting within state and correlation across observations that are close in time. To account for temporal correlation, the base case model implemented a first-order, autoregressive (lag 1-week) covariance structure. This covariance structure assumes correlation is greatest for observations adjacent in time, with decreasing correlation between observations more distant in time.
Sensitivity analysis: We conducted a series of sensitivity analyses to explore how alternative assumptions influence our conclusions.
First, we conducted an analysis limited to the 10 states designated “mostly closed” at some point between September 15 through December 27, 2020 (California, Kentucky, Illinois, Michigan, Minnesota, New Mexico, Oregon, Pennsylvania, Rhode Island, and Washington).
Second, we explored alternative model specifications that omitted some of the explanatory variables in the base case model, including1 the daily COVID mortality rate,2 the daily COVID case rate, or3 both the case rate and the mortality rate. We conducted this sensitivity analysis because inclusion of the case rate and mortality rate in the regression model may lead to “over-control” of phenomena correlated with government restrictions, and that could artificially reduce the estimated impact of government restrictions on economic activity. This set of sensitivity analyses explores the potential magnitude of this type of potential error.
Third, we considered alternative criteria for designating a week as subject to government-imposed restrictions. The first alternative designates a state as subject to restrictions only after restrictions have been in place for at least 14 days. This alternative explores the potential for a lag (of two weeks) between a state’s imposition of restrictions and the impact of those restrictions on economic activity. For example, if a state enacted restrictions from the 1st to the 21st of October, this sensitivity analysis designates the week of October 1st and the week of October 8th as not , but designates the week of October 15th as . The second alternative recognizes only those restrictions that remain in place for at least three weeks. For the preceding example, that would mean that all three weeks (starting October 1st, October 8th, and October 15th) would be designated as . On the other hand, if the state had imposed restrictions from October 1st to October 20th (just under 3 weeks), this sensitivity analysis would designate all three weeks as not . That is, we treat states imposing only restrictions shorter than three weeks in duration as unrestricted at all times. The third alternative set of criteria recognizes only those restrictions that include a complete ban on indoor dining at restaurants.
Finally, we considered alternative model correlation structures, including 2nd, 3rd, and 4th order autoregressive models (i.e., AR2, AR3, and AR4), 1st and 2nd order moving average (i.e., MA1 and MA2), and a series of autoregressive-moving average models (ARMA) with different combinations of first- and second-order AR and MA components (i.e., AR1MA1, AR1MA2, AR2MA1, and AR2MA2).
We report the Akaike Information Criterion (AIC) statistic as an indicator of goodness of fit for each model (lower or more negative values indicate better fit).
Data: We report our time series data as weekly values. For spending data reported by the original source as daily seven-day moving averages, we retained one value from each seven-day period to represent that week.
Outcomes – Outcomes data come from the Opportunity Insights COVID-19 Economic Tracker project at Harvard University.19,20 The Opportunity Insights Economic Tracker data repository sourced its spending data from Affinity Solutions, and its initial unemployment claims data from the Department of Labor. Selection of these outcomes reflects the expectation that government restrictions affect consumer spending in general and restaurant dining and accommodations in particular. These impacts, in turn, contribute to higher initial unemployment claims.
For state and week , outcomes include percent change in seasonally adjusted spending on restaurants and accommodations compared to January 2020 (), and percent change in seasonally adjusted total consumer spending compared to January 2020 (). To eliminate weekend and weekday periodicity, the Opportunity Insights Economic Tracker group computed seven-day moving average values for the spending data, as described above. To eliminate effects of state size, they also normalized all spending values by population size. The spending data span the period September 15 to December 27, 2020. Our third outcome, for state and week , was initial unemployment claims (reported on Thursday of each week) per 100 people in the 2019 labor force (). This data series spanned the period September 19 to December 19, 2020.
High frequency data are well suited to assessing restrictions imposed at moderately different times across states and remaining in effect for durations often measured in weeks during the fall and winter of 2020-2021. Moreover, because states imposed and lifted these restrictions only shortly before we conducted our analysis, frequently updated data best cover salient periods. Conventional economic activity datasets, like government estimates of gross domestic product (GDP) growth, undergo updating too infrequently to assess the impact of short-term restrictions and the recent imposition of restrictive government measures.
Explanatory variables – As with outcomes, we index explanatory variables by state and week . Our primary explanatory variable of interest, designated , is binary. We classified state businesses as restricted or not restricted based on narrative descriptions of state-level closures maintained by the New York Times, which reported for each day whether businesses in each state were “mostly closed.”21 Based on review of these narratives, we identified when each state changed from not “mostly closed” to “mostly closed”, or the reverse. Our base case analysis designated business in a state as “restricted” during week if, according to the New York Times database, businesses were “mostly closed” on Monday (for the consumer spending outcomes) or Thursday (for the initial unemployment claim outcome) of that week.
We included other explanatory variables in an effort to account for how news about the pandemic might influence voluntary, spontaneous reductions in economic activity. These variables included seven-day average, population-normalized1 daily new COVID cases (),2 daily COVID mortality (),3 the increase in daily new COVID cases over the last two weeks (), and4 the increase in daily COVID mortality over the last two weeks (). Daily COVID cases and deaths were provided from the New York Times COVID-19 Repository to the Opportunity Insights Economic Tracker data repository.22
Descriptive statistics: Table 1 summarizes the data. Outcomes (consumer spending, unemployment claims) are more favorable during weeks without restrictions (first three numeric columns) than during weeks with restrictions (last three numeric columns). Case counts and mortality are lower during weeks without restrictions than during weeks with restrictions. The rate at which case counts grow (increase per two-week period) is higher during weeks without restrictions. On the other hand, the change in mortality is similar across these two sets of weeks.
During weeks without restrictions | During weeks with restrictions | |||||
---|---|---|---|---|---|---|
Nd | Mean | SD | Nd | Mean | SD | |
Outcomes | ||||||
Change – total consumer spendinga | 689 | -0.02 | 0.07 | 49 | -0.07 | 0.05 |
Change – restaurant and accommodation spendinga | 689 | -0.27 | 0.10 | 49 | -0.43 | 0.06 |
Initial weekly unemployment claimsb | 660 | 0.43 | 0.28 | 41 | 0.78 | 0.43 |
Explanatory variables | ||||||
Restricted | 689 | 0 | 0.00 | 49 | 1 | 0.00 |
Case ratec | 689 | 40 | 30 | 49 | 66 | 28 |
Mortalityc | 689 | 0.44 | 0.40 | 49 | 0.84 | 0.43 |
Change in case rate over last two weeks | 689 | 0.32 | 0.44 | 49 | 0.13 | 0.43 |
Change in mortality over last two weeks | 689 | 0.40 | 1.06 | 49 | 0.47 | 0.49 |
d Missing values: The original dataset included 750 observations for total consumer spending and for spending on restaurants and accommodations (50 states, 15 weeks). We removed 12 observations because zero reported deaths during the index week meant we could not compute a percent change in deaths over the following two weeks. The 12 missing observations included 1 observation for ME, 10 for VT, and 1 for WY. For initial unemployment claims, the original dataset included 714 observations (50 states plus DC, 14 weeks). We removed 13 observations for the same reason as described above for spending, including 1 observation for ME, 1 for NH, 10 for VT, and 1 for WY. All removed observations come from weeks without restrictions. These missing values represent less than 2 percent of our original sample, and a substantially smaller fraction of U.S. GNP. We therefore took no action to provide values for these missing observations.
Base case analysis: Table 2 reports regression analysis results for our base case models. The estimated impacts of government-imposed restrictions (row labeled “Restricted”) are statistically significant and in the expected direction for all three outcomes – i.e., a reduction in consumer spending, a reduction in restaurant and accommodations spending, and an increase in initial unemployment claims.
# Obs. | Change in total consumer spending | Std. Error | F values | Change in restaurant and accommodation spending | Std. Error | F values | Change in initial unemployment claims rate | Std. Error | F values |
---|---|---|---|---|---|---|---|---|---|
N = 738 | N = 738 | N = 701 | |||||||
Intercept | -0.02* | 0.009 | 11.48 | -0.25* | 0.014 | 444.86 | 0.37* | 0.041 | 147.38 |
Restricted | -0.02* | 0.007 | 20.82 | -0.05* | 0.008 | 100.64 | 0.21* | 0.033 | 59.31 |
Case rate per 100,000 population | -0.00* | 0.000 | 13.72 | -0.00* | 0.000 | 77.08 | 0.00* | 0.000 | 17.31 |
Mortality per 100,000 population | -0.00 | 0.007 | 2.57 | -0.01 | 0.007 | 10.89 | 0.07* | 0.025 | 7.29 |
Change: case rate over last two wks. | 0.01 | 0.004 | 1.19 | 0.02* | 0.004 | 28.36 | -0.00 | 0.012 | 0.04 |
Change: mortality over last two wks. | -0.00 | 0.001 | 1.32 | -0.00 | 0.001 | 0.81 | -0.00 | 0.003 | 1.07 |
AIC | -2485 | -2711 | -981 |
Sensitivity analysis: Our first sensitivity analysis (Table 3) explored the impact of restricting attention to the 10 states that all experienced periods during which the government imposed restrictions and other periods during which the government did not impose restrictions. For these 10 states, government restrictions had the same impact on total consumer spending (coefficient of -0.02 for Restricted, i.e., a 2% reduction) as they had for all 50 states (Table 2). The impacts on restaurant and accommodations spending (coefficient of -0.04 in Table 3 vs. coefficient of -0.05 in Table 2) and on initial unemployment claims (coefficient of 0.20 in Table 3 vs. coefficient of 0.21 in Table 2) were slightly smaller than the corresponding impacts in the base case.
# Obs. | Change in total consumer spending (10 state*) | Std. Error | F values | Change in restaurant and accommodation spending (10 state*) | Std. Error | F values | Change in initial unemployment claims rate (10 state*) | Std. Error | F values |
---|---|---|---|---|---|---|---|---|---|
N = 150 | N = 150 | N = 154 | |||||||
Intercept | -0.03* | 0.011 | 28.02 | -0.32* | 0.022 | 282.41 | 0.36* | 0.099 | 42.46 |
Restricted | -0.02 | 0.011 | 19.57 | -0.04* | 0.011 | 103.93 | 0.20* | 0.046 | 34.23 |
Case rate per 100,000 population (c) | -0.00 | 0.000 | 0.30 | -0.00* | 0.000 | 8.19 | 0.00 | 0.001 | 3.71 |
Mortality per 100,000 population | -0.01 | 0.019 | 1.01 | -0.02 | 0.020 | 7.43 | 0.20* | 0.092 | 3.76 |
Change: case rate over last two wks. | 0.00 | 0.010 | 0.03 | 0.03* | 0.010 | 9.12 | 0.02 | 0.038 | 0.21 |
Change: mortality over last two wks. | 0.00 | 0.008 | 0.10 | 0.00 | 0.007 | 0.39 | -0.02 | 0.023 | 0.85 |
Tables 4, 5, and 6 show results for the second set of sensitivity analyses – i.e., for alternative models that do not control for COVID case rate, COVID mortality, or both. The impacts of government restrictions on total consumer spending (Table 4) remain similar to the corresponding base case impacts (coefficient of around -0.02). Impacts on restaurant and accommodations spending (Table 5) likewise remain similar to the corresponding base case impacts (coefficient of around -0.05). For initial weekly unemployment claims (Table 6), not controlling for case rate and death rate modestly increased the estimated impact of restrictions on initial unemployment claims to 0.25 percent of the 2019 workforce from 0.21 percent in the base case.
# Obs | Change in total consumer spendinga (Death rate removed as an explanatory variable) | Std. Error | F values | Change in total consumer spendinga (Case rate removed as an explanatory variable) | Std. Error | F values | Change in total consumer spendinga (Death rate and case rate removed as explanatory variables) | Std. Error | F values |
---|---|---|---|---|---|---|---|---|---|
N = 738 | N = 738 | N = 738 | |||||||
Intercept | -0.02* | 0.009 | 11.46 | -0.02* | 0.008 | 11.40 | -0.03* | 0.008 | 11.06 |
Restricted | -0.02* | 0.007 | 20.82 | -0.02* | 0.007 | 20.74 | -0.03* | 0.007 | 19.17 |
Case rate per 100,000 population | -0.00* | 0.000 | 13.72 | N/A | N/A | N/A | N/A | N/A | N/A |
Mortality per 100,000 population | N/A | N/A | N/A | -0.02* | 0.005 | 13.10 | N/A | N/A | N/A |
Change: case rate over last two wks. | 0.01 | 0.003 | 3.15 | N/A | N/A | N/A | N/A | N/A | N/A |
Change: mortality over last two wks. | N/A | N/A | N/A | -0.00 | 0.001 | 1.01 | N/A | N/A | N/A |
AIC | -2507 | -2511 | -2522 | ||||||
ΔAICa | -22 | -26 | -37 |
a AIC statistic value compared to corresponding base case model (see left panel, last row of Table 2, AIC value of -2485).
# Obs | Change in restaurant and accommodation spendinga (Death rate removed as an explanatory variable) | Std. Error | F values | Change in restaurant and accommodation spendinga (Case rate removed as an explanatory variable) | Std. Error | F values | Change in restaurant and accommodation spendinga (Death rate and case rate removed as explanatory variables) | Std. Error | F values |
---|---|---|---|---|---|---|---|---|---|
N = 738 | N = 738 | N = 738 | |||||||
Intercept | -0.25* | 0.014 | 444.95 | -0.26* | 0.014 | 453.75 | -0.28* | 0.013 | 462.83 |
Restricted | -0.05* | 0.008 | 98.14 | -0.06* | 0.009 | 66.44 | -0.06* | 0.010 | 34.37 |
Case rate per 100,000 population | -0.00* | 0.000 | 75.02 | N/A | N/A | N/A | N/A | N/A | N/A |
Mortality per 100,000 population | N/A | N/A | N/A | -0.04* | 0.006 | 34.59 | N/A | N/A | N/A |
Change: case rate over last two wks. | 0.02* | 0.003 | 37.63 | N/A | N/A | N/A | N/A | N/A | N/A |
Change: mortality over last two wks. | N/A | N/A | N/A | 0.00 | 0.001 | 0.05 | N/A | N/A | N/A |
AIC | -2732 | -2689 | -2693 | ||||||
ΔAICa | -21 | +22 | +18 |
a AIC statistic value compared to corresponding base case model (see middle panel, last row of Table 2, AIC value of -2711).
# Obs | Change in initial unemployment claims rate (Death rate removed as an explanatory variable) | Std. Error | F values | Change in initial unemployment claims rate (Case rate removed as an explanatory variable) | Std. Error | F values | Change in initial unemployment claims rate (Death rate and case rate removed as explanatory variables) | Std. Error | F values |
---|---|---|---|---|---|---|---|---|---|
N = 701 | N = 738 | N = 738 | |||||||
Intercept | 0.38* | 0.040 | 149.55 | 0.40* | 0.039 | 148.82 | 0.44* | 0.037 | 151.81 |
Restricted | 0.22* | 0.033 | 58.37 | 0.23* | 0.032 | 59.75 | 0.25* | 0.033 | 57.32 |
Case rate per 100,000 population | 0.00* | 0.000 | 17.19 | N/A | 0.023 | 16.56 | N/A | N/A | N/A |
Mortality per 100,000 population | N/A | N/A | N/A | 0.09* | N/A | N/A | N/A | N/A | N/A |
Change: case rate over last two wks. | -0.01 | 0.012 | 0.47 | N/A | 0.003 | 1.06 | N/A | N/A | N/A |
Change: mortality over last two wks. | N/A | N/A | N/A | -0.00 | N/A | N/A | N/A | N/A | N/A |
AIC | -992 | -997 | -1000 | ||||||
ΔAICa | -11 | -16 | -19 |
a AIC statistic value compared to corresponding base case model (see right panel, last row of Table 2, AIC value of -981).
Tables 7, 8, and 9 present regression model results for the third set of sensitivity analyses, which explore alternative definitions for the variable. Models designating weeks as only after two weeks following enactment of state-imposed distancing measures (left panels in Tables 7, 8, and 9) estimated that government restrictions had smaller estimated impacts than the corresponding impacts in our base case model. In Table 7, the left panel coefficient for is -0.01, compared to -0.02 for the corresponding base case coefficient in Table 2. In Table 8, the left panel coefficient for is -0.02, compared to -0.05 for the corresponding base case coefficient in Table 2. In Table 9, the left panel coefficient for is 0.04, compared to 0.21 for the corresponding base case coefficient in Table 2. As detailed in the last rows in Tables 7, 8, and 9, these models had higher AIC values than the base case model, indicating that they do not fit the data as well as the base case model.
# Obs | Definition for : Weeks designated restricted only after two weeks following enactment of distancing measures | Definition for : Restrictions must last at least 3 weeks | Definition for : Indoor dining fully closed | ||||||
---|---|---|---|---|---|---|---|---|---|
Change in total consumer spending (a) | Std. Error | F values | Change in total consumerspending | Std. Error | F values | Change in total consumer spending | Std. Error | F values | |
N = 738 | N = 738 | N = 738 | |||||||
Intercept | -0.02* | 0.009 | 11.45 | -0.02* | 0.009 | 11.47 | -0.02* | 0.009 | 11.50 |
Restricted | -0.01 | 0.009 | 7.33 | -0.02* | 0.008 | 15.62 | -0.02* | 0.007 | 17.96 |
Case rate per 100,000 population | -0.00* | 0.000 | 20.93 | -0.00* | 0.000 | 17.39 | -0.00* | 0.000 | 15.26 |
Mortality per 100,000 population | -0.01 | 0.007 | 3.31 | -0.01 | 0.007 | 2.88 | -0.00 | 0.007 | 2.84 |
Change: case rate over last two wks. | 0.01 | 0.004 | 1.41 | 0.01 | 0.004 | 1.15 | 0.01 | 0.004 | 1.26 |
Change: mortality over last two wks. | -0.00 | 0.001 | 1.49 | -0.00 | 0.001 | 1.40 | -0.00 | 0.001 | 1.35 |
AIC | -2481 | -2484 | -2484 | ||||||
ΔAICa | +4 | +1 | +1 |
a AIC statistic value compared to corresponding base case model (see left panel, last row of Table 2, AIC value of -2485).
# Obs | Definition for : Weeks designated restricted only after two weeks following enactment of distancing measures | Definition for : Restrictions must last at least 3 weeks | Definition for : Indoor dining fully closed | ||||||
---|---|---|---|---|---|---|---|---|---|
Change in restaurant and accommodation spending | Std. Error | F values | Change in restaurant and accommodation spending | Std. Error | F values | Change in restaurant and accommodation spending | Std. Error | F values | |
N = 738 | N = 738 | N = 738 | |||||||
Intercept | -0.25* | 0.014 | 423.95 | -0.25* | 0.014 | 443.82 | -0.25* | 0.014 | 447.78 |
Restricted | -0.02 | 0.009 | 19.62 | -0.06* | 0.010 | 97.70 | -0.06* | 0.009 | 114.98 |
Case rate per 100,000 population | -0.00* | 0.000 | 88.28 | -0.00* | 0.000 | 87.31 | -0.00* | 0.000 | 82.88 |
Mortality per 100,000 population | -0.01 | 0.008 | 10.88 | -0.01 | 0.007 | 10.43 | -0.01 | 0.007 | 10.86 |
Change: case rate over last two wks. | 0.02* | 0.004 | 31.55 | 0.02* | 0.004 | 27.20 | 0.02* | 0.004 | 27.71 |
Change: mortality over last two wks. | -0.00 | 0.001 | 0.94 | -0.00 | 0.001 | 0.86 | -0.00 | 0.001 | 0.82 |
AIC | -2684 | -2720 | -2721 | ||||||
ΔAICa | +27 | -9 | -10 |
a AIC statistic value compared to corresponding base case model (see middle panel, last row of Table 2, AIC value of -2711).
# Obs | Definition for : Weeks designated restricted only after two weeks following enactment of distancing measures | Definition for : Restrictions must last at least 3 weeks | Definition for : Indoor dining fully closed | ||||||
---|---|---|---|---|---|---|---|---|---|
Change in initial unemployment claims rate | Std. Error | F values | Change in initial unemployment claims rate | Std. Error | F values | Change in initial unemployment claims rate | Std. Error | F values | |
N = 701 | N = 701 | N = 701 | |||||||
Intercept | 0.36* | 0.042 | 140.34 | 0.36* | 0.041 | 142.98 | 0.37* | 0.041 | 145.15 |
Restricted | 0.04 | 0.035 | 4.00 | 0.26* | 0.038 | 57.75 | 0.21* | 0.034 | 51.34 |
Case rate per 100,000 population | 0.00* | 0.000 | 27.58 | 0.00* | 0.000 | 21.38 | 0.00* | 0.000 | 19.49 |
Mortality per 100,000 population | 0.07* | 0.026 | 8.21 | 0.07* | 0.025 | 7.44 | 0.07* | 0.025 | 7.43 |
Change: case rate over last two wks. | -0.01 | 0.012 | 0.57 | 0.00 | 0.012 | 0.02 | -0.00 | 0.012 | 0.08 |
Change: mortality over last two wks. | -0.00 | 0.004 | 0.92 | -0.00 | 0.003 | 1.02 | -0.00 | 0.003 | 1.10 |
AIC | -941 | -983 | -976 | ||||||
ΔAICa | +40 | -2 | +5 |
a AIC statistic value compared to corresponding base case model (see right panel, last row of Table 2, AIC value of -981).
Finally, we report results for other model correlation structures (Tables 10, 11, and 12). Not all alternative correlation structures we evaluated produced models that converged. For those that did, the estimated impacts of government-imposed restrictions were similar to or modestly larger than the corresponding base case estimates. The AIC goodness of fit statistics indicate, however, that models that produced estimates for the impact of government-imposed restrictions that differed the most from the corresponding base case estimates did not fit the data as well as the base case model (less negative AIC value).
# Obs | Change in total consumer spending – AR2 (Std. dev.) | F values | Change in total consumer spending – AR3 (Std. dev.) | F values | Change in total consumer spending –AR4 (Std. dev.) | F values | Change in total consumer spending – MA1 (Std. dev.) | F values | Change in total consumer spending – MA2 (Std. dev.) | F values | Change in total consumer spending – AR1MA1 (Std. dev.) | F values | Change in total consumer spending – AR1MA2 (Std. dev.) | F values |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
738 | 738 | 738 | 738 | 738 | 738 | 738 | ||||||||
Intercept | -0.02* (0.009) | 11.50 | -0.02* (0.009) | 12.33 | -0.02* (0.009) | 12.29 | -0.02* (0.009) | 11.49 | -0.02* (0.009) | 11.55 | -0.02* (0.009) | 11.50 | -0.02* (0.009) | 11.51 |
Restricted | -0.02* (0.007) | 20.52 | -0.02* (0.008) | 17.67 | -0.02* (0.008) | 17.56 | -0.02* (0.007) | 21.03 | -0.02* (0.007) | 21.02 | -0.02* (0.007) | 21.05 | -0.02* (0.007) | 20.89 |
Case rate per 100,000 population | -0.00* (0.000) | 13.04 | -0.00 (0.000) | 4.86 | -0.00 (0.000) | 4.91 | -0.00* (0.000) | 13.93 | -0.00* (0.000) | 13.20 | -0.00* (0.000) | 13.94 | -0.00* (0.000) | 13.50 |
Mortality per 100,000 population | -0.00 (0.007) | 2.69 | -0.01 (0.007) | 5.11 | -0.01 (0.004) | 4.96 | -0.00 (0.007) | 2.62 | -0.00 (0.007) | 2.94 | -0.00 (0.007) | 2.62 | -0.00 (0.007) | 2.72 |
Change: case rate over last two wks. | 0.01 (0.004) | 1.37 | 0.01 (0.004) | 2.10 | 0.01 (0.004) | 2.12 | 0.01 (0.004) | 1.18 | 0.01 (0.004) | 1.47 | 0.01 (0.004) | 1.18 | 0.01 (0.004) | 1.31 |
Change: mortality over last two wks. | -0.00 (0.002) | 1.26 | -0.00 (0.001) | 1.74 | -0.00 (0.001) | 1.69 | -0.00 (0.001) | 1.33 | -0.00 (0.001) | 1.24 | -0.00 (0.001) | 1.33 | -0.00 (0.001) | 1.29 |
AIC | -2484 | -2531 | -2529 | -2485 | -2482 | -2483 | -2482 | |||||||
ΔAICa | +1 | -45 | -44 | 0 | +3 | +2 | +3 |
a AIC statistic value compared to corresponding base case model (see left panel, last row of Table 2, AIC value of -2485).
# Obs | Change in restaurant and accommodation spending – AR2 (Std. dev.) | F values | Change in restaurant and accommodation spending – AR3 (Std. dev.) | F values | Change in restaurant and accommodation spending – MA1 (Std. dev.) | F values | Change in restaurant and accommodation spending – MA2 (Std. dev.) | F values | Change in restaurant and accommodation spending – AR1MA1 (Std. dev.) | F values |
---|---|---|---|---|---|---|---|---|---|---|
738 | 738 | 738 | 738 | 738 | ||||||
Intercept | -0.26* (0.014) | 451.23 | -0.26* (0.014) | 463.71 | -0.25* (0.014) | 446.94 | -0.25* (0.014) | 444.75 | -0.26* (0.014) | 466.96 |
Restricted | -0.05* (0.009) | 70.14 | -0.05* (0.009) | 70.20 | -0.06* (0.007) | 190.28 | -0.05* (0.008) | 139.71 | -0.05* (0.008) | 81.42 |
Case rate per 100,000 population | -0.00* (0.000) | 32.63 | -0.00* (0.000) | 27.97 | -0.00* (0.000) | 152.36 | -0.00* (0.000) | 107.36 | -0.00* (0.000) | 40.47 |
Mortality per 100,000 population | -0.00 (0.007) | 7.13 | -0.00 (0.007) | 4.54 | -0.01 (0.007) | 19.93 | -0.01 (0.007) | 17.36 | -0.00 (0.007) | 6.76 |
Change: case rate over last two wks. | 0.02* (0.003) | 34.98 | 0.02* (0.004) | 33.39 | 0.02* (0.004) | 24.79 | 0.02* (0.004) | 30.01 | 0.02* (0.004) | 30.88 |
Change: mortality over last two wks. | -0.00 (0.001) | 0.69 | -0.00 (0.001) | 1.51 | -0.00 (0.001) | 1.07 | -0.00 (0.001) | 0.40 | -0.00 (0.001) | 1.40 |
AIC | -2745 | -2755 | -2671 | -2703 | -2764 | |||||
ΔAICa | -34 | -44 | +40 | +8 | -53 |
a AIC statistic value compared to corresponding base case model (see middle panel, last row of Table 2, AIC value of -2711).
# Obs | Change in initial unemployment claims rate – AR2 (Std. dev.) | F values | Change in initial unemployment claims rate – AR3 (Std. dev.) | F values | Change in initial unemployment claims rate – MA1 (Std. dev.) | F values | Change in initial unemployment claims rate – MA2 (Std. dev.) | F values | Change in initial unemployment claims rate – AR1MA1 (Std. dev.) | F values | Change in initial unemployment claims rate – AR1MA2 (Std. dev.) | F values |
---|---|---|---|---|---|---|---|---|---|---|---|---|
701 | 701 | 701 | 701 | 701 | 701 | |||||||
Intercept | 0.37* (0.041) | 142.77 | 0.37* (0.042) | 142.34 | 0.38* (0.038) | 151.24 | 0.38* (0.038) | 151.24 | 0.37* (0.042) | 142.48 | 0.37* (0.042) | 142.48 |
Restricted | 0.21* (0.032) | 60.11 | 0.21* (0.032) | 60.61 | 0.24* (0.029) | 160.10 | 0.24* (0.029) | 160.10 | 0.21* (0.032) | 60.40 | 0.21* (0.032) | 60.40 |
Case rate per 100,000 population | 0.00* (0.000) | 16.07 | 0.00* (0.000) | 16.05 | 0.00 (0.000) | 24.55 | 0.00 (0.000) | 24.55 | 0.00* (0.000) | 16.04 | 0.00* (0.000) | 16.04 |
Mortality per 100,000 population | 0.07* (0.025) | 7.81 | 0.07* (0.025) | 7.91 | 0.13* (0.027) | 32.94 | 0.13* (0.027) | 32.94 | 0.07* (0.025) | 7.87 | 0.07* (0.025) | 7.87 |
Change: case rate over last two wks. | -0.00 (0.012) | 0.04 | -0.00 (0.012) | 0.04 | -0.00 (0.015) | 0.21 | -0.00 (0.015) | 0.21 | -0.00 (0.012) | 0.04 | -0.00 (0.012) | 0.04 |
Change: mortality over last two wks. | -0.00 (0.003) | 0.78 | -0.00 (0.003) | 0.79 | -0.00 (0.005) | 0.62 | -0.00 (0.005) | 0.62 | -0.00 (0.003) | 0.78 | -0.00 (0.003) | 0.78 |
AIC | -986 | -984 | -533 | -531 | -986 | -984 | ||||||
ΔAICa | -5 | -3 | +448 | +450 | -5 | -3 |
a AIC statistic value compared to corresponding base case model (see right panel, last row of Table 2, AIC value of -981).
We found that government-imposed restrictions during the fall and early winter of 2020-2021 were associated with reduced economic activity. Descriptive statistics revealed lower total consumer spending, lower consumer spending on restaurants and accommodations, and a greater number of initial unemployment claims during weeks with restrictions than during weeks without restrictions (Table 1 – compare outcome means for weeks without and with restrictions). Regression analysis revealed an association with restrictions even after controlling for the number of new COVID cases, COVID mortality, and the change in those rates over the preceding two weeks (Table 2). That influence appears to be robust to modeling assumptions, as indicated by the modest impact of our sensitivity analyses on the estimated impact of government-imposed restrictions. Where sensitivity analyses yielded the most notable departures from the base case, the AIC value suggested the alternative model did not fit the model as well.
Several factors complicated assessment of the impact of government restrictions on economic outcomes. Importantly, the restrictions imposed by state governments differed across states and over time. Our sensitivity analyses using alternative definitions for government restrictions suggest, however, that this issue does not invalidate our findings. A second complication is the fact that government-imposed restrictions tend to coincide with the events that cause voluntary reductions in economic activity. In short, the same news headlines that cause state governments to impose restrictions also cause many consumers to voluntarily stay home and reduce their spending. We attempted to isolate the impact of government-imposed restrictions by including in our models daily COVID cases and mortality, and the changes in those statistics over the preceding two weeks.
We estimated the dollar cost of restrictions as follows. Our base case analysis results imply that restrictions reduce consumer spending by 2%, reduce restaurant and accommodations spending by 5%, and increase weekly unemployment claims by 0.21% of the 2019 work force. Nationally, total annualized consumer spending amounted to $13.3 trillion in the fourth quarter of 2019;23 restaurant and accommodations spending totals approximately $1.2 trillion annually, including $863 billion spent in restaurants24 and $300 billion spent on accommodations.25 The U.S. labor force in 2019 totaled 163 million individuals.26 The model results hence imply that restrictions, if imposed by all states for a full year, would reduce total consumer spending by , of which could be attributed to a reduction in spending on restaurants and accommodations. The model results also imply that restrictions imposed by all states would increase initial weekly unemployment claims by initial claims each week.
The computations just described yield cost estimates for a hypothetical, nationwide, year-long imposition of business restrictions. We scale these estimates down to characterize the impact of the restrictions actually imposed. During the fall and winter of 2020-2021, when the U.S. experienced the pandemic’s third wave, 10 states (CA, IL, KY, MI, MN, NM, OR, PA, RI, and WA) imposed restrictions for between 21 and 86 days, with an average (and GDP-weighted average) duration of 49 days. Those states represent approximately one-third of the country’s GDP.27
Taking a third of the projected nationwide, annual costs ($90 billion for total spending and $20 billion for restaurant and accommodations spending), and then scaling these values down by a further 86.5 percent to impute the costs associated with the imposition of restrictions for 7 weeks (13.5 percent the year) yields costs of $12 billion in total consumer spending, of which $2.7 billion would be attributable to decreased spending on restauraunts and accommodations. Assuming employment is approximately proportional to GDP, these states would together experience an additional 114,000 initial weekly unemployment claims each week during the imposition of these restrictions. (We note that the unemployment data do not reflect seasonal adjustment, but it is not evident that this limitation introduces any particular bias; nonetheless, it does introduce some uncertainty.)
While a total cost of $12 billion can seem modest in the context of a global pandemic with estimated costs likely amounting to trillions of dollars in lost economic activity, the losses estimated here are indeed substantial. Keep in mind that they occur over a limited time period (during the 1 or 2 months at the peak of a surge in COVID cases) and that the population can experience multiple case surges during a pandemic; as of this writing, the United States has experienced three such surges and is in the midst of a fourth due to the Delta variant. Assuming that late 2020 is representative of tendencies for the government to restrict economic activity in response to high hospital utilization, therapies reducing hospital utilization have the potential to confer substantial societal value.
Whether prices charged for therapies should reflect this component of value is another question, as decision makers must also consider a range of issues, including affordability.28 Importantly, this analysis shows that estimating the cost of government-imposed restrictions is feasible, hence making it possible to extend health technology assessments beyond the typical and often exclusive focus on the valuation of health benefits.
Government restrictions reduced consumer spending by 12 billion dollars and increased unemployment claims by 114,000 each week during the Fall/early Winer surge of COVID-19. Sensitivity analysis showed these findings to be robust to alternative modeling assumptions. The criteria for implementing business restrictions in various U.S. states, such as California and New York, suggest that increases in hospital utilization during COVID pandemic surges trigger such government restrictions. As COVID-19 therapies that can lower the risk of hospitalization and severe disease are developed and become available, government business restrictions may become a less necessary measure for lowering the hospital burden. Therefore, our analysis suggests that investment in the development and use of such therapies may not only provide a substantial health benefit, but also avert some of the economic impact of government restrictions, providing a substantial societal benefit.
While a therapy’s health benefits will no doubt remain the core element of health technology assessment, for therapies addressing threats that affect others in addition to those who become ill, recognizing societal benefits will help allocate resources to promote innovations that address the most important risks society faces.
https://github.com/sweidner1/CEVR---Consortium---COVID-19-
This project contains the following underlying data:
• Generated Data for Analysis – Spending.csv – Data file containing weekly observations of business restrictions data for each state.
• Generated Data for Analysis – Unemployment.csv – Data file containing weekly observations of business restrictions data for each state.
• Data Cleaning. R – R code file that takes raw data files and cleans them into files suitable for analysis using our model.
• Base Case. R – R code file that completes our base case regression analysis for all three outcomes and produces results files.
• Table 1. R – R code file that generates summary statistics for our data and produces results files.
• Table A2.R – R code file that completes our ten state subgroup regression analysis for all three outcomes and produces results files.
• Table A3a. R – R code file that completes our sensitivity analyses in which we remove case rate, death rate, and both as explanatory variables for the total consumer spending outcome and produces results files.
• Table A3b. R – R code file that completes our sensitivity analyses in which we remove case rate, death rate, and both as explanatory variables for the restaurant and accommodation spending outcome and produces results files.
• Table A3c. R – R code file that completes our sensitivity analyses in which we remove case rate, death rate, and both as explanatory variables for the initial unemployment claims outcome and produces results files.
• Table A4a. R – R code file that completes our sensitivity in which we alter the definition of our business restrictions variables Restricted for the total consumer spending outcome and produces results files.
• Table A4b. R – R code file that completes our sensitivity in which we alter the definition of our business restrictions variables Restricted for the restaurant and accommodation spending outcome and produces results files.
• Table A4c. R – R code file that completes our sensitivity in which we alter the definition of our business restrictions variables Restricted for the initial unemployment claims outcome and produces results files.
• Table A5a. R – R code file that completes our sensitivity in which we vary out assumptions for outcome correlations over time for the total consumer spending outcome and produces results files.
• Table A5b. R – R code file that completes our sensitivity in which we vary out assumptions for outcome correlations over time for the restaurant and accommodation spending outcome and produces results files.
• Table A5c. R – R code file that completes our sensitivity in which we vary out assumptions for outcome correlations over time for the initial unemployment claims outcome and produces results files.
• README.docx – README file that gives further details on all data files and describes how to properly run all code files to replicate our analysis
Data are available under the terms of the Creative Commons Zero “No rights reserved” data waiver (CC0 1.0 Public domain dedication).
https://github.com/OpportunityInsights/EconomicTracker
This project contains the following underlying data:
• Affinity – State – Daily.csv – Data file containing daily observations of spending statistics for each U.S. state, including % change in total consumer spending since January 2020, and % change in restaurant and accommodation spending since January 2020.
• COVID – State – Daily.csv – Data file containing daily observations of COVID statistics for each U.S. state, including new case rate and new death rate.
• UI Claims – State – Weekly.csv – Data file containing weekly observations of unemployment claims statistics for each U.S. state, including initial weekly unemployment claims rates.
https://github.com/sweidner1/CEVR---Consortium---COVID-19-
This project contains the following underlying data:
• 2021 08 03a – STROBE checklist.docx – Word document containing the STROBE (Strengthening the Reporting of Observational Studies in Epidemiology) reporting guidelines checklist with all relevant information from our manuscript to show fulfillment of the checklist.
Data are available under the terms of the Creative Commons Zero “No rights reserved” data waiver (CC0 1.0 Public domain dedication).
Views | Downloads | |
---|---|---|
F1000Research | - | - |
PubMed Central
Data from PMC are received and updated monthly.
|
- | - |
Is the work clearly and accurately presented and does it cite the current literature?
Yes
Is the study design appropriate and is the work technically sound?
Partly
Are sufficient details of methods and analysis provided to allow replication by others?
Yes
If applicable, is the statistical analysis and its interpretation appropriate?
Yes
Are all the source data underlying the results available to ensure full reproducibility?
Yes
Are the conclusions drawn adequately supported by the results?
Partly
Competing Interests: No competing interests were disclosed.
Reviewer Expertise: Economics
Is the work clearly and accurately presented and does it cite the current literature?
Yes
Is the study design appropriate and is the work technically sound?
Yes
Are sufficient details of methods and analysis provided to allow replication by others?
Yes
If applicable, is the statistical analysis and its interpretation appropriate?
Partly
Are all the source data underlying the results available to ensure full reproducibility?
Yes
Are the conclusions drawn adequately supported by the results?
Partly
Competing Interests: No competing interests were disclosed.
Reviewer Expertise: Operating room and anesthesia group administrative modeling
Alongside their report, reviewers assign a status to the article:
Invited Reviewers | ||
---|---|---|
1 | 2 | |
Version 1 26 Aug 21 |
read | read |
Provide sufficient details of any financial or non-financial competing interests to enable users to assess whether your comments might lead a reasonable person to question your impartiality. Consider the following examples, but note that this is not an exhaustive list:
Sign up for content alerts and receive a weekly or monthly email with all newly published articles
Already registered? Sign in
The email address should be the one you originally registered with F1000.
You registered with F1000 via Google, so we cannot reset your password.
To sign in, please click here.
If you still need help with your Google account password, please click here.
You registered with F1000 via Facebook, so we cannot reset your password.
To sign in, please click here.
If you still need help with your Facebook account password, please click here.
If your email address is registered with us, we will email you instructions to reset your password.
If you think you should have received this email but it has not arrived, please check your spam filters and/or contact for further assistance.
Comments on this article Comments (0)