What Baseball Can Teach Policymakers

With the Major League Baseball season having just begun, I’m reminded of the truism that the best teams win their divisions in the regular season, but the hot teams win in the post-season playoffs.  Why the difference?  The regular season is 162 games long, but the post-season consists of just a few brief 5-game and 7-game series.  And because of the huge random element that pervades the sport, in a single game (or a short series), the best teams often lose, and the worst teams often win.

The numbers are striking, and bear repeating.  In a typical year, the best teams lose 40 percent of their games, and the worst teams win 40 percent of theirs.  In the extreme, one of the best Major League Baseball teams ever ­- the 1927 New York Yankees – lost 29 percent of their games; and one of the worst teams in history – the 1962 New York Mets – won 25 percent of theirs.  On any given day, anything can happen.  Uncertainty is a fundamental part of the game, and any analysis that fails to recognize this is not only incomplete, but fundamentally flawed.

The same is true of analyses of environmental policies.  Uncertainty is an absolutely fundamental aspect of environmental problems and the policies that are employed to address those problems.  Any analysis that fails to recognize this runs the risk not only of being incomplete, but misleading as well.  Judson Jaffe, formerly at Analysis Group, and I documented this in a study published in Regulation and Governance.

To estimate proposed regulations’ benefits and costs, analysts frequently rely on inputs that are uncertain —  sometimes substantially so.  Such uncertainties in underlying inputs are propagated through analyses, leading to uncertainty in ultimate benefit and cost estimates, which constitute the core of a Regulatory Impact Analysis (RIA), required by Presidential Executive Order for all “economically significant” proposed Federal regulations.

Despite this uncertainty, the most prominently displayed results in RIAs are typically single, apparently precise point estimates of benefits, costs, and net benefits (benefits minus costs), masking uncertainties inherent in their calculation and possibly obscuring tradeoffs among competing policy options.  Historically, efforts to address uncertainty in RIAs have been very limited, but guidance set forth in the U.S. Office of Management and Budget’s (OMB) Circular A‑4 on Regulatory Analysis has the potential to enhance the information provided in RIAs regarding uncertainty in benefit and cost estimates.  Circular A‑4 requires the development of a formal quantitative assessment of uncertainty regarding a regulation’s economic impact if either annual benefits or costs are expected to reach $1 billion.

Over the years, formal quantitative uncertainty assessments — known as Monte Carlo analyses — have become common in a variety of fields, including engineering, finance, and a number of scientific disciplines, as well as in “sabermetrics” (quantitative, especially statistical analysis of professional baseball), but rarely have such methods been employed in RIAs.

The first step in a Monte Carlo analysis involves the development of probability distributions of uncertain inputs to an analysis.  These probability distributions reflect the implications of uncertainty regarding an input for the range of its possible values and the likelihood that each value is the true value.  Once probability distributions of inputs to a benefit‑cost analysis are established, a Monte Carlo analysis is used to simulate the probability distribution of the regulation’s net benefits by carrying out the calculation of benefits and costs thousands, or even millions, of times.  With each iteration of the calculations, new values are randomly drawn from each input’s probability distribution and used in the benefit and/or cost calculations.  Over the course of these iterations, the frequency with which any given value is drawn for a particular input is governed by that input’s probability distribution.  Importantly, any correlations among individual items in the benefit and cost calculations are taken into account.  The resulting set of net benefit estimates characterizes the complete probability distribution of net benefits.

Uncertainty is inevitable in estimates of environmental regulations’ economic impacts, and assessments of the extent and nature of such uncertainty provides important information for policymakers evaluating proposed regulations.  Such information offers a context for interpreting benefit and cost estimates, and can lead to point estimates of regulations= benefits and costs that differ from what would be produced by purely deterministic analyses (that ignore uncertainty).  In addition, these assessments can help establish priorities for research.

Due to the complexity of interactions among uncertainties in inputs to RIAs, an accurate assessment of uncertainty can be gained only through the use of formal quantitative methods, such as Monte Carlo analysis.  Although these methods can offer significant insights, they require only limited additional effort relative to that already expended on RIAs.  Much of the data required for these analyses are already obtained by EPA in their preparation of RIAs; and widely available software allows the execution of Monte Carlo analysis in common spreadsheet programs on a desktop computer.  In a specific application in the Regulation and Governance study, Jaffe and I demonstrate the use and advantages of employing formal quantitative analysis of uncertainty in a review of EPA’s 2004 RIA for its Nonroad Diesel Rule.

Formal quantitative assessments of uncertainty can mark a truly significant step forward in enhancing regulatory analysis under Presidential Executive Orders.  They have the potential to improve substantially our understanding of the impact of environmental regulations, and thereby to lead to more informed policymaking.

Share

Moving Beyond Vintage-Differentiated Regulation

A common feature of many environmental policies in the United States is vintage-differentiated regulation (VDR), under which standards for regulated units are fixed in terms of the units’ respective dates of entry, with later vintages facing more stringent regulation.  In the most common application, often referred to as “grandfathering,” units produced prior to a specific date are exempted from a new regulation or face less stringent requirements.

As I explain in this post, an economic perspective suggests that VDRs are likely to retard turnover in the capital stock, and thereby to reduce the cost-effectiveness of regulation in the long-term, compared with equivalent undifferentiated regulations.  Further, under some conditions the result can be higher levels of pollutant emissions than would occur in the absence of regulation.  Thus, economists have long argued that age-discriminatory environmental regulations retard investment, drive up the cost of environmental protection, and may even retard pollution abatement.

Why have VDRs been such a common feature of U.S. regulatory policy, despite these problems?  Among the reasons frequently given are claims that VDRs are efficient and equitable.  These are not unreasonable claims.  In the short-term, it is frequently cheaper to control a given amount of pollution by adopting some technology at a new plant than by retrofitting that same or some other technology at an older, existing plant.  Hence, VDRs appear to be cost-effective, at least in the short term.  But this short-term view ignores the perverse incentive structure that such a time-differentiated standard puts in place.  By driving up the cost of abatement with new vintages of plant or technology relative to older vintages, investments (in plants and/or technologies) are discouraged.

In terms of equity, it may indeed appear to be fair or equitable to avoid changing the rules for facilities that have already been built or products that have already been manufactured, and to focus instead only on new facilities and products.  But, on the other hand, the distinct “lack of a level playing field” – an essential feature of any VDR – hardly appears equitable from the perspective of those facing the more stringent component of an age-differentiated regulation.

An additional and considerably broader explanation for the prevalence of VDRs is fundamentally political.  Existing firms seek to erect entry barriers to restrict competition, and VDRs drive up the costs for firms to construct new facilities.  And environmentalists may support strict standards for new sources because they represent environmental progress, at least symbolically.  Most important, more stringent standards for new sources allow legislators to protect existing constituents and interests by placing the bulk of the pollution control burden on unbuilt factories.

Surely the most prominent example of VDRs in the environmental realm is New Source Review (NSR), a set of requirements under the Clean Air Act that date back  to  the  1970s.  The lawyers and engineers who wrote the law thought they could secure faster environmental progress by imposing tougher emissions standards on new power plants (and certain other emission sources) than on existing ones.  The theory was that emissions would fall as old plants were retired and replaced by new ones.  But experience over the past 25 years has shown that this approach has been both excessively costly and environmentally counterproductive.

The reason is that it has motivated companies to keep old (and dirty) plants operating, and to hold back investments in new (and cleaner) power generation technologies.  Not only has New Source Review deterred investment in newer, cleaner technologies; it has also discouraged companies from keeping power plants maintained.  Plant owners contemplating maintenance activities have had to weigh the possible loss of considerable regulatory advantage if the work crosses a murky line between upkeep and new investment.  Protracted legal wrangling has been inevitable over whether maintenance activities have crossed a threshold sufficient to justify forcing an old plant to meet new plant standards.  Such deferral of maintenance has compromised the reliability of electricity generation plants, and thereby increased the risk of outages.

Research has demonstrated that the New Source Review process has driven up costs  tremendously (not just for the electricity companies, but for their customers and shareholders, that is, for all of us) and has resulted in worse environmental quality than would have occurred if firms had not faced this disincentive to invest in new, cleaner technologies.  In an article that appeared in 2006 in the Stanford Environmental Law Journal, I summarized and sought to synthesize much of the existing, relevant economic research.

The solution is a level playing field, where all electricity generators would have the same environmental requirements, whether plants are old or new.  A sound and simple approach would be to cap total pollution, and use an emissions trading system to assure that any emissions increases at one plant are balanced by offsetting reductions at another.  No matter how emissions were initially allocated across plants, the owners of existing plants and those who wished to build new ones would then face the correct incentives with respect to retirement decisions, investment decisions, and decisions regarding the use of alternative fuels and technologies to reduce pollution.

In this way, statutory environmental targets can be met in a truly cost-effective manner, that is, without introducing perverse incentives that discourage investment, drive up costs in the long run, and have counter-productive effects on environmental protection.

It is not only possible, but eminently reasonable to be both a strong advocate for  environmental protection and an advocate for the elimination of vintage differentiated regulations, such as New Source Review.  That is where an economic perspective and the available evidence leads.

Share

A Tale of Two Taxes

Whether they are called “revenue enhancements” or “user charges,” fear of the political consequences of taxes restricts debate on energy and environmental policy options in Washington. In a March 7th post on “Green Jobs,” in which I argued that it is not always best to try to address two challenges with a single policy instrument, I also noted that in some cases such dual-purpose policy instruments can be a good idea, and I gave gasoline taxes as an example.

Although a serious recession is clearly not the time to expect political receptivity to such a proposal, the time will come — we all hope very soon — when the economy turns around, employment rises, and a sustained period of economic growth ensues. When that happens, serious consideration should be given to increases in the Federal tax on gasoline.

A gas tax increase — coupled with an offsetting reduction in other taxes, such as the Social Security tax on wages — could make most American households better off, while reducing oil imports, local pollution, urban congestion, road accidents, and global climate change. This revenue-neutral tax reform would exemplify the market-based approaches to environmental protection and resource management I examined in previous posts.

Such a change need not constitute a new tax, but a reform of existing ones. It is well known ­– both from economic theory and numerous empirical studies ­– that taxes tend to reduce the extent to which people undertake the taxed activity. In the United States, most tax revenues are raised by levies on labor and investment; the resulting reduction in these fundamentally desirable activities is viewed as an unfortunate but unavoidable side-effect of the need to raise revenue for government operations. Would it not make more sense to raise the revenue we need by taxing undesirable activities, instead of desirable ones?

Combustion of gasoline in motor vehicles produces local air pollution as well as carbon dioxide that contributes to global climate change, increases imports of oil, and exacerbates urban highway congestion. Can anyone really claim that — given a choice between discouraging work and discouraging gasoline consumption — it is better to discourage work?

According to the U.S. Department of Energy, a 50 cent gas tax increase could eventually reduce gasoline consumption by 10 to 15%, reduce oil imports by perhaps 500 thousand barrels per day, and generate about $40 billion per year in revenue.

Furthermore, this approach would be far more effective than on-going proposals to increase the Corporate Average Fuel Economy (CAFE) standards, which affect only new vehicles and lead to serious safety problems by encouraging auto makers to produce lighter vehicles. Also, remember that a major effect of CAFE standards has been to accelerate the shift from cars to SUVs and light trucks (so that overall fuel efficiency of new vehicles sold is no better than it was a decade ago, despite the great strides that have taken place in fuel efficiency technologies). As my Harvard colleague Martin Feldstein pointed out in The Wall Street Journal in 2006, the conventional approach “does nothing to encourage individuals to drive less, to use their cars more efficiently, or to shift sooner to new and more fuel efficient [and cleaner] vehicles.” A more enlightened approach ­— a market-based approach — would reward consumers who economize on gasoline use. And that is what a revenue-neutral gas tax is all about.

The revenue from the gas tax could be transferred to the Social Security Trust Fund and credited to current workers. If $40 billion per year from new gas tax revenues were transferred to Social Security, the payroll tax — the employee contribution to Social Security — could be cut by perhaps a third: a worker with annual wages of $30,000 would take home an additional $750 per year! The extra income would more than offset the cost of the gas tax, unless the worker drove over 35,000 miles per year in a car getting 25 miles or less per gallon. Rebating the gas tax in this way addresses the greatest concern about higher gas taxes — that they can hit hardest those workers who drive to their jobs. Further, a tax of this magnitude could be phased in gradually, perhaps no more than 10 cents per year over 5 years, allowing individuals and firms to adjust their consuming and producing behavior.

Proposals for gasoline tax increases in recent sessions of Congress would have dedicated the revenue to public spending (for transportation and other programs). A key difference is that the proposal I have outlined here is for a revenue-neutral change in which the gas tax revenue would be returned to Americans through reduced payroll taxes. To adopt some of the language I developed in my previous posts, such a change can be both efficient and equitable, and — for those reasons — perhaps even politically feasible.

Of course, such a scheme is not a panacea for U.S. energy and environmental problems. But it would make a significant contribution if enacted. On the other hand, political fear of the T-word in Washington may mean that it is never discussed seriously in public, let alone adopted. Most fear of taxes is due to politicians’ anxieties about asking their constituents to pay more. But an increase in the Federal gas tax, rebated through reduced payroll taxes would not cost most Americans any more and would have significant long-term benefits for the country. Still, fear of the T-word looms large; maybe it should be called an “All-American Ecologically Sound, Fully Recyclable, Anti-Terror, Energy-Independence Assessment.”

Share