"Stress Testing: What's Inside the Black Box?"
1. Introduction
Chairman Barr, Ranking Member Foster, and members of the Subcommittee, thank you for the opportunity to testify today. My name is
The Forum represents the eight global systemically important banks (GSIBs) headquartered in
As the largest banks, Forum members meet the most stringent set of bank regulatory requirements and undergo the most rigorous supervision from the federal banking agencies. Collectively, the
In recent years, the firms have not only satisfied hypothetical stress tests, but they have also been a strong source of support during real economic stress events. During the COVID-19 pandemic, Forum institutions acted quickly to conserve capital - by voluntarily suspending capital distributions - in anticipation of the needs of individual and business customers as major parts of the
2. Executive Summary
The importance of today's hearing demands a full and detailed assessment of transparency in the stress testing regime as well as the implications of a lack of transparency on government regulation and administration, as well as its effects on the economy. The remainder of my testimony considers these issues in detail, but I also provide a brief overview of my key findings here.
The stress testing regime is characterized by a high degree of variation in the amount of transparency provided to the public. Some aspects of the regime, such as the bank data collection as well as the scenarios that inform the exercise exhibit a significant degree of transparency. The quantitative models that determine how the data and scenarios are translated to losses and stressed capital ratios exhibit the lowest degree of transparency and are largely opaque to all but
Transparency in the stress testing regime is critical because open and transparent regulation is a cornerstone of long-established good governance standards. Indeed, certain laws such as the Administrative Procedures Act and the Government in the Sunshine Act demand a high degree of transparency from the government to ensure that government regulation benefits from a diverse set of views and feedback, appropriately limit the exercise of government authority, and to ensure public accountability. These goals are just as worthy in the context of the stress tests as they are in any other arena of banking or government regulation.
Relatedly, the lack of transparency in the stress tests does not comport with the degree of transparency afforded to the public in the context of related bank capital initiatives such as the GSIB capital surcharge or risk-weighted asset measurements - both of which have recently been subjected to public notice and comment following public proposals to modify these rules. n1 The lack of transparency in the stress testing regime is incongruous with the rest of the large bank capital regime and creates a clear and troubling disconnect in the government's approach to transparency in bank capital regulation.
Transparency in bank capital regulation, in general, and the stress tests, in particular, is important because bank capital and stress testing requirements impact credit allocation in the economy. As an example, using limited public disclosures, researchers have found strong evidence that the stress tests have limited funding for small business loans and certain healthcare-related industries. In the context of the non-stress testing components of the capital framework, the public is afforded the opportunity to comment on these impacts and regulators are required to consider these comments in crafting final rules. The public has no such opportunity in the case of the stress tests and the
A lack of transparency in the stress testing framework is further problematic because it frustrates banks' ability to practice prudent risk management. Capital requirements, of which the stress tests are a part, serve to provide a signal about the relative riskiness of different bank assets. Prudent risk management demands that banks be aware of these relative risk levels and that they use this information as they conduct their own risk management and capital planning. Opacity in the stress testing regime denies banks critical information that is required for sound decision making. Moreover, banks are not denied specific, granular information as it relates to any other aspect of the bank capital regime. Whether it be specific risk-weight rules, or the specific rules governing the GSIB capital surcharge, banks have a full window into the specification and calibration of these rules and use that information to inform their risk management and capital management decision. Indeed, regulators fully expect that banks will make use of such information and have either called upon banks to do so or have applauded their efforts in this regard.
Finally, opacity in the stress testing regime creates unhelpful and unnecessary regulatory uncertainty. Because banks do not fully understand or know the capital rules to which they are subject, they may respond either by pulling back in general from economic activity as that is a clear and natural response to heightened uncertainty, or they may make incomplete and inefficient adjustments based on limited data that are unproductive and unduly costly.
The present lack of transparency in the bank stress testing regime represents a clear public policy failure that must be rectified in the near term. The "original sin" of the SCAP should not be allowed to be re-branded as the "immaculate conception" of stress testing. In my concluding remarks, I provide a discussion of possible remedies that should be considered as part of a broader, public, and transparent policy discussion. Options for improving the stress testing regime would include changes that would bring the stress tests closer in line with the rest of the regulatory capital framework which is subject to the standard notice and comment process, as well as improved engagement with the public in regards to the annual stress scenario and an independent audit of the entire stress testing infrastructure that would provide both the
3. Stress Testing Stringency and GSIB Capital Adequacy
Over the last decade, the
Since the introduction of the Supervisory Capital Assessment Program, or SCAP, in 2009, the
A review of the macroeconomic scenarios that drive the severity of the stress tests show a consistent degree of variability or "dynamism" from year to year. More specifically, using data on the severely adverse macroeconomic scenario over the past decade shows a consistent level of variability in key scenario variables such as
Against this backdrop, it is useful to consider the performance of
Some interpret the resilience of our nation's largest banks as demonstrated by the annual stress tests as a sign of weakness or reduced "dynamism" of the stress tests. This conclusion does not comport with the facts. The capital levels and capital adequacy of large banks, in general, and
Taken as a whole, the available data that is available on the severity of the
4. Transparency in the Stress Testing Framework
a. Scenario Articulation and Design
The
The stress tests begin with the articulation of three scenarios - a baseline macroeconomic scenario, a severely adverse macroeconomic scenario, and a severely adverse global market shock scenario that is important for banks with significant trading activities. These scenarios represent one of three key inputs that determine the outcome of each year's exercise.
The output of the macroeconomic scenarios (baseline and severely adverse) is largely though not entirely transparent. Specifically, the
In contrast to the macroeconomic scenarios, the global market shock is comprised of a large number -as in several thousand - shocks to risk factors that impact the value of capital market instruments and private equity holdings. These severely adverse shocks are disclosed to the public in their entirety. The disclosed variables are articulated at an extremely high degree of granularity and specificity. As an example, in 2023 the
While the output of the stress scenario process is somewhat transparent, the process of formulating each year's scenario is not transparent. The main source of information on the scenario design process is the
"[t]he Board will specify the paths of most other macroeconomic variables based on the paths of unemployment, income, house prices, and activity. Some of these other variables, however, have taken wildly divergent paths in previous recessions (e.g., foreign GDP), requiring the Board to use its informed judgment in selecting appropriate paths for these variables. In general, the path for these other variables will be based on their underlying structure at the time that the scenario is designed (e.g., economic or financial-system vulnerabilities in other countries)."
The discussion above makes clear that while the scenario design framework does provide some broad and high-level guidance on the articulation of scenarios, it does not meaningfully limit or guide the selection of scenarios in any way that would give the public a detailed understanding of how or why certain scenarios are chosen from year to year.
Finally, while the
b. Bank-Specific Data Collection
Banks subject to stress tests are required to furnish a large volume of data to the
The
The
c. Quantitative Stress Test Models
The information from the scenarios and the bank-specific data that is collected as part of the
There is less transparency regarding the specification of the
The quantitative models underpinning the stress test exercise are also not subject to the usual notice and comment process. As a result, the public is unable to comment on the precise specification of the models or how they relate to the underlying scenario variables. Moreover,
As a result, the scope for such models to benefit from public transparency and the input of a wide range of informed stakeholders is large.
While the degree of transparency that is provided concerning the
The provided descriptions give the public a broad sense of the nature of each of the models that is described but the description is sufficiently high-level so as to obscure key elements of each model's specification. The provided descriptions articulate key scenario variables and key data items that are included in the loss model but do not say how these variables are included or the quantitative significance of the variables that are included. To analogize, the descriptions effectively describe a lemon chiffon cake as consisting of some flour, some eggs, some sugar and some butter and flavorings - the ingredients in most any cake. Overall, the descriptions are not sufficient to allow for a critical examination of their specification or to assess their impact. An example of one excerpt from the discussion of the
"The specific macroeconomic variables that enter each regression model differ across equations and are chosen based on statistical predictive power and economic theory. For example, yields on
The discussion above offers little specificity aside from a few examples of variables that are included in "many" of the models. Moreover, the provided discussion does not include any indication of the quantitative impact or contribution of these variables. While the discussion does provide a modicum of high-level and abstract discussion, the information provided would be of little use to the public or a quantitative analyst attempting to fully understand how the model translates bank data and scenario assumptions into stress test projections.
In addition to these broad, high-level, model descriptions the
As a specific example, in 2023, the
"The international other consumer, international small-business, international first mortgage, and international home equity portfolios, which are components of the other retail loans model, will be assigned loss rates associated with a percentile of the historical loss distribution. Under the supervisory severely adverse scenario, this percentile is related to the frequency of severe recessions."
The change described above does not provide any transparency to the magnitude of loss rates assigned beyond communicating that a loss rate associated with a "severe recession" is assigned. Clearly, without any further discussion of what is meant by a "severe recession" or what percentile of the loss distribution is employed, the provided description has effectively no empirical or substantive content that could be used to critically assess the reasonableness of the model change.
5. The Importance of Transparency in the Stress Testing Framework
a. The Historical Source of the
Having described the range of transparency that exists within the stress testing regime, it is appropriate to discuss the importance of transparency in the stress tests. Before doing so, however, it is important to briefly discuss the historical evolution of the stress test as, in many things, history has much to do with where we are today.
As previously discussed, before the Financial Crisis bank regulators did not regularly use stress tests to assess capital adequacy. During the Financial Crisis, however, regulators decided to stress test the 19 largest banks in order to assess the health of the banking sector and instill public confidence in its solvency. The desire to quickly develop, execute, and communicate the results of the stress tests to the public, as well as to ensure the stability of the banking sector - given the economic effects of the Financial Crisis - outweighed the importance of providing transparency regarding the design of the stress tests.
While such a choice at that time was clearly defensible, though still debatable, there is no such compelling argument more than 15 years after the financial crisis. Indeed, the basic transparency contours of stress testing in today's stress tests bear a striking resemblance to the initial SCAP. Specifically, in the SCAP regulators disclosed the scenarios that were used as well as form templates that were used to collect data from each of the 19 firms but did not provide detailed disclosures on the supervisory models employed nor did they seek public comment on these models. n8 Fifteen years after the financial crisis it stands to reason that the approach to transparency within the stress tests is ripe for vigorous reconsideration.
b. Transparency Promotes Good and Open Governance
Government regulation in
There are three key rationales for openness and transparency in government regulation. First, openness and transparency bring to bear the widest and most diverse range of views in addressing a particular problem that is to be addressed by regulation. As regulation is generally involved in addressing complex problems, such problems are generally best addressed when more and not fewer ideas are considered in the crafting of a regulation. More generally, it is difficult to identify any serious mode of inquiry in which better outcomes are yielded by restricting, rather than expanding, the source of ideas and feedback that are considered. Second, openness and transparency guard against an inappropriate use or misuse of authority. History provides ample examples in which a lack of transparency and openness has been used to exercise an undue use of authority. Conducting government regulation in an open and transparent manner ensures that light can serve as a powerful disinfectant that promotes the appropriate exercise of authority and good governance. Third, openness and transparency in government regulation promotes accountability for regulators. A clear and unfiltered understanding of a regulation is a necessary precondition for the public to adequately evaluate its effects on the entities being regulated and the broader public. Regulators must always be accountable to the public so that they have appropriate incentives to get it right and so that regulation can be improved over time. Regulations that are not openly disclosed frustrate the public's ability to hold regulators accountable, which can, itself, lead to an exercise of authority that does not serve the public's interests.
c. The Stress Tests Drive Credit Allocation in the
Perhaps the most compelling reason to provide more transparency to the stress testing process is that the stress tests have a clear and discernible impact on credit allocation in the
In one recent research paper, economists examined the impact of stress testing and concluded that
"Banks subject to stress tests have strongly cut small business loans secured by home equity, an important source of financing for entrepreneurs. Lower credit supply has led to a relative decline in entrepreneurship during the recovery in counties with higher exposure to stress tested banks."
The results of this research underscore how the stress testing process affects the entire economy. Specifically, evidence suggests that the
In another recent paper, economists found that the stress tests have had measurable deleterious consequences for the hospital sector. Specifically, the researchers found that hospitals that obtain funding from banks subject to the stress tests were subjected to a reduction in credit at increased cost that has had a measurable impact on health care outcomes. Specifically, they found that, "affected hospitals shift their operations to increase resource utilization following a negative credit shock but reduce the quality of their care to patients across a variety of measures, including a significant increase in risk-adjusted readmission and mortality rates. The results indicate that access to credit can affect the quality of healthcare hospitals deliver, pointing to important spillover effects of credit market frictions on health outcomes."
As in the case of small businesses, available data and research clearly suggest that the stress tests have credit allocation ramifications that impact households, businesses and communities throughout
Because of insufficient transparency in the stress tests, we only know about the credit allocation that has been uncovered to date in the limited research available. It is likely that the stress tests are having much wider and more significant impacts but the public's ability to assess impact is significantly impeded by a lack of transparency. The public's ability to understand and consider the impact of the stress tests would be greatly improved if the stress tests adhered to the same level of transparency that characterizes the rest of the regulatory capital system. In addition, such transparency would improve the quality of research on the impacts of the stress test regime and make it more imperative that the
d. Consistency with the Rest of the Capital and Bank Regulatory Framework
In discussions of stress testing and transparency, a claim is often made that somehow the stress tests are different and deserve a status and treatment that differs markedly from the rest of the capital framework. Such statements are incorrect. With the implementation of the stress capital buffer (SCB) framework, the stress tests are simply one part of an inter-related regulatory capital framework. More precisely, for
4.5% + GSIB% + SCB% [less than] Capital. n9
As can be seen in the above equation, the stress tests are simply one part of the regulatory capital framework that operates alongside and interchangeably with other aspects of the framework. As an example, if a bank exhibits an increase in its SCB by, say, 1 percentage point, and also exhibits a decline in its GSIB surcharge of 1 percentage point then its regulatory capital requirement is unchanged and the bank's overall economic incentives are similarly unaffected.
At this point it is useful to consider the transparency standard that applies to each component of the regulatory capital framework so that it can be compared and contrasted to the stress testing regime.
Consider the schedule of risk-weights that define RWA. Currently, the banking agencies are reviewing public comments to proposed changes to the risk-based capital framework - a process known as Basel III Endgame or "B3E"; the proposal makes various changes to the existing risk-weight schedule. More generally, the risk-weights that apply to various bank assets are fully transparent at the most granular level and are known to banks and the public. The current B3E process sheds important light on the value of the open and transparent nature of the risk-based capital framework. Importantly, the public comment process has elicited voluminous comment on the proposed B3E changes. In response to these comments, regulators have already indicated that "broad material changes" will be made to the proposal. n10 Accordingly, it is abundantly clear that regulators have found the provided comments to be a useful source of comment and analysis that will ultimately improve the final regulation.
In the case of B3E, the public comment process has generated a wide range of comments from public stakeholders that are not banks. In particular, an analysis of the B3E public comments found that among 347 comment letters that were examined, 86 percent were provided by sectors outside the banking industry, such as small businesses, interest groups, civil rights groups, agriculture, energy, manufacturing, and other end-user communities, demonstrating it is not just banks that are impacted by bank regulation. Consequently, because the entire economy is affected by capital regulation, it is critical to ensure bank capital requirements are calibrated appropriately through an open, public, and transparent process.
The voluminous comments by non-banks as part of the B3E process makes abundantly clear that non-banks have a clear and immediate interest in the precise form and calibration of bank capital regulation. The public's significant interest in the form and shape of capital regulation derives from one simple fact - households, businesses and communities are directly affected by bank regulation as it impacts the cost and availability of credit in the economy. Regulators themselves have openly acknowledged the value of these public comments to the B3E rulemaking process. Accordingly, the open and transparent B3E process has elicited a diverse range of views, provided relevant information which the banking agencies must consider, and provides a significant degree of public accountability. Considering the clear and significant benefits that public transparency has brought to the B3E process, it is difficult to understand why regulators are unwilling to reap such benefits in the context of the stress tests that function as one interdependent part of the overall bank capital regime.
Apart from the SCB, the regulatory capital requirement for
Similar to the experience of the B3E rulemaking process, a review of the 73 public comment letters filed in conjunction with the recent GSIB surcharge proposal clearly document a wide array of stakeholders. Academics, public interest groups, energy and commodity concerns, and nonbank financial institutions have all provided valuable, public comment on the proposal. As in the case of the B3E process, the public comments provide an effective means to gather a diverse set of views, appropriately limit the exercise of regulatory authority, and promote public accountability that undoubtedly serves to improve the shape of the final rule.
Finally, while the whole of the risk-based regulatory capital framework, aside from the stress tests, is open and transparent to the public, it is important not to lose sight of the broader frame in which the risk-based capital framework sits. All manner of bank regulation is broadly open and transparent to a degree far exceeding that of the stress tests. Apart from risk-based capital requirements, banks are also subject to leverage-based capital requirements - all of which are subject to the open and transparent public comment process. Relatedly, bank liquidity requirements, single counterparty credit limits, derivative margining requirements, and activity restrictions such as the Volcker Rule are all crafted in accordance with a public notice and comment process and final regulations, in their entirety, are available to the public. Any argument or suggestion that somehow stress testing is "different" and should be subject to different transparency requirements conflicts with basic standards of good governance and public accountability while contradicting long-established practices that are widely adopted throughout the whole of the bank regulatory framework.
e. Promoting Prudent Risk Management and Resource Allocation
At their core, capital requirements are about risk. Regulator prescribed capital requirements make a clear statement about the risk of various bank assets that are intended to ensure that riskier assets are funded with more loss absorbing capital. This is an appropriate goal of capital regulation. For the risk signal embedded in capital regulation to have an effect, however, banks must understand the capital regulation to which they are subject so that they can adapt and plan accordingly. As an example, if the risk of a certain asset increases and regulatory capital requirements increase, a decision by a bank to moderate or otherwise hedge its exposure to that asset would generally be identified as prudent risk management.
In the case of risk-weights, the subject of the current B3E proposal process, banks actively consider the specific and granular risk weights assigned to various assets such as mortgages, small business loans, and auto loans. Indeed, the voluminous and productive commentary received as part of the B3E proposal process underscores the clear understanding the public has about how bank's use the information contained in regulatory capital standards to make prudent risk management choices. Risk-weights that are not tied to risk or embed incorrect risk assessments can result in poor risk management incentives and capital allocation decisions that are not consistent with real underlying risks and divert bank funding from its most productive and efficient use.
Similarly, as banks consider how to allocate bank funding to various assets they consider how such allocations would influence their regulator-defined systemic risk profile, as defined by the GSIB Score, and resulting capital requirements, as defined through the GSIB surcharge. In the context of the GSIB Score and Surcharge, regulators have broadly applauded banks' internalization of the rule and its impact on their capital requirements. As an example, in voting to approve the final GSIB Surcharge rule in 2015, Chair
"In practice, this final rule will confront these firms with a choice: they must either hold substantially more capital, reducing the likelihood that they will fail, or else they must shrink their systemic footprint, reducing the harm that their failure would do to our financial system. Either outcome would enhance financial stability." n11
As this statement makes clear, regulators understand and approve of the fact that banks internalize regulatory constraints and actively consider them when making business decisions. When capital regulations are appropriately specified, doing so ensures that banks are able to allocate the scarce resources they steward to the use that achieves the best risk-adjusted return for the economy.
Relatedly, the
For reasons that are difficult to understand, regulators take an altogether different and generally dim view of banks' responding to the incentives embedded in the capital framework as it relates to stress testing. Such efforts by banks are typically labeled as "gaming" or "regulatory arbitrage" whereas the same action in the context of assessing risk weights or GSIB surcharges is viewed as a natural and indeed laudable feature of sound risk management.
A common argument that is used to support a lack of transparency in the context of the stress tests - but not in the context of risk-weights or GSIB surcharges - is that somehow, in some unspecified and unarticulated manner, banks would use information embedded in the specification of the stress tests to make changes to their asset allocation that would reduce the stress test result without reducing actual risk.
This argument is highly problematic for at least three reasons. First, and foremost, an unstated predicate of the argument is that the calibration of the stress test is incorrect. That is to say, there is an aspect of the stress test that misidentifies risk - otherwise banks would be unable to change their asset allocation without changing the risk measured by the stress test. If there is a concern by regulators that the stress tests are flawed and incorrect, the first question to be answered should be, "how can we improve the stress tests and rectify the problem?" As has been discussed previously, history and experience clearly show that complex problems are best solved when more and not fewer eyeballs are fixed on the problem. Making the specification of the stress tests more transparent would improve the ability of outside experts, academics, and other stakeholders to identify any such inaccuracies in the stress testing framework. What's more, maintaining opacity in the stress tests will surely result in a stress testing framework that is more likely to exhibit the very flaws that regulators are concerned about in the first place.
Second, regulators appear to believe that the only remedy for a flawed and inaccurate stress test is opacity. This is incorrect and inconsistent with long-standing and existing regulatory practice. More specifically, regulators routinely use the supervisory and oversight authority to examine how banks comply with an entire array of bank regulations. If regulators are of the view that a particular aspect of the stress test is being exploited, they can identify the problem through the supervisory process and then publicly explain their reasoning and propose amendments to the stress tests to address the supposed problem through the usual notice and comment process.
Indeed, regulators regularly adopt this approach in the context of other regulations. As a specific example, one specific change being suggested in the
proposed solution and whether it addresses the putative concern at reasonable cost. In general, there is no compelling reason why a similar process could not work in the context of the stress tests. The public proposal and comment process is regularly used to address such concerns while providing for a range of views on the concerns raised as well as the proposed remedy.
Third, this argument effectively assumes banks are bad actors from the start and presumes mal intent. Using opacity to guard against manipulation assumes that any attempt by banks to adjust their asset allocation in light of the stress tests is being done for inappropriate reasons. A regulator should not hold an initial presumption that the entities it regulates are motivated by mal intent. Such a view creates an unhealthy dynamic between the regulator and the regulated entity that is overtly and unnecessarily adversarial. Regulators should engage with banks in an open and transparent manner that begins with an expectation that they aim to comply with both the letter and spirit of any regulation in an above-board and forthright manner.
Another argument that is commonly used to argue against transparency in the stress tests is the notion that if banks are provided with greater stress test transparency, we will observe a "model monoculture" that simply converges to the stress testing model. This argument does not comport with economic theory or observed practice. On the theory side, risk modeling and risk management is perhaps the single greatest competitive margin in banking. If all banks slavishly adhered to a single regulatory model, the incentive for a bank with better information to outcompete its competition by using that information would be extreme. Competition in the banking market would largely deal with the monoculture concern. As to observed practice, recall that banks already operate under a system of regulator prescribed risk weights. If the monoculture concern were at all relevant, we would already have seen the predicted convergence to a model monoculture as banks would have simply reverse engineered the risk management model embedded in risk weights. In practice, we observe a healthy degree of variation in banks' risk assessments. Moreover, bank regulations in other areas such as liquidity regulation also make use of such "regulator models" and we simply do not observe the sort of model monoculture that the argument predicts is certain to arise. Finally, and perhaps most importantly, regulators have wide latitude and authority to monitor and assess bank behavior. If such a model monoculture concern was realized in practice, regulators could identify the issue and take steps to address the identified problem - presumably in a public and transparent fashion.
f. Transparency Reduces Regulatory Uncertainty
An important cost of reduced transparency in the stress testing framework is regulatory uncertainty. Regulatory uncertainty arises when regulated firms are unable to understand the regulations to which they are subject and are likewise unaware of how those regulations may change in the future. In the case of the stress tests, a key source of regulatory uncertainty is variation in firm-level SCB's that are not attributable to any specific factors that banks can identify because they are not aware of how the stress tests are conducted. The fact that the stress tests result in significant variation in SCB's is clear. Looking at data on published SCB's over the past few years shows several cases in which SCB's vary by as much as a full percentage point from one year to the next. In some exceptional cases, SCB's have been known to vary by several percentage points.
The result of this regulatory uncertainty is to reduce the ability of banks to engage in capital planning and to reduce the effectiveness of whatever capital planning occurs. Banks often make long-term investments, such as lending a company funds for a term of five-years. The amount of capital required to fund a bank loan is a primary determinant of a bank's willingness and ability to fund a loan. If a bank believes that its regulatory capital requirement might increase by one or more percentage points over the course of the next five-years, its willingness to engage in such long-term investments will be meaningfully curtailed.
Likewise, investors rely on regulatory capital levels to assess the overall health of financial institutions. A firm that exhibits a sharp increase in its required capital may be viewed as more risky by its investor base. If the increase in capital is a result of changes to its GSIB surcharge or a change to B3E risk-weights, investors and bank management can jointly assess the nature of the increase. Indeed, banks often spend copious amounts of time on earnings calls discussing developments in their risk-weighted asset levels and GSIB surcharges. If, however, a firm sees a marked increase in its SCB, it very often will not have a clear understanding of the reason for the increase due to the lack of transparency in the stress testing framework. As a result, bank management and investors are often only left to wonder what prompted the increase. The resulting variability in capital requirements adds to the uncertainty surrounding investments and banks, which generally reduces the attractiveness of bank investments relative to, say, investments in unregulated non-banks.
Finally, when banks do not understand the determinants of their SCB, they are forced to make hard choices in an unnecessarily uncertain environment. Confronted with a significant increase to its SCB, a firm may conduct an analysis to try and understand the source of the increase. With incomplete information, the bank will have to form an uncertain judgement and may adjust its balance sheet based on imperfect information. As a result, the bank may reduce or otherwise adjust its balance sheet in ways that are not appropriate given the actual specifics of the stress test, but without more information it is impossible to make a more informed adjustment. As a result, activities and bank assets may be impacted merely as a matter of collateral damage rather than as a result of any actual link to increased risk.
6. Recommendation to Improve Transparency in the Stress Testing Process
The stress tests are characterized by a low level of transparency that deprives the public of a clear understanding of how large banks' capital levels are regulated. The approach taken in the stress tests is counter to the transparent approach taken in the rest of the bank regulatory framework and stands in stark contrast to well accepted and long-established norms of good governance. Clearly, significant reform to improve the amount of transparency and public oversight in the stress tests is required.
Importantly, in the name of transparency, when determining appropriate solutions, we should engage in a deliberate public process that considers a variety of alternative remedies and seeks input on those remedies from banks, the public, and other key stakeholders. Nevertheless, it is worth outlining some key areas where reform could be most useful while providing some thoughts on remedies that could be considered as part of public deliberation.
With regard to stress scenarios, consideration should be given to providing the public with a structured opportunity to comment on the scenarios. There are a variety of mechanisms that could be employed for this purpose ranging from engagement at roundtables and other public events to a formal notice and comment process. A more regular and structured engagement with the public on the form and shape of the stress scenarios would help ensure that the
In addition, consideration should be given to making all variables that encompass the stress scenario fully transparent and public. Stress scenarios that provide quantitative paths for some variables and only a high-level discussion of others creates a hazy and inaccurate picture of the specific scenario under consideration.
With respect to the quantitative models that drive the stress testing process, consideration should be given to significantly increasing the amount and degree of transparency that is provided to the public. The standard notice and comment process that is used in the case of risk-weighted asset requirements (e.g. B3E), or GSIB surcharges, or any number of other regulatory requirements, should serve as the baseline in this discussion. To the extent that there are any departures from the notice and comment process, these departures should be specifically identified for the public, and such departures should be explained and supported through a public process.
Regarding the administration and execution of the stress tests, consideration should be given to the use of an outside and independent audit function that does not reside within the
* The accuracy of data collected and how it is maintained, stored and ultimately fed into the stress test models
* The composition of the specific computer code that is used to translate the documentation of each model into an actionable calculation that is included in the stress test
* The governance process that is used to maintain the stress testing infrastructure including the process for updating and documenting changes to models as well as any changes to data feeds that are implemented as models are updated
* The accuracy and correctness of the final stress test results that are generated in each year's exercise.
Such an audit process could be used to provide an independent, external report to the
7. Conclusion
The stress tests have emerged as a central component of the large bank capital regime since the initial SCAP exercise was conducted in 2009. Appropriately calibrated and conducted, the stress tests serve as an important tool to safeguard the safety and soundness of the banking system and our economy. There is no debate about whether the stress tests should be conducted. Rather the debate focuses on how the stress tests should be conducted.
The approach to transparency in today's stress tests is largely a vestige of the hurried, historical development of the stress tests that occurred during a deep financial crisis when the need to act quickly and decisively potentially outweighed the need for public transparency. Fifteen years following the SCAP, it is time to align stress testing transparency standards with the rest of banking and government regulation.
Transparency in regulation is a touchstone of good government. Regulatory transparency ensures that the public can understand how their public institutions operate in the light of day and allows the public to assess the impact of regulation on affected entities and the broader economy. Banking regulations that are opaque frustrate prudent risk management and create costly regulatory uncertainty that has deleterious effects on the whole economy.
A broad, public, and transparent public policy discussion should now ensue to place the stress testing regime's approach to transparency on more thoughtful and firmer footing that fits more comfortably within our nation's long held and practiced commitment to an open and accountable government.
Table A1: SCAP vs. Stress Test 2024 n12
Scenario Peak to Trough Stress (%) ......SCAP ......2024......DiHerence
Unemployment Rate Increase .........3.4 ......6.3 ......2.9
House Price Decline ............-27.5 ......-36.0 ......-8.6
n1 On
n2 On
n3 These data are available at, https://www.federalreserve.gov/supervisionreg/dfa-stress-tests-2023.htm
n4 See for example, the discussion of the baseline and severely adverse scenario in the 2024 scenario disclosure document.
n5 The
n6 This description is purposefully general and does not describe all of the specifics relating to the stress test calculation including, for example, the treatment of deferred tax assets, paxes and so on.
n8 In the SCAP, PPNR and loss projections were generated through a combination of supervisory and bank models. Today, only supervisory models are used in the stress testing process.
n9 Technically, both the GSIB surcharge and the SCB are "buffers" and banks may operate at capital levels below that prescribed by full compliance with these buffers. In practice, market participants expect and demand full compliance with all buffers and so the distinction between minima and buffers is merely academic.
n11 https://www.federalreserve.gov/newsevents/press/bcreg/yellen-statement-20150720a1.htm
n12 Data coming from: The Supervisory Capital Assessment Program: Design and Implementation.
Read this original document at: https://docs.house.gov/meetings/BA/BA20/20240626/117459/HHRG-118-BA20-Wstate-CampbellS-20240626.pdf
KBRA Assigns Rating to Star Vantage Reciprocal Exchange
"Stress Testing: What's Inside the Black Box?"
Advisor News
Annuity News
Health/Employee Benefits News
Life Insurance News