• About
    • Who We Are
    • Partners & Providers
    • News & Events
    • The ESRD Blog
    • Careers
    • Contact Us
  • Applications
    • What We Solve
    • Detailed Stress
    • Composites
    • Fracture Mechanics
    • Residual Stress
    • Sim Apps
  • Products
    • What We Develop
    • StressCheck Professional
      • StressCheck Core
      • Solvers
      • Advanced Modules
      • Utilities
      • Academic Licensing
    • StressCheck Apps
      • CAE Handbook
      • StressCheck Tool Box
    • Product Updates
  • Support
    • How We Can Help
    • Training
    • Webinars
    • Quick Start Guide
    • Help Documentation
    • Software FAQ’s
  • Simulation
    • How We Simulate
    • Benchmarks
    • Simulation Governance
    • History of FEA
    • Dictionary & Terms
  • Resources
    • Browse Our Resource Library
    • White Papers
    • Case Studies
    • Product Demos
    • StressCheck Tutorials
Serving the Numerical Simulation community since 1989
  • Contact Us
  • Register
Login
Forgot Password?
Join Us
ESRDESRD
ESRDESRD
  • About
    • Who We Are
    • Partners & Providers
    • News & Events
    • The ESRD Blog
    • Careers
    • Contact Us
  • Applications
    • What We Solve
    • Detailed Stress
    • Composites
    • Fracture Mechanics
    • Residual Stress
    • Sim Apps
  • Products
    • What We Develop
    • StressCheck Professional
      • StressCheck Core
      • Solvers
      • Advanced Modules
      • Utilities
      • Academic Licensing
    • StressCheck Apps
      • CAE Handbook
      • StressCheck Tool Box
    • Product Updates
  • Support
    • How We Can Help
    • Training
    • Webinars
    • Quick Start Guide
    • Help Documentation
    • Software FAQ’s
  • Simulation
    • How We Simulate
    • Benchmarks
    • Simulation Governance
    • History of FEA
    • Dictionary & Terms
  • Resources
    • Browse Our Resource Library
    • White Papers
    • Case Studies
    • Product Demos
    • StressCheck Tutorials

Why Is Solution Verification Necessary?

Home The ESRD BlogWhy Is Solution Verification Necessary?

Why Is Solution Verification Necessary?

February 24, 2025 The ESRD Blog

By Dr. Barna Szabó
Engineering Software Research and Development, Inc.
St. Louis, Missouri USA


We at ESRD preach and practice solution verification. We believe that reporting data computed by an approximate method is incomplete without providing an estimate of the size of the relative error. This simple and self-evident statement tends to trigger fierce resistance from those who were schooled in the use of legacy finite element modeling tools.

Persuading those folks is not easy because the conceptual framework and language of finite element modeling are very different from those of finite element analysis. I had the privilege of having witnessed several debates between Olek Zienkiewicz, one of the pioneers of finite element modeling, and Ivo Babuška, who elevated finite element analysis to a scientific discipline.

In these debates, Zienkiewicz would make an intuitive statement supported by one or more examples. Babuška would then construct a counter-example showing that the statement was not generally valid. Zienkiewicz would modify his statement, and Babuška would show that the modified statement was not generally valid either, and so on. Engineers tend to extrapolate from particular examples, whereas mathematicians delight in constructing counter-examples.

In defense of my fellow engineers, I say this: If we had waited for the mathematicians, we would still be living in caves. However, now that we have come this far, we must not ignore what they have to say. This is especially true in our age of artificial intelligence.

The Key Differences Between FEM and FEA

It is important to understand the difference between finite element modeling (FEM) and finite element analysis (FEA). The development of FEM dates back to the 1960s when engineers sought to extend the application of matrix methods of structural mechanics to problems in two- and three-dimensional elasticity, making several intuitively plausible but theoretically flawed assumptions. The development of FEA occurred later, with many important theorems being established in the 1980s.

The essential difference is that, whereas FEA is concerned with the numerical approximation of well-posed mathematical problems cast in variational form, FEM is an intuitive construction of a numerical problem that is usually not an approximation to a mathematical problem but stands on its own. Therefore, the concept of approximation error is well-defined in FEA but has no precise meaning in FEM.

Another important difference is the separation of model form errors from the approximation errors. In FEM, model form and approximation are conflated in the definition of finite elements. In FEA, on the other hand, the model form is associated with the definition of the mathematical problem, and the approximation errors are controlled independently through the finite element mesh and the polynomial degrees assigned to the elements.

Following are three frequently asked questions and the corresponding answers that highlight key technical issues pertaining to solution verification.

Question 1:  If I do not know the exact solution of the mathematical problem being approximated by FEA, how can I compute the relative error of approximation?

Answer:  It is not necessary to know the exact solution to obtain a reliable estimate of the relative error in the quantities of interest. We know that the exact values of the quantities of interest are finite numbers and independent of the choice of the numerical method used for finding an approximate solution. In the case of the finite element method, they are independent of the finite element mesh and the polynomial degree of the elements. Therefore, if we produce a converging sequence of finite element solutions either by mesh refinement or increasing the polynomial degrees, then the corresponding quantities of interest will converge to a limit. Estimating that limit from the sequence of solutions allows us to estimate the relative errors. This method has been thoroughly researched and explained in textbooks. See, for example, reference [1].

Question 2:  Since we do not know the applied loads with precision, why should we worry about the accuracy of the numerical approximation?

Answer: The premise of this question is wrong. To understand why, consider two scenarios: the application and formulation of design rules. In the application of design rules, engineers must show that certain quantities, like the maximum stress, do not exceed allowed values under specified loading conditions. Therefore, the loading conditions are fixed by the design rules. The design criterion is:

\Phi_{max}(u_{EX}) \le \Phi_{all}\qquad (1)

where Φall is the allowable value of the design variable Φ > 0 and Φmax(uEX) is the maximum value of Φ corresponding to the exact solution uEX. Of course, we do not know uEX, we know only the finite element solution uFE.  Suppose that Φmax(uFE) underestimates Φmax(uEX) by a relative error 𝜏:

\Phi_{max}(u_{EX})-\Phi_{max}(u_{FE}) = \tau\Phi_{max}(u_{EX}),\qquad 0\le\tau\lt1\qquad (2)

In this case, equation (1) becomes:

\Phi_{max}(u_{FE}) \le (1-\tau)\Phi_{all}\qquad (3)

Two important conclusions follow from this result: (1) If we do not know the value of 𝜏, then we are not in a position to say whether the design meets the design criteria. In other words, design certification is not possible. (2) Approximation errors penalize design by reducing allowable values. Since these values are chosen conservatively to account for uncertainties, the economic costs of using further reduced values to compensate for errors in the approximate solution far exceed those associated with ensuring the accuracy of the data of interest within a small relative error. Therefore, estimating the relative error in terms of the quantities of interest is essential. Further discussion on this topic can be found in reference [1].

Let us now turn to the problem of formulating design rules. Here, we are interested in defining the allowable values Φall which are positive real numbers. These values characterize some hypothesis of failure that has to be validated in experiments. For example, the hypothesis that a ductile material begins to yield when the von Mises stress reaches a critical value is one such hypothesis. The critical value of the von Mises stress cannot be observed directly but must be inferred from experiments in which the applied load is controlled, and local displacements and, possibly, strains are measured. Once again, the load is known precisely, and it is necessary to ensure that the relative error in any numerically determined quantity of interest is negligibly small. Similar considerations apply to all model development projects [2].

Question 3: Is it possible to estimate the relative error in the quantities of interest using legacy finite element codes?

Answer: Yes, provided that the elements chosen from the element library are properly formulated, the boundary conditions are properly defined, and the quantities of interest are finite numbers. When the software architecture of legacy codes was established in the 1960s and early 1970s, no provisions were made for error estimation. Therefore, this step remains rather challenging and is usually omitted in practice.

The First V in VVUQ

The first “V” in the acronym VVUQ stands for verification. Verification is like a three-legged stool: one leg is solution verification, and the other two are data and code verification. All three are key technical requirements in numerical simulation. Analysts are responsible for data and solution verification, while code developers are responsible for code verification and for providing the means to perform solution verification efficiently and reliably in industrial settings.


References

[1] Szabó, B. and Babuška, I. Introduction to Finite Element Analysis. Formulation, Verification and Validation. John Wiley & Sons Ltd. Chichester UK 2011.

[2] Szabó, B. and Actis, R. The demarcation problem in the applied sciences.  Computers and Mathematics with Applications. Vol. 162, pp. 206–214, 2024. 


Related Blogs:

  • Where Do You Get the Courage to Sign the Blueprint?
  • A Memo from the 5th Century BC
  • Obstacles to Progress
  • Why Finite Element Modeling is Not Numerical Simulation?
  • XAI Will Force Clear Thinking About the Nature of Mathematical Models
  • The Story of the P-version in a Nutshell
  • Why Worry About Singularities?
  • Questions About Singularities
  • A Low-Hanging Fruit: Smart Engineering Simulation Applications
  • The Demarcation Problem in the Engineering Sciences
  • Model Development in the Engineering Sciences
  • Certification by Analysis (CbA) – Are We There Yet?
  • Not All Models Are Wrong
  • Digital Twins
  • Digital Transformation
  • Simulation Governance
  • Variational Crimes
  • The Kuhn Cycle in the Engineering Sciences
  • Finite Element Libraries: Mixing the “What” with the “How”
  • A Critique of the World Wide Failure Exercise
  • Meshless Methods
  • Isogeometric Analysis (IGA)
  • Chaos in the Brickyard Revisited
Tags: Errors of ApproximationFinite Element AnalysisFinite Element ModelingMechanical DesignTechnical Requirements
3

You also might be interested in

Why is Simulation Governance Essential for the Reliable Deployment of FEA-Based Engineering Simulation Apps?
Simulation governance must be implemented to achieve democratization of simulation.

Why is Simulation Governance Essential for the Reliable Deployment of FEA-Based Engineering Simulation Apps?

May 8, 2018

How can the vision for expanding the use of numerical simulation by persons who do not have expertise in finite element analysis (FEA) be safely realized? The solution lies in the establishment of Simulation Governance through the development and dissemination of expert-designed Engineering Simulation Apps. Read more[...]

Chaos in the Brickyard Revisited

Chaos in the Brickyard Revisited

Jan 15, 2025

In a letter published in Science in 1963, Bernard K. Forscher used the metaphor of building edifices to represent the construction of scientific models, also called laws. These models explain observed phenomena and make predictions beyond the observations made. Building models consistent with the science of numerical simulation should never be confused with finite element modeling, an activity rooted in pre-1970s thinking. We should keep Forscher's metaphor in mind when evaluating claims about the benefits AI integration is expected to bring to numerical simulation.

S.A.F.E.R. Simulation Views: Toward Simulation-Driven Design
Q&A's with colleagues, experts and industry leaders

S.A.F.E.R. Simulation Views: Toward Simulation-Driven Design

Feb 19, 2018

Introducing S.A.F.E.R. Simulation Views, where we invite colleagues, simulation experts, and A&D industry leaders to address simple questions about simulation. In this edition, ESRD's President & CEO Dr. Ricardo Actis is asked about the hurdles we must overcome to achieve simulation-driven design. [...]

Leave a Reply

We appreciate your feedback!
Cancel Reply

You must be logged in to post a comment.

Looking for Resources?

Interested in a Demo, Evaluation or Purchase?

Have a Software Question, Issue or Feature Request?

Recent News & Events

  • Trustworthiness in Simulation: Credibility or Decision-grade Reliability?
  • Beyond the Black Box: Explainable AI Requires Explainable Simulation
  • Turtle Shells and Legacy Finite Element Codes: Evolutionary Constraints in the Age of Explainable AI

Quick Links

  • Quick Start Guide
  • Documentation
  • Software FAQs
  • Software Demos

Testimonials

  • “The p-type element has been used to great advantage in the finite element system ESRD StressCheck, [26]. This software provides the engineer with the means to conduct solution verification in an extremely straightforward manner by simply increasing the degree of the element, monitoring convergence and using Richardson extrapolation reliably to estimate the error. This can be conducted automatically by the software thereby enabling the engineer to concentrate on the engineering rather than the simulation. StressCheck has also been used to develop ESRD’s Handbook and Toolbox applications. The first of these provides engineers with a repository of parameterised standard problems of the type found in texts like Roark’s “Formulas for Stress and Strain”, [27]. The second, Toolbox, is a tool that can be used to parameterise a company’s range of components for rapid and reliable analysis by non-expert analysis. Toolbox then is an exemplary of the way in which the democratisation of simulation can be applied.”

    Angus Ramsay, PhD
    Engineering Director, Ramsay Maunder Associates

Testimonials

“The addition of incremental theory of plasticity in StressCheck has greatly improved our ability to accurately predict the fatigue life of joints with interference fit fasteners and cold worked holes. This ability is especially important, not only in support of maintaining aging aircraft but also in analyzing some of the new cold working techniques that have been introduced in recent years.
Prior to this implementation, analysts often relied on closed-form approximations or simple factors that were often overly conservative and sometimes even unconservative when used in life prediction. Now, not only can we more accurately predict residual stresses in these complex structural joints, but we can also do so in a timely manner given the modeling and analysis efficiency that exists with a p-version FEA code such as StressCheck.”

F-15 Structures Manager, The Boeing Company

Member Portal

  • Member Registration
  • Member Login

Contact Us

© 2026 · Engineering Software Research & Development, Inc. | Terms & Conditions | Privacy & Cookie Policy | Software License Agreement | Software Maintenance and Technical Support Policy

Prev Next

We use cookies on our website to give you the most relevant experience by remembering your preferences and repeat visits, as outlined in our Cookie Policy. You may adjust your cookie preferences within .

ESRD
Powered by  GDPR Cookie Compliance
Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.

Strictly Necessary Cookies

Strictly Necessary Cookies should be enabled at all times so that we can save your preferences for cookie settings.