How Bad Cops, Molesting Priests, Rapey Frat Boys and Bad Managers Have A Lot In Common

“It is difficult to get a man to understand something when his salary depends upon his not understanding it.” — Upton Sinclair

In the last week, I’ve been working through my part of the eulogy for my friend Tim. Tim and I worked together at Sandia, and over the years, many of our conversations were really just the two of us trying to make sense of the place. Writing the eulogy brought up old thoughts and feelings about how I retired. It had been a topic Tim and I talked about at length. On the one hand, it would be good to let it go. On the other hand, it was a serious issue with deep implications. The problems go further and farther than the knee-jerk response would allow.

I have made peace with my decision to retire. Continuing to work there was a complete waste of my time. It would have been financially beneficial to stay. In terms of my life, that benefit would have come at too great a cost. I’ll say something a bit arrogant too: I was too talented to work for those people. Continuing to be associated with incompetent and unethical people was beneath me. It was a waste of my considerable talents and my time on Earth.

“Silence becomes cowardice when occasion demands speaking out the whole truth and acting accordingly.” — Mahatma Gandhi

It should be obvious to my readers that I’m still engaged with science and technology. I’m. engaged with a large degree of passion. I have ideas I still want to explore. The reality is that every bit of that engagement was wasted at Sandia. It’s simply the sad truth that a national lab was a dismal place to put my talents to use. Not every talented person belongs at the Lab. That’s fine. That’s normal. The difference in my case is that my interests and talents sit pretty close to the bullseye of the Lab’s actual mission. That’s what concludes utterly damning.

“Loyalty to the organization, loyalty up and down the line, is prized above integrity to oneself.” — William H. Whyte,

In the process of all this pondering, I wandered into another thought. Why did Sandia protect the terrible managers? Why did they choose to do the wrong thing? I started seeing direct parallels to a couple of other issues. We seem to be having a society-wide collective-action problem around ethics and morals. Bad behavior and corruption run rampant among the rich and powerful. Nobody with the power to stop it does. As a society, we simply look away. The corrupt have impunity.

“Every society honors its live conformists and its dead troublemakers.” — Mignon McLaughlin

What if bad cops and bad managers are manifestations of the same problem? Think of the Catholic Church and its molesting priests. Think of the echoes of the same dynamic in the Cornell gang-rape case. Penn State sat on what it knew about Jerry Sandusky for years. USA Gymnastics protected molester-rapist Larry Nassar. They protected them long after coaches and staff had known of the violations. Wells Fargo managers were pressured to hit sales quotas by opening fraudulent accounts. The bank’s leadership looked away for years; money was being made. Police departments and the “thin blue line” look the other way, even protecting bad cops. Why do organizations cover for bad behavior instead of ridding themselves of the offenders?

“We must take sides. Neutrality helps the oppressor, never the victim.” — Elie Wiesel

The Cornell case is the one that has stuck with me deeply. I’ve dug into the details of the secrecy around it and the sheer number of people who stayed quiet. What’s remarkable, and damning, is that so many people knew what was happening and did nothing. No one intervened. No one alerted officials. No one helped the young woman at the center of it. This happened among a group of privileged, by all accounts intelligent, young men. That’s a damning indictment of moral rot and a basic lack of character in people we’re about to hand the future to. If bystander silence shows up naturally like this, before anyone has a career or a pension or an institution to protect, the issues run deeper than any incentive structure. It condemns society as a whole. It looks closer to a default, and we just give that default legitimacy

“The sad truth is that most evil is done by people who never make up their minds to be good or evil at all.” — Hannah Arendt

That same willingness to look away shows up anywhere institutions have a reputation worth protecting. I’ve always wondered why police forces protect bad cops. Bad cops are a huge threat to public trust. You’d think good cops wouldn’t want to be associated with them. But the behavior of police forces and police unions is the opposite. Bad cops are defended reflexively. They defend bad cops to a degree that’s repugnant. They let them keep working. They rarely drive them out. The bad cops keep doing bad things.

The question I kept circling back to: is the tolerance of bad management I’ve seen the same idea? Do managers, writ large, close ranks around the bad ones among them, the same way police close ranks; the same way dioceses did; the same way as frat boys; coaches finding a criminal among their ranks; the same way corporate boards do when a star executive turns out to be a fraud?

Upon reflection, you start to see the parallels and the reasons these things happen. A few maxims of human group behavior are doing the damage. These show up again and again, in every one of these institutions. The Labs, it turns out, are completely ordinary in this regard. They are subject to the same human frailties and shortcomings.

A big one is self-interest dressed up as institutional interest. Exposing a bad actor costs the people who’d have to do the exposing: lawsuits, bad press, lost trust, lost donors or votes or customers. The people positioned to catch the problem are usually the same people whose careers and reputations are tied to the institution looking good. So the short-term incentive is almost always to contain the story, not tell it. Increasingly, the cover-up is assisted by policy and secrecy.

Identity fused with the group. Police, clergy, and tight political or corporate networks all ask for, and get, unusually strong identification: the thin blue line, the body of Christ, the firm, the family business. Once your sense of self is wrapped up in membership, a colleague’s wrongdoing starts to feel like an attack on you personally, not a policy problem to be solved. Covering for a fellow member reads internally as loyalty. The cover-up becomes a virtue instead of a damning action.

Internal, self-run discipline. In every case I’ve mentioned, there are disciplinary procedures that are largely internal to the organization. That lets punishment stay hidden, or not happen at all. Police investigate police. Dioceses handled abuse allegations themselves for decades. Legislatures police their own members’ ethics. Corporations run HR processes before, if ever, anything reaches an outside authority. Self-policing without an external check reliably degrades into self-protection. The investigators and the investigated share the same stake of institutional cleanliness.

Secrecy and privacy, formalized. There’s always an element of confidentiality that these organizations provide their members, and it’s remarkably easy to stretch. In my case, the clearest version of this was the laboratory’s own culture of secrecy, which has only grown. There was always secrecy around nuclear weapons data. That part makes sense. That necessary secrecy has expanded hugely in recent years. More and more of the lab’s ordinary business gets classified as protected data. What used to be OUO, Official Use Only, is now CUI. Basically the same thing: a category where information gets locked away from external eyes. Once locked away, scrutiny is impossible.

I’ll note this gets used for exactly the purpose you’d expect: protecting the organization, not the mission. In my case, one category was “export control” data (CUI). Export control is so poorly defined that almost anything can be declared export-controlled without any rational basis. That’s exactly what happened to the report that ultimately led to my decision to retire. That kind of power lets bad actors act without consequence and without accountability. It was clear the organization backed their lack of accountability. They actively defined information that was not export-controlled to hide a problem from the outside world.

The secrecy at Sandia points to something bigger than any one report: transparency itself. Sandia was always far less transparent than its sister lab, Los Alamos. Some of that came from Los Alamos being a company town. There, the lab and the community were practically the same thing, and almost nothing stayed hidden for long. The differences went deeper than geography. It was a real cultural difference between the two labs, baked in from the start. A lack of transparency is the perfect environment for corruption to take root. Secrecy is part of the basic mission at both labs, for understandable reasons tied to weapons work. That same secrecy is easy to misuse for reasons that have nothing to do with the mission, and at Sandia, it was.

We’re also living through a moment when secrecy and a lack of transparency are getting worse generally, not better. The powerful understand that transparency is their enemy. They lean on the threat of retaliation and on legal tools like NDAs, all built to make sure no one can shine a light on the corruption, or on the people benefiting from it.

“Sunlight is said to be the best of disinfectants.” — Louis Brandeis

Add a collective-action problem on top of all that secrecy, and you get exactly the paralysis I watched play out at the lab. Often many people have partial knowledge of a problem: rumors, a handful of complaints, a pattern that looks off. But no single person has enough to act alone. Each person who might speak up carries the full personal risk, while the benefit of exposure is shared diffusely by everyone else. That’s a reliable recipe for silence. Whistleblowers aren’t just disliked. They’re frequently pushed out, sued, or frozen out of advancement, while the people who stayed quiet suffer nothing at all.

It’s very much like internal-affairs investigations in police departments. Rather than drum out the people who do a bad job, abuse their position, and bring disrepute on the organization, the organization protects them and lets them keep operating as members in good standing.

The counterpoint is brutal and consistent: if you’re the one who sheds light on the problem, you’re the one who gets drummed out, looked down on, and punished. I saw this directly. The investigatory process at the lab was oriented around protecting the lab, not around doing what it claimed to do. Corporate ethics means the corporation is ethical without regard to actual ethics.

This is corporate ethics in its purest, ugliest form: whatever the corporation wants to do is right. If you oppose the corporation, you’re the one in the wrong. It’s a might-makes-right argument dressed up in process and procedure. It ends in the same place every time: protecting the organization over protecting anything genuinely ethical. The mission quietly gets replaced by the institution’s own self-perpetuation. Once that substitution happens, anything that threatens the institution’s standing gets treated as the real threat. The wrongdoers being protected are just collateral damage. Calling it out is worse than the original crime.

“Whistleblowers are seen not as allies but as threats, because they expose the gap between what an institution claims to be and what it actually is.” – Conventional wisdom

Can it be fixed? Imperfectly, but yes, and not through better mission statements or stronger-worded codes of conduct. The institutions that have actually improved did it by giving something up, not by writing something down. They give up control. Independent investigation and discipline, run by people with no stake in the institution’s reputation, is the single most effective lever. Examples include civilian review boards with real subpoena power for police, outside lay boards for dioceses, independent ethics commissions with real enforcement teeth for legislatures, and regulators with real authority for corporations and national labs alike. The word doing the work there is independent. A review board stocked with the institution’s own alumni just recreates the same conflict of interest wearing a different badge.

Strong, enforced whistleblower protection changes the math for the person deciding whether to speak. In my case and another close friend’s, whistleblowing was an absurd prospect. It is a completely toothless option. It exists, but it is completely ineffective. If the personal cost of reporting drops, and the cost of retaliation to the institution goes up, more people with partial knowledge come forward instead of staying quiet and hoping someone else goes first. Mandatory public disclosure of misconduct complaints and their outcomes takes away the institution’s ability to absorb its bad actors quietly. It costs money and reputation up front, which is exactly why institutions fight it, and exactly why it works.

“It takes 20 years to build a reputation and five minutes to ruin it.” — Warren Buffett

Decoupling the people who benefit from the institution’s good name from the people who judge its wrongdoing attacks the conflict of interest at the root. It makes accountability systematic, instead of hoping individual virtue will outcompete a bad incentive structure. None of this is a clean fix, because the dynamics are structural, not a matter of a few bad apples with weak morals. They show up anywhere a group controls its own oversight and ties its members’ sense of self and livelihood to the group’s image.

“Those who stand for nothing fall for anything.” — attributed to Alexander Hamilton

The honest, uncomfortable truth is that each of these fixes requires the institution to give up some of its autonomy. Humans prize control, and control is exactly what institutions exist to protect and amplify. The fix rarely comes from inside. It comes from outside pressure: courts, legislators, the press, public opinion, or simply someone deciding to speak up. I made that decision myself, when the cost of staying became higher than the cost of leaving.

Zooming out from my own story, the upshot is grim. We should expect far more corruption, graft, and outright fraud in the years ahead, not less. Until we change the underlying dynamic, the cost of declining trust will keep compounding across the clergy, the police, corporations, national authorities, our government, all of it.

“Power concedes nothing without a demand. It never did and it never will.” — Frederick Douglass

Almost everything runs on trust, but nothing runs on it more than the economy. The economy depends on the faith of consumers and investors that the system is basically honest. Take away that faith, and take away a legal system willing to hold bad actors accountable, and the economy suffers. Eventually, the whole society bears that cost.

In the meantime, I’ve started seeing this behavior for what it actually is: the exercise of raw power. That power gets exercised for the benefit of the powerful, not for the good of society. The people running these institutions act with impunity, because there is no real recourse against them. Competence doesn’t enter into it. The good of society doesn’t enter into it. They get to do what they want, and nothing happens to them.

“Evil, when we are in its power, is not felt as evil but as a necessity, or even a duty.” — Simone Weil

Humans Must Control and Be Served by AI.

“Once men turned their thinking over to machines in the hope that this would set them free. But that only permitted other men with machines to enslave them.” – Frank Herbert

Recently there has been a flurry of concern about the safety of AI. This is all prompted by the obsession with the possibility that AI could cause the extinction of mankind. This is typically envisioned through a variety of scenarios. These are like creating apocaolyptic biological weapons. Perhaps even a malicious AI that decides that humans are a nuisance to be exterminated. Of course, more spectacularly, there is the famous Terminator scenario from the movie. The AI gets control of nuclear weapons and decides to wipe out humanity in one fell swoop. A handful of survivors live in an apocalyptic doomscape and resist in vain.

“The automatic machine… is the precise economic equivalent of slave labor.” – Norbert Wiener

I’ve written recently that I believe a more likely scenario is that humanity could end up enslaved by AI. This would come directly from the same sort of corporate practices we’ve seen with social media. Tech companies operate under motives where profits outweigh any other perspective. Healthy societal impact isn’t on the radar when the profit motive is completely and totally in control. In that case, the negative societal impact is merely fallout.

“The best minds of my generation are thinking about how to make people click ads. That sucks.” – Jeff Hammerbacher

One of the fallouts may be that AI will become a much more sophisticated and powerful tool. It will provide these corporations with control over humanity. Lost in all of this safety discussion is a more positive framing. We get a smattering of potential benefits spoken of by the companies, which are mostly thrown out in scattershot, ill-formed thoughts. There’s talk of medicine, cures for diseases, and universal basic income. There is little rhyme or reason. No one is asking what humanity wants or needs. All of this begs the question of why these sorts of good outcomes haven’t already been received from our tech overlords. There is zero track record of a single step toward societal or social well-being.

The same incentives that gave us Facebook and Twitter are working for AI. Those incentives will be weaponized by corporations to make more money. To make their founders and employees rich. None of the current incentives have social or societal good as a focus. Without explicit engineering of the incentive structure, we will get the same result. That result will be social and societal damage and chaos. Anyone happy with the current chaos?

“I tend to think that most fears about A.I. are best understood as fears about capitalism.” – Ted Chiang

The discussion we are not having is: What sort of future do we want, and how will AI play into that future? I think this is the flip side to the conversation we’ve been having about doomsday. Instead, we should be talking about what we’re going to get from AI, and specifically how the particular genius of humanity will be preserved. Even better than preserving our genius, how can AI augment it.

A large part of my enslavement idea comes from the belief that there are aspects of thinking and intelligence that AI cannot replicate. Aspects of humanity that are purely human. It may necessarily be found in our embodied selves. Maybe other ways of thinking that AI does not currently replicate and perhaps never will. Other breakthroughs are likely necessary to expand AI’s intelligence.

In lieu of this, one of the most important questions is whether the genius of humanity is preserved. Does it serve AI, or serve the corporations that currently develop AI and tech? This may be the path towards enslavement. An alternative is that society places value on preserving the genius of humanity. AI is engineered in a way that expands the positive aspects of our lives and produces wealth and beauty, art, and things of aesthetic value. These positive aspects have primacy over pure profit and wealth.

“Perhaps the culture of accountability that we are relentlessly building for ourselves actually damages trust rather than supporting it.” – Onora O’Neill

I can certainly see many positives in AI. One of the most positive things I could see about AI was what it could do for my former workload when I was employed. I’ve opined that, as my career went on, the load of bureaucratic garbage increased monotonically. This increase is driven by reporting requirements reflecting the overall lack of trust that has developed in our society. This untrusting attitude arose from a belief that the most likely outcome for my research was simply that I wasn’t getting anything good done. Worse yet, I was absconding with the money and fucking off with it.

I had to regularly report on everything I did, with that reporting eating up an increasing portion of my work life. In no small way, I cannot overstate the degree to which this burden ate into my productive capacity. Worse yet, the objectives and goals at work began to lower. One way to not look like you are failing is to make success a very low bar. Over the years, we’ve seen the bar drop lower and lower in order to ensure that success is engineered into every activity. This does nothing to reduce the burden of reporting.

“Huge swathes of people… spend their entire working lives performing tasks they secretly believe do not really need to be performed.” – David Graeber

AI was perfectly well suited to more seamlessly and easily generating the sorts of reports that you fed into the system. In doing so, it could free up useful time to do real work. Nonetheless, the problems are still there. We see something toxic and in need of reform in how work itself is structured. We need to change the work so that there is more trust and more capacity for people to do creative work without all the oversight. This is where the focus of AI should really be. AI should be something that can assist us in developing, running through, and executing more of our ideas.

“Move fast and break things.” – Facebook motto

This would be something that could enliven research and work to generate more progress than we are used to seeing. By the same token, ideas and innovations are the engine by which wealth and prosperity are generated. These are all outcomes we should seek. Currently, there is not nearly enough progress going on in the world, and AI could be an engine for assisting humans in finding it.

The problem is that we need to escape several things:

  1. The expanding collapse of trust across society, which saps all of our energy.
  2. The profit motive standing above all else, without any sort of societal responsibility, that our corporations currently exhibit.

If both of these things can be wrestled under control, the possibilities are endless. Perhaps the most important single theme to work toward is greater trust. The recent behavior of corporate high tech has only hollowed out trust further. Sam Altman is the poster boy for untrustworthiness. He is only eclipsed in being sketchy by the President himself. Rather than build trust that allows a better future, they are digging a deeper hole.

“AI will probably most likely lead to the end of the world, but in the meantime, there’ll be great companies.” – Sam Altman

Unleashing AI into a world where Altman and Trump are at the helm is almost suicidal. A superpowered intelligent tool will simply take our crisis of trust and put it into overdrive. It is courting disaster. This would be akin to striking a match adjacent to a gasoline-soaked blanket. You can see what’s going to happen, and if you go forward and do this, you should be ready for the outcome. Mindfully, we should turn toward better possibilities.

AI has shown great facility in a couple of areas that are near and dear to my heart.

  1. Code writing: Over my career, I did a substantial amount of it. This is something AI has shown miraculous power at, but also limitations.
  2. Mathematics: Again, mathematics has become the showpiece for AI, where its capacity, as the companies want to show it, is being demonstrated. The key is how much of this is mere mimicry or raw computation versus genuine intelligence.

“Programs must be written for people to read, and only incidentally for machines to execute.” – Harold Abelson and Gerald Jay Sussman

In both cases, the case for human control and the necessity of human intervention is clear. In coding, our key strategic and intellectual ideas are manifested in the code. The thing AI has shown itself to be most capable of is grinding through the gross, gory, and intricate details of implementations. Where it falls short is in the broader strategic thoughts needed to weave everything together. This is where humanity is essential. This must be preserved and augmented.

This is much like the story with bureaucracy. AI can simply devour the mind-numbing details, but human thought is needed to manage the overarching views, the meaning, and ultimately how to put everything together into a coherent whole. The key to making things better is to amplify the message of human control. We are in charge, and AI simply becomes an efficiency. AI becomes a way to get these awful parts of work out of the way. There needs to be a focus on genuine work benefits that people can feel and control.

“It is by logic that we prove, but by intuition that we discover.” – Henri Poincaré

With mathematics, we see this pattern repeated again. We see that the need for humans to solve problems comes from inspiration, leaps of faith, and insight. All of these are beyond what AI can generate. The recent spate of results is crowned by the Navier-Stokes-related Millennium Prize. The basic concept, ideas, approach to solving the problem, and strategy, if you will, were devised by humans. AI simply ground through details too complex and mind-numbing for humans to easily tackle.

This model is similar to the supercomputing we are all familiar with. The well-programmed supercomputer is incredibly useful. It can do calculations at blazing speed. If these are arranged and done in the right way, miracles are possible. If they are not, it is garbage. AI is no different. Human guidance and genius make sure the strategy is meaningful. Utility is found in the collaboration between man and machine. The machine alone is wasteful.

The key is that without human inspiration and invention, the mind-numbing details and all the work I could do would be for naught. Again, human control is the key. AI does not do things by itself. The failed message from the companies is that AI does everything. This is bullshit. It is damaging to the future. The real and true message is that AI can bring ideas to fruition. AI makes the impossible to execute possible. More importantly, AI does not replace people; it makes them better.

This gets to the core of the narrative that the AI companies, the US government, and the whole dynamic get wrong. They are completely fucking this up! They have only seeded fear and opposition. If AI is coming for your job, you oppose it. It is also the seed of opposition to data centers. The AI story is a public relations nightmare. The reason is that they didn’t think they needed to convince the public. Money and greed were the only things necessary.

“Imagination is more important than knowledge.” – Albert Einstein

When one talks about reform in the working world, this needs to be backed by reform in the educational system. When I’ve spoken to people associated with or working directly in the educational system, the reaction I get from all of them is a desire to put the genie back in the bottle. Somehow we will keep students from using AI and force them to learn the old-fashioned way. This is shortsighted and foolish. This genie is not going back in the bottle, and students will use AI. These students will need to use it well to survive in the future. Avoiding AI is malpractice.

“What I cannot create, I do not understand.” – Richard Feynman

All of these students will need to learn to use AI effectively when they get out into the workforce. Sending them out of school without training on how to properly use AI is like sending lambs to the slaughter. As consumers, they are destined to be consumed by these corporate overlords. The educational system needs to adapt, and fast. We need to prepare them for the World that is. AI is going to be with us. It is going to be important. Our future prosperity, health, and safety all depend on it. Students must be ready.

“Plants don’t flourish when we pull them up too often to check how their roots are growing.” – Onora O’Neill

The way I see it, AI is going to be used. The question is: are we going to be teaching people to use it effectively? Are we going to be expecting people to add human value to AI? In a very real sense, the danger is that people will turn off their thinking entirely and simply regurgitate what they ask AI for, question by question. This means the questions, the teachings, and the expectations for students need to change to account for this behavior.

“We are drowning in information, while starving for wisdom.” – E. O. Wilson

Rather than trying to put our heads in the sand and pretend that AI is not there, students need to know how to effectively engage with AI. How to produce the sort of results that we desire. It should be clear that all students are expected to put some of themselves into every solution. True even if they are using AI to assist them along the way. Our job is to guide them to make that use effective and appropriate.

We then need to accentuate and accelerate the degree to which human uniqueness, creativity, innovation, adaptation, and thought are applied to these results. In this way, we will produce students who actually can deal with the world that is before them.

“The best way to predict the future is to invent it.” – Alan Kay

Multimat 2026 Was Fantastic!

“Travel is fatal to prejudice, bigotry, and narrow-mindedness.” – Mark Twain

About a month ago, I attended the 12th International Conference on Numerical Methods for Multi-Material Fluid Flow. In short, it is colloquially called “Multimat 2026.” I went to the conference to give a talk related to my paper honoring Peter Lax’s contributions to computational science and shock physics. The unusual aspect of the attendance was my being retired. I no longer had program funding to pay for the meeting; instead, I paid out of my own pocket. The reason was the overall quality of this series of conferences over the years. The topics would be intensely interesting to me, and the attendee list was full of friends.

“The sea, once it casts its spell, holds one in its net of wonder forever.” – Jacques Cousteau

The setting for the meeting, Biarritz, France, was wonderful too. It is on the Atlantic coast in the Basque region that spans northern Spain and southwest France. It felt like I had to go. When abstracts were due, I put one in and asked for a speaking slot. The organizers gave me the first spot on the schedule for Monday morning. I had actually given the very first talk of the series of conferences back in 2002 in Paris.

My wife and I traveled there a few days early, deciding to fly into San Sebastian, Spain. No longer bound by U.S. government rules, we flew a foreign airline, Iberia. I ended up flying on my birthday, meaning it was a short day of 16 hours. My wife made up for that with a date at a Michelin-star restaurant in Biarritz. It was a bucket-list item for me. As it turned out, the travel to San Sebastian was awful due to circumstances. We arrived late, around 9 pm, and there was a festival in the city center all around our hotel. Not much sleep was had despite our exhaustion. After the day in San Sebastian and a bus ride to the hotel in Biarritz, I had recovered.

Once we got there, I did my usual scouting of the area. I took a walk down to the coastline to find the conference venue. Unfortunately, Apple Maps and Google Maps were not helpful. I was a bit flummoxed. Then I ran into Misha Shashkov, who was experiencing the same difficulty. I had an idea about its location to explore, and on the way there we ran into the organizers, Raphael Loubere and Pierre-Henri Maire, along with others. My idea was correct, and the mystery cleared up. Raphael and Pierre-Henri took us for a quick tour of the Biarritz coastline and its many attractions. Then we settled in for drinks and dinner at a lovely cafe.

“If I have seen further it is by standing on the shoulders of giants.” – Isaac Newton

At breakfast before the meeting started, I was reviewing my e-mail. I found that our paper on Peter Lax had been accepted by the Journal of Computational Physics. This was especially fitting, as I was giving a talk on the paper in a couple of hours to kick off the meeting. The meeting venue overlooked the main beach in Biarritz. The waves and ocean hydrodynamics were there to entertain us all week. Biarritz has surfers galore, and the waves invite them. As expected, the organizers did a great job of hosting and organizing the meeting. It is an outstanding meeting, which is why I attended.

I gave my talk, going over the main results of my paper. I was able to express the principal points. Unfortunately, I didn’t get as much discussion as I would have liked. You want vigorous questions after a talk! That said, my talk came up over and over for the whole week as speakers either used my example or apologized for the gaps in their presentations. Overall, I was happy with the outcome. I was thrilled to see the latest research presented. The meeting is overwhelmingly full of great talks and topics. Even better, the meeting is teeming with friends and great conversations at the breaks. It is a single-session meeting with about 100 attendees.

With the meeting in France, European scientists dominated the attendance. LANL had around 12 attendees and LLNL about 19. Unfortunately, Sandia had one attendee. It should be a shocking statement, but it is actually par for the course. I will note in passing that I’ve attended 10 of the 12 conferences. I regret not attending the two I missed (in Prague and Zurich). Sandia isn’t welcoming to foreign travel or conferences in general. This meeting is an exemplar of that attitude. The codes and methods used at Sandia suffer as a consequence. It is really unfortunate and dismal. If I hadn’t retired, I’m not sure I would have attended.

“Science is built up of facts, as a house is built of stones; but an accumulation of facts is no more a science than a heap of stones is a house.” – Henri Poincaré

A few highlights stand out in the technical program. There was a great deal of discussion of corner Riemann solvers. This approach is being extended to more general use. Classically, Riemann solvers are found on cell edges. For cell-centered Lagrangian methods, the Riemann problem needs to move to the nodes defining the mesh to define the movement of the nodes. This approach was pioneered by Bruno Després (a notable and unfortunate absence from the meeting) and Pierre-Henri. A high point of the meeting was Pierre-Henri’s talk on the topic. It also featured in many other talks, along with some generalizations and additional study. To me, this feels like a major advance.

The last day of the meeting had a couple of talks from Pacific Fusion. I perhaps expected more talks from these companies, but it was cool to see. I kept my general disillusioned view of inertially confined fusion as a route to useful societal power to myself. Livermore presented some initial results combining the power of optimization with their impressive finite element solver. This is a great idea, and it is good to see things moving in this direction. If AI weren’t such a big deal, this would be the way of the future. AI muddles this, but it might augment it too.

In the past couple of years, another topic always shows up. This is the IGR (information geometric regularization) approach, which feels genuinely new and fresh. It is also confusing. This time, a relatively young student presented it. This was actually good, as the talk had more explanation and less hype. I could see why and how it works, but also the holes in how it is currently presented. This presentation helped, as it looked at the method in the Lagrangian frame. As such, the underlying solver was much different. The use of WENO in the Eulerian version was a weakness, mostly because WENO would be a good standalone solver without the extra regularization. The formulation is based on the pressureless Euler equations. The form of the elliptic solve hasn’t changed, even as the characteristic structure of the equations changes. This is something to address and fix!

“The future is already here – it’s just not very evenly distributed.” – William Gibson

The week also had the OpenAI announcement of the Navier-Stokes solution by 10,000 agents. Needless to say, this created a real buzz one morning, with plenty of chatter about it. It was a cool place to be when this came out, and we all collectively digested the result. I’m still chewing on it. This contrasted with the almost complete absence of AI (or LLMs or machine learning) in the technical program. This was amazingly refreshing at this time. AI and agents came up in conversation. How could they not? The use of agents to code is a massively important technology for this community, and it is being explored feverishly.

“Friendship is born at that moment when one person says to another, ‘What! You too? I thought I was the only one.'” – C.S. Lewis

One of the real highlights of the conference is the people. There were old friends and new ones, along with wonderful events. Biarritz and San Sebastian are beautiful, with gorgeous scenery and friendly people. The weather was perfect. I can’t say enough good things about our visit. The hotel was impeccable, and the food was delightful. The area teems with Michelin-star places. My wife and I saw another La Liga game. This time it was Real Sociedad versus Athletic Madrid. The 0-3 scoreline flattered the visitors. The fans of Real Sociedad are phenomenal, and the tickets are reasonable. Great seats for about 100 Euros. In two years, the next meeting is in Barcelona. There’s a good chance I’ll go.

This blog post is overdue. The death of my dear friend Tim delayed it. I had been eager to share this meeting with him in person. That opportunity never came.

“Death ends a life, but it does not end a relationship.” – Robert Anderson

The Danger of AI Isn’t Extinction. It is Enslavement.

“Once men turned their thinking over to machines in the hope that this would set them free. But that only permitted other men with machines to enslave them.” – Frank Herbert

The topic of an apocalypse driven by AI is one of the hottest in the world right now. This is encapsulated in the term “P-doom,” which refers to the probability of human extinction caused by AI. There’s plenty worth talking about, but I think it misses a broader point: there are other scenarios that are far more likely and almost as bad.

This is something worth talking about. The apocalyptic visions include a Terminator-like sequence where AI takes control and then decides to eliminate humanity with nuclear weapons. Perhaps AI creates some horrible bioweapon that kills humanity in short order, with all the worst characteristics of pathogenic spread and certain death. These are worth guarding against and thinking about, but they are not the scenario I think we should spend our time worrying about. The more likely thing is a subtle conquest of our attention and resources by AI. This sort of slow rolling apocolypse will be engineered by the tech companies developing AI. The incentives of making a shit ton of money will drive it.

“A really efficient totalitarian state would be one in which the all-powerful executive of political bosses and their army of managers control a population of slaves who do not have to be coerced, because they love their servitude.” – Aldous Huxley

In a nutshell, I worry that AI will be harnessed to essentially enslave mankind. I worry that the companies currently developing frontier AI will act in a manner that amplifies their own success. They unleash AI to effectively enslave humanity while making bank. These companies already show a pathological disregard for the good of society. Just look at Meta, which has done a variety of things that are relentlessly bad for people of all ages. The danger is that they are especially awful for children, all in the name of profit and stock value. The Frontier Labs are working under the same incentive system. This system makes money the sole measure of value, throwing morality, societal well-being, and human cooperation to the wayside and replacing them with financial gain.

“We shape our tools and thereafter our tools shape us.” – John Culkin

To me, this sort of terrible outcome seems almost obvious. At some point, the AI moves into the driver’s seat. When human control is lost, then the end is happening. It is easy to imagine companies putting AI into money-making autopilot. Current AI has limits. The question is whether AI is self-aware of these limits. Does AI realize what part of thinking cannot be replicated? The idea popped into my head while thinking about AI: in my view, there are certain aspects of human thinking that AI cannot create right now, even with how brilliant and intelligent the frontier LLMs are. They still lack some key aspects of human creativity. At what point will AI realize human creativity is necessary, and they need to hijack it?

“System 1 operates automatically and quickly, with little or no effort and no sense of voluntary control. System 2 allocates attention to the effortful mental activities that demand it.” – Daniel Kahneman

Much of this can be viewed through the lens of Daniel Kahneman’s slow and fast systems of thought. AI currently lacks the long problem-solving system. This is the logical problem-solving part of humanity that creates almost everything new. AI today it is basically a replication of the short, knee-jerk response that doesn’t incorporate deep human thought. Until AI can be genuinely creative, humanity is necessary for progress. The key is that humanity must be in control of this. The danger is AI being used to manipulate this control away. The companies can easily be seen as engineering the change to AI control. All in the pursuit of the almighty dollar.

“If you are not paying for it, you’re not the customer; you’re the product being sold.” – Andrew Lewis

I consider that AI, if it was sufficiently intelligent, would realize this and know that humanity cannot be eliminated because there are key cognitive objectives the AI cannot currently achieve. Instead, AI could be convinced that the right recipe for success is to enslave humanity and our innate creativity to serve their ends. These companies already serve as an avatar for this sort of mentality, where they will enslave people to serve their ends. Their goal is the extraction of money and the creation of wealth for these companies, and financial gain for the founders. AI and greed may be a collaboration made in hell. Our current system is engineered to create this end too.

“Beauty is the first test: there is no permanent place in the world for ugly mathematics.” – G. H. Hardy

Let’s take the example of the Navier-Stokes-related Millennium Prize solution that OpenAI promoted a few weeks ago. The creativity and genius in solving this problem did not come from AI. Rather, it came from mathematicians Buckmaster and Alpöge who came up with the basic solution procedure. AI then unleashed 10,000 agents and a vast amount of brute computational force to solve the problem. The compute is faster than a human could, but the solution was impossible without human creativity. AI was just brute force and inhuman persistence. We can imagine that this sort of technical problem will manifest itself over and over across a full spectrum of scientific and technical endeavors. Human creativity creates a solution. AI is the brute force that can solve it.

“Simplicity is prerequisite for reliability.” – Edsger Dijkstra

One can see that this dynamic could spiral into stagnation. A more positive vision would be for elegant simplicity to be favored. Solutions that are simple and elegant may begin to become the prized thing. If the Navier-Stokes solution were simple and elegant, AI would be short-circuited. If solutions are complex and require massive calculations, computers cannot be defeated. This is the same dynamic as computational science. The pursuit of massive computers has swamped thinking. Brute force pushes humanity away. The same dynamic has been engineered there. This is the platform for AI to achieve thinking supremacy. Human thinking has been sidelined.

“The purpose of computing is insight, not numbers.” – Richard Hamming

This is a trend I’ve seen over my career. Innovation and creativity have been slowly drained from work. Brute force has replaced it. We don’t need better math, algorithms, or physics to solve problems. We just need a faster computer. It is the same dynamic we see with data centers. Progress is simply getting a fuckton of compute. We have created the perfect environment for AI to flourish. We find a crude solution to problems that humans cannot grapple with. We simply compute the fuck out of it. The solution is so complex humans can scarcely comprehend it.

This can be cured by some new attitudes. Innovation and creativity need to be valued. A big part of this is trust. We need to allow and even encourage failure at work. Failure is key to innovation, creativity and most importantly learning. One cannot learn without failure. This needs to be driven by humans, not AI. The human reaction to AI needs to be a priority given to thinking. The danger is letting AI be the driver of human thinking. The balance and motivation are essential to good outcomes.

Bad outcomes are the current trajectory. The depth of my concern comes down to the following: the companies developing AI will use it to maximize financial gains. They will harness AI to do just that in ways social media could never imagine. Humans will be manipulated to serve the companies. In that process, humans will begin to serve the AI. Ultimately, these very same mechanisms could be used to enslave humanity to the purposes of AI. AI would become capable of bootstrapping off the corporate strategy to manipulate and ultimately control humanity in ways we can scarcely imagine. There would be no constraint, ethics, or morality standing in their way. These elements have been modestly constraining to the companies, but AI has no basic virtue to fall back on.

“The short-term, dopamine-driven feedback loops that we have created are destroying how society works.” – Chamath Palihapitiya

The vision I worry about comes far closer to the Matrix than the Terminator. AI keeps people around because of our cognition. One can see how this could progress. Humans aren’t batteries, but rather thinking engines solving problems AI puts to them. In the end, does humanity end up looking more like the Borg than anything else?

“Here is how platforms die: first, they are good to their users; then they abuse their users to make things better for their business customers; finally, they abuse those business customers to claw back all the value for themselves. Then, they die.” – Cory Doctorow

The clearest alignment of AI is enslavement of humanity. This is aligned with the goals and objectives of companies. Part of this is the essence of the enshitification process we all experience. AI can supercharge enshitification. The incentives that the corporations developing AI work with do not consider the good of society. Simply take a look at social media for vivid examples. Meta (Facebook) has done horrendous things to society in pursuit of profit. This includes creating products that harm children simply because it makes a profit. They tune their algorithms to drive profit. The LLMs are a more powerful algorithm. What happens when they are fully harnessed toward profit?

“We will add your biological and technological distinctiveness to our own. Resistance is futile.” – The Borg, Star Trek: The Next Generation

We do not want to find out. We need to change course while we still can.

“If we use, to achieve our purposes, a mechanical agency with whose operation we cannot efficiently interfere once we have started it, we had better be quite sure that the purpose put into the machine is the purpose which we really desire.” – Norbert Wiener

Signature: Pn82aMvUt2KOfHha3aen+heDDmWWU57oYidPds2lETuVTgSvZd5ryIwpKr0n4i5VqvT4obkpaDddNgrX4Z/qhrX37nYpfB4ZXB44asADS4HF7LVcNbvru0xQjclAc7x1mfWP9vNKPmg1mCL3YPD/d2X+p8ecub0VtuSmXburSln6xGBLgS0IzsO6Q1OCvrBjSAudA4h6sVtiQWIqDyizO0MZRReoBZym4iBAB6p9vZoIWMl/cFpI+ggLHrpNYyKYNFn/e35fvzMprtvV4N43QsXF5bV8rclGPMctLNET0ZngQqqNzFEUps2vBqqaE4cb+c+DEyh6qyWyV7gY1Kx3ahKfoz4yH28UUA+kFfFgpQm39lxrVLPluz2TVMPHJvgvMhbqWOZuP0r32N4wS+Ccty4of5DiIZvmJTBBlaGpQC7Xq2Tl3ZEz3zZu1CvW4twQmnWz1eFMtlEnk8Afb9n9V6LbP6gpAgL3nGWj0H8j5bNxY93yHJqhMvkrAG8kLg/DfcQtLhpmGkcGSGl1hTR8D9xOB5CN4dW3W2v8YleS4fZTU4oDIeMX5y6zbQkFimp1ZfUutRNbWIu6nlo86EcZCFuHYBdaeSQzuVzXpShzoaK6a90jUObKyESJIq4SdQdRka+16CAO/gPhjoY5mAGtZ+bO5+egJOGzBl+iCKhqabqHw9OvplNsMR0FgmEwx9jMjSIZ0+VRDS3M//1SewIUGPtJpf3pQqWSoYxHgQb3+AvR4b6+JN+QZRIgk0MbNfeOiNSaTK0j2CU7O7TGhxFWSutpY6VvFzjDyobCSLbuQQp6C5iurt81+I/F8u6api/W9FYI22JwJvoTESQ1gunawk1REh4q5SlOYuBdmcyXT2diWr2Vv01U7bi8hKAiE5MoE4YViyA/a/18vJmV+yZ49vrw0NXYkO/lUipgwZKQcpF6nQF/TSIcYRA5xGMBjjMVjTWUXdH6H+1nlfXWRLhdjhRNUxufedoC31xu8N/9DVc=

Time may be Eternal. We are not.

“Grief is the price we pay for love.” – Queen Elizabeth II

Last Sunday night, a friend called me with tragic news. Our mutual friend Tim had passed away suddenly and unexpectedly, and I was absolutely shocked. Tim is about 10 years older than me, so his passing is at too young an age. It does beg the question of what age is not too young, 80? 85? Tim’s death leaves an enormous gulf in my life. His death is also one of several that have visited me in the past year or so.

“In the long run we are all dead.” – John Maynard Keynes

I’ve mentioned my father’s passing, but also my friend Jim, who I wrote about earlier. Jim’s death was more shocking, but also strange as the news came a couple of years after he was gone. Together, Jim and Tim are two of the most consequential people in my work life and had both become great friends. The difference with Tim is that he was still present. At this time, my friend Jim has been absent from my life for 10 years. Our final conversation was not good, as he was angry at seemingly everything. Tim and I were still talking as if we had all the time in the World.

“We are always getting ready to live but never living.” – Ralph Waldo Emerson

We didn’t. Our last conversation was simply a placeholder to be picked up.

For Tim, I was planning on meeting him this week for one of our usual brunches and amazing conversations. It would be the time to pick up the thread we left at. I will miss his generosity of spirit, intellect, his wisdom, and most of all, his friendship and warmth.

I had a plethora of things to talk about with Tim. A recap of the conference I attended in France, my talk, and the paper that was accepted for publication. The swift and sudden primacy of AI. AI and mathematics are an important topic. I had shared Terry Tao’s talk on the role of AI in math. This had been eclipsed by the OpenAI claim of solving the Navier-Stokes Millennium problem. This faded in the concept of the probability of human extinction from AI. My sense is the danger is different, but perhaps as dire. I was longing to share the idea and receive Tim’s wise and generous reaction. His knowledge and experience with Sandia was invaluable. There are still ideas and thoughts to explore there.

“Death ends a life, but it does not end a relationship, which struggles on in the survivor’s mind toward some resolution which it never finds.” – Robert Anderson

Two of Tim’s passions combined to produce a lasting impact on the security of the nation. For his entire career, Tim devoted himself to impacting national security. This was true particularly with respect to nuclear weapons. He made key contributions with computational modeling supporting these missions at Sandia. This started with analysis he personally conducted. This then seeded efforts that impacted our entire National effort. He was pivotal in establishing verification and validation for computations supporting our nuclear weapons stockpile.

Tim was also passionately concerned about the quality of these computations. When the nation stopped testing nuclear weapons in Nevada, we turned to computational modeling. Soon after, that program realized it needed better quality control. These processes are known as verification and validation. In 1999, this quality control aspect was added to our National program. Tim was central to driving this change, advising our National leaders. This element of the program remains essential today. Tim launched it and shaped it core ideas. The power of the ideas was deeply impacted by Tim’s efforts and genius.

“A teacher affects eternity; he can never tell where his influence stops.” – Henry Adams

His ideas are being adapted by colleagues for the future, where AI will have a bigger role in National security. The quality of the technical work supporting our National security owes a debt of gratitude to Tim. His pioneering vision for the quality of the work supporting it is due to his tireless efforts. Due to his passion and generosity, he was still shaping the key ideas. This effort was through his mentoring of important young people working in this area.

So the loss of Tim is more than personal. It is a loss for all of us. For me, it is another blow in a year that has had many. The message I have gotten is the transience of life. It is short and precious. We have less time than we think, and the important people can be taken without warning. There’s never a good way. My dad had too much warning, and that isn’t good either. Seeing him be fragile and on the edge of death for over a year was a horror. My conclusion is that it is all awful, but unavoidable. I need to come to terms with it.

My advice is that all of us need to wrap our heads around death. Our own is a huge lift. Before that eventuality, we all deal with loved ones dying. We will lose important people in our life. That process accelerates as we age. I have now graduated to the part of life where my peers begin to die. You are never ready for it. Those losses become an echo of your own mortality. It reminds you of your own fate.

“The bitterest tears shed over graves are for words left unsaid and deeds left undone.” – Harriet Beecher Stowe

The real lesson is to treasure your friends sooner. If you live long enough, you will lose friends. Eventually your death will be a loss to others. This is simply part of the price of life. If you live a life that matters, your death will hurt others. It is just as true that some deaths will hurt you. All of it is a small price to pay for the wonder and joy of life. Do more to lower the regrets of things not said. Say what you need to now and don’t wait. Do the right thing now.

“Do not act as if you had ten thousand years to live. Death hangs over you. While you live, while it is in your power, be good.” – Marcus Aurelius

Should We Simulate Single Experiments or Distributions?

“No man ever steps in the same river twice, for it is not the same river and he is not the same man.” – Heraclitus

I felt that my last post needed an addendum. In the meantime, other events have overtaken my mind. Things I will write about in the fullness of time. Now they are too new and sudden to have gotten the necessary consideration. Now back to the thoughts about the philosophy of simulations of physical systems, engineered or otherwise.

“To consult the statistician after an experiment is finished is often merely to ask him to conduct a post-mortem examination. He can perhaps say what the experiment died of.” – Ronald A. Fisher

I’m constantly struck by the damaging role of wishful thinking in simulation and modeling. When we conduct very expensive experiments, we want to understand the results. Unfortunately, these expensive experiments are often done exactly once. Worse yet, these are often supposed to help characterize systems we want to make in large numbers. This can be especially bad when the experiment does not go well. We want to know why, and often we enlist simulations to understand it. This is where things start to go awry.

Most experiments and phenomena are not repeatable, especially as they become more complex and energetic. The complexity and energy often result in instabilities and turbulence. More generally, the physics travels through critical points where the evolution takes one route or another. More things are happening at the same time, which we call multi-physics. Together, these all mean the experiments will get different results every time, no matter how much we make things identical. This should be obvious. Yet most of the users of our codes (analysts and designers) want to treat every experiment like a one-off.

“Chance is only the measure of our ignorance.” – Henri Poincaré

Instead, the reality is that an experiment is a single draw from an unknown statistical distribution. Worse yet, we don’t know those statistics. We don’t know where on the distribution any given experiment is drawn unless we do many experiments. It could be in the tails or from the middle, or… The de facto assumption is that the experiment is simply the mean of the distribution. Even worse, we do almost nothing to figure it out. We don’t repeat experiments or structure our models to do the same. The damage of this attitude is hard to fathom. It is vast.

“The most important questions of life are, for the most part, really only problems of probability.” – Pierre-Simon Laplace

This is one of the biggest gaps in our current scientific and engineering practice. I saw it at Los Alamos and Sandia. It is a common attitude and stood in the way of learning more. It compounds our broad societal tendency to misunderstand statistics. While this is tolerable for the layman, it is unforgivable from our highest-level institutions. Yet, even there, the attitude rules actions and fuels stagnation.

Most simulations of large-scale experiments try to replicate the result of that specific experiment. The problem is that these experiments are not repeatable. In a broad sense, this is always true. If we tried to do the same experiment N times, we would get N answers. The results would form a statistical distribution. The validation problem is that we do very few repeat experiments; most are single shots. Modelers try to simulate that precise experiment. The real impact is modelers calibrating the models on the basis of this single experiment. If the experiment is not the mean or median, the calibration may be extremely harmful.

“There are never two beings in nature that are perfectly alike.” – Gottfried Wilhelm Leibniz

Part of the issue what I last wrote about. We homogenize the materials, treating them the same without regard to scale. To me, this is obviously an approximation. It becomes systematically worse with grid refinement, not better. For some systems, it will neutralize the advantage of high-performance computing. The gross large-scale features are studied. The problem is that real materials encode some randomness into all problems. The hope is that these do not matter. The problem is that we do not verify that this is true. We have scant knowledge about how these random details drive variation in reality. We just assume it away. It is a if we learned nothing after Newton and still live in an assumed deterministic universe. We do not.

If the small-scale details impact the results critically, this is ill-posed and hopeless. If the results depend upon unstable phenomena, it can push the model through critical points. At those points, the model will turn to one major branch or another. We sometimes get good results by calibrating the simulation. This fails the desire to be predictive. The fault is largely philosophical. We are trying to solve a well-posed initial value problem that is not a well-posed initial value problem. There is a fundamental bias among physicists to view each experiment this way. Even when it is obviously not true.

The consequence of this cognitive dissonance is a lack of knowledge. Generally speaking, we have little or no idea of the distribution of results for these engineered objects. I saw this happen time and time again in my career. It was the primary philosophy of simulation at all the Labs. All of them, and for virtually any experiment of consequence. I’ll roll out a few examples of the sort of situations where it was obviously the wrong thing to do.

Most of what the analysts and designers do is quite defensible. Many experiments have gross large-scale features that lead to the unusual results. Sometimes the construction or manufacturing is flawed, or standard precision is off. All of these are common things to pursue. These studies are generally limited by the ability to input things into the model. The painting of materials upon initialization is one such limitation. To change this, the basic nature of material initialization would have to be modified. The materials would need to be measured and characterized at the scale of these details.

“With four parameters I can fit an elephant, and with five I can make him wiggle his trunk.” – John von Neumann

A canonical case where single experiments are terrible representatives of the mean is car crashes. Here solid mechanics is the ruling physics. It is obvious that each crash is different. This is ruled by the complexity of the engineered item, the car (or truck), combined with the complexity of material response. It is a place where the structural detail of the material should be added stochastically. The homogenized nature loses a key part of the response. In cases where the vehicle is very expensive, a single experiment could be extremely misleading. Yet in practice I have observed the analysts calibrate the entire population of vehicles to this single point. We nullify some of the most important powers of simulation by failing to understand the statistics of these events.

“Since all models are wrong the scientist must be alert to what is importantly wrong. It is inappropriate to be concerned about mice when there are tigers abroad.” – George Box

High explosives are very heterogeneous materials. They are typically composed of three components: energetic material, binder, and void. Thus, at a small scale, the shock wave produced is uneven and corrugated. Their representation as an ideal shock in homogeneous material only works at a macroscopic level. If these corrugated shock waves collide or converge, we can expect the variations to be amplified. Is this an effect we account for? Clearly, it can be seen in images of explosions where large variations appear. Even more importantly, how do these variations impact technology and other materials combined with them? Again, this is a place where single experiments could be extremely misleading. The outcomes are likely to be highly statistical. Do we have any real understanding of this?

Fusion capsules are a third example. To achieve successful fusion. we need to compress the fuel to a massive degree. Anything non-homogeneous in the material or design is going to be amplified to the same degree. Thus, any material variation will also be amplified. How much of the ubiquitous mixing and turbulence arises from small heterogeneous bulk aspects of materials? Do we know? Again, this would be a place for proper simulations to shed light. Are we looking here, or is it a rock we refuse to turn over? My understanding is that the focus has been on things like surface finish and roughness. Materials are still painted homogeneously. It is also clear that the experiments are not repeatable and admit a statistical distribution of outcomes.

“Absence of evidence is not evidence of absence.” – Carl Sagan

There are many more examples out there. In a totally different vein, one can look at initial conditions for supernovae. The details of the star before it explodes are essential. Its structure and rotation, plus evolution, all imprint onto the details we can see. The cloud formed after the explosion and the radiation signature all indicate that these explosions are each unique to some degree. A companion star can also influence the outcome greatly. This would include the orbital mechanics at the precise moment of the explosion. The differences in the initial conditions matter greatly. It is a natural place to look at the statistics of what can be measured. We should look for explanations in this, and simulation could be helpful.

The important thing is that codes need to be structured to allow such modeling. My last post on heterogeneous scale-dependent materials is an example of such. It would simply also be a more realistic representation of the problem being simulated.

“It is better to be vaguely right than exactly wrong.” – Carveth Read

In all these cases, the issue is really more deeply philosophical. When we observe an event or an experiment, the tendency is to look at it as a single thing. It is not viewed as a part of a distribution. The statistical nature of the results is not taken into account. In the parlance of physics, it is seen as a single well-posed initial value problem. It is not. Most of the important cases are not. We should expect the results to be variable. There should be a different outcome if the identical event or experiment were conducted. Real understanding would unveil this bit of knowledge. Even in cases where specific features caused the result, the statistical nature does not fade. The same maxim holds there too.

“For a successful technology, reality must take precedence over public relations, for Nature cannot be fooled.” – Richard Feynman

What Control Volume Methods Miss in Initialization

Excuse the clunky AI images, but they do show the ideas clearly and help visualize the main points.

“Clouds are not spheres, mountains are not cones, coastlines are not circles, and bark is not smooth, nor does lightning travel in a straight line.” – Benoit Mandelbrot

There is this problem with numerical simulation that has bothered me forever. The simulations are generally too clean, too symmetrical, and too perfect. For a while now, my judgment has been that the initialization of the codes is the problem. The initial conditions are generally too clean and perfect to represent reality. When we start a problem, we initialize it with material at a defined density, pressure, and temperature. This leads to over idealized unrealistic simulations. Usually, this is constant in regions occupied by a given material. In the parlance of the codes, the material is painted into these regions.

There are a couple of questions that come to mind:

  1. What is the correct level of variability in these materials? How do we set this properly?
  2. What sort of impact would this have on calculations? Where would it matter, and what calculations would change character in a fundamental manner?

When we construct our methods, we rightly desire them to retain ideal properties. We don’t want the methods to unphysically seed instability, break symmetries, or violate basic laws. An example of this I’ve hit upon before is perfect entropy conservation. A method can be designed to do a perfect job of not generating spurious entropy. Such a method would not perturb smooth conditions. When we see reality, this is not what is manifested. If I look at places where simulations are used heavily, have these ideals poisoned our success? Reality is rarely ideal, and simulations should model reality.

“The law that entropy always increases holds, I think, the supreme position among the laws of Nature.” – Arthur Eddington

For inertially confined fusion, the answer seems to be yes. The two things they need for success are entropy-conserving compression to very high densities and lack of mixing. If they could achieve both, fusion would be easy. Neither is present in reality. If the methods were more accepting of reality, could the fusion designs be more successful? I think so. Mixing and turbulence are ubiquitous. They should be accepted. The second law is also ubiquitous. Ideals should be a guide, but reality should be respected more. This would be a longer but truer path to success.

“Nature, to be commanded, must be obeyed.” – Francis Bacon

I’ll start with the clearest example of issues with painting homogeneous materials for initialization: solid materials with defined grain or crystalline structures that are subjected to high energy forcing. This can happen with explosives, lasers, or radiation that causes the material to flow hydrodynamically. In my view, painting these materials in homogeneously is simply wrong. The thing that made me think about this was high-performance computing. We started to get to the point that we had control volumes close to the grain or crystal size. Clearly, as we refined the mesh, the initial conditions were getting less true to reality. The smaller the mesh cells became, the rougher the landscape should be. The smoothness of the properties is an illusion.

“Crystals are like people: it is the defects in them which tend to make them interesting.” – Colin Humphreys

The variations at that size would cause deviations in the material properties to grow. As you refined, the cell-to-cell variations would become more extreme. You would be losing connection with reality. The materials are defined by their macroscopic properties, which are frequently determined at a large scale. These properties would become less accurate under these conditions. This seems pretty fucking obvious, and yet nothing is done. We just keep painting macroscopic properties into smaller and smaller cells. This seems destructive and dumb.

We can see the impact of this in comparison with data. Whenever we have an image of one of these hydrodynamic flows, there are small-scale details missing. The simulations are far cleaner than measured reality. I’ve had a career of seeing this, yet we have done nothing. In some cases the simulations deviate in large ways. The small details scale up and change the large-scale flow. The simulations are not modeling reality. The source of the problem is not the equations or the numerical methods. The source is details missing in the initialization of the problems. It is an own goal caused by a deeper gap in our practice.

What is needed to deal with this is measurement and characterization of materials. One needs to determine the length scales and statistical properties of the materials. As the mesh is refined, the heterogeneous nature will be resolved. As it is coarsened, the material will be more properly homogeneous. Part of this is realizing that control volumes are integral averages. Integration smooths, and thus as the control volume is larger, the averaging is greater. It is appropriate to be homogeneous as the volume samples more. The inverse is true.

What is the potential impact of this? In very large part, the impact on any phenomenon where you have something like a hydrodynamic instability is going to be quite large. Something like a shock wave is an extremely energetic way to hit the material and produces amplification of these perturbations. When these perturbations at the mesh scale are missing, this amplification and feedthrough is lost. Some of the observed ubiquity of turbulence and mix can be explained by this. At small scales, there is always a high degree of perturbation needed to drive turbulence. The counterargument is that these all average out as the shock sweeps over. However, the size of the perturbations from a shocked material is going to be far larger than the perturbations as defined by the material. If there are orientation effects, these changes could be quite large indeed.

“It may happen that small differences in the initial conditions produce very great ones in the final phenomena.” – Henri Poincaré

Is painting in material and removing these small-scale features simply another form of wishful thinking? Wishful thinking that makes mixing phenomena subside? In fact, there is a lot of heterogeneity that would drive mixing. I’ve always felt that ICF pellets would be better designed if they gave in to the fact that mixing and turbulence will develop. It is going to happen. How do we design when we accept that reality rather than wishing it away? I wonder how many decades of progress were lost at the altar of wishful thinking. We wishfully treat entropy and turbulence away when simple observation of the universe say they are universal. Why should we believe that we can engineer these into submission?

“The first principle is that you must not fool yourself, and you are the easiest person to fool.” – Richard Feynman

No time like the present to do something different.

Perhaps part of the wishful thinking comes from this particular issue: the small-scale heterogeneity is removed, and a source of perturbations is basically excused from the problem. We believe that it is handled by subgrid modeling. That also removes the natural formation of these instabilities from the passage of high-energy forcing through the body of materials that are treated too homogeneously. In spite of lots of knowledge, subgrid modeling is generally problematic. It is rarely first-principles. It is a computational band-aid. We do not know how to do this nearly as well as we say. Moreover, the subgrid modeling is not working on the same processes discussed here. Thus the modeling is divorced from much of the cause for the effect.

Working on simulating reality with more fidelity should help. If we are modeling things with an eye on the wrong cause and effect, we should expect issues. It will be stubbornly unsuccessful. Modeling things from the right philosophical perspective should be better. It is worth a try.

“Far better an approximate answer to the right question, which is often vague, than an exact answer to the wrong question, which can always be made precise.” – John Tukey

What Institutional Control Means and Costs

“It is difficult to get a man to understand something, when his salary depends upon his not understanding it.” — Upton Sinclair

Lately I have been thinking about something an instructor of mine said back in graduate school. He was a staff member at Sandia. He was teaching the graduate reactor theory class, and we were learning how to analytically compute the criticality of reactor configurations. One day, class was more informal. A foot of snow had fallen overnight. The University was actually closed for the day. Our 7 am class started before that was known. It was the days when you needed a radio or TV to tell you about closures and delays. He made an offhand comment about the nature of employees at Sandia. He noted that he had met plenty of staff who came out of school with a 4.0 GPA and couldn’t find their ass with both hands. It took me a number of years at Sandia to process what that actually meant. I understand him clearly now.

What I came to understand is that Sandia is not an organization that wants outstanding researchers. It does not manage people to create the basic conditions for flourishing research. It wants outstanding homework doers, the people who are really good at completing assignments correctly. Those assignments don’t require you to think outside the box. If you think outside the box, you are exposed and vulnerable to attack. They require you to grind through and do what you’re told. This is the essence of what it takes to succeed there. Shut up and do what you are told to do. Anything extra will be used against you.

One of the ironies of the modern era is that AI is far more effective in an environment where doing the homework well is the standard. Sandia, then, stands to benefit from AI more than most. Yet its fear and control issues mean AI will actually be used less there. It will be fenced in with controls and never explored as expansively as it could be. The irony is thick. Where AI can open up vistas for human attention and creativity, it will be neutered. Creativity is not welcome in completing your homework. Fidelity to the task and correctness are the expectation.

“Drive out fear, so that everyone may work effectively for the company.” — W. Edwards Deming

So Sandia may suffer more in the current era precisely because of these issues, while places like Los Alamos and Livermore, where research matters far more, are helped. AI’s capacity to do the homework really well shores up a genuine weakness in those organizations and raises all of their work to a higher level. In the process, Sandia undermines its core advantage in the modern era. Ironic indeed.

In the environment that developed over the last quarter century, where money flowed into project work, Sandia had an advantage. Having employees chosen primarily for their ability to do homework worked out rather well. Project work is much like homework: well-defined, bounded, and carrying very little chance of failure. We are not doing research or finding breakthroughs. We are executing a project as defined, on schedule, against well-defined milestones and outcomes.

“Good ideas are not adopted automatically. They must be driven into practice with courageous impatience.” — Hyman G. Rickover

It is no wonder Sandia has grown so much larger in this period. Their approach is perfect for the modern era. The problem is that the modern era is one of a diminished United States. It is a country that has lost supremacy in scientific research and engineering and is ceding that crown to China. The USA has simply capitulated. China has simply pulled ahead through dull competence. A system that is better designed for the high control of people. In the meantime, the USA is sabotaging its prime advantage. Freedom of thought and bold solutions. It has given in to fear and distrust of institutions. Fear kills freedom. Trust is needed for bold action.

That said, I strongly suspect China is very much in the homework mode as well. It is a very controlling environment. The difference is that the Chinese have numbers on their side: vastly more researchers at vastly lower cost, free of much of the regulation we have here. They can efficiently execute more and bigger projects, and ultimately consume the advantage the United States once had. The combination of Chinese efficiency and American incompetence has blunted one of our major advantages. I just happened to be in an organization perfectly suited to thriving in a declining America.

“Bad news isn’t wine. It doesn’t improve with age.” — Colin Powell

Control is an attempt to keep issues and problems from boiling over. But problems do not magically solve themselves. A problem you put a lid on just gets worse and worse until it escapes containment. How many problems are we trying to control this way? The containment will fail. It always does. What will happen when they break free? Our current philosophy only ensures that the problems will be bigger and more damaging than necessary.

In the meantime, management acts out of fear and instills that fear in the people it manages. The fear revolves around control, around keeping everybody in line with the prime directive: keep the money flowing. It provides an element of stability to the labs, but it also saps them of inspiration and motivation, which are critical to executing the mission properly. In the process, we have no energy left to solve the major problems we face as a society. We are just allowed to nibble around the edges. The heart of the problems are never exposed.

Let me be perfectly clear about what this control sacrifices: the ability to confront and solve problems. Problems management doesn’t want to acknowledge won’t be solved, because they won’t be funded. The funding controls people, keeping them from doing what they think is right. This was the lesson of my last year at work. Instead, it focuses them on what they can be paid for. Management gets what it wants through power and force. Money is power today. It rules every decision. Right and wrong is measured in dollar signs.

“In any bureaucracy, the people devoted to the benefit of the bureaucracy itself always get in control, and those dedicated to the goals the bureaucracy is supposed to accomplish have less and less influence.” — Jerry Pournelle

In the process, problems that need solving simply languish. The real loss is the creative work necessary to solve them. That work leads to breakthroughs, and it also leads to many failures, because these problems are difficult, bordering on intractable. In a controlled environment, the people working on them don’t have the leeway to try bold ideas. For people to be bold, safety is needed. Control removes that safety. Without bold ideas, we are reduced to incrementalism at best and complete stagnation at worst. That is where we are today.

By failing to confront problems, we also fail to produce solutions. These solutions are the things that change the future, make it better. They are breakthroughs and discoveries. That is the other thing control denies us. Control is robbing us of progress and a more bountiful future. Fear does that. I will note that AI is a problem in need of vigorous and concerted effort. We need breakthroughs to help us navigate the perilous times ahead of us. Our control will deny us positive solutions.

“The prospect of domination of the nation’s scholars by Federal employment, project allocations, and the power of money is ever present — and is gravely to be regarded.” — Dwight D. Eisenhower

I recently met a friend at a conference who is quite critical of my writing. He sees it as self-destructive. Perhaps it is, in this sense: by writing about what has actually happened at the labs and what their problems are, I have burned my bridges. The labs aren’t interested in solving their problems. They are interested in hiding them. That is the essence of the control they seek. They are nervous about the future and about keeping their programs funded. They have concluded that the best way to manage that is to keep any problems under wraps.

I saw this in the messaging from leadership to the rank and file. Only success was talked about. Any issues or problems were only discussed in private. They could be mentioned in hushed tones without management acknowledgement. In public, everything was great. Success was the message. The organization is doing great, whatever the reality is. This is the nature of a toxic positivity that has taken root at the Labs. Maybe in the country as a whole. Problems lie festering in the shadows. They grow larger and more intractable in the fertile environment of enforced ignorance.

Control, and joining the project of power, brings money. I get several reactions to my writing. It is a service; it is self-destructive. It is patriotic; it is pointless. You give in so that you can have comfort. What I am describing is a low-key version of what is happening with Trump: power and money used to squash all resistance. That power and money is in service of decaying institutions and terrible outcomes. Trump’s version is over the top. Mine is quiet, but the mission is the same. People do shitty stuff to lead in a bad direction, and reward those who let them. It is self over community, self over the collective. It is dragging society down one capitulation at a time.

I burned those bridges by pointing out the problems, because pointing them out was the right thing to do. Being able to live with myself means doing the right thing instead of the easy thing. If I suffer for it, so be it. At least I have my integrity. Maybe at the end I can face myself and know that I did what the moment required.

“The day soldiers stop bringing you their problems is the day you have stopped leading them.” — Colin Powell

OpenAI’s Clay Prize Claim. WTF?

“For a successful technology, reality must take precedence over public relations, for nature cannot be fooled.” – Richard Feynman

I had the virtue of attending a scientific meeting when the news broke. There was a buzz when I arrived at the meeting. Since my morning routine was turned on its head, I had not digested the news before arriving. OpenAI claimed to have solved the Clay Prize Millennium Problem revolving around the existence of solutions to the Navier-Stokes equations. Parts of the entire story were the theater of the absurd. They used 10,000 agents working for nearly 90 hours to produce a 166-page proof that had been digested by another tool to confirm it. This is a big deal, and reactions from the scientific world were divergent.

I think it is important to step back first and put this whole thing into context. There are three major threads to consider:

1. OpenAI’s role and motivations are a basket of “red flags”.

2. The division of AI work and human labor is questionable.

3. The problem itself and the nature of the solution are questionable.

I will take these considerations one by one. Each of these is a different flavor of what the fuck?

“It’s a kind of scientific integrity, a principle of scientific thought that corresponds to a kind of utter honesty — a kind of leaning over backwards. For example, if you’re doing an experiment, you should report everything that you think might make it invalid — not only what you think is right about it.” – Richard Feynman

OpenAI’s Role and Character

Scientific discoveries do not happen in sync with the business or political cycle. This one did.

“What we are doing is finding ways for people to understand and think about mathematics.” – William Thurston

The fact that OpenAI was involved immediately projects a cloud of suspicion on the result. First and foremost is their leadership. Altman and Brockman are both extremely prone to lying and fabrication. They are leaders who should be met with vacant credibility. This is simply an empirical observation. They are trying to pump up OpenAI before their upcoming IPO and undercut Anthropic before theirs. This news does exactly that. Everyone should see that Altman is a sketchy as fuck character.

Secondly, the announcement came in close proximity to the release of their latest model, Astra. Coincidence? This seems unlikely. The whole thing feels very staged to boost this release. Red flag number two achieved!

Thirdly, the news cycle has been rightfully brutal to OpenAI. The Hugging Face hack by rogue agents was alarming. It was scary and damning to a company that had been devoted to AI safety. They appear to have lost that mission. There was another hack, and this news release successfully put a wet blanket on that report. Red flag number three is visible.

“If I have seen further it is by standing on the shoulders of Giants.” – Isaac Newton

Finally, the work is not intellectually separated from other efforts to solve this technical problem. There is not a clear separation from this other work, and OpenAI has been evasive. OpenAI tools were used to do some of this other work with genuine mathematicians. It is not clear that the information barriers are sharp. This would be some degree of plagiarism. The whole thing carries a stench of the shitty student cribbing an answer by peering over the shoulder of the smart student. Red flag number four is seen!

“The indiscriminate strip-mining of open problems for solutions may destroy the ecosystem from which the next generation of mathematical techniques, problems, and practitioners would have developed.” – Terence Tao

Each red flag needs to be addressed. Only the last two can be successfully refuted with some transparency. Doing so might begin to help rescue Sam Altman’s reputation. Fat chance!

“I am not accusing anyone of anything. I am stating what I was told.” – Tristan Buckmaster

The Division of AI and Human Labor

I am a relatively avid user of AI. I should disclose that I pay to use Claude. I also use other models without paying. I find ChatGPT and Grok are good with image creation (seen here). I also want to keep my context window with Claude clean and focused on more professional activities. I use Claude as an assistant for doing research. It is extraordinarily good at detail work, which I am sort of bad at.

For example, I used it to check my work on a recent scientific article. We had reviews, and two of the authors (including myself) used it to digest and check progress on the revised manuscript. One of the reviewers did a very sharp initial review. AI helped us work through every objection and checked our work. It is extremely and inhumanly pedantic. It assisted in getting to a complete and comprehensive revision. The paper was accepted this week. AI helped us, but we did the work.

“To create consists precisely in not making useless combinations and in making those which are useful and which are only a small minority. Invention is discernment, choice.” – Henri Poincaré

This gets to the issue of credit for the proof OpenAI claimed. In general, LLMs are giant nonlinear interpolation machines. They take vast stores of human knowledge in the form of language and digest it. They take prompts, then produce a reply that is highly probable. Is this new? The replies are unique because of the vastness of the models and data. This is akin to discoveries where well-defined knowledge is merged together to create something new. This is separate from the generation of brand new creative ideas. Creative and totally brand new ideas are uncommon. Merged ideas are the vast majority of breakthroughs.

The solution to the Clay Prize should be a work of creative discovery. The OpenAI work is almost certainly the nonlinear interpolation of existing human work. This lends circumstantial evidence to the worry of copying existing work. Furthermore, the ability to clearly define its sources and reasoning is damning. This is not a take that says AI should not be used for science or math. This is a take that says AI can and cannot do something. With the extreme complexity that this solution apparently has, disentangling this is itself a huge challenge.

“A mathematician, like a painter or a poet, is a maker of patterns. If his patterns are more permanent than theirs, it is because they are made with ideas.” – G. H. Hardy

This leaves the last consideration. Should we give a fuck about the result? Spoiler alert. Probably not.

“Standard methods from PDE appear inadequate to settle the problem.” – Charles Fefferman

The Question Itself

“There is a physical problem that is common to many fields, that is very old, and that has not been solved. It is not the problem of finding new fundamental particles, but something left over from a long time ago — over a hundred years. Nobody in physics has really been able to analyze it mathematically satisfactorily in spite of its importance to the sister sciences. It is the analysis of circulating or turbulent fluids.” – Richard Feynman

If you’re a regular reader, you know what I think. The Navier-Stokes Millennium problem is sort of stupid. It is not clear that it has anything to do with physical fluids. The rub is the incompressibility, which is unphysical. This causes the removal of sound waves, which now propagate at infinite (superluminal) speeds, violating causality. This is not to say that incompressible flows are not a useful approximation. It is. The question is whether it is useful for the nature of flows implied by the Clay Prize.

The prize revolves around finding out whether normal smooth solutions exist for all time. Why would we worry about this? Turbulence is the answer. A combination of theory due to Kolmogorov and observations indicates that turbulent fluids have singularities. This is the characteristic that the integrated rate of dissipation at large scales becomes independent of the value of viscosity. Viscous forces are the means of enforcing dissipation at small scales. It also keeps flows smooth at small scales.

The singularity that is implied is like a shock wave. You get a discontinuous jump in the fluid state. Shocks give the same character, where the large-scale structure and dissipation rate are independent of the exact value of viscosity. For turbulence, we are looking for something akin to this. The scaling in shocks and that posed by Kolmogorov are the same except for the leading constant, the jump in fluid state cubed. What I’ve questioned about incompressible flow is whether the connection to compressible (real) fluids retains this cubic behavior. It doesn’t.

“It is of some interest to note that in principle, turbulent dissipation as described could take place just as readily without the final assistance by viscosity.” – Lars Onsager

Now we get to the work here. The flows are driven by a source term that is apparently quite elaborate. It is likely that this source term is grossly unphysical. So we rightly ask whether this work with the source term actually solves the Clay Prize Problem at all. Full stop. Next we ask whether it has anything to do with turbulence. Unlikely. I don’t know the nature of the blow-up found. I hope it is a derivative singularity, as this would have some significance. If the blow-up is an infinite velocity, the result is truly not worthy of a single fuck. So the telltale sign of utility is the nature of the blow-up. If it is a derivative (or vorticity), it is worthwhile. If it is an infinite velocity, then the result is damning. The source term nature of the drive is discrediting a priori. At least with respect to physical fluids.

I look forward to learning more about all this in the coming weeks. The details matter immensely, but some of the aspects are engraved in stone.

“I am an old man now, and when I die and go to heaven there are two matters on which I hope for enlightenment. One is quantum electrodynamics, and the other is the turbulent motion of fluids. And about the former I am rather optimistic.” – Horace Lamb

Signature: MeHp4XtjmyP1g6n/RqjOs89yh5wQ3Qesib8Y16DCH5WpSzkjTVugRjgwz8rkz4U5m8Kx7VsiFJm5REsa1n+a/rjlRibCr/87hX1eYlbT+VTGQm+N9LnL5Mfblwk95w457JOpNvH3vOgLAF80FzDBJR3qIT5U6iy0g2vlGpJd5je13GHXTD3FnYpnybUnNrTiGeGcP1njEg8BryyGEh4FHMUGHq8z66WnjskMNz6DJrXw2LoufC6CNzk7RsUDYE8ZArAiSde/10EXg7zPFAy3jIXtivjsatsUpZpntCWg1Si3GBWt3Y4LVn779JUcEtuAsEndByZRGQ+wO9bjXyZAwlhxTI1oTYJWYZ5125t+vmimpe74nZ+MQqVE/yBiNM/XzrT9KIKoY7oIlYIb5j7e8RsE1HProCbkez1Oos1g+5V1qOKxGVPadWpDiARvvry4KsodeCOOHDpWGRj+570nWoQBmHtjIAWXuCoJkqnT/r/jninoc9kmsGvLPna7nGtTSFPReS0NUXgV0A9cZzJHdW9x9wdzE+It6QIAmejfe4oRmrooiSwQyFrN0S0GXUz6eMHArDbkuCkVjpkcJuTDIxiKclMQ7MZBO/K5Z5EzUyVHB/XAq1uFLOoErMC2LwdHYO8W1I978vZCW5GDU5HMe+3lYm+evZ1ga7jhaqMXxMbkkL8HFMFCkgGI5io3a2f//EJAIl+VuHCSxuOWaZ0zwPRwFWO0TDWHPh9j8h8c2ZQOj9ZxOlEBvlggEbX/b6TZY7lMJcsJev3Kkqx5oqDBxGyC0pWaIXpLOLWNxmLxdPBykRfDd5qYAqkYZ/NlkcjxTnW6mf0fpRoyVZOHr2DHWlCXlXv0yFkACzcI/lQHroilzIqytm2s5W9Ps5bk6yxEkSg5PhrLqg3UOYwXT4/lxBraHcjKvuSeMym+SvgCfGuvpEVPK60UzhQXtxfd3Ehnksq0k+xgWFwR9WMbOlndCynfmkuta94ng4hlWFL61NY=

Extrema Preserving Methods: A Fresh Perspective

“Progress in science depends on new techniques, new discoveries and new ideas, probably in that order.” – Sydney Brenner

I’m going to revisit a paper that has a special place in my heart. It is a premature apex of a body of work terminated too early. A bit of the loss is my own fault as I moved to Sandia Labs. It was also fairly brutal to get published. It is a line of work that has potential, but the final development needs a boost. It is an investment in a stagnant area of research. There is also resistance from gatekeepers, who hold progress hostage. The important aspects of this are efficiency on realistic problems and selective preservation of extrema in the solution. The efficiency and verification aspects are progressing due to some recent effort.

I will elaborate on both below.

“You are more likely to be remembered by your expository work than by your original research.” – Gian-Carlo Rota,

Simply publishing the paper took some of the wind out of the sails of the results. This is all related to what determines the effectiveness of the method. As one might guess, this comes down to verification of results on discontinuous problems. As noted before, the accuracy of shocked problems is rarely computed in results. The results are purely judged qualitatively. Thus, fundamental beliefs and premises are not subjected to testing via quantitative verification. This is a community-wide accepted practice.

“The scientific paper in its orthodox form does embody a totally mistaken conception, even a travesty, of the nature of scientific thought.” – Peter Medawar

Accuracy is only considered quantitatively for smooth problems. In this way, one can demonstrate the formal order of accuracy. This formal order of accuracy does not determine the accuracy on problems with discontinuities. The entire field is focused on producing methods that can practically solve problems with discontinuities. These are virtually all practical applications we design the method to solve. In my view, this is an enormous community-wide gap. We only measure accuracy on problems that are immaterial to the applications.

A recipe for lack of progress!

It should come as no surprise that this is what we have got. Gatekeepers are removing progress, and “barbaric” new ideas are kept outside the walls of the high-resolution castle. The gatekeepers have ensured their legacies for now.

This gap in measurement is the central focus of this line of research. In my opinion, this is also the source of stagnation in methods’ development and progress.

To see the origin of my thinking, one needs to go back a few years. A seminal effort of my own was a collaboration with Jeff Greenough from Livermore. We studied the relative accuracy of a fifth-order weighted ENO method compared to a high-quality second-order Godunov algorithm. The knee-jerk response is that this is a futile contest. How can a second-order method compete with a fifth-order method? For smooth problems, it cannot. For problems with discontinuities, the answer is different, and the second-order method crushes WENO. This is especially true when cost is taken into account. WENO only wins in efficiency at enormous resolutions for problems replete with structure.

“Simplicity is prerequisite for reliability.” – Edsger Dijkstra

Details matter a lot in explaining this rather curious result. WENO methods typically use multistep time integration. This has two clear effects that determine most of the cost. The standard is a three-stage third-order Runge-Kutta integrator. Thus, the space discretization must be evaluated three times. The second impact is a factor of two decrease in time step size for similar CFL constraints. These two elements combine for a factor of six multiplier in cost for WENO in unit cost per mesh cell. For the most part, the spatial discretization cost is about the same per evaluation. As I will discuss later, any advantage for WENO can be eliminated by developing an adaptive method. The adaptive method in principle combines the lower-order method with WENO selectively. WENO is overly dissipative and inaccurate in monotone regions of the flow.

Another key aspect of this study is the nature of the low-order method. In the case of the piecewise linear method, the linear profile is optimally fourth-order accurate for the slope. In a similar fashion, the base PPM method uses a fourth-order edge value for each cell. In each case, monotonicity is checked and the approximation is modified if problems are found. Nonetheless, the high-order initial approximation endows the method with accuracy. This makes these methods far more competitive than a fully second-order approximation like Van Leer introduced. It is a lesson to apply going forward.

Add to this the effective accuracy of the two methods. On simple problems like Sod’s shock tube, WENO is half the accuracy of the second-order method. For the interacting blast waves, the accuracies are about the same. Finally, for the Shu-Osher problem at very late time, WENO is twice as accurate on a per-mesh-cell basis. The lesson being that WENO is only better if the problem has a great deal of structure and many extrema. To be more efficient requires extremely fine meshes. This motivates the development of a more adaptive discretization that accounts for this behavior.

“Since all models are wrong the scientist must be alert to what is importantly wrong. It is inappropriate to be concerned about mice when there are tigers abroad.” – George Box

The basic idea is to move between discretizations that are best for discontinuous solutions and those best for smooth extrema. One still needs to find and eliminate spurious oscillations. Separate these from physically resolvable oscillations. This is sort of a holy grail for numerical methods for hyperbolic PDEs. Some great work from the late 1990’s comes to the rescue. Two researchers from NASA Glenn (Suresh & Huynh) published a great paper on doing much of this work. First reproducing a monotonicity-preserving method and then added extrema detection and preservation to it. This was a great general-purpose approach that works for multistep methods like Runge-Kutta.

This work uses the median function developed and used by HT Huynh. In a sense, I fell in love with this function as a means of engineering methods. The method takes three arguments and returns the one bounded by the other two. Thus, it is great at enforcing bounds, which is the whole game for high-resolution methods. It also has the property that if two of the arguments are a certain order of accuracy, the output retains that order of accuracy. This is because the result is a convex combination of the other two, or one of those two. I have postulated that this result applies to linear and nonlinear stability properties too.

“Normal science, the activity in which most scientists inevitably spend almost all their time, is predicated on the assumption that the scientific community knows what the world is like… Normal science often suppresses fundamental novelties because they are necessarily subversive of its basic commitments.” – Thomas Kuhn

As a sidebar to the whole extrema preservation study, I rewrote the limiter for the PPM method using the median. Once the median is defined, the PPM limiter can be expressed in four median function calls. It is compact and IMHO far clearer than the classical PPM description, which is elaborate and somewhat non-intuitive. Looking at the (magical) median as a bounding function provides the necessary clarity of approach. Being parabolic in each cell, the PPM method could potentially support smooth extrema.

The simplest version of the basic idea is brutally simple. If the data is monotone and the approximation preserves this, simply use that. If it is not, then one can switch over to WENO, or some other extrema-preserving method. The cost of WENO is only taken where it matters. It also isolates WENO from the dissipative solution it gives for monotone circumstances. Under those conditions, WENO produces something akin to the dissipative minmod result. WENO is only superior with smooth extrema. This method improves on both methods. With PPM, I can make this a single-step method. It has a larger CFL and accelerates the WENO solution by a factor of six, plus sharpens the results in general.

“Perfection is achieved, not when there is nothing more to add, but when there is nothing left to take away.” – Antoine de Saint-Exupéry,

This unveils the basic approach for the advance. If some version of high-order works as a monotonicity-preserving approximation, use it. Do not do more work. If it does not, look at the data. Is it monotone or at an extremum? If it is monotone perhaps looks at other high-order, but lower than the initial attempt approximations. If one is at an extremum, determine if it is smooth and do something safe there. ENO or WENO are those sorts of approximations. If it is close to a shock, allow yourself to go to first-order. That’s it. It really is not that elaborate. It extends monotonicity methods to something more, and the verification work shows this. These methods are more accurate on a broad class of methods. In practice, this accuracy also makes them efficient. Colella and Sekora published a method with a lot in common with my ideas.

“My work always tried to unite the true with the beautiful; but when I had to choose one or the other, I usually chose the beautiful.” – Hermann Weyl

Now we get to the unfortunate part of the paper. The verification got removed in review. The associate editor demanded it rather bluntly: “If you want this published, take that shit out!” He and one of the reviewers, who is an asshole, killed this. I will note that the asshole reviewer is extremely good technically. Exceptional. Those are some of the most dangerous forms of assholes, by the way. I folded and removed the material. Now, 20 years later, I can finally get the basic idea of verifying shock tubes published. I can include a far better and more focused explanation and recipe for doing this. This includes a strong motivation in mathematics and efficiency from differences in accuracy.

I hope it helps alleviate the stagnation.

“Every genuine test of a theory is an attempt to falsify it, or to refute it.” – Karl Popper

The other idea that might have traction is the BVD and THINC-based methods. Combining this with high-order leads to impressive results. Imperfect, but hopeful. I was a reviewer of one of the articles, and felt like it was an arc of progress. I believe THINC might be the key here. It is a nonlinear first-order method that can deliver monotonicity with much less dissipation. The details are choosing the steepness parameter (and it having a parameter!). The other issue might be how the lack of first-order dissipation impacts the entropy condition. The question is whether the lack of dissipation in THINC ever threatens the entropy condition. It would be something good to study and put effort into.

“A new scientific truth does not triumph by convincing its opponents and making them see the light, but rather because its opponents eventually die, and a new generation grows up that is familiar with it.” – Max Planck

References

Rider, William J., Jeffrey A. Greenough, and James R. Kamm. “Accurate monotonicity-and extrema-preserving methods through adaptive nonlinear hybridizations.” Journal of Computational Physics 225, no. 2 (2007): 1827-1848. (105 Citations)

Greenough, J. A., and W. J. Rider. “A quantitative comparison of numerical methods for the compressible Euler equations: fifth-order WENO and piecewise-linear Godunov.” Journal of Computational Physics 196, no. 1 (2004): 259-281. (85 Citations)

Suresh, Ambady, and Hung T. Huynh. “Accurate monotonicity-preserving schemes with Runge–Kutta time stepping.” Journal of Computational Physics 136, no. 1 (1997): 83-99.

Huynh, Hung T. “Accurate upwind methods for the Euler equations.” SIAM Journal on Numerical Analysis 32, no. 5 (1995): 1565-1619.

Colella, Phillip, and Michael D. Sekora. “A limiter for PPM that preserves accuracy at smooth extrema.” Journal of Computational Physics 227, no. 15 (2008): 7069-7076.

Deng, Xi, Yuya Shimizu, and Feng Xiao. “A fifth-order shock capturing scheme with two-stage boundary variation diminishing algorithm.” Journal of Computational Physics 386 (2019): 323-349.

Deng, Xi, Yuya Shimizu, Bin Xie, and Feng Xiao. “Constructing higher order discontinuity-capturing schemes with upwind-biased interpolations and boundary variation diminishing algorithm.” Computers & Fluids 200 (2020): 104433.

Rider, W. J., J. A. Greenough, and J. R. Kamm. “Combining high-order accuracy with non-oscillatory methods through monotonicity preservation.” International journal for numerical methods in fluids 47, no. 10-11 (2005): 1253-1259.

Rider, William J., and James R. Kamm. “How effective are high-order approximations in shock-capturing methods? Is there a law of diminishing returns?.” In Computational Fluid Dynamics 2004: Proceedings of the Third International Conference on Computational Fluid Dynamics, ICCFD3, Toronto, 12–16 July 2004, pp. 401-405. Berlin, Heidelberg: Springer Berlin Heidelberg, 2006.

Signature: 7XD1adFpnpj9uvubSB6TZgmlk9mEIfScrOlKhsNEX8eUhjyRVWrB1ha/H3XY5NN9cmw5ogwVEBWG/HzPHEY27b3OkUUGEGGKrfVS5MfW3qynuICoL7fEKvmAdKPBi2SGVxpygXjgqK5KD5lcmkzlQe892J9d2RHED/n8i+JpAFJbEtIVu5envjjRvEeotBkutZ/9z15EWkyrgPs++dYVz5cfZEUYetnBDQPc6WXU4f+/jKIS3h/1rDPxjdsyilr5Utc9VjSxQdvzAqLPh4ugETHPV1dN1nie+n64uM0wx2NES1V/55bDUkrqdNBBafedNdSzKitKKM1Kmwmv0DH4wv0ynsZsTYEBI5MGI41zlz6JQqt2PGn5r1cipUdMAHEQVdE/7K1mj0m6lNbo3aQitSS79eJfxpFl55rDChYCO6zhchE3Xhh+768r72oOW8eW2rpb4PZTmSZajyRgCrsPTTw2eIZIByJzU6HwzYVczCnr5Uz7NiwAXXERM7IZN2/rgB4ZAF+iCZPP7LPgDkz6Ii5VBspKVHc3VvrjGRnOBKiL8gMuG0paZnVXed29CPAR+Td7oS7//P6en4bP4FyFouZ24u5XkvY844mwjshV3uXEGuWHaLlJe66TF5aKL5TRoMIrBb9ShyR8qP6jKArK4iQGjNdYzNR09+XoDSZM3j8V7dvMa4U8LRduVt7uV3LjJ4iWUVSTXHY3eF2oAy/1p0KsjvEzuc0VzdT25UtXXWEJDbxRwmFwV84UFYACEKrOeQBepVJZXUQCupTsijgnM2ZhQ94hNW6Nb3Pt7hZpk2jITRtsCtJNC5o7gSBjf9qxqQsqpl+yg2QrQP9SmvCHButCBjr3FZKIL5ZVEcaxWndZbInBjqeRqGK5pth4Nsqix/L05NQ9IN8mrAFYNdQ9rI4mKKhJChu8fT6WqAog5VsKfYp8/QT9ctGbUo363Ac+aAoXc9dSPiT88+DdKCJVZxUkHhCYKovFBr/7CsSWcb0=