Vortical structures at the onset of transition to turbulence by Taylor Green...
Vortical structures at the onset of transition to turbulence by Taylor Green vortices.
Source: CSE/lab ETH Zurich

Researchers compute turbulence with AI

For the first time, researchers at ETH Zurich have successfully automated the modelling of turbulence. Their project relies on fusing reinforcement learning algorithms with turbulent flow simulations on the CSCS supercomputer "Piz Daint".

The modelling and simulation of turbulent flows is crucial for designing heart valves, cars, predicting the weather, and even retracing the birth of a galaxy. The Greek mathematician, physicist and engineer Archimedes occupied himself with fluid mechanics some 2,000 years ago, and to this day, the complexity of fluid flows is still not fully understood. The physicist Richard Feynman counted turbulence among the most important unsolved problems in classical physics, and it remains an active topic for engineers, scientists and mathematicians alike.

Engineers have to consider the effects of turbulent flows when building an aircraft or a prosthetic heart valve. Meteorologists need to account for them when they forecast the weather, as do astrophysicists when simulating galaxies. Consequently, researchers from these communities have been modelling turbulence and performing flow simulations for more than 60 years.

Turbulent flows are characterized by flow structures spanning a broad range of spatial and temporal scale. There are two major approaches for simulating these complex flow structures: One is direct numerical simulation (DNS), and the other is large eddy simulation (LES).

Flow simulations test the limits of supercomputers

DNS solves the Navier-Stokes equations, which are central to the description of flows, with a resolution of billions and sometimes trillions of grid points. DNS is the most accurate way to calculate flow behaviour, but unfortunately it is not practical for most real-world applications. In order to capture the details of these turbulent flows, they require far more grid points than can be handled by any computer in the foreseeable future.

As a result, researchers use models in their simulations so that they do not have to calculate every detail to maintain accuracy. In the LES approach, the large flow structures are resolved, and so-called turbulence closure models account for the finer flow scales and their interactions with the large scales. However, the correct choice of closure model is crucial for the accuracy of the results.

Rather art than science

“Modelling of turbulence closure models has largely followed an empirical process for the past 60 years and remains more of an art than a science”, says Petros Koumoutsakos, professor at the Laboratory for Computational Science and Engineering at ETH Zurich. Koumoutsakos, his PhD student Guido Novati, and former master’s student (now PhD candidate at the University of Zurich) Hugues Lascombes de Laroussilhe have proposed a new strategy to automate the process: use artificial intelligence (AI) to learn the best turbulent closure models from the DNS and apply them to the LES.

Specifically, the researchers developed new reinforcement learning (RL) algorithms and combined them with physical insight to model turbulence. "Twenty-five years ago, we pioneered the interfacing of AI and turbulent flows," says Koumoutsakos. But back then, computers were not powerful enough to test many of the ideas. "More recently, we also realised that the popular neural networks are not suitable for solving such problems, because the model actively influences the flow it aims to complement," says the ETH professor. The researchers thus had to resort to a different learning approach in which the algorithm learns to react to patterns in the turbulent flow field.

Schematic of multi-​agent reinforcement learning (MARL) for modelling. The...
Schematic of multi-​agent reinforcement learning (MARL) for modelling. The agents (marked by red cubes) execute a control policy that maximises the similarity between simulations.
Source: CSElab/ETH Zurich

Automated modelling

The idea behind Novati’s and Koumoutsako's novel RL algorithm is to use the grid points that resolve the flow field as AI agents. The agents learn turbulence closure models by observing thousands of flow simulations. “In order to perform such large scale simulations, it was essential to have access to the CSCS supercomputer "Piz Daint", stresses Koumoutsakos. After training, the agents are free to act in the simulation of flows in which they have not been trained before.

The turbulence model is learned by ‘playing’ with the flow. “The machine ‘wins’ when it succeeds to match LES with DNS results, much like machines learning to play a game of chess or GO" says Koumoutsakos. “During the LES, the AI performs the actions of the unresolved scales by only observing the dynamics of the resolved large scales.” According to the researchers the new method not only outperforms well-established modelling approaches, but can also be generalised across grid sizes and flow conditions.

The critical part of the method is a novel algorithm developed by Novati that identifies which of the previous simulations are relevant for each flow state. The so-called "Remember and Forget Experience Replay" algorithm has been shown to outperform the vast majority of existing RL algorithms on multiple benchmark problems beyond fluid mechanics, according to the researchers. The team believes that their newly developed method will not only be of importance in the construction of cars and in weather forecasting. "For most challenging problems in science and technology, we can only solve the 'big scales' and model the 'fine' ones," says Koumoutsakos. "The newly developed methodology offers a new and powerful way to automate multiscale modelling and advance science through a judicious use of AI.”

The research has been published in Nature Machine Intelligence.

Subscribe to our newsletter

Related articles

Robots encourage risk-taking behaviour in humans

Robots encourage risk-taking behaviour in humans

“The Robot made me do it” - research has shown robots can encourage humans to take greater risks in a simulated gambling scenario than they would if there was nothing to influence their behaviours.

Artificial intelligence rapidly computes protein structures

Artificial intelligence rapidly computes protein structures

Scientists have created a deep learning method, RoseTTAFold, to provide access to highly accurate protein structure prediction.

A contact aware robot design

A contact aware robot design

Researchers have developed a new method to computationally optimize the shape and control of a robotic manipulator for a specific task.

Artificial intelligence for emergency management

Artificial intelligence for emergency management

A consortium aims to develop a platform that will serve as the basis for novel services and test the use of new artificial intelligence tools.

Harnessing AI to discover new drugs

Harnessing AI to discover new drugs

Artificial intelligence can recognise the biological activity of natural products in a targeted manner.

A robot scientist is ready for drug discovery

A robot scientist is ready for drug discovery

The robot scientist Eve has been assembled and is now operating at Chalmers University of Technology. Eve’s f​irst mission is to identify and test drugs against Covid-19.​

Making AI understandable – constructing explanation processes

Making AI understandable – constructing explanation processes

Human-machine interaction is complex. Researchers investigate a new form of interaction between humans and machines.

Smart biosensor to explore the biomolecular world

Smart biosensor to explore the biomolecular world

Scientists have developed AI-powered nanosensors that let researchers track various kinds of biological molecules without disturbing them.

Xenobots 2.0: The next generation of living robots

Xenobots 2.0: The next generation of living robots

Researchers have created life forms that self-assemble a body from single cells and do not require muscle cells to move. They're faster, live longer, and can now record information.

Popular articles

Subscribe to Newsletter