TY - JOUR
T1 - Reinforcement-learning-based control of turbulent channel flows at high Reynolds numbers
AU - Zhou, Zisong
AU - Zhang, Mengqi
AU - Zhu, Xiaojue
PY - 2025/3/10
Y1 - 2025/3/10
N2 - Deep reinforcement learning (DRL) is employed to develop control strategies for drag reduction in direct numerical simulations of turbulent channel flows at high Reynolds numbers. The DRL agent uses near-wall streamwise velocity fluctuations as input to modulate wall blowing and suction velocities. These DRL-based strategies achieve significant drag reduction, with maximum rates 35.6 % at Reτ ≈ 180, 30.4 % at Reτ ≈550, and 27.7 % at Reτ ≈ 1000, outperforming traditional opposition control methods. An expanded range of wall actions further enhances drag reduction, although effectiveness decreases at higher Reynolds numbers. The DRL models elevate the virtual wall through blowing and suction, aiding in drag reduction. However, at higher Reynolds numbers, the amplitude modulation of large-scale structures significantly increases the residual Reynolds stress on the virtual wall, diminishing the drag reduction. Analysis of budget equations provides a systematic understanding of the underlying drag reduction dynamics. The DRL models reduce skin friction by inhibiting the redistribution of wall-normal turbulent kinetic energy. This further suppresses the wall-normal velocity fluctuations, reducing the production of Reynolds stress, thereby decreasing skin friction. This study showcases the successful application of DRL in turbulence control at high Reynolds numbers, and elucidates the nonlinear control mechanisms underlying the observed drag reduction.
© The Author(s), 2025. Published by Cambridge University Press.
AB - Deep reinforcement learning (DRL) is employed to develop control strategies for drag reduction in direct numerical simulations of turbulent channel flows at high Reynolds numbers. The DRL agent uses near-wall streamwise velocity fluctuations as input to modulate wall blowing and suction velocities. These DRL-based strategies achieve significant drag reduction, with maximum rates 35.6 % at Reτ ≈ 180, 30.4 % at Reτ ≈550, and 27.7 % at Reτ ≈ 1000, outperforming traditional opposition control methods. An expanded range of wall actions further enhances drag reduction, although effectiveness decreases at higher Reynolds numbers. The DRL models elevate the virtual wall through blowing and suction, aiding in drag reduction. However, at higher Reynolds numbers, the amplitude modulation of large-scale structures significantly increases the residual Reynolds stress on the virtual wall, diminishing the drag reduction. Analysis of budget equations provides a systematic understanding of the underlying drag reduction dynamics. The DRL models reduce skin friction by inhibiting the redistribution of wall-normal turbulent kinetic energy. This further suppresses the wall-normal velocity fluctuations, reducing the production of Reynolds stress, thereby decreasing skin friction. This study showcases the successful application of DRL in turbulence control at high Reynolds numbers, and elucidates the nonlinear control mechanisms underlying the observed drag reduction.
© The Author(s), 2025. Published by Cambridge University Press.
KW - drag reduction
KW - turbulence control
KW - turbulence simulation
UR - http://www.scopus.com/inward/record.url?scp=105000054143&partnerID=8YFLogxK
UR - https://www.scopus.com/record/pubmetrics.uri?eid=2-s2.0-105000054143&origin=recordpage
U2 - 10.1017/jfm.2025.27
DO - 10.1017/jfm.2025.27
M3 - RGC 21 - Publication in refereed journal
SN - 0022-1120
VL - 1006
JO - Journal of Fluid Mechanics
JF - Journal of Fluid Mechanics
M1 - A12
ER -