Reinforcement Learning-Based Adaptive Control for a Permanent Magnet Synchronous Generator Connected to a Hybrid AC/DC Grid with Virtual Inertia Support

Abstract

The increasing penetration of renewable energy sources has increased the need for advanced control strategies capable of maintaining stability under low-inertia, converter-dominated operating conditions. In grid-connected wind energy conversion systems (WECSs), constant power loads (CPLs) exhibit negative incremental impedance characteristics that can amplify DC-link oscillations and complicate the coordination between the electrical and mechanical subsystems. The main contribution of this work is a Soft Actor–Critic (SAC) reinforcement learning algorithm that tunes the outer proportional-integral gains of the machine-side DC-voltage-squared control loop together with the active damping gain, allowing online adaptation of the controller according to the operating condition and disturbance level, thereby improving energy system sustainability. The proposed control framework includes a two-mass shaft model, virtual inertia control, and DC-link load uncertainty in the form of both resistive loads and CPLs. The system is modeled and evaluated using MATLAB/Simulink, and its performance is compared with that of a conventional fixed-gain controller under AC load disturbances and wind speed variations. It has been found that for a 25% load disturbance, the maximum DC-link voltage deviation is reduced by 1.2% under resistive loading and 6.5% under CPL operation. For a 1 m/s reduction in wind speed, the corresponding reductions are 0.8% and 0.9%, respectively. The proposed controller also provides smoother output power and improved damping of the rotor speed and system frequency responses.