Abstract The penetration of intermittent wind turbines in power systems imposes challenges to frequency stability. In this light, a new control method is presented in this paper by proposing a modified fractional order proportional integral derivative (FOPID) controller. This method focuses on the coordinated control of the load-frequency control (LFC) and superconducting magnetic energy storage (SMES) using a cascaded FOPD–FOPID controller. To improve the performance of the FOPD–FOPID controller, the developed owl search algorithm (DOSA) is used to optimize its parameters. The proposed control method is compared with several other methods, including LFC and SMES based on the robust controller, LFC and SMES based on the Moth swarm algorithm (MSA)–PID controller, LFC based on the MSA–PID controller with SMES, and LFC based on the MSA–PID controller without SMES in four scenarios. The results demonstrate the superior performance of the proposed method compared to the other mentioned methods. The proposed method is robust against load di