Supplying sustainable energy is of a critical prominence nowadays. A main outcome of the galloping development in energy generation technologies is the ability to integrate multi-carrier energy systems that facilitates meeting the fast growth of energy demand. Energy hub is one of the main infrastructures making the incorporation of multi-carrier systems smoother. In this paper, the optimal scheduling problem of an energy hub structure equipped with combined heat and power, boiler, power-to-gas storage, thermal energy storage and electrical energy storage in order to supply power, heat and gas demands is presented. Power to gas is regarded as a new technology that creates a connection between power and gas networks by converting power to the natural gas through two processes of electrolysis and mechanization, respectively. The proposed framework is formulated as a mixed-integer linear programming (MILP) model. The simulation results demonstrate the effectiveness of the integration of multi-carrier energy storage systems in energy hub on the operation cost reduction.