Good idea. Marine ply. I do fix-it jobs like this quite a lot. What I would do is cut the ply to size then glue and (stainless steel) screw it over the existing structure. If you pull it to bits to replace sections you may be making extra work for yourself. Then a good quality outdoor silicon filler to keep water out.
Nice window too