Reduced Order Method (ROM) and Anderson Acceleration for Iterative Schemes on Least Square Problems and Optimization, with Applications to Neural Networks and Partial Differential Equations (PDEs).