Abstract
A subspace method is introduced to solve large-scale trace ratio problems. This approach is matrix-free, requiring only the action of the two matrices involved in the trace ratio. At each iteration, a smaller trace ratio problem is addressed in the search subspace. Additionally, the algorithm is endowed with a restarting strategy, that ensures the monotonicity of the trace ratio value throughout the iterations. The behavior of the approximate solution is investigated from a theoretical viewpoint, extending existing results on Ritz values and vectors, as the angle between the search subspace and the exact solution approaches zero. Numerical experiments in multigroup classification show that this new subspace method tends to be more efficient than iterative approaches relying on (partial) eigenvalue decompositions at each step.
Original language | English |
---|---|
Article number | 108108 |
Number of pages | 17 |
Journal | Computational Statistics and Data Analysis |
Volume | 205 |
DOIs | |
Publication status | Published - May 2025 |
Bibliographical note
Publisher Copyright:© 2024 The Author(s)
Keywords
- Davidson's method
- Fisher's discriminant analysis
- Linear dimensionality reduction
- Multigroup classification
- Subspace method
- Trace ratio