AUTHOR=Karimov Karim , Kirby Michael , Peterson Chris 

TITLE=An algorithm for computing Schubert varieties of best fit with applications

JOURNAL=Frontiers in Artificial Intelligence

VOLUME=6

YEAR=2023

URL=https://www.frontiersin.org/journals/artificial-intelligence/articles/10.3389/frai.2023.1274830

DOI=10.3389/frai.2023.1274830

ISSN=2624-8212

ABSTRACT=<p>We propose the geometric framework of the Schubert variety as a tool for representing a collection of subspaces of a fixed vector space. Specifically, given a collection of <italic>l</italic>-dimensional subspaces <italic>V</italic><sub>1</sub>, …, <italic>V</italic><sub><italic>r</italic></sub> of ℝ<sup><italic>n</italic></sup>, represented as the column spaces of matrices <italic>X</italic><sub>1</sub>, …, <italic>X</italic><sub><italic>r</italic></sub>, we seek to determine a <italic>representative</italic> matrix <italic>K</italic>∈ℝ<sup><italic>n</italic>×<italic>k</italic></sup> such that each subspace <italic>V</italic><sub><italic>i</italic></sub> intersects (or comes close to intersecting) the span of the columns of <italic>K</italic> in at least <italic>c</italic> dimensions. We formulate a non-convex optimization problem to determine such a <italic>K</italic> along with associated sets of vectors {<italic>a</italic><sub><italic>i</italic></sub>} and {<italic>b</italic><sub><italic>i</italic></sub>} used to express linear combinations of the columns of the <italic>X</italic><sub><italic>i</italic></sub> that are close to linear combinations of the columns of <italic>K</italic>. Further, we present a mechanism for integrating this representation into an artificial neural network architecture as a computational unit (which we refer to as an abstract node). The representative matrix <italic>K</italic> can be learned <italic>in situ</italic>, or sequentially, as part of a learning problem. Additionally, the matrix <italic>K</italic> can be employed as a change of coordinates in the learning problem. The set of all <italic>l</italic>-dimensional subspaces of ℝ<sup><italic>n</italic></sup> that intersects the span of the columns of <italic>K</italic> in at least <italic>c</italic> dimensions is an example of a Schubert subvariety of the Grassmannian <italic>GR</italic>(<italic>l, n</italic>). When it is not possible to find a Schubert variety passing through a collection of points on <italic>GR</italic>(<italic>l, n</italic>), the goal of the non-convex optimization problem is to find the Schubert variety of best fit, i.e., the Schubert variety that comes as close as possible to the points. This may be viewed as an analog of finding a subspace of best fit to data in a vector space. The approach we take is well-suited to the modeling of collections of sets of data either as a stand-alone Schubert variety of best fit (SVBF), or in the processing workflow of a deep neural network. We present applications to some classification problems on sets of data to illustrate the behavior of the method.</p>