Results 1 
9 of
9
TENSOR RANK AND THE ILLPOSEDNESS OF THE BEST LOWRANK APPROXIMATION PROBLEM
"... There has been continued interest in seeking a theorem describing optimal lowrank approximations to tensors of order 3 or higher, that parallels the Eckart–Young theorem for matrices. In this paper, we argue that the naive approach to this problem is doomed to failure because, unlike matrices, te ..."
Abstract

Cited by 193 (13 self)
 Add to MetaCart
There has been continued interest in seeking a theorem describing optimal lowrank approximations to tensors of order 3 or higher, that parallels the Eckart–Young theorem for matrices. In this paper, we argue that the naive approach to this problem is doomed to failure because, unlike matrices, tensors of order 3 or higher can fail to have best rankr approximations. The phenomenon is much more widespread than one might suspect: examples of this failure can be constructed over a wide range of dimensions, orders and ranks, regardless of the choice of norm (or even Brègman divergence). Moreover, we show that in many instances these counterexamples have positive volume: they cannot be regarded as isolated phenomena. In one extreme case, we exhibit a tensor space in which no rank3 tensor has an optimal rank2 approximation. The notable exceptions to this misbehavior are rank1 tensors and order2 tensors (i.e. matrices). In a more positive spirit, we propose a natural way of overcoming the illposedness of the lowrank approximation problem, by using weak solutions when true solutions do not exist. For this to work, it is necessary to characterize the set of weak solutions, and we do this in the case of rank 2, order 3 (in arbitrary dimensions). In our work we emphasize the importance of closely studying concrete lowdimensional examples as a first step towards more general results. To this end, we present a detailed analysis of equivalence classes of 2 × 2 × 2 tensors, and we develop methods for extending results upwards to higher orders and dimensions. Finally, we link our work to existing studies of tensors from an algebraic geometric point of view. The rank of a tensor can in theory be given a semialgebraic description; in other words, can be determined by a system of polynomial inequalities. We study some of these polynomials in cases of interest to us; in particular we make extensive use of the hyperdeterminant ∆ on R 2×2×2.
Symmetric tensors and symmetric tensor rank
 Scientific Computing and Computational Mathematics (SCCM
, 2006
"... Abstract. A symmetric tensor is a higher order generalization of a symmetric matrix. In this paper, we study various properties of symmetric tensors in relation to a decomposition into a symmetric sum of outer product of vectors. A rank1 orderk tensor is the outer product of k nonzero vectors. An ..."
Abstract

Cited by 101 (22 self)
 Add to MetaCart
(Show Context)
Abstract. A symmetric tensor is a higher order generalization of a symmetric matrix. In this paper, we study various properties of symmetric tensors in relation to a decomposition into a symmetric sum of outer product of vectors. A rank1 orderk tensor is the outer product of k nonzero vectors. Any symmetric tensor can be decomposed into a linear combination of rank1 tensors, each of them being symmetric or not. The rank of a symmetric tensor is the minimal number of rank1 tensors that is necessary to reconstruct it. The symmetric rank is obtained when the constituting rank1 tensors are imposed to be themselves symmetric. It is shown that rank and symmetric rank are equal in a number of cases, and that they always exist in an algebraically closed field. We will discuss the notion of the generic symmetric rank, which, due to the work of Alexander and Hirschowitz, is now known for any values of dimension and order. We will also show that the set of symmetric tensors of symmetric rank at most r is not closed, unless r = 1. Key words. Tensors, multiway arrays, outer product decomposition, symmetric outer product decomposition, candecomp, parafac, tensor rank, symmetric rank, symmetric tensor rank, generic symmetric rank, maximal symmetric rank, quantics AMS subject classifications. 15A03, 15A21, 15A72, 15A69, 15A18 1. Introduction. We
Canonical Tensor Decompositions
 ARCC WORKSHOP ON TENSOR DECOMPOSITION
, 2004
"... The Singular Value Decomposition (SVD) may be extended to tensors at least in two very different ways. One is the HighOrder SVD (HOSVD), and the other is the Canonical Decomposition (CanD). Only the latter is closely related to the tensor rank. Important basic questions are raised in this short pap ..."
Abstract

Cited by 42 (16 self)
 Add to MetaCart
The Singular Value Decomposition (SVD) may be extended to tensors at least in two very different ways. One is the HighOrder SVD (HOSVD), and the other is the Canonical Decomposition (CanD). Only the latter is closely related to the tensor rank. Important basic questions are raised in this short paper, such as the maximal achievable rank of a tensor of given dimensions, or the computation of a CanD. Some questions are answered, and it turns out that the answers depend on the choice of the underlying field, and on tensor symmetry structure, which outlines a major difference compared to matrices.
Generic and typical ranks of multiway arrays
 Linear Algebra Appl
"... HAL is a multidisciplinary open access archive for the deposit and dissemination of scientific research documents, whether they are published or not. The documents may come from teaching and research institutions in France or abroad, or from public or private research centers. L’archive ouverte p ..."
Abstract

Cited by 27 (5 self)
 Add to MetaCart
(Show Context)
HAL is a multidisciplinary open access archive for the deposit and dissemination of scientific research documents, whether they are published or not. The documents may come from teaching and research institutions in France or abroad, or from public or private research centers. L’archive ouverte pluridisciplinaire HAL, est destinée au dépôt et a ̀ la diffusion de documents scientifiques de niveau recherche, publiés ou non, émanant des établissements d’enseignement et de recherche français ou étrangers, des laboratoires publics ou privés.
Genericity and Rank Deficiency of High Order Symmetric Tensors
 Proc. IEEE Int. Conference on Acoustics, Speech, and Signal Processing (ICASSP
, 2006
"... Blind Identification of UnderDetermined Mixtures (UDM) is involved in numerous applications, including MultiWay factor Analysis (MWA) and Signal Processing. In the latter case, the use of HighOrder Statistics (HOS) like Cumulants leads to the decomposition of symmetric tensors. Yet, little has be ..."
Abstract

Cited by 9 (6 self)
 Add to MetaCart
(Show Context)
Blind Identification of UnderDetermined Mixtures (UDM) is involved in numerous applications, including MultiWay factor Analysis (MWA) and Signal Processing. In the latter case, the use of HighOrder Statistics (HOS) like Cumulants leads to the decomposition of symmetric tensors. Yet, little has been published about rankrevealing decompositions of symmetric tensors. Definitions of rank are discussed, and useful results on Generic Rank are proved, with the help of tools borrowed from Algebraic Geometry. 1.
Generic and typical ranks of threeway arrays
 Research Report ISRN I3S/RR200629FR, I3S, SophiaAntipolis
"... The concept of tensor rank, introduced in the twenties, has been popularized at the beginning of the seventies. This has allowed to carry out Factor Analysis on arrays with more than two indices. The generic rank may be seen as an upper bound to the number of factors that can be extracted from a giv ..."
Abstract

Cited by 6 (3 self)
 Add to MetaCart
(Show Context)
The concept of tensor rank, introduced in the twenties, has been popularized at the beginning of the seventies. This has allowed to carry out Factor Analysis on arrays with more than two indices. The generic rank may be seen as an upper bound to the number of factors that can be extracted from a given tensor. We explain in this short paper how to obtain numerically the generic rank of tensors of arbitrary dimensions, and compare it with the rare algebraic results already known at order three. In particular, we examine the cases of symmetric tensors, tensors with symmetric matrix slices, or tensors with free entries. Résumé La notion de rang tensoriel, proposée dans les années vingt, a été popularisée au début des années soixantedix. Ceci a permis de mettre en oeuvre l’Analyse de Facteurs sur des tableaux de données comportant plus de deux indices. Le rang générique peut être vu comme une borne supérieure sur le nombre de facteurs pouvant être extraits d’un tenseur donné. Nous expliquons dans ce court article comment trouver numériquement le rang générique d’un tenseur de dimensions arbitraires, et le comparons aux quelques rares résultats algébriques déjà connus à l’ordre trois. Nous examinons notamment les cas des tenseurs symétriques, des tenseurs à tranches matricielles symétriques, ou des tenseurs à éléments libres.
SCIENTIFIQUE Canonical Tensor Decompositions
, 2004
"... The Singular Value Decomposition (SVD) may be extended to tensors at least in two very different ways. One is the HighOrder SVD (HOSVD), and the other is the Canonical Decomposition (CanD). Only the latter is closely related to the tensor rank. Important basic questions are raised in this short pap ..."
Abstract
 Add to MetaCart
(Show Context)
The Singular Value Decomposition (SVD) may be extended to tensors at least in two very different ways. One is the HighOrder SVD (HOSVD), and the other is the Canonical Decomposition (CanD). Only the latter is closely related to the tensor rank. Important basic questions are raised in this short paper, such as the maximal achievable rank of a tensor of given dimensions, or the computation of a CanD. Some questions are answered, and it turns out that the answers depend on the choice of the underlying field, and on tensor symmetry structure, which outlines a major difference compared to matrices.
Generic and Typical Ranks of . . .
, 2009
"... The concept of tensor rank was introduced in the twenties. In the seventies, when methods of Component Analysis on arrays with more than two indices became popular, tensor rank became a much studied topic. The generic rank may be seen as an upper bound to the number of factors that are needed to con ..."
Abstract
 Add to MetaCart
The concept of tensor rank was introduced in the twenties. In the seventies, when methods of Component Analysis on arrays with more than two indices became popular, tensor rank became a much studied topic. The generic rank may be seen as an upper bound to the number of factors that are needed to construct a random tensor. We explain in this paper how to obtain numerically in the complex field the generic rank of tensors of arbitrary dimensions, based on Terracini’s lemma, and compare it with the algebraic results already known in the real or complex fields. In particular, we examine the cases of symmetric tensors, tensors with symmetric matrix slices, complex tensors enjoying Hermitian symmetries, or merely tensors with free entries.