1991 Mathematics Subject Classification. Primary 15A99,16Y60.
Kapranov rank vs. tropical rank
K. H. Kim
F. W. Roush
Department of Mathematics, Alabama State University, Montgomery, Alabama 36101-0271, and Fellow, Korean Academy of Science and Technology E-mail address : khkim@alasu.edu Department of Mathematics, Alabama State University, Montgomery, Alabama 36101-0271 E-mail address : froush@alasu.edu
-
Abstract.
We show that determining Kapranov rank of tropical matrices is not only NP-hard over any infinite field but if solving Diophantine equations over the rational numbers is undecidable, then determining Kapranov rank over the rational numbers is also undecidable. We prove that Kapranov rank of tropical matrices is not bounded in terms of tropical rank, answering a question of Develin, Santos, and Sturmfels [4] .
1 Introduction
The tropical semiring
has many applications but is of special interest in relation to algebraic geometry in terms of valuations. Roughly speaking a tropical matrix can arise as the matrix of valuations of a matrix of polynomials or power series over a field. In the paper [4] three natural notions of rank are introduced.
Definition 1.1.
An
tropical matrix
is nonsingular if and only ifthe minimum value over permutations
of
is realized uniquely.
If a matrix of power series is singular, then the corresponding tropical matrix must be singular in this sense.
Definition 1.2.
The tropical rank of a tropical matrix
is the largest
such that
has a nonsingular
submatrix.
The relationship of the tropical semiring to algebraic geometry starts with a field of power series
, where the power series are allowed to have general real exponents in
and the coefficients lie in a base field
. The degree map gives a valuation of this ring. Let
be an ideal in
, corresponding to an algebraic variety.
This gives rise to a variety
in
consisting of (nonzero)
-tuples which when substituted for the
make all elements of the ideal
equal to
. That gives rise to a tropical variety
in Euclidean
-space by taking its image under the degree mapping.
For purposes of defining rank the following definition is satisfactory, however [11] gives a more general concept using Grassmannians and hyperplane intersections.
Definition 1.3.
A tropical linear space is a tropical variety
where
is generated by linear forms in the
. Its dimension is
minus the number of minimal generators of
.
Definition 1.4.
The Kapranov rank of a tropical matrix
is the least dimension of a tropical linear space containing the rows of
.
The Kapranov rank may differ from the tropical rank, but the tropical rank is a lower bound for it. The Kapranov rank is closer to the concept one would like to use in algebraic geometry but does not have such a simple tropical nature. Moreover it can vary according to the field.
Definition 1.5.
The Barvinok rank of an
tropical matrix
is the least
such that
is the product of an
tropical matrix and a
tropical matrix.
The Barvinok rank is an upper bound for the Kapranov rank. It is the most natural concept of rank for Boolean matrices, where it also has names such as Boolean rank and Schein rank [7] . The
-element Boolean algebra is the subsemiring of the tropical semiring consisting of zero and infinity. However if we look at any
elements of the tropical semiring, the additive semigroup is isomorphic to the
-element Boolean algebra, and some properties of matrices whose entries lie in this subset will be like those of Boolean matrices. For basic properties of Boolean matrices, see [7] .
Determining Kapranov rank over a given field involves dealing with nonlinear systems of polynomial equations over that field. Here we will largely deal with the case of Kapranov rank of
-matrices. Develin, Santos, and Sturmfels proved the following.
Theorem 1.6.
[
4]
. The tropical rank of
is at most
if and only if
lies in the variety
where
is the algebraic variety of matrices of the same size as
over
of rank
, and
denotes tropicalization.
That means that there must be some matrix of rank
over the field whose image is
. They deduce the corollary that the Kapranov rank is the smallest rank of any lifting over
.
2 Kapranov rank of matrices related to projective planes
Proposition 1.
The Kapranov rank over a infinite field
of an
-matrix
is the least
such that there exist two families of
-dimensional vectors
over
such that
if and only if the inner product
where
denotes transpose.
More generally the Kapranov rank over a field
of an
nonnegative matrix
is the least
such that there exist two families of vectors
over the ring
of power series over
involving arbitrary nonnegative powers of an indeterminate
, such that
is precisely the order in
of the inner product
and here
denotes transpose.
-
Proof.
All entries of
lie in the ring
of power series with no negative degrees.
This is a valuation ring in a valuated field and is a principal ideal domain. Over this ring, modules of
-dimension
have also
dimension
, by the theory of torsion-free finitely generated modules over a principal ideal domain. Therefore a matrix representing
will factor as a product of
and
matrices,
and
over
, one of which gives the module basis for the row space of
and the other gives the linear combinations of that basis which products all row vectors of
. Then the leading terms of
and
will give the required vectors if
does have Kapranov rank at most
. In the second case, the converse is immediate.
Conversely (in the former case) suppose that the family of vectors exists. If we add generic degree
terms to
and
then the product will have degree
wherever the degree is not zero, and we will have the required pattern. □
This result extends to the case of any two-valued tropical matrix. It would be of some interest to know whether if
is nonnegative integer-valued, then one can always work with power series having nonnegative integer exponents.
Instead of working with two families of vectors, it is equivalent to work with a collection of vectors and hyperplanes through the origin, with the condition that a vector lies in the hyperplane, if we choose the hyperplanes orthogonal to the respective vectors in one of the two sets. That represents some concept of incidence which is natural for projective planes.
The following result is also essentially in [4] .
Proposition 2.
Suppose we have a geometry consisting of a finite collection of points and lines and their incidence (membership) matrix, and suppose there is at most one line through any two points and any two lines intersect in at most one point. The tropical rank of the incidence matrix of the geometry, taken as a tropical
-matrix, is at most 3.
This remains true if we replace the
entries by arbitrary positive real numbers.
-
Proof.
Consider the nature of
submatrices. By the Hall-Koenig theorem [6] on systems of distinct representatives there is at least one system of distinct representatives (matching) for the corresponding binary relation, which consists entirely of zero unless there are configurations of incidence which include
permuted rectangles where all points are on all lines. Of these only
and
will occur, and we defer consideration of this case. So assume the minimum permuted diagonal sum is zero. From [7] on matrices of permanent 1 (the complementary result for Boolean matrices), it follows that if any nonnegative matrix has a unique permuted diagonal sum of zero, then one can permute the rows and columns so that the zeroes lie entirely on or below the main diagonal, and the main diagonal is zero. (This is proved by putting the permuted diagonal on the main diagonal and noting that the graph of the remaining zeroes must be acyclic, hence orderable). But such a pattern means that 2 columns have 2 positive entries in common, two points lie on two different lines.
Now consider the case when the top row consists entirely of positive entries, but no column consists entirely of positive entries. By the condition of the theorem, all the other rows have at most one positive entry. We claim that the minimum permuted diagonal sum equals the minimum entry in the top row, and that it is not unique. Since any sum involves a term from the top row, this is a lower bound on the minimum. Now delete its row and column, we have a
matrix with at most one positive entry per row, and no column consisting entirely of positive entries.
There cannot be any blocking matrix, so this has minimum permuted diagonal of zero. Moreover it cannot be permuted so that the zeroes are all on or below the diagonal, so it has at least two permuted diagonals of zero, and is singular.
Finally consider the case where the top row and the first column are entirely positive. Then there can be no other positive entries in the matrix. The minimum permuted diagonal sum is either equal to the
entry or the minimum sum of another entry in the first row and another entry in the first column. In either case, by deleting the rows and columns of those entries, one finds there will be at least two ways to complete the permuted diagonal with zeroes. □
For modules over the ring of power series, it will not only be true that a submodule of a finitely generated free module will be free, but that if we have any spanning set for the submodule, some subset of that spanning set will be a basis (spanning and independent over the quotient field). One way to see this is to look at the first coordinate, take a spanning set element of minimum order there, use it as a first basis element, and use it to clear out that coordinate entirely; the resulting module is the kernel of a nontrivial mapping the projection to that coordinate, and has lower rank over the quotient field, and one can repeat the process. This is useful in analyzing certain configurations.
Lemma 2.1.
Let
be the algebraic set (subset of an algebraic variety) of all inner products from 2 sequences of
vectors in
-space. Its tropical dimension does not exceed its ordinary dimension which is at most a constant times
.
-
Proof.
This follows from the Bieri-Groves theorem [1] , alternatively from the more precise results about tropical Grassmannians in [10] . Note that this set lies in the algebraic variety of
matrices of rank at most
; their row and column spaces represent
planes in
-space; the entire set is an image of a product of two sets of dimension
. □
Theorem 2.2.
Under the above hypothesis, there are tropical matrices of tropical rank 3 and arbitrarily high Kapranov rank. These are obtained by taking the incidence matrices of finite projective planes and inserting general positive real numbers for the 1 entries (incidences of points on lines).
-
Proof.
By Proposition 2 these matrices have tropical rank 3. The proof that they have arbitrarily large Kapranov rank is essentially done by counting dimensions.
Such a matrix
of this can have arbitrarily large size
and
arbitrary positive entries, since each line has
points on it. Here
can be any order of a finite field, a power of a prime. If the Kapranov rank is at most
then by Proposition 1 there are two families
called points and lines, each consisting of
non-zero vectors in
dimensional space over a power series ring
over the complex numbers, in a variable
, such that the orders in
of the inner products of the points with the lines are given by matrix
. All inner products in this set have ordinary dimension at most
by choice of each of
coordinates for each of
points and lines, but the tropical dimension is equal to the number of incidences in the projective plane, asymptotically
.
Therefore Lemma 3 gives a contradiction. □
3 Diophantine equations
Hypothesis. Diophantine equations over the rational numbers are not decidable by a general algorithm.
This problem is unknown and very deep; Davis, Putnam, and Robinsion, and Matijasevitch proved (Hilbert's Tenth Problem) that Diophantine equations over the integers are algorithmically undecidable. To relate this to Kapranov rank, we note by the above that representing any system of incidence of lines and points in a projective plane is a problem of deciding if Kapranov rank is at most
. Then we make use of Hall's method given in [5] for coordinatizing projective planes and defining algebraic operations solely in terms of systems of intersections of points and lines.
The method of Hall to coordinatize a projective plane starts by choosing
points
no three collinear, where
is assigned coordinates
),
is given coordinates
,
and
are the
and
-axes, and
is understood as the line at infinity. The points on
other than its intersection denoted (1) with
are given coordinates
. All points
of the plane not on
are given their
and
coordinates by intersecting
(a horizontal line) and
(a vertical line) with
. Addition is defined by setting
if and only if
is a finite point on the line joining
with
. Multiplication is defined by setting
if and only if
is a finite point on the line joining
and the infinite point
which is the intersection of the line joining
and
, with
. These operations agree with standard operations of arithmetic for the standard projective plane over any field. We can take a projective transformation so that any given finite set of points and lines are finite in the since of being and not lying on
.
For further information on Diophantine undecidability over the rational numbers, see [8] .
Theorem 3.1.
Determining whether a two-valued tropical matrix has Kapranov rank 3 over an infinite field has precisely the computational complexity of solving a system of Diophantine equations over that field.
Under the above hypothesis, computing Kapranov rank over the rational numbers is algorithmically undecidable. Computing Kapranov rank of an
-matrix over any infinite field is NP-hard; over an algebraically closed field it is PSPACE-easy.
-
Proof.
For a
-matrix, having Kapranov rank 3 over the rational numbers is equivalent by Proposition 1 to finding two systems of 3 dimensional vectors over the field in question whose zero and nonzero inner products represent it, and as remarked above, to finding a system of nonzero vectors and planes through the origin in 3 space whose incidence relations represent it. For a finite system, we can move all the vectors and planes away from infinity, and represent them in terms of a system of points and lines in the plane (or projective plane) over that field.
We use Halls construction to represent a general Diophantine equation with positive integer coefficients on each side as a question of existence of a system of points and lines with suitable intersections and nonintersections. We choose 4 points as above to define the system, with the non-collinearity assumption. Then we choose a number of general points sufficient to define the number of variables required. Then we take the lines and intersections required to define each side of the equations as a point on
. Existence of this configuration is then equivalent to solving the Diophantine system. Some incidences and intersections have been undefined, but if we take all possibilities for
and
on the incidence matrix for them, it cannot be possible to algorithmically decide all the cases.
The same argument proves NP-hardness in general, given that solving Diophantine equations or systems over a field, of polynomial size with coefficients and exponents having polynomially many digits is NP-hard. This follows by taking equations representing a Boolean satisfiability problem, adding equations
to force the solutions to be
or
.
However in the NP case it is not sufficient to allow all possibilities for the unknown incidences, since there might be exponentially many. Instead, we can control them by adding new variables and equations, and then taking linear combinations of the given equations. Our addition and multiplication constructions define certain points and lines and incidences of these. In particular cases there may be additional incidences of a point and a line. But if so this will be because of the separate constructions involved in one or two equations, not the entire system if there are many equations. Transform the equations as in [9] to be linear-quadratic, and arrange that the nth variable instead of being
has
added to it so that it is either
or
.
Assume first the field has transcendentals, indeterminate or generic elements.
Choose all equations consist of one side set equal to zero. Add 2 new variables, and 2 new equations
in them, which in effect define the new variables as generic and independent quadratic combinations of the other variables. Replace the previous equations by their sums with generic linear combinations of the new equations
; the combined equations have the same quadratic form as the
. Do the addition and multiplication constructions so as to compute in some fixed order all the new coefficients in each equation and their products with products of at most 2 previous variables and then add them successively, and finally add in the linear terms in the 2 new variables. The coordinates of points and coefficients of line equations will represent partial steps in the computation, or separate variables or certain fixed constants or transcendentals for the coefficients. It will not matter for our proof exactly what the incidences in each equation or pair of equations are, just that they can be computed in polynomial time and that they will not depend on which variables have one of the two values versus which variables have the other.
Note that we do not have to construct the numerical values of the variables–their existence alone is what is needed to see whether this configuration is possible and to see whether the Diophantine equations are solvable. We also do not have to construct the transcendentals, their existence is enough, and that the linear combinations which we take are nonzero so that we can recover solutions of the original equations from solutions of the new equations. However we must construct the coefficients as polynomial combinations of the transcendentals in them, and all integers in them starting with 1. In the next two paragraphs we argue that for 2 different equations, or at two different terms for same equation, the partial steps in the computation will involve different transcendentals, and we can have no new incidence among them; for different partial computations of the same term in the same equation, there are only the natural incidences, not ones depending on values of the variables; the incidences involving variables will be only that the same variable has the same value in two different equations.
The addition construction can be arranged to construct in turn, using some parallelism, from
,
. Thus it adds the following varying finite points in order to add
:
, and the following finite lines:
. The multiplication construction can be arranged to construct in turn
. Thus it adds the following finite points in order to multiply
:
and these lines:
. We can choose in these that
is a partial computation carried from before, and
is a coefficient or variable, or the integers -1,1 or 2. We do computations of terms in order, with the new variables in
last; when each term is complete, add it to the previous partial sum.
Consider a term as some
where
are transcendentals (there may be only one, and
are variables (there may be one or none), and
are integers. Lowest powers of
are added first in computing binary integers. For subtraction, we multiply a coefficient, after computing it, by a fixed
(a fixed diagram verifies its sum with 1 is 0). First the transcendentals
are multiplied, and among those, first transcendentals from the
, then the multiples by them of the powers of 2 in the binary expansions of
, then those are added, then once the entire polynomial coefficient is computed, it is multiplied times
, over which we have little control beyond knowing their two possible values.
The lines above are either vertical or horizontal or at a 45 degree angle with intercepts
, or have the form
. The points lie on pairs of these lines and their coordinates are all
. This means for incidences, in addition to partial computations being equal we need only to look at ratios
when a sum is being computed, for incidences on some
and differences
when a product is being computed, for incidences on some
; the second coordinate is always the more advanced in a product and the less advanced in a sum, in the partial computation. Every line or point involving an
involves a new transcendental or linear combination of transcendentals in a new term: these partial computations will not be the same as those for another equation or another term in the same equation, nor can they equal a variable. This is also true for
. As things are arranged, also new transcendentals will not cancel from
and will not give the value of any variable; all the more this cannot happen when we are adding a previous collection of terms. Such
cannot occur in the stages of multiplying in the variables, and cancellation will not occur in adding in a completed term. In the process of multiplying out a particular term within itself there cannot be any unpredictable incidences involving the variables, since multiplying them is done last. This shows that all incidences are computable in polynomial time from a knowledge of the equations, without knowing the values of the variables.
Solvability of the new system means precisely realizability in terms of a system of points and lines over the field, hence Kapranov rank at most 3 of the corresponding
-matrix. Hence if there were a P algorithm for Kapranov rank 3, then there would be a P algorithm for solving a system of Boolean or Diophantine equations in terms of 0,1 which is an NP-complete problem.
If we have a non-algebraically closed but infinite field, then a polynomial number of trials of substitutions of field elements for transcendentals one by one will result in some case where each of the polynomially many intersections remain distinct. Canny's result [2] implies the last statement with proposition 1, that is, he proved that solving a system of polynomial equations over an algebraically closed field is a problem lying within PSPACE. □
This extends to the case in which the matrix consists of integers of at most polynomial size. For larger sizes we must solve equations in terms of power series which are zero over large ranges, and the result is less clear. If it is a question of extending linearly after a very few stages, then it can be done.
It has previously been proved that determining Barvinok rank [3] and tropical rank [9] are in general NP-hard problems. It would also be interesting to know what the general form of a nonnegative matrix of small tropical rank is, when it is not given directly by the pattern of zeroes.
It would also be interesting to know whether the Kapranov ranks over the complex numbers of a sequence projective planes over finite fields represented as tropical
-matrices tends to infinity. If so then there can be no purely tropical definition of a lower bound on Kapranov rank by which Kapranov rank over every field can be bounded, for the Kapranov ranks over different fields will not be mutually bounded. However it appears that there will be a tropically computable lower bound which can deal with dimensionality phenomenon of Theorem 4 and in that sense improves on Kapranov rank.
This is related to the topic of realizable matroids. References
-
R. Bieri and J.R.J. Groves, The geometry of the set of characters induced by valuations, J. reine und angewandte Mathematik 347(1984),168-195.
-
J. Canny, Some algebraic and geometric computations in PSPACE, Proc. 20th Symp. Theory of Computing, Chicago(1988),ACM Press.
-
E. C ̧ ela, R. Rudolf, and J. Woeginger, On the Barvinok rank of matrices, presentation at the 2nd Aussois Workshop on Combinatorial Optimization, February 1998.
-
M. Develin, F. Santos, and B. Sturmfels, On the rank of a tropical matrix, arxiv:math.CO/0312114.
-
Marshall Hall, Group Theory, Macmillan, New York, 1964.
-
Philip Hall, On the representatives of subsets, J. London Math. Soc. 10(1935),26-30.
-
K. H. Kim, Boolean Matrix Theory and Applications, Marcel Dekker, New York, 1982.
-
K. H. Kim and F. W. Roush, Problems equivalent to rational Diophantine solvability, Proc. A.M.S 124-2 (1989),493-505.
-
K. H. Kim and F. W. Roush, Factorization of polynomials in one variable over the tropical semiring, arxiv:math.CO/0501167
-
D. Speyer and B. Sturmfels, The tropical Grassmannian, math.AG/0304218.
-
D. Speyer and B. Sturmfels, Tropical mathematics, arxiv:math.CO/0408099.
Department of Mathematics, Alabama State University, Montgomery, Alabama 36101-0271, and Fellow, Korean Academy of Science and Technology E-mail address : khkim@alasu.edu Department of Mathematics, Alabama State University, Montgomery, Alabama 36101-0271 E-mail address : froush@alasu.edu