<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="3.0" xml:lang="en" article-type="research article"><front><journal-meta><journal-id journal-id-type="publisher-id">JAMP</journal-id><journal-title-group><journal-title>Journal of Applied Mathematics and Physics</journal-title></journal-title-group><issn pub-type="epub">2327-4352</issn><publisher><publisher-name>Scientific Research Publishing</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.4236/jamp.2020.81002</article-id><article-id pub-id-type="publisher-id">JAMP-97444</article-id><article-categories><subj-group subj-group-type="heading"><subject>Articles</subject></subj-group><subj-group subj-group-type="Discipline-v2"><subject>Physics&amp;Mathematics</subject></subj-group></article-categories><title-group><article-title>
 
 
  Sparse Solutions of Mixed Complementarity Problems
 
</article-title></title-group><contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Peng</surname><given-names>Zhang</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref><xref ref-type="corresp" rid="cor1"><sup>*</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Zhensheng</surname><given-names>Yu</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref></contrib></contrib-group><aff id="aff1"><addr-line>College of Science, University of Shanghai for Science and Technology, Shanghai, China</addr-line></aff><pub-date pub-type="epub"><day>26</day><month>12</month><year>2019</year></pub-date><volume>08</volume><issue>01</issue><fpage>10</fpage><lpage>22</lpage><history><date date-type="received"><day>28,</day>	<month>November</month>	<year>2019</year></date><date date-type="rev-recd"><day>24,</day>	<month>December</month>	<year>2019</year>	</date><date date-type="accepted"><day>27,</day>	<month>December</month>	<year>2019</year></date></history><permissions><copyright-statement>&#169; Copyright  2014 by authors and Scientific Research Publishing Inc. </copyright-statement><copyright-year>2014</copyright-year><license><license-p>This work is licensed under the Creative Commons Attribution International License (CC BY). http://creativecommons.org/licenses/by/4.0/</license-p></license></permissions><abstract><p>
 
 
  In this paper, we consider an extragradient thresholding algorithm for finding the sparse solution of mixed complementarity problems (MCPs). We establish a relaxation 
  l
  <sub>1</sub> regularized projection minimization model for the original problem and design an extragradient thresholding algorithm (ETA) to solve the regularized model. Furthermore, we prove that any cluster point of the sequence generated by ETA is a solution of MCP. Finally, numerical experiments show that the ETA algorithm can effectively solve the 
  l
  <sub>1</sub> regularized projection minimization model and obtain the sparse solution of the mixed complementarity problem.
 
</p></abstract><kwd-group><kwd>Mixed Complementarity Problem</kwd><kwd> Sparse Solution</kwd><kwd> &lt;i&gt;l&lt;/i&gt;&lt;sub&gt;1&lt;/sub&gt; Regularized Projection Minimization Model</kwd><kwd> Extragradient Thresholding Algorithm</kwd></kwd-group></article-meta></front><body><sec id="s1"><title>1. Introduction</title><p>Define a continuously differentiable function F : R n → R n , and a nonempty set</p><p>Ω : = { x ∈ R n | a ≤ x ≤ b } ,</p><p>where a = { R ∪ { − ∞ } } n , b = { R ∪ { + ∞ } } n and a &lt; b ( a i &lt; b i , i = 1 , 2 , ⋯ , n ) . The mixed complementarity problem is to find a vector x ∈ Ω , such that</p><p>( y − x ) T F ( x ) ≥ 0, ∀ y ∈ Ω . (1)</p><p>The mixed complementarity problem, also known as box constrained variational inequality problem, denoted by MCP (a, b, F). In particular, if Ω : = R + n , the mixed complementarity problem becomes a nonlinear complementarity problem (NCP), is to find a vertor x ≥ 0 , such that</p><p>F ( x ) ≥ 0 ,   F ( x ) T x = 0.</p><p>Moreover, if F ( x ) : = M x + q , where M ∈ R n &#215; n , q ∈ R n , the nonlinear complementary problem reduces a linear complementary problem (LCP):</p><p>x ≥ 0, M x + q ≥ 0,   ( M x + q ) T x = 0.</p><p>The set of solution to the mixed complementarity problem is denoted by SOL (F), throughout this paper, we assume S O L ( F ) ≠ ∅ .</p><p>The MCP has wide applications in fields of science and engineering [<xref ref-type="bibr" rid="scirp.97444-ref1">1</xref>] [<xref ref-type="bibr" rid="scirp.97444-ref2">2</xref>], and many results on its theories and algorithms have been developed (see e.g. [<xref ref-type="bibr" rid="scirp.97444-ref3">3</xref>] [<xref ref-type="bibr" rid="scirp.97444-ref4">4</xref>] [<xref ref-type="bibr" rid="scirp.97444-ref5">5</xref>] [<xref ref-type="bibr" rid="scirp.97444-ref6">6</xref>] ).</p><p>In recent years, the problem of recovering an unknown sparse solution from some linear constraints has been an active topic with a range of applications including signal processing, machine learning, and computer vision [<xref ref-type="bibr" rid="scirp.97444-ref7">7</xref>], and there are many articles available for sloving the sparse solutions of systems of linear equations [<xref ref-type="bibr" rid="scirp.97444-ref8">8</xref>] - [<xref ref-type="bibr" rid="scirp.97444-ref13">13</xref>] as well as the optimization problems [<xref ref-type="bibr" rid="scirp.97444-ref14">14</xref>] [<xref ref-type="bibr" rid="scirp.97444-ref15">15</xref>] [<xref ref-type="bibr" rid="scirp.97444-ref16">16</xref>].</p><p>In contrast with the fast development in sparse solutions of optimization and linear equations, there are few researches available for the sparse solutions of the complementarity problems. The sparse solution problem of linear complementarity was first studied by Chen and Xiang [<xref ref-type="bibr" rid="scirp.97444-ref17">17</xref>], by using the concept of minimum p ( 0 &lt; p &lt; 1 ) norm solution, they studied the characteristics and calculations of sparse solutions and minimum p-norm solutions for linear complementarity problems. Recently, some solution methods had been proposed for LCP and NCP, for examples, shrinkage-thresholding projection method [<xref ref-type="bibr" rid="scirp.97444-ref18">18</xref>], half thresholding projection algorithm [<xref ref-type="bibr" rid="scirp.97444-ref19">19</xref>] and extragradient thresholding method [<xref ref-type="bibr" rid="scirp.97444-ref20">20</xref>].</p><p>Along with the research of [<xref ref-type="bibr" rid="scirp.97444-ref17">17</xref>] [<xref ref-type="bibr" rid="scirp.97444-ref18">18</xref>] [<xref ref-type="bibr" rid="scirp.97444-ref19">19</xref>] [<xref ref-type="bibr" rid="scirp.97444-ref20">20</xref>], in this paper, we aim to design an extragradient thresholding Algorithm for the sparse solution of MCP, and which can be seen as an extension of the sparse solution algorithm for NCP.</p><p>Due to the relationship between MCP and the variational inequality, we aim to seek a vector x ∈ Ω by solving the solution of l 0 norm minimization problem:</p><p>min   ‖ x ‖ 0 , s .t .   ( y − x ) T F ( x ) ≥ 0, (2)</p><p>for any y ∈ Ω , where ‖ x ‖ 0 stands for the number of nonzero components of x and a solution of problem (2) is called the sparse solution of MCP.</p><p>In essence, the minimization problem (2) is a sparse optimization problem with equilibrium constraints. It is not easy to get solutions due to the equilibrium constraints, even if the objective function is continuous.</p><p>To overcome the difficulty for the l 0 norm, many researchers have suggested to relax the l 0 norm and instead to consider the l 1 norm, see [<xref ref-type="bibr" rid="scirp.97444-ref21">21</xref>]. Motivated by this outstanding work, we consider applying l 1 norm minimization to find the sparse solution of MCP, and we obtain the following minimization problem to approximate problem (2):</p><p>min x ∈ Ω ‖ x ‖ 1 , s .t .   ( y − x ) T F ( x ) ≥ 0 (3)</p><p>for any y ∈ Ω and where ‖ x ‖ 1 = ∑ i = 1 n | x i | .</p><p>Given a vector x ∈ Ω , let P Ω ( x ) be the projection of x on Ω , for convenience, we write P Ω ( x ) = [ x ] Ω , it is well known (see, e.g., [<xref ref-type="bibr" rid="scirp.97444-ref22">22</xref>] ) that x * is a solution point of problem (1) if and only if it satisfies the following projection equation:</p><p>W ( x * ) : = x * − [ x * − F ( x * ) ] Ω = 0, (4)</p><p>and therefore problem (3) is equivalent to the following optimization problem</p><p>min x , z ∈ R n f ( x ) : = ‖ x ‖ 1 s .t .   x = [ x − F ( x ) ] Ω . (5)</p><p>In order to simplify the objective function, we introduce a new variable z ∈ R n and a regularization parameter λ &gt; 0 and establish the corresponding regularized minimization problem as follows:</p><p>min x , z ∈ R n f λ ( x , z ) : = ‖ x − z ‖ 2 + λ ‖ x ‖ 1 s .t .   z = [ x − F ( x ) ] Ω . (6)</p><p>We call (6) the l 1 regularized projection minimization problem.</p><p>This paper is organized as follows. In Section 2, we study the relation between the solution of model (6) and that of problem (3), and we show theoretically that (6) is a good approximation of problem (3). In Section 3, we propose an extragradient thresholding algorithm(ETA) for (6) and analyze the convergence of this algorithm. Numerical results are given in Section 4 and conclusion is described in Section 5.</p></sec><sec id="s2"><title>2. The l<sub>1</sub> Regularized Approximation</title><p>In this section, we study the relation between the solution of model (6) and that of model (3). The following theorem shows that model (6) is a good approximation of problem (3).</p><p>Theorem 2.1. For any fixed λ &gt; 0 , the solution set of (6) is nonempty and bounded. Let { ( x λ k , z λ k ) } be a solution of (6), and { λ k } be any positive sequence converging to 0. If S O L ( F ) ≠ ∅ , then { ( x λ k , z λ k ) } has at least one accumulation point, and any accumulation point x ∗ of { x λ k } is a solution of (1.3).</p><p>Proof. For any fixed λ &gt; 0 , since</p><p>f λ ( x , z ) → + ∞     as   ‖ ( x , z ) ‖ → ∞ , (7)</p><p>which means f λ ( x , z ) is coercivity. On the other hand, it is clear that for any x ∈ R n and z ∈ R n , f λ ( x , z ) ≥ 0 . This together with (7) implies the level set</p><p>L = { ( x , z ) ∈ R n &#215; R n | f λ ( x , z ) ≤ f λ ( x 0 , z 0 )   and   z = [ x − F ( x ) ] Ω }</p><p>is nonempty and compact, where x 0 ∈ R n and z 0 = [ x 0 − F ( x 0 ) ] Ω are given points, which deduces that the solution set of problem (6) is nonempty and bounded since f λ ( x , z ) is continuous on L.</p><p>Now we consider the proof of the second part of this theorem. Let x ^ ∈ S O L ( F ) and z ^ = [ x ^ − F ( x ^ ) ] Ω . from (5), we have x ^ = z ^ . Since ( x λ k , z λ k ) is a solution of (6) with λ = λ k , where z λ k = [ x λ k − F ( x λ k ) ] Ω , it follows that</p><p>max { ‖ x λ k − z λ k ‖ 2 , λ k ‖ x λ k ‖ 1 } ≤ ‖ x λ k − z λ k ‖ 2 + λ k ‖ x λ k ‖ 1 ≤ ‖ x ^ − z ^ ‖ 2 + λ k ‖ x ^ ‖ 1 = λ k ‖ x ^ ‖ 1 . (8)</p><p>This implies that for any λ k &gt; 0 ,</p><p>‖ x λ k ‖ 1 ≤ ‖ x ^ ‖ 1 . (9)</p><p>Hence the sequence { x λ k } is bounded and has at least one cluster point and so is { z λ k } due to ‖ x λ k − z λ k ‖ 2 ≤ λ k ‖ x ^ ‖ 1 .</p><p>Let x ∗ and z ∗ be any cluster points of { x λ k } and { z λ k } , respectively, and z λ k = [ x λ k − F ( x λ k ) ] Ω . Then there exists a subsequence of { λ k } , say { λ k j } , such that</p><p>lim k j → ∞ x λ k j = x ∗   and   lim k j → ∞ z λ k j = z ∗ .</p><p>We can obtain z ∗ = [ x ∗ − F ( x ∗ ) ] Ω by letting k j → ∞ in z λ k = [ x λ k − F ( x λ k ) ] Ω . Letting λ k j → 0 , in</p><p>‖ x λ k j − z λ k j ‖ 2 ≤ λ k j ‖ x ^ ‖ 1</p><p>yields x ∗ = z ∗ . Consequently, x ∗ = [ x ∗ − F ( x ∗ ) ] Ω , which implies x ∗ ∈ S O L ( F ) . Let k j tend to ∞ in (9), we get ‖ x ∗ ‖ 1 ≤ ‖ x ^ ‖ 1 . Then by the arbitrariness of x ^ ∈ S O L ( F ) , we know x ∗ is solution of problem (3). This completes the proof. &#162;</p></sec><sec id="s3"><title>3. Algorithm and Convergence</title><p>In this section, we give the extragradient thresholding algorithm (ETA) to solve l 1 regularization projection minimization problem (6) and give the convergence analysis of ETA.</p><p>First, we review some basic concepts about the monotone operator and the properties of the projection operator which can be found in [<xref ref-type="bibr" rid="scirp.97444-ref23">23</xref>].</p><p>Lemma 3.1. Let P K ( ⋅ ) be a projection from R n to K, where K is a non-empty closed convex subset on R n . Then we have</p><p>(a) For y ∈ R n ,</p><p>( y − P K [ y ] ) T ( P K [ y ] − x ) ≥ 0,   ∀ x ∈ K ; (10)</p><p>(b) for any y , z ∈ R n ,</p><p>‖ P K [ y ] − P K [ z ] ‖ 2 ≤ ( y − z ) T ( P K [ y ] − P K [ z ] ) . (11)</p><p>Using Lemma 3.1, we can obtain the following properties easily.</p><p>Lemma 3.2. Define a residue funtion</p><p>H ( α ) : = P K [ x − α d ] ,   α ≥ 0 , d ∈ R n . (12)</p><p>Then the following statements are valid.</p><p>(a) For any α ≥ 0 , ‖ x − H ( α ) ‖ α is non-increasing;</p><p>(b) ∀ α &gt; 0 , d T ( x − H ( α ) ) ≥ ‖ x − H ( α ) ‖ 2 α ;</p><p>(c) ∀ z ∈ R n , ‖ P K [ z ] − x ‖ 2 ≤ ‖ z − x ‖ 2 − ‖ P K [ z ] − z ‖ 2 .</p><p>In this paper, we suppose the mapping F : R n → R n is co-coercive on the set Ω , i.e., there exists a constant c &gt; 0 such that</p><p>〈 F ( x ) − F ( y ) , x − y 〉 ≥ c ‖ F ( x ) − F ( y ) ‖ 2 , ∀ x , y ∈ Ω .</p><p>It is clear that the co-coercive mapping is monotone, namely,</p><p>〈 F ( x ) − F ( y ) , x − y 〉 ≥ 0, ∀ x , y ∈ Ω .</p><p>For a given z k ∈ Ω and λ k &gt; 0 , we consider an unconstrained minimization subproblem:</p><p>min x ∈ R n f λ k ( x , z k ) : = ‖ x − z k ‖ 2 + λ k ‖ x ‖ 1 . (13)</p><p>Evidently, the minimizer x * of the model (13) satisfies the corresponding optimality condition</p><p>x * = S λ k ( z k ) , (14)</p><p>where the shrinkage operator S λ is defined by (see, e.g., [<xref ref-type="bibr" rid="scirp.97444-ref18">18</xref>] )</p><p>( S λ ( z ) ) i = ( z i − λ 2 ,           z i ≥ λ 2 ; 0, − λ 2 ≤ z i ≤ λ 2 ; z i + λ 2 ,           z i ≤ − λ 2 . (15)</p><p>It demonstrates that a solution x ∈ R n of the subproblem (13) can be analytically expressed by (14).</p><p>In what follows, we construct the extragradient thresholding algorithm (ETA) to solve the l 1 regularized projection minimization problem (6).</p><p>Algorithm ETA</p><p>Step 0: Choose 0 ≠ z 0 ∈ Ω , λ 0 , γ &gt; 0 , τ , l , μ ∈ ( 0 , 1 ) , ϵ &gt; 0 and a positive integers n max &gt; K 0 &gt; 0 , set k = 0 .</p><p>Step 1: Compute x k = S λ k ( z k ) , y k = [ x k − α k F ( x k ) ] Ω , where α k = γ l m k with m k being the smallest nonnegative integer satisfying</p><p>‖ F ( x k ) − F ( y k ) ‖ ≤ μ ‖ x k − y k ‖ α k . (16)</p><p>Step 2: If ‖ x k − z k ‖ ≤ ϵ or the number of iterations is greater than n max , then return z k , x k , y k and stop. Otherwise, compute</p><p>z k + 1 = [ x k − α k F ( y k ) ] Ω ,</p><p>and update λ k + 1 by</p><p>λ k + 1 = ( τ λ k , if   k + 1   is   a   multiple   of   K 0 , λ k ,                   otherwise .</p><p>Step 3: Let k = k + 1 , then go to Step 1.</p><p>Define</p><p>x ( α ) = [ x − α F ( x ) ] Ω ,   α ≥ 0</p><p>and</p><p>e ( x , a ) = x − x ( α ) ,   r ( x , α ) = ‖ e ( x , α ) ‖</p><p>It is easy to see that x k is a solution for MCP if and only if e ( x k , α ) = 0 ,   ∀ α &gt; 0 .</p><p>The following lemma plays an important role in the analysis of the global convergence of the Algorithm ETA.</p><p>Lemma 3.3. Suppose that mapping F is co-coercive and S O L ( F ) ≠ ∅ . If x k generated by ETA is not a solution of M C P ( F ) , then for any x ^ ∈ S O L ( F ) , we have</p><p>〈 F ( y k ) , x k − x ^ 〉 ≥ 〈 F ( y k ) , x k − y k 〉 ≥ ( 1 − μ ) ‖ x k − y k ‖ 2 γ . (17)</p><p>Proof. Since x ^ ∈ S O L ( F ) and y k ∈ Ω , it follows that 〈 F ( x ^ ) , y k − x ^ 〉 ≥ 0 . By the co-coercive of mapping F, we have 〈 F ( y k ) , y k − x ^ 〉 ≥ 0 . Hence</p><p>〈 F ( y k ) , x k − x ^ 〉 = 〈 F ( y k ) , x k − y k + y k − x ^ 〉 ≥ 〈 F ( y k ) , x k − y k 〉 = 〈 F ( x k ) , x k − y k 〉 − 〈 F ( x k ) − F ( y k ) , x k − y k 〉 ≥ 1 α k ‖ x k − y k ‖ 2 − μ α k ‖ x k − y k ‖ 2 ≥ 1 − μ γ ‖ x k − y k ‖ 2 ,</p><p>where the second inequality comes from Lemma 3.2(b) and (16), and the last inequality is based on α k ≤ γ .&#162;</p><p>The following theorem gives the global convergence of the algorithm ETA.</p><p>Theorem 3.4. Suppose F is co-coercive and S O L ( F ) ≠ 0 . If { x k } and { y k } are infinite columns generated by the algorithm ETA, then</p><p>lim k → ∞ ‖ x k − y k ‖ = 0. (18)</p><p>Further, { x k } converges to a solution of the problem MCP(a, b, F).</p><p>Proof. Let x ^ ∈ S O L ( F ) , by Lemma 3.2(c) and (17), we have</p><p>‖ z k + 1 − x ^ ‖ 2 ≤ ‖ ( x k − α k F ( y k ) ) − x ^ ‖ 2 − ‖ z k + 1 − x k + α k F ( y k ) ‖ 2 = ‖ x k − x ^ ‖ 2 − 2 α k F ( y k ) T ( x k − x ^ ) − 2 α k F ( y k ) T ( z k + 1 − x k ) − ‖ x k − z k + 1 ‖ 2 ≤ ‖ x k − x ^ ‖ 2 − 2 α k F ( y k ) T ( z k + 1 − y k ) − ‖ x k − z k + 1 ‖ 2 = ‖ x k − x ^ ‖ 2 − ‖ x k − y k ‖ 2 − ‖ z k + 1 − y k ‖ 2 + 2 ( x k − y k − α k F ( y k ) ) T ( z k + 1 − y k ) (19)</p><p>Now consider the last term of Equation (19), by Lemma 3.1 (a), we have</p><p>( y k − x k + α k F ( x k ) ) T ( z k + 1 − y k ) ≥ 0</p><p>It follows that</p><p>2 ( x k − y k − α k F ( y k ) ) T ( z k + 1 − y k ) ≤ 2 ( x k − y k − α k F ( y k ) ) T ( z k + 1 − y k ) + 2 ( y k − x k + α k F ( x k ) ) T ( z k + 1 − y k ) = 2 α k ( F ( x k ) − F ( y k ) ) T ( z k + 1 − y k ) ≤ α k 2 ‖ ( F ( x k ) − F ( y k ) ) ‖ 2 + ‖ z k + 1 − y k ‖ 2 (20)</p><p>Replacing (20) into (19), and by (16), we deduce</p><p>‖ z k + 1 − x ^ ‖ 2 ≤ ‖ x k − x ^ ‖ 2 − ‖ x k − y k ‖ 2 − ‖ z k + 1 − y k ‖ 2       + α k 2 ‖ ( F ( x k ) − F ( y k ) ) ‖ 2 + ‖ z k + 1 − y k ‖ 2 ≤ ‖ x k − x ^ ‖ 2 − ‖ x k − y k ‖ 2 + μ 2 ‖ x k − y k ‖ 2 = ‖ x k − x ^ ‖ 2 − ( 1 − μ 2 ) ‖ x k − y k ‖ 2 (21)</p><p>According to the definition of shrinkage operator (15), we know that</p><p>‖ x k + 1 − x ^ ‖ ≤ ‖ z k + 1 − x ^ ‖ .</p><p>Hence, { ‖ x k − x ^ ‖ 2 } has contraction properties, which means { x k } is bounded, and</p><p>( 1 − μ 2 ) ∑ k = 0 ∞ ‖ x k − y k ‖ 2 ≤ ∑ k = 0 ∞ { ‖ x k − x ^ ‖ 2 − ‖ x k + 1 − x ^ ‖ 2 } &lt; + ∞ ,</p><p>so we get (18) holds.</p><p>Since { x k } is bounded, the sequence { x k } has at least one cluster point, let x * be a cluster points of { x k } and a subsequence { x k i } converge to x * . Next we will show x * ∈ S O L ( F ) , we consider two cases:</p><p>Case 1: assume that there is a positive low bounded α min such that α k i ≥ α min &gt; 0 , then by inequality</p><p>min { 1, α } ‖ e ( x ,1 ) ‖ ≤ ‖ e ( x , α ) ‖ ≤ max { 1, α } ‖ e ( x ,1 ) ‖ . (22)</p><p>the continuity of e ( x , α ) for x and (18), we get</p><p>‖ e ( x * , 1 ) ‖ = lim k i → ∞ ‖ e ( x k i , 1 ) ‖ ≤ lim k i → ∞ ‖ e ( x k i , α k i ) ‖ min { 1 , α k i } ≤ lim k i → ∞ ‖ e ( x k i , α k i ) ‖ min { 1 , α min } = lim k i → ∞ ‖ x k i − y k i ‖ min { 1 , α min } = 0.</p><p>Case 2: assume α k i → 0 , for enough large k i , by the Lemma 3.2 (a) and the Arimijo search (16), we get</p><p>μ ‖ e ( x k i , 1 ) ‖ ≤ μ ‖ e ( x k i , 1 l α k i ) ‖ 1 l α k i &lt; ‖ F ( x k i ) − F ( x k i ( 1 l α k i ) ) ‖ .</p><p>Hence, we have</p><p>‖ e ( x * , 1 ) ‖ = lim k i → ∞ ‖ e ( x k i , 1 ) ‖ ≤ lim k i → ∞ ‖ F ( x k i ) − F ( x k i ( 1 l α k i ) ) ‖ = 0. (23)</p><p>In summary, we can get x * ∈ S O L ( F ) . Replacing this formula into (21), we have</p><p>‖ x k + 1 − x * ‖ 2 ≤ ‖ z k + 1 − x * ‖ 2 ≤ ‖ x k − x * ‖ 2 − ( 1 − μ 2 ) ‖ x k − y k ‖ 2 .</p><p>Hence we get { x k } converges to the solution x * . The proof is thus complete. &#162;</p></sec><sec id="s4"><title>4. Numerical Experiments</title><p>In this section, we present some numerical experiments to demonstrate the effectiveness of our ETA algorithm, and show the algorithm can obtain the sparse solution of the MCP (a, b, F).</p><p>We will stimulate three examples to implement the ETA algorithm. They will be ran 100 times for difference dimensions, and thus average results will be recorded. In each experiment, we set z 0 = e , γ = 2 c , l = 0.1 , μ = 1 / c , n max = 2000 and other related parameters will be given in the following test example.</p><sec id="s4_1"><title>4.1. Test for LCPs with Z-Matrix [<xref ref-type="bibr" rid="scirp.97444-ref18">18</xref>]</title><p>The test is associated with the Z-matrix which has an important property, that is, there is a unique sparse solution of LCPs when M is a kind of Z-matrix. Let us consider LCP(q, M) where</p><p>M = I n − 1 n e e T = ( 1 − 1 n − 1 n ⋯ − 1 n − 1 n 1 − 1 n ⋯ − 1 n ⋮ ⋮ ⋱ ⋮ − 1 n − 1 n ⋯ 1 − 1 n )</p><p>and q = ( 1 n − 1, 1 n , ⋯ , 1 n ) T , here I n is the identity matrix of order n and e = ( 1,1, ⋯ ,1 ) T ∈ R n . Such a matrix M is widely used in statistics. It is clear that M is a positive semidefinite Z-matrix. For any scalar α ≥ 0 , we know that vector x = α e + e 1 is a solution to LCP(q, M), since it satisfies</p><p>x ≥ 0 ,   M x + q = M e 1 + q = 0 ,   x T ( M x + q ) = 0.</p><p>Among all the solution, the vector x ^ = e 1 = ( 1 , 0 , ⋯ , 0 ) T is the unique sparse solution.</p><p>We choose z 0 = e , c = 1 , λ 0 = 0.2 , γ = 2 c , τ = 0.75 , l = 0.1 , μ = 1 / c , ϵ = 1 e − 6 , n max = 2000 , K 0 = 5 . We will take advantage of the recovery error ‖ x − x ^ ‖ to evaluate our algorithm. Apart from that, the average cpu time (in seconds), the average number of iteration times and residual ‖ x − z ‖ will also be taken into consideration on judging the performance of the method.</p><p>As indicated in <xref ref-type="table" rid="table1">Table 1</xref>, the ETA algorithm behaves very robust because the average number of times of iteration is identically equal to 205, the recovered error ‖ x − x ^ ‖ and residual ‖ x − z ‖ are basically similar. In addition, the sparsity ‖ x ‖ 0 of the recovered solution x is in all cases equivalents to 1, which means the recover is successful.</p></sec><sec id="s4_2"><title>4.2. Text for LCPs with Positive Semidefinite Matrices</title><p>In this subsection, we test ETA for randomly created LCPs with positive semidefinite matrices. First, we state the way of constructing LCPs and their solution. Let a matrix Z ∈ R n &#215; r ( r &lt; n ) be generated with the standard normal distribution and M = Z Z T . Let the sparse vector x ^ be produced by choosing randomly the s = 0.01 ∗ n nonzero components whose values are also randomly generated from a standard normal distribution. After the matrix M and the sparse vector x ^ have been generated, a vector q ∈ R n can be constructed such that x ^ is a solution of the LCP (q, M). Then x ^ can be regarded as a sparse solution of the LCP (q, M). Namely,</p><p>x ^ ≥ 0,   M x ^ + q ≥ 0,   x ^ T ( M x ^ + q ) = 0,   and   ‖ x ^ ‖ 0 = 0.01 ∗ n .</p><p>To be more specific, if x ^ i &gt; 0 then choose q i = − ( M x ^ ) i , if x ^ i = 0 then</p><table-wrap id="table1" ><label><xref ref-type="table" rid="table1">Table 1</xref></label><caption><title> ETA’s computational results on LCPs with Z-matrices</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >n</th><th align="center" valign="middle" >Iter</th><th align="center" valign="middle" >‖ x − x ^ ‖</th><th align="center" valign="middle" >‖ x − z ‖</th><th align="center" valign="middle" >‖ x ^ ‖ 0</th><th align="center" valign="middle" >‖ x ‖ 0</th><th align="center" valign="middle" >Time(sec.)</th></tr></thead><tr><td align="center" valign="middle" >3000</td><td align="center" valign="middle" >205</td><td align="center" valign="middle" >7.7007E−06</td><td align="center" valign="middle" >7.5424E−07</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >2.89</td></tr><tr><td align="center" valign="middle" >5000</td><td align="center" valign="middle" >205</td><td align="center" valign="middle" >7.6995E−06</td><td align="center" valign="middle" >7.5424E−07</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >7.92</td></tr><tr><td align="center" valign="middle" >10,000</td><td align="center" valign="middle" >205</td><td align="center" valign="middle" >7.6986E−06</td><td align="center" valign="middle" >7.5424E−07</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >36.68</td></tr><tr><td align="center" valign="middle" >15,000</td><td align="center" valign="middle" >205</td><td align="center" valign="middle" >7.6983E−06</td><td align="center" valign="middle" >7.5424E−07</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >78.40</td></tr><tr><td align="center" valign="middle" >20,000</td><td align="center" valign="middle" >205</td><td align="center" valign="middle" >7.6981E−06</td><td align="center" valign="middle" >7.5424E−07</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >148.45</td></tr><tr><td align="center" valign="middle" >25,000</td><td align="center" valign="middle" >205</td><td align="center" valign="middle" >7.6980E−06</td><td align="center" valign="middle" >7.5424E−07</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >232.82</td></tr></tbody></table></table-wrap><p>choose q i = | ( M x ^ ) i | − ( M x ^ ) i . Let M and q be the input to our ETA algorithm and take z 0 = e , c = max ( s v d ( M ) ) , λ 0 = 0.2 , γ = 2 c , τ = 0.75 , l = 0.1 , μ = 1 / c , ϵ = 1 e − 10 , n max = 2000 , K 0 = max ( 2 , ⌊ 10000 / n ⌋ ) , here ⌊ 10000 / n ⌋ denotes the largest integer less than 10,000/n. Then ETA will output a solution x. Similarly, the average number of iteration times, average cpu time (in seconds), and the residual ‖ x − z ‖ will also be taken into consideration on valuating our ETA algorithm.</p><p>As manifested in <xref ref-type="table" rid="table2">Table 2</xref>, the ETA algorithm performs quite efficiently. Furthermore, the sparsity ‖ x ‖ 0 of recovered solution x is in all cases equal to the sparsity ‖ x ^ ‖ 0 , which means the recover is exact.</p></sec><sec id="s4_3"><title>4.3. Test for Co-Coercive Mixed Complementarity Problem</title><p>We now consider a co-coercive mixed complementarity problem (MCP) with</p><p>F ( x ) = D ( x ) + M x + q (24)</p><p>where D ( x ) and M x + q are the nonlinear part and the linear part of F ( x ) , generate a linear part of M x + q in a way similar to [<xref ref-type="bibr" rid="scirp.97444-ref24">24</xref>]. The matrix M = A T A + B , where A is an n &#215; n matrix whose entries are randomly generated in the interval ( − 5,5 ) , and a skew-symmetric matrix B is generated in the same way. In D ( x ) , the nonlinear part of F ( x ) , the components are D j ( x ) = d j ∗ arctan ( x j ) , and d j is a random variable in ( − 1,0 ) , see similar example [<xref ref-type="bibr" rid="scirp.97444-ref25">25</xref>]. Then the sequent part of generating the sparse vector x ^ and vector q ∈ R n such that</p><p>x ^ ∈ Ω ,   ( y − x ^ ) T F ( x ^ ) ≥ 0 ,   ∀ y ∈ Ω ,   and   ‖ x ^ ‖ 0 = 0.01 ∗ n .</p><p>is similar to the procedure of Section 4.2. Let M and q be the input to our ETA algorithm and take z 0 = e , c = 150 ∗ log ( n ) , λ 0 = 0.2 , γ = 2 c , τ = 0.75 , l = 0.1 , μ = 1 / c , ϵ = 1 e − 6 , n max = 2000 , K 0 = max ( 2 , 10000 / n ) , and d = − r a n d ( n ,1 ) . Then ETA will output a solution x. Similariy, the average number of iteration times, the average residual ‖ x − z ‖ , the average sparsity ‖ x ‖ 0 of x, and the average cpu time (in seconds) will also be taken into consideration on valuation our ETA algorithm.</p><p>It is not difficult to see from <xref ref-type="table" rid="table3">Table 3</xref> that the ETA algorithm also performs quite efficiently in such mixed complementarity problems. The sparsity ‖ x ‖ 0 of the recovered solution x are all equal to the sparsity ‖ x ^ ‖ 0 , that is, the recover is exact.</p><table-wrap id="table2" ><label><xref ref-type="table" rid="table2">Table 2</xref></label><caption><title> Results on randomly created LCPs with positive semidefinite matrices</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >n</th><th align="center" valign="middle" >Iter</th><th align="center" valign="middle" >‖ x − z ‖</th><th align="center" valign="middle" >‖ x ^ ‖ 0</th><th align="center" valign="middle" >‖ x ‖ 0</th><th align="center" valign="middle" >Time (sec.)</th></tr></thead><tr><td align="center" valign="middle" >2000</td><td align="center" valign="middle" >350</td><td align="center" valign="middle" >8.0136E−11</td><td align="center" valign="middle" >20</td><td align="center" valign="middle" >20</td><td align="center" valign="middle" >18.05</td></tr><tr><td align="center" valign="middle" >3000</td><td align="center" valign="middle" >210</td><td align="center" valign="middle" >9.8366E−11</td><td align="center" valign="middle" >30</td><td align="center" valign="middle" >30</td><td align="center" valign="middle" >11.86</td></tr><tr><td align="center" valign="middle" >4000</td><td align="center" valign="middle" >142</td><td align="center" valign="middle" >8.5188E−11</td><td align="center" valign="middle" >40</td><td align="center" valign="middle" >40</td><td align="center" valign="middle" >28.65</td></tr><tr><td align="center" valign="middle" >5000</td><td align="center" valign="middle" >142</td><td align="center" valign="middle" >9.5243E−11</td><td align="center" valign="middle" >50</td><td align="center" valign="middle" >50</td><td align="center" valign="middle" >20.47</td></tr><tr><td align="center" valign="middle" >7000</td><td align="center" valign="middle" >144</td><td align="center" valign="middle" >8.4519E−11</td><td align="center" valign="middle" >70</td><td align="center" valign="middle" >70</td><td align="center" valign="middle" >43.67</td></tr></tbody></table></table-wrap><table-wrap id="table3" ><label><xref ref-type="table" rid="table3">Table 3</xref></label><caption><title> Results on co-coercive mixed complementarity problems</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >n</th><th align="center" valign="middle" >Iter</th><th align="center" valign="middle" >‖ x − z ‖</th><th align="center" valign="middle" >‖ x ^ ‖ 0</th><th align="center" valign="middle" >‖ x ‖ 0</th><th align="center" valign="middle" >Time (sec.)</th></tr></thead><tr><td align="center" valign="middle" >1000</td><td align="center" valign="middle" >468</td><td align="center" valign="middle" >8.5467E−07</td><td align="center" valign="middle" >10</td><td align="center" valign="middle" >10</td><td align="center" valign="middle" >2.64</td></tr><tr><td align="center" valign="middle" >3000</td><td align="center" valign="middle" >159</td><td align="center" valign="middle" >7.8034E−07</td><td align="center" valign="middle" >30</td><td align="center" valign="middle" >30</td><td align="center" valign="middle" >16.84</td></tr><tr><td align="center" valign="middle" >5000</td><td align="center" valign="middle" >105</td><td align="center" valign="middle" >9.4924E−07</td><td align="center" valign="middle" >50</td><td align="center" valign="middle" >50</td><td align="center" valign="middle" >37.59</td></tr><tr><td align="center" valign="middle" >7000</td><td align="center" valign="middle" >103</td><td align="center" valign="middle" >7.4224E−07</td><td align="center" valign="middle" >70</td><td align="center" valign="middle" >70</td><td align="center" valign="middle" >73.59</td></tr><tr><td align="center" valign="middle" >10,000</td><td align="center" valign="middle" >101</td><td align="center" valign="middle" >9.5524E−07</td><td align="center" valign="middle" >100</td><td align="center" valign="middle" >100</td><td align="center" valign="middle" >148.94</td></tr></tbody></table></table-wrap></sec></sec><sec id="s5"><title>5. Conclusion</title><p>In this paper, we concentrate on finding sparse solution for co-coervice mixed complementarity problems (MCPs). An l 1 regularized projection minimization model is proposed for relaxation, and an extragradient thresholding algorithm (ETA) is then designed for this regularized model. Furthermore, we analyze the convergence of this algorithm and show any cluster point of the sequence generated by ETA is a sparse solution of MCP. Preliminary numerical results indicate that the l 1 regularized model as well as the ETA is promising to find the spare solution of MCPs.</p></sec><sec id="s6"><title>Data Availability</title><p>Since data in the Network Vector Autoregression (NAR) is not public, we have not done empirical analysis.</p></sec><sec id="s7"><title>Acknowledgements</title><p>This paper is supported by the Top Disciplines of Shanghai.</p></sec><sec id="s8"><title>Conflicts of Interest</title><p>The authors declare no conflicts of interest regarding the publication of this paper.</p></sec><sec id="s9"><title>Cite this paper</title><p>Zhang, P. and Yu, Z.S. (2020) Sparse Solutions of Mixed Complementarity Problems. Journal of Applied Mathematics and Physics, 8, 10-22. https://doi.org/10.4236/jamp.2020.81002</p></sec></body><back><ref-list><title>References</title><ref id="scirp.97444-ref1"><label>1</label><mixed-citation publication-type="other" xlink:type="simple">Ferris, M.C. and Pang, J.S. (1997) Engineering and Economic Applications of Complementarity Problem. SIAM Review, 39, 669-713. https://doi.org/10.1137/S0036144595285963</mixed-citation></ref><ref id="scirp.97444-ref2"><label>2</label><mixed-citation publication-type="other" xlink:type="simple">Harker, P.T. and Pang, J.S. (1990) Finite-Dimensional Variational Inequality and Nonlinear Complementarity Problems: A Survey of Theory, Algorithms and Applications. Mathematical Programming, 48, 161-220. https://doi.org/10.1007/BF01582255</mixed-citation></ref><ref id="scirp.97444-ref3"><label>3</label><mixed-citation publication-type="other" xlink:type="simple">Billups, S.C., Dirkse, S.P. and Ferris, M.C. (1997) A Comparison of Algorithms for Large-Scale Mixed Complementarity Problems. Computational Optimization and Applications, 7, 3-25. https://doi.org/10.1007/978-0-585-26778-4_2</mixed-citation></ref><ref id="scirp.97444-ref4"><label>4</label><mixed-citation publication-type="other" xlink:type="simple">Facchinei, F. and Pang, J.S. (2003) Finite-Dimensional Variational Inequality and Complementarity Problems I. Springer Series in Operations Research, Springer, New York. https://doi.org/10.1007/b97544</mixed-citation></ref><ref id="scirp.97444-ref5"><label>5</label><mixed-citation publication-type="other" xlink:type="simple">Facchinei, F. and Pang, J.S. (2003) Finite-Dimensional Variational Inequality and Complementarity Problems II. Springer Series in Operations Research, Springer, New York. https://doi.org/10.1007/b97544</mixed-citation></ref><ref id="scirp.97444-ref6"><label>6</label><mixed-citation publication-type="other" xlink:type="simple">Zhou, Z.Y. and Peng, Y.C. (2019) The Locally Chen-Harker-Kanzow-Smale Smoothing Functions for Mixed Complementarity Problems. Journal of Global Optimization, 74, 169-193. https://doi.org/10.1007/s10898-019-00739-4</mixed-citation></ref><ref id="scirp.97444-ref7"><label>7</label><mixed-citation publication-type="other" xlink:type="simple">Eldar, Y.C. and Kutyniok, G. (2012) Compressed Sensing: Theory and Applications. Cambridge University Press, Cambridge.</mixed-citation></ref><ref id="scirp.97444-ref8"><label>8</label><mixed-citation publication-type="other" xlink:type="simple">Bruckstein, A.M., Donoho, D.L. and Elad, M. (2009) From Sparse Solutions of Systems of Equations to Sparse Modeling of Signals and Images. SIAM Review, 51, 34-81. https://doi.org/10.1137/060657704</mixed-citation></ref><ref id="scirp.97444-ref9"><label>9</label><mixed-citation publication-type="other" xlink:type="simple">Candes, E.J., Romberg, J. and Tao, T. (2006) Robust Uncertainty Principles: Exact Signal Reconstruction from Highly Incomplete Frequency Information. IEEE Transactions on Information Theory, 52, 489-509. https://doi.org/10.1109/TIT.2005.862083</mixed-citation></ref><ref id="scirp.97444-ref10"><label>10</label><mixed-citation publication-type="other" xlink:type="simple">Candes, E. and Tao, T. (2005) Decoding by Linear Programming. IEEE Transactions on Information Theory, 51, 4203-4215. https://doi.org/10.1109/TIT.2005.858979</mixed-citation></ref><ref id="scirp.97444-ref11"><label>11</label><mixed-citation publication-type="other" xlink:type="simple">Foucart, S. and Rauhut, H. (2013) A Mathematical Introduction to Compressive Sensing. Springer, Basel. https://doi.org/10.1007/978-0-8176-4948-7</mixed-citation></ref><ref id="scirp.97444-ref12"><label>12</label><mixed-citation publication-type="other" xlink:type="simple">Ge, D., Jiang, X. and Ye, Y. (2011) A Note on the Complexity of   Minimization. Mathematical Programming, 129, 285-299. https://doi.org/10.1007/s10107-011-0470-2</mixed-citation></ref><ref id="scirp.97444-ref13"><label>13</label><mixed-citation publication-type="other" xlink:type="simple">Natarajan, B. (1995) Sparse Approximate Solutions to Linear Systems. SIAM Journal on Computing, 24, 227-234. https://doi.org/10.1137/S0097539792240406</mixed-citation></ref><ref id="scirp.97444-ref14"><label>14</label><mixed-citation publication-type="other" xlink:type="simple">Chen, X., Xu, F. and Ye, Y. (2010) Lower Bound Theory of Nonero Entries in Solutions of   Minimization. SIAM Journal on Scientific Computing, 32, 2832-2852. https://doi.org/10.1137/090761471</mixed-citation></ref><ref id="scirp.97444-ref15"><label>15</label><mixed-citation publication-type="other" xlink:type="simple">Beck, A. and Eldar, Y. (2013) Sparsity Constrained Nonlinear Optimization: Optimality Conditions and Algorithms. SIAM Journal on Optimization, 23, 1480-1509. https://doi.org/10.1137/120869778</mixed-citation></ref><ref id="scirp.97444-ref16"><label>16</label><mixed-citation publication-type="other" xlink:type="simple">Lu, Z. (2014) Iterative Hard Thresholding Methods for   Regularized Convex Cone Programming. Mathematical Programming, 147, 125-154. https://doi.org/10.1007/s10107-013-0714-4</mixed-citation></ref><ref id="scirp.97444-ref17"><label>17</label><mixed-citation publication-type="other" xlink:type="simple">Chen, X. and Xiang, S. (2016) Sparse Solutions of Linear Complementarity Problems. Mathematical Programming, 159, 539-556. https://doi.org/10.1007/s10107-015-0950-x</mixed-citation></ref><ref id="scirp.97444-ref18"><label>18</label><mixed-citation publication-type="other" xlink:type="simple">Shang, M. and Nie, C. (2014) A Shrinkage-Thresholding Projection Method for Sparsest Solutions of LCPs. Journal of Inequalities and Applications, 2014, Article No. 51. https://doi.org/10.1186/1029-242X-2014-51</mixed-citation></ref><ref id="scirp.97444-ref19"><label>19</label><mixed-citation publication-type="other" xlink:type="simple">Shang, M., Zhang, C., Peng, D. and Zhou, S. (2015) A Half Thresholding Projection Algorithm for Sparse Solutions of LCPs. Optimization Letters, 9, 1231-1245. https://doi.org/10.1007/s11590-014-0834-7</mixed-citation></ref><ref id="scirp.97444-ref20"><label>20</label><mixed-citation publication-type="other" xlink:type="simple">Shang, M., Zhou, S. and Xiu, N. (2015) Extragradient Thresholding Methods for Sparse Solutions of Co-Coercive NCPs. Journal of Inequalities and Applications, 2015, Article No. 34. https://doi.org/10.1186/s13660-015-0551-5</mixed-citation></ref><ref id="scirp.97444-ref21"><label>21</label><mixed-citation publication-type="other" xlink:type="simple">Shang, M., Zhang, C. and Xiu, N. (2014) Minimal Zero Norm Solutions of Linear Complementarity Problems. Journal of Optimization Theory and Applications, 163, 795-814. https://doi.org/10.1007/s10957-014-0549-z</mixed-citation></ref><ref id="scirp.97444-ref22"><label>22</label><mixed-citation publication-type="other" xlink:type="simple">Gabriel, S.A. and More, J.J. (1997) Smoothing of Mixed Complementarity Problems in Complementarity and Variational Problems.</mixed-citation></ref><ref id="scirp.97444-ref23"><label>23</label><mixed-citation publication-type="book" xlink:type="simple">Zarantonello, E.H. (1971) Projections on Convex Sets in Hilbert Space and Spectral Theory. In: Zarantonello, E.H., Ed., Contributions to Nonlinear Functional Analysis, Academic Press, New York.</mixed-citation></ref><ref id="scirp.97444-ref24"><label>24</label><mixed-citation publication-type="book" xlink:type="simple">Harker, P.T. and Pang, J.S. (1990) A Damped-Newton for the Linear Complementarity Problems. In: Allgower, E.L. and Georg, K., Eds., Computational Solution of Nonlinear Systems of Equations: AMS Lectures on Applied Mathematics, 26th Edition, American Mathematical Society, Providence, 265-284.</mixed-citation></ref><ref id="scirp.97444-ref25"><label>25</label><mixed-citation publication-type="other" xlink:type="simple">Taji, K., Fukushima, M. and Ibaraki, T. (1993) A Globally Convergent Newton Method for Solving Strongly Monotone Variational Inequalities. Mathematical Programming, 58, 369-383. https://doi.org/10.1007/BF01581276</mixed-citation></ref></ref-list></back></article>