Composite Minimization Problems in Hadamard Spaces

In this paper, we prove some Δ-convergence and strong convergence results for the sequence generated by a new algorithm to a minimizer of two convex functions and a common fixed point for quasi-pseudo-contractive mappings in Hadamard spaces. Our theorems improve and generalize some recent results in the literature.

• Hadamard Spaces
• Composite Minimization
• Common Fixed Points
• Quasi-Pseudo-Contractive Mappings
• Quasilinearization

1. Introduction

Let ( X , d ) be a metric space and x , y ∈ X with l = d ( x , y ) . A geodesic path from x to y is an isometry c : [ 0, l ] → X such that c ( 0 ) = x , c ( l ) = y . The image of a geodesic path is called a geodesic segment. A metric space X is a geodesic space if every two points of X are joined by a geodesic segment. A geodesic triangle Δ ( x 1 , x 2 , x 3 ) in a geodesic space X consists of three points x 1 , x 2 , x 3 of X and three geodesic segments joining each pair of vertices. A comparison triangle of a geodesic triangle Δ ( x 1 , x 2 , x 3 ) is the triangle Δ ¯ ( x 1 , x 2 , x 3 ) : = Δ ( x 1 ¯ , x 2 ¯ , x 3 ¯ ) in the Euclidean space ℝ 2 such that d ( x i , x j ) = d ℝ 2 ( x i ¯ , x j ¯ ) for all i , j = 1,2,3 .

A geodesic space X is a CAT(0) space if for each geodesic triangle Δ : = Δ ( x 1 , x 2 , x 3 ) in X and its comparison triangle Δ ¯ : = Δ ( x 1 ¯ , x 2 ¯ , x 3 ¯ ) in ℝ 2 , the CAT(0) inequality

d ( x , y ) ≤ d ℝ 2 ( x ¯ , y ¯ )

is satisfied by all x , y ∈ Δ and x ¯ , y ¯ ∈ Δ ¯ . The meaning of the CAT(0) inequality is that a geodesic triangle in X is at least as thin as its comparison triangle in the Euclidean plane. It is well-known that any complete and simply connected Riemannian manifold having non-positive sectional curvature is a CAT(0) space. Other examples of CAT(0) spaces include pre-Hilbert spaces, R-trees, Euclidean buildings. A complete CAT(0) space is called a Hadamard space.

Let C be a nonempty set and consider the following composite optimization problem: find x * ∈ C such that

f ( x * ) + g ( x * ) = m i n x ∈ C { f ( x ) + g ( x ) } , (1)

where f , g are real-valued functions defined on C. This problem has a typical scenario in linear inverse problems, and it has applications in image reconstruction, machine learning, data recovering and compressed sensing (see [1] - [7] and the references therein).

In the case that X is a real Hilbert space or a real Banach space, problem (1) has been studied by many authors ( [3] [5] [8] - [12]). For example, in 2019, Chang et al. [8] used a modified hybrid algorithm to find a minimizer for problem (1) in Banach spaces without the assumption that the potential function is Fréchet differentiable and its gradient is L-Lipschitz continuous.

Recently, many convergence results for solving optimization problems have been extended from the classical linear spaces to the setting of manifolds. For example, in 2015, Cholamjiak-Abdou-Cho [13] established strong convergence of the sequence to a minimizer of a convex function and to a fixed point of nonexpansive mappings in CAT(0) spaces. Also in 2019, Chang et al. [14] presented a new modified proximal point algorithm for solving the minimization of a convex function and the common fixed points problem for two k-strictly pseudononspreading mappings in Hadamard spaces.

Recall that a mapping T : C → C is said to be

(i) nonexpansive, if

d ( T x , T y ) ≤ d ( x , y ) ,   ∀ x , y ∈ C ;

(ii) quasi-nonexpansive, if F i x ( T ) ≠ ∅ and

d ( T x , x * ) ≤ d ( x , x * ) ,   ∀   x ∈ C ,   ∀ x * ∈ F i x ( T ) ;

(iii) k-strictly pseudononspreading, if there exists a constant k ∈ ( 0,1 ) such that for all x , y ∈ C

d 2 ( T x , T y ) ≤ d 2 ( x , y ) + k d 2 ( x , T x ) + k d 2 ( y , T y ) + 2 ( 1 − k ) 〈 x T ( x ) → , y T ( y ) → 〉 ;

(iv) demicontractive, if F i x ( T ) ≠ ∅ and there exists k ∈ ( 0,1 ) such that

d 2 ( T x , x * ) ≤ d 2 ( x , x * ) + k d 2 ( x , T x ) ,   ∀ x ∈ C ,   ∀ x * ∈ F i x ( T ) .

Definition 1. An operator T : C → C is said to be pseudo-contractive if

〈 T x T y → , x y → 〉 ≤ d 2 ( x , y ) ,   ∀ x , y ∈ C .

Remark 1. The interest of pseudo-contractive operators lies in their connection with monotone mappings, namely, T is a pseudo-contraction if and only if I − T is a monotone mapping. It is well known that T is pseudo-contractive if and only if

d 2 ( T x , T y ) ≤ d 2 ( x , y ) + d 2 ( ( I − T ) x , ( I − T ) y ) ,   ∀ x , y ∈ C .

Definition 2. An operator T : C → C is said to be quasi-pseudo-contractive if F i x ( T ) ≠ ∅ and

d 2 ( T x , x * ) ≤ d 2 ( x , x * ) + d 2 ( x , T x ) ,   ∀ x ∈ C ,   ∀ x * ∈ F i x ( T ) . (2)

From the above definitions, it is easy to see that the class of quasi-pseudo-contractive mappings is fundamental. It includes many kinds of nonlinear mappings such as the demicontractive mappings, the quasi-nonexpansive mappings and the k-strictly pseudononspreading with fixed points as special cases. Motivated by the researches above, we establish the convergent results to a minimizer of two convex functions and a common fixed point of quasi-pseudo-contractive mappings in Hadamard spaces. Thus our results generalize the corresponding results of Cholamjiak-Abdou-Cho [13], Chang et al. [14], Ariza-Ruiz et al. [15], Bačák [16], Dhompongsa et al. [17], Khan-Abbas [18] and many others.

2. Preliminaries and Lemmas

We now collect some elementary facts about CAT(0) spaces which will be used in the proofs of our main results. In 1976, Lim [19] introduced the concept of Δ-convergence in a general metric space. Recall that a sequence { x n } in a CAT(0) space X is said to Δ-converge to x ∈ X if x is the unique asymptotic center of { u n } for every subsequence { u n } of { x n } . A geodesic space ( X , d ) is a CAT(0) space, if and only if

d 2 ( ( 1 − t ) x ⊕ t y , z ) ≤ ( 1 − t ) d 2 ( x , z ) + t d 2 ( y , z ) − t ( 1 − t ) d 2 ( x , y ) (3)

for all x , y , z ∈ X and all t ∈ [ 0,1 ] . Berg and Nikolaev [20] introduced the concept of quasilinearization as follows. Denote a pair ( a , b ) ∈ X × X by a b → and call it a vector. Then quasilinearization is defined as a map 〈 ⋅ , ⋅ 〉 : ( X × X ) × ( X × X ) → ℝ defined by

〈 a b → , c d → 〉 = 1 2 [ d 2 ( a , d ) + d 2 ( b , c ) − d 2 ( a , c ) − d 2 ( b , d ) ]

for all a , b , c , d ∈ X . It is easy to see that

〈 a b → , c d → 〉 = 〈 c d → , a b → 〉 ,   〈 a b → , c d → 〉 = − 〈 b a → , c d → 〉 , 〈 a x → , c d → 〉 + 〈 x b → , c d → 〉 = 〈 a b → , c d → 〉

for all a , b , c , d , x ∈ X . It is proved in [20] that a geodesically connected metric space is a CAT(0) space if and only if it satisfies the Cauchy-Schwarz inequality:

〈 a b → , c d → 〉 ≤ d ( a , b ) d ( c , d ) ,   ∀ a , b , c , d ∈ X .

Lemma 1. [14] Let X be a Hadamard space. Then for all x , y , z , u , w ∈ X and t , s ∈ [ 0,1 ] , we have

(i) d ( ( 1 − t ) x ⊕ t y , z ) ≤ ( 1 − t ) d ( x , z ) + t d ( y , z ) ;

Definition 3. [14] Let C be a nonempty subset of a Hadamard space X and let be a sequence in X. Then is Fejér monotone respect to C if

Lemma 2. [21] Let be a sequence in a Hadamard space X and let C be a nonempty subset of X. Suppose that is Fejér monotone with respect to C and that every Δ-sequential cluster point of belongs to C. Then Δ-converges to a point in C.

Lemma 3. Let C be a nonempty closed and convex subset of a Hadamard space X and be an L-Lipschizian mapping with. Denote

If, then the following conclusions hold:

(ii) If is demiclosed at 0, then is also demiclosed at 0;

(iii) If T is quasi-pseudo-contractive, then the mapping K is quasi-nonexpansive, that is,

Proof. (i) If, it is obvious that. Conversely, if, i.e., , letting, then. Put. Then. Now we prove that. In fact, we have

Since, we have, i.e.,. This shows that . It is obvious that if and only if. The conclusion (1) is proved.

(ii) For any sequence satisfying and. Next we prove that. From conclusion (1), we only need to prove that. In fact, since T is L-Lipschizian, we get

which implies that

Since T is demiclosed at 0, we have. The conclusion (2) is proved.

for all. Since T is L-Lipschitzian, we get

From (2) and (3), one has

By (2) and (6), we obtain

By (5), (7) and (8), we have

Since, we deduce that. From (9), one gets

for all and. Combing (2) and (10) one has

which together with implies that

that is,

The proof is completed.

Now we consider the following problem: find a point such that

where C is a nonempty closed convex set of a Hadamard space X, are proper convex functions and is a quasi-pseudo-contractive mapping. Recall that a function is said to be convex, if for any geodesic joining, the function is convex. If we set

then the problem (11) is equivalent to the problem of finding such that

Define

It is easy to show that the bifunction has the following properties:

(A₁);

(A₂) F is monotone, i.e.,;

(A₃) The function is convex for all;

Define a mapping by

Lemma 4. Let C be a nonempty closed convex subset of a Hadamard space X. Let F be a bifunction satisfying assumptions (A₁)-(A₃) and

(A₄) For each and, there exists a compact subset containing a point such that whenever.

Then, the following conclusions hold:

(a) is well defined in X and is single-valued;

(b) is firmly nonexpansive restricted to C, i.e., ,

(c), where is the solution set of problem (1) (i.e., the set of minimizers of problem (1));

(d) For, one has

Proof. The result is a special case of Theorem 4 and Theorem 5 in [22], so we omit the proof here.

3. Δ-Convergence Theorems

We are in a position to give our main theorems. Throughout this section we assume that

(1) is a Hadamard space and C is a nonempty closed convex subset of X;

(2) are proper convex functions and the bifunction satisfies the assumption (A₄);

(3) is an L-Lipschitzian and quasi-pseudo-contractive mapping with, is demiclosed at 0;

(4) Denote

with.

Theorem 1. Let be the same above. For any given, define the sequence as follows:

where, are sequences in with . If the solution set of problem (11) is nonempty, then the sequence Δ-converges to a point, which is a minimizer of in C and also a common fixed point of in C.

Proof. Step 1. It follows from Lemma 4 (c) that if, then . Besides, by Lemma 3 (ii) we have is demiclosed at 0.

Step 2. Next we prove that is Fejér monotone with respect to. In fact, by Lemma 4 (b), is firmly nonexpansive, then it is nonexpansive. Let, then one has

It follows from (13) and (14) that

From (13), (14) and (15) we obtain

which implies that is decreasing and bounded below. Thus the limit exists for each. It implies that is Fejér monotone with respect to. Without loss of generality, we can assume that

Therefore the sequence is bounded and so are the sequences .

Step 3. Now we prove that

In fact, it follows from (12) that

Hence in order to prove (18), it suffices to prove that. Indeed, by (16) we get

which can be rewritten as

which together with (17) implies that

Combing (15) and (17) we obtain

which together with (20) implies that

Also, by (15) we have

Then one gets

which together with (21) shows that

On the other hand, it follows from (14) that

These imply that. Thus by (19) one has that the equality (18) holds.

Step 4. In this step, we show that

In fact, it follows from (3), (13), (14) and Lemma 3 (iii) that

which together with (3), (13), (14) and Lemma 3 (iii) implies that

After simplifying and by using the condition that, one gets

which shows that

Thus by (13) and (22), we get

Furthermore, it follows form (18), (22) and (23) that

Step 5. Finally, we prove that Δ-converges to some point. Since in the second step, we have shown that is bounded in C and it is Fejér monotone with respect to. Then by Lemma 2, in order to prove Δ-converges to some point in, it suffices to show that every Δ-sequential cluster point of belongs to.

In fact, let be a Δ-sequential cluster point of, then there exits a subsequence of Δ-converging to. From (18) and (23), it follows that and. Since is nonexpansive, is demiclosed at 0. Note that and are also demiclosed at 0 by Lemma 3 (ii). Now by (24) and Lemma 3 (i), we obtain . Therefore, by Lemma 2, Δ-converges to some point in. The proof is completed.

4. Strong Convergence Theorems

Let be a Hadamard space and C be a nonempty closed convex subset of X. Recall that a mapping is said to be demi-compact, if for any bounded sequence in C such that (as), then there is a subsequence such that converges strongly (i.e., in metric topology) to some point in C.

Theorem 2. Let all the conditions in Theorem 1 be satisfied and be demi-compact restricted to C, then the sequence defined by (13) converges strongly to a point.

Proof. Indeed, since is demi-compact restricted to C, it follows from (24) that there is a subsequence such that converges strongly to some point. Since is demiclosed at 0, we have.

Moreover, it follows from (18) and (23) that and as. Since is demi-closed at 0, by (24) we have . Hence. Besides, it follows form (17) that exists. Thus we get. The proof is completed.

Theorem 3. Suppose that all the conditions in Theorem 1 are satisfied. Moreover, let be a nondecreasing function with and

then the sequence defined by (13) converges strongly to a point.

Proof. It follows form (24) and (25) that

Since is nondecreasing with and, we have

which implies that

Hence is a Cauchy sequence in C. Noting that C is closed and convex in the Hadamard space X, C is also complete. Without loss of generality, we can assume that converges strongly to some point. Then . Besides, since is quasi-nonexpansive and is nonexpansive, it is clear that is closed in C. Thus we get. The proof is completed.

5. Conclusion and Remarks

Let us conclude this paper with some open questions whose answers might largely improve the applicability of the results in this present paper.

Question. Whether or not we can improve the (A₄) condition: For each and, there exists a compact subset containing a point

such that whenever, in order to obtain similar results regarding the resolvent operator?

Acknowledgements

The author would like to thank the referees for their pertinent comments and valuable suggestions.

Conflicts of Interest

The author declares that there is no conflict of interest regarding the publication of this paper.

References

1. Beck, A. and Teboulle, M. (2009) A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems. SIAM Journal on Imaging Sciences, 2, 183-202. https://doi.org/10.1137/080716542

2. Chang, S.S., Wen, C.F. and Yao, J.C. (2018) Common Zero Point for a Finite Family of Inclusion Problems of Accretive Mappings in Banach Spaces. Optimization, 67, 1183-1196. https://doi.org/10.1080/02331934.2018.1470176

3. Qin, X. and Yao, J.C. (2017) Projection Splitting Algorithms for Nonself Operators. Journal of Nonlinear and Convex Analysis, 18, 925-935.

4. Xu, H.K. (2017) Bounded Perturbation Resilience and Superiorization Techniques for the Projected Scaled Gradient Method. Inverse Problems, 33, Article ID: 044008.https://doi.org/10.1088/1361-6420/33/4/044008

5. Yunier, J. and Cruz, B. (2017) On Proximal Subgradient Splitting Method for Minimizing the Sum of Two Nonsmooth Convex Functions. Set-Valued and Variational Analysis, 25, 245-263. https://doi.org/10.1007/s11228-016-0376-5

6. Yamada, I., Yukawa, M. and Yamagishi, M. (2011) Minimizing the Moreau Envelope of Nonsmooth Convex Functions over the Fixed Point Set of Certain Quasi-Nonexpansive Mappings. In: Fixed-Point Algorithms for Inverse Problems in Science and Engineering, Springer, New York, 345-390. https://doi.org/10.1007/978-1-4419-9569-8_17

7. Zhao, X., Ng, K.F., Li, C. and Yao, J.C. (2018) Linear Regularity and Linear Convergence of Projection-Based Methods for Solving Convex Feasibility Problems. Applied Mathematics and Optimization, 78, 613-641. https://doi.org/10.1007/s00245-017-9417-1

8. Chang, S.S., Liu, M., Zhao, L.C. and Tang, J.F. (2019) A Modified Hybrid Algorithm for Solving a Composite Minimization Problem in Banach Spaces. Journal of Nonlinear and Variational Analysis, 3, 357-364. https://doi.org/10.23952/jnva.3.2019.3.09

9. Cho, S.Y., Qin, X. and Wang, L. (2014) Strong Convergence of a Splitting Algorithm for Treating Monotone Operators. Fixed Point Theory and Applications, 2014, Article No. 94. https://doi.org/10.1186/1687-1812-2014-94

10. Guo, Y. and Cui, W. (2018) Strong Convergence and Bounded Perturbation Resilience of a Modified Proximal Gradient Algorithm. Journal of Inequalities and Applications, 2018, Article No. 103. https://doi.org/10.1186/s13660-018-1695-x

11. Liu L. ,et al. (2019)A Hybrid Steepest Descent Method for Solving Split Feasibility Problems Involving Nonexpansive Mappings Journal of Nonlinear and Convex Analysis 20, 471-488.

12. Sabach, S. and Shtern, S. (2017) A First Order Method for Solving Convex Bi-Level Optimization Problems. SIAM Journal on Optimization, 27, 640-660. https://doi.org/10.1137/16M105592X

13. Cholamjiak, P., Abdou, A.A. and Cho, Y.J. (2015) Proximal Point Algorithms Involving Fixed Points of Nonexpansive Mappings in CAT(0) Spaces. Fixed Point Theory and Applications, 2015, Article No. 227.https://doi.org/10.1186/s13663-015-0465-4

14. Chang S.S., Wang X.R., Liu M., Zhao L.C. and Qin. L.J. ,et al. (2019)A Modified Proximal Point Algorithm Involving Fixed Points for k-Strictly Pseudononspreading Mappings in Hadamard Spaces Journal of Nonlinear and Variational Analysis 20, 1647-1658.

15. Ariza-Ruiz, D., Leustean, L. and Lopez-Acedo, G. (2014) Firmly Nonexpansive Mappings in Classes of Geodesic Spaces. Transactions of the American Mathematical Society, 366, 4299-4322. https://doi.org/10.1090/S0002-9947-2014-05968-0

16. Bačák, M. (2013) The Proximal Point Algorithm in Metric Spaces. Israel Journal of Mathematics, 194, 689-701. https://doi.org/10.1007/s11856-012-0091-3

17. Dhompongsa, S. and Panyanak, B. (2008) On Δ-Convergence Theorems in CAT(0) Spaces. Computers & Mathematics with Applications, 56, 2572-2579.https://doi.org/10.1016/j.camwa.2008.05.036

18. Khan, S.H. and Abbas, M. (2011) Strong and Δ-Convergence of Some Iterative Schemes in CAT(0) Spaces. Computers & Mathematics with Applications, 61, 109-116. https://doi.org/10.1016/j.camwa.2010.10.037

19. Lim, T.C. (1976) Remarks on Some Fixed Point Theorems. Proceedings of the American Mathematical Society, 60, 179-182. https://doi.org/10.1090/S0002-9939-1976-0423139-X

20. Berg, I.D. and Nikolaev, I.G. (2008) Quasilinearization and Curvature of Alexandrov Spaces. Geometriae Dedicata, 133, 195-218.https://doi.org/10.1007/s10711-008-9243-3

21. Bauschke, H.H. and Combettes, P.L. (2011) Convex Analysis and Monotone Operator Theory in Hilbert Spaces. CMS Books in Mathematics, Springer, Berlin. https://doi.org/10.1007/978-1-4419-9467-7

22. Izuchukwu, C., Aremu, K.O., Oyewole, O.K., Mewomo, O.T. and Khan, S.H. (2019) On Mixed Equilibrium Problems in Hadamard Spaces. Journal of Mathematics, 2019, Article ID: 3210649. https://doi.org/10.1155/2019/3210649