An exact viscosity solution to a Hamilton–Jacobi–Bellman quasi-variational inequality for animal population management

Abstract

We formulate a stochastic impulse control model for animal population management and a candidate of exact solutions to a Hamilton–Jacobi–Bellman quasi-variational inequality. This model has a qualitatively different functional form of the performance index from the existing monotone ones. So far, optimality and unique solvability of the Hamilton–Jacobi–Bellman quasi-variational inequality has not been investigated, which are thus addressed in this paper. We present a candidate of exact solutions to the Hamilton–Jacobi–Bellman quasi-variational inequality and prove its optimality and unique solvability within a certain class of solutions in a viscosity sense. We also present and examine a dynamical system-based numerical method for computing coefficients in the exact solutions.

1 Introduction

This paper focuses on mathematical analysis of an exact viscosity solution to Hamilton–Jacobi–Bellman quasi-variational inequality arising in an animal population management problem. Our problem, despite it is relatively simple, is important from mathematical, environmental and ecological engineering standpoints since many management problems can be described and/or analyzed with mathematical tools focused on in our paper. Our results are mathematical ones but providing a background of the problem is important for understanding it. Hence, we firstly describe the problem background in this section.

Management of animal population, such as fishery resources and their predators, is an important ecological problem. Such examples include aquaculture of Plecoglossus altivelis (P. altivelis, Ayu) in Japan [1], extermination of its predator bird Phalacrocorax carbo (P. carbo, Great cormorant) [2, 3], agricultural crops damage by a wild boar Sus scrofa in Europe [4], and feeding damage from many insects to soybean seeds [5]. Recently, fish-eating bird P. carbo population has been increasing worldwide, such as in Japan [6], Europe [7], North America [8], and Greenland [9]. The increase of the population causes several problems. In Japan, feeding damage from fish-eating birds, such as P. carbo, to inland fishery resources, has been increasing and is currently one of the most severe problems to be solved [6]. Cost-effective and ecologically-sound bird population management policy is required for effective reduction of the feeding damage.

Stochastic optimal control theory [10] has been applied to population and resource management problems [1, 11,12,13,14]. In reality, there are fixed costs besides proportional costs when some interventions are performed for management of animal population. Stochastic impulse control theory serves as an effective mathematical tool for dealing with this issue [14,15,16,17] and has been applied to many problems, such as finance and economics [18,19,20], and animal population management by the authors [21].

Finding an optimal control policy in the context of stochastic impulse control reduces to solving a Hamilton–Jacobi–Bellman quasi-variational inequality (HJBQVI), a degenerate elliptic or parabolic differential inequality. Many researchers have investigated mathematical properties of HJBQVIs. In Cadenillas [17], the performance index is quadratic monomial (convex). He proposed a candidate of the exact solution to the HJBQVI and proved a verification theorem and that the exact solution satisfies the HJBQVI. Existence and uniqueness of exact solutions has not been proved. In Ohnishi and Tsujimura [15] and Øksendal [21], the performance index is quadratic monomial (convex). They proposed a candidate of the exact solution to the HJBQVI and proved a verification theorem, existence and uniqueness of the exact solution, and that it satisfies the HJBQVI. Note that in Ohnishi and Tsujimura [15], the cost function is quadratic unlike those of Cadenillas [17], Øksendal [21], and this paper. In addition, viscosity solutions are appropriate weak solutions for degenerate elliptic and parabolic equations [22,23,24], and are appropriate solutions to HJBQVIs.

Recently, Yaegashi et al. [3] proposed an optimal control model for cost-effective and sustainable management of P. carbo and a candidate of its exact viscosity solution to a HJBQVI. This model has a different performance index from those in the above-mentioned literature. However, existence and uniqueness of the solution, and its optimality namely the verification, have not been discussed so far. If we could give an answer on the above-mentioned problems about the exact solution, the solution and the associated optimal policy can establish a firm position as a reasonable mathematical tool. This is the motivation of this paper.

The objectives of this paper are thus to formulate the stochastic impulse control model of an animal population management, to present a candidate of the exact solutions to a HJBQVI, and to prove its optimality and unique solvability within a certain class of solutions from a viscosity viewpoint. The novelty of this paper against the previous studies from Cadenillas [17], Ohnishi and Tsujimura [15], and Øksendal [21] is the point that our performance index is based on a concave polynomial as a sum of two monomials. Our performance index is therefore not based on monotone functions as in the above-mentioned models. We also propose and examine a numerical method to compute the coefficients of the exact solution.

The rest of this paper consists of 4 Sections and 3 Appendices. Section 2 introduces our model. Section 3 provides the exact solution. Section 4 concerns mathematical analysis of the exact solution. Section 5 presents and examines the numerical method. Section 6 concludes this paper. Appendix A contains the proofs of lemmas in Sects. 2 and 4. Appendix B contains the proofs of Theorems 4.2 and 4.3. Finally, Appendix C presents the proof of Theorem 5.1.

2 Mathematical model: our method

Our aim is mathematical and numerical analysis on a recent population management problem with an emphasis of viscosity solutions. This section presents our mathematical approach and derives basic properties of the present mathematical model.

2.1 Population dynamics

An infinite-horizon management problem of an animal population in a habitat is considered [21]. We assume that the decision-maker, the manager of the animal population, can reduce the animal population through intervention, and also assume that they are carried out in a much shorter timescale than that of the animal population dynamics, so that the impulsive control formalism is justified. The population in the habitat at the time t is denoted as $X_{t}$, which is governed by a stochastic differential equation (SDE) with the fluctuation term defined in the Itô’s sense:

$$ \textstyle\begin{cases} \,\mathrm{d}X_{t} = X_{t} ( \mu \,\mathrm{d}t + \sigma \,\mathrm{d}B_{t} ), & \tau_{i} \le t < \tau_{i + 1} \\ X_{\tau} = X_{\tau_{i -}} - \zeta_{i}, \end{cases}\displaystyle \quad \mbox{with an initial condition } X_{0 -} > 0, $$

(1)

where $\mu > 0$ is the intrinsic growth rate, $\sigma > 0$ is the magnitude of stochastic fluctuation involved in the population dynamics, $B_{t}$ is the 1-D standard Brownian motion defined on a usual complete probability space [25], $\tau_{i}$ ($i = 0,1,2, \ldots$ , $\tau_{0} = 0$) is the time when the intervention is performed to reduce the population and $\zeta_{i} > 0$ represents the magnitude of the intervention, the total population of the killed animal, at the time $\tau_{i}$. Whenever the intervention is performed, we assume the cost

$$ K ( \zeta_{i} ) = k_{1}\zeta_{i} + k_{0} \quad ( \zeta_{i} > 0 ) $$

(2)

where $k_{1} > 0$ is the cost proportional to $\zeta_{i}$ and $k_{0} > 0$ is the fixed cost incurred regardless of $\zeta_{i}$. In this model, both the timing $\tau_{i}$ and the magnitude of the intervention $\zeta_{i}$ are the control variables to be optimized.

2.2 Performance index

The performance index J is the expected net profit of the decision-maker subject to a discount:

$$ J ( x;\eta ) = \mathrm{E} \Biggl[ \int_{0}^{\infty} e^{ - \delta s} \bigl( RX_{s}^{M} - rX_{s}^{m} \bigr)\, \mathrm{d}s - \sum_{i = 0}^{\infty} e^{ - \delta \tau_{i}}K ( \zeta_{i} ) \Biggr] $$

(3)

with

$$ 0 < M < 1 < m < 2, $$

(4)

where $\delta > 0$ is the discount rate, and R, r, M and m are the positive constants. In the right-hand side of (3), the term $RX_{s}^{M}$ represents the ecological utility provided by the existence of the animal, the term $- rX_{s}^{m}$ represents the disutility by the existence of the animal, and the last summation term is the cost of the intervention. The net profit $RX_{s}^{M} - rX_{s}^{m}$ is not monotone but concave with respect to $X_{s}$. The relationship (4) means that the increase rate of the disutility by the existence of the animal is higher than that of the utility by the existence of the animal, and the condition $0 < M < 1$ in (4) intrinsically means that the ecological services drastically change between the states where the population exists and where the population does not exist. This consideration is represented by the divergence of the derivative of $RX_{s}^{M}$ with respect to $X_{s}$ at the origin $X_{s} = 0$.

Here, η represents the management policy defined by the timing and magnitude of the intervention

$$ \eta = ( \tau_{i},\zeta_{i} )_{i \ge 0} $$

(5)

and is called an admissible control if it satisfies the conditions stated in Definition 2.1 in Onishi and Tsujimura [15], which are listed up in what follows:

$$\begin{aligned}& 0 \le \tau_{i} < \tau_{i + 1},\quad \mbox{a.s. }i \ge 0, \end{aligned}$$

(6)

$$\begin{aligned}& \tau_{i}\mbox{ is an } \{ \mathcal {F}_{t} \}_{t \ge 0}\mbox{ stopping time},\quad i \ge 0, \end{aligned}$$

(7)

$$\begin{aligned}& \zeta_{i}\mbox{ is }\mathcal {F}_{\tau_{i}}\mbox{ measurable},\quad i \ge 0, \end{aligned}$$

(8)

$$\begin{aligned}& P \Bigl[ \lim_{i \to \infty} \tau_{i} \le T \Bigr] = 0,\quad \forall T \in [ 0,\infty ), \end{aligned}$$

(9)

and

$$ X_{t} \ge 0,\qquad t \ge 0. $$

(10)

2.3 Hamilton–Jacobi–Bellman quasi-variational inequality

Let $\mathfrak{A}$ be the set of the admissible controls. The objective of the decision-maker is to find the optimal control $\eta^{ *}$ such that

$$ V ( x ) = \sup_{\eta \in \mathfrak{A}}J ( x;\eta ) = J \bigl( x; \eta^{*} \bigr), $$

(11)

where $V = V ( x )$ is the maximized performance index referred to as the value function. The dynamic programming principle [10] leads to a HJBQVI [14,15,16,17], which is hereafter simply referred to as the HJBQVI, as

$$ \min \bigl\{ - \mathcal{L}V - Rx^{M} + rx^{m},V - \mathcal {M}V \bigr\} = 0,\quad x > 0 $$

(12)

with the differential operator $\mathcal{L}$ and the intervention operator $\mathcal {M}$ defined as

$$ \mathcal{L}W = \frac{1}{2}\sigma^{2}x^{2} \frac{\mathrm{d}^{2}W}{\mathrm{d}x^{2}} + \mu x\frac{\mathrm{d}W}{\mathrm{d}x} - \delta W $$

(13)

and

$$ \mathcal {M}W = \sup_{\zeta > 0} \bigl[ - K ( \zeta ) + W ( x - \zeta ) \bigr], $$

(14)

respectively, for generic sufficiently smooth $W = W ( x )$. The boundary condition for the HJBQVI is $V ( 0 ) = 0$, which means that no problem arises when there is no population. The left part in “min” operator in the HJBQVI (12) corresponds to the situation where no intervention should be performed, while the right part corresponds to the situation where the intervention should be performed immediately. The following lemma gives the upper and lower bound of V. The lemma shows that the value function is locally bounded.

Lemma 2.1

$$ A_{1}x^{M} + A_{2}x^{m} \le V ( x ) \le A_{1}x^{M},\quad x \ge 0. $$

(15)

Proofs of all lemmas and theorems in the paper are in Appendices for the sake of brevity of the main body. In what follows, solutions to the HJBQVI complying with the condition (15) are explored.

2.4 Optimal control

Under the QVI controls (Definition 3.2 in Cadenillas [17])

$$\begin{aligned}& ( \tau_{0},\zeta_{0} ) = ( 0,0 ), \end{aligned}$$

(16)

$$\begin{aligned}& \tau_{i} = \inf \bigl\{ t > \tau_{i - 1}:V ( X_{t} ) = \mathcal {M}V ( X_{t} ) \bigr\} ,\quad i \ge 0, \end{aligned}$$

(17)

and

$$ \zeta_{i} = \arg \sup_{\omega > 0} \bigl\{ - K ( \omega ) + V ( X_{\tau_{i}} - \omega ):\omega \in \mathbb{R},X_{\tau_{i}} - \omega \in ( 0,\infty ) \bigr\} ,\quad i \ge 0, $$

(18)

the following threshold-type management policy with the threshold values x̄ and $\underline{x}$ ($\bar{x} > \underline{x}$) is found to be optimal (Verification theorem, Theorem 3.1 in Cadenillas [17]):

• (A) If $X_{t -} < \bar{x}$, then no intervention is performed. If $X_{t -} = \bar{x}$, the intervention is immediately performed and $X_{t -}$ is reduced to $\underline{x}$ ($X_{t} = \underline{x}$).

• (B) If $X_{0 -} > \bar{x}$, then $X_{0 -}$ is immediately reduced to $\underline{x}$ ($X_{0} = \underline{x}$) by the intervention, and follows (A).

With the thresholds x̄ and $\underline{x}$, the optimal amount of the intervention $\zeta^{ *}$ is

$$ \zeta^{ *} = \textstyle\begin{cases} x - \underline{x}& ( x \ge \bar{x} )\\ 0& ( x < \bar{x} ) \end{cases} $$

(19)

A sample path of the process $X_{t}$ following the above-mentioned policy is plotted in Fig. 1. Note that Cadenillas [17] proved the verification theorem (Theorem 3.1 in the literature), which states that the solution to HJBQVI (12) under the QVI control (16) through (18) is in fact the value function (11) and the QVI control is the optimal impulse control. Thus, if we could solve the HJBQVI (12), then we are able to obtain the optimal impulse control.

Figure 1

The process $X_{t}$ under the optimal management policy is blue line. The thresholds are $\bar{x} = 2$ (red line) and $\underline{x} = 1$ (pink line). The optimal magnitude of the killed animal $\zeta_{i}$ is shown as green line

3 Results and discussion on an exact solution

In this section, we present a candidate of the solution to the HJBQVI (12), which later turns out to be a viscosity solution. We assume the following conditions to derive a non-trivial exact viscosity solution [10]:

$$\begin{aligned}& \mu > \sigma^{2}/2, \end{aligned}$$

(20)

$$\begin{aligned}& \delta - \mu m - 0.5\sigma^{2}m ( m - 1 ) > 0, \end{aligned}$$

(21)

and

$$ \beta = \frac{1}{2} \biggl( 1 - \frac{2\mu}{\sigma^{2}} + \sqrt{ \biggl( \frac{2\mu}{\sigma^{2}} - 1 \biggr)^{2} + \frac{8\delta}{\sigma^{2}}} \biggr) ( > 2 ). $$

(22)

The inequality (20) means that the animal population does not become extinct without interventions. The relationship (21) and (22) means that the decision-maker manages the animal population from the sufficiently long-term perspectives.

Here, a formal exact solution to the HJBQVI (12) is presented, which is inspired from the impulse control models in the literature [15, 17, 21]. Let V̄ be a candidate of the solution to the HJBQVI (12). At first, we consider the situation with $x < \bar{x}$, under which no intervention should be performed. In the HJBQVI (12), the equality [26]

$$ \mathcal{L}\bar{V} + Rx^{M} - rx^{m} = 0 $$

(23)

has a solution

$$ \bar{V} ( x ) = a_{1}x^{\beta_{ +}} + a_{2}x^{\beta_{ -}} + A_{1}x^{M} + A_{2}x^{m}, $$

(24)

where

$$\begin{aligned}& \beta_{ \pm} = \frac{1}{2} \biggl( 1 - \frac{2\mu}{\sigma^{2}} \pm \sqrt{ \biggl( \frac{2\mu}{\sigma^{2}} - 1 \biggr)^{2} + \frac{8\delta}{ \sigma^{2}}} \biggr), \end{aligned}$$

(25)

$$\begin{aligned}& A_{1} = R \biggl[ \delta - \mu M - \frac{\sigma^{2}}{2}M ( M - 1 ) \biggr]^{ - 1} > 0, \end{aligned}$$

(26)

and

$$ A_{2} = - r \biggl[ \delta - \mu m - \frac{\sigma^{2}}{2}m ( m - 1 ) \biggr]^{ - 1} < 0. $$

(27)

In (24), $a_{1}x^{\beta_{ +}} + a_{2}x^{\beta_{ -}}$ is the general solution to $\mathcal{L}\bar{V} = 0$ and $A_{1}x^{M} + A_{2}x^{m}$ is a particular solution to (23). Assume $a_{2} \ne 0$, then we have $\lim_{x \to + 0}a_{2}x^{\beta_{ -}} = \pm \infty$ since $\beta_{ -} < 0$. However, this contradicts the boundary condition $\bar{V} ( 0 ) = 0$. Hence, $a_{2} = 0$ holds. At last, the solution (24) becomes

$$ \bar{V} ( x ) = ax^{\beta} + A_{1}x^{M} + A_{2}x^{m}, $$

(28)

where the notations $a_{1} = a$ and $\beta_{ +} = \beta$ are used.

For $x \ge \bar{x}$ where the intervention should be performed immediately, by the HJBQVI (12), the condition

$$ \begin{aligned}[b] \bar{V} ( x ) &= - k_{1} ( x - \underline{x} ) - k_{0} + \bar{V} ( \underline{x} ) \\ &= - k_{1} ( x - \underline{x} ) - k_{0} + a \underline{x}^{\beta} + A_{1}\underline{x}^{M} + A_{2}\underline{x}^{m} \end{aligned} $$

(29)

has to be satisfied. Consequently, a candidate of solutions to HJBQVI (12) is found as

$$ \bar{V} ( x ) = \textstyle\begin{cases} ax^{\beta} + A_{1}x^{M} + A_{2}x^{m}& ( x < \bar{x} ), \\ - k_{1} ( x - \underline{x} ) - k_{0} + a\underline{x}^{\beta} + A_{1}\underline{x}^{M} + A_{2}\underline{x}^{m}& ( x \ge \bar{x} ), \end{cases} $$

(30)

where a, x̄ and $\underline{x}$ are unknown at this stage.

Assume the following condition in the solution $\bar{V} ( x )$ to determine its unknown coefficients [15, 16]:

• (a) Continuity of $\bar{V} ( x )$ at $x = \bar{x}$ (Value matching),

• (b) Continuity of $\bar{V}' ( x )$ at $x = \bar{x}$ (Smooth pasting),

• (c) Optimality of the thresholds x̄ and $\underline{x}$ in (14).

Firstly, by (a), we have

$$ \bar{V} ( \bar{x} ) = - k_{1} ( \bar{x} - \underline{x} ) - k_{0} + \bar{V} ( \underline{x} ). $$

(31)

By (b), we have

$$ \begin{aligned}[b] \bar{V}' ( \bar{x} ) &= \lim _{x \downarrow \bar{x}}\frac{\mathrm{d}}{\mathrm{d}x} \bigl\{ - k_{1} ( x - \underline{x} ) - k_{0} + \bar{V} ( \underline{x} ) \bigr\} \\ &= - k_{1} \end{aligned}. $$

(32)

Finally, by (c)

$$ \bar{V} ( \bar{x} ) = \sup_{y > 0} \bigl\{ - k_{1} ( \bar{x} - y ) - k_{0} + \bar{V} ( y ) \bigr\} , $$

(33)

namely, we have

$$ \frac{\mathrm{d}}{\mathrm{d}y} \bigl[ - k_{1} ( \bar{x} - y ) - k_{0} + \bar{V} ( y ) \bigr] |_{y = \underline{x}} = 0 $$

(34)

holds. Substituting (28) into (31), (32), and (34), the following system of nonlinear equations governing the coefficients is derived:

$$ \textstyle\begin{cases} a\bar{x}^{\beta} + A_{1}\bar{x}^{M} + A_{2}\bar{x}^{m} = - k_{1} ( \bar{x} - \underline{x} ) - k_{0} + a\underline{x}^{\beta} + A_{1}\underline{x}^{M} + A_{2}\underline{x}^{m}, \\ a\beta \bar{x}^{\beta - 1} + A_{1}M\bar{x}^{M - 1} + A_{2}m\bar{x}^{m - 1} = - k_{1}, \\ a\beta \underline{x}^{\beta - 1} + A_{1}M\underline{x}^{M - 1} + A_{2}m\underline{x}^{m - 1} = - k_{1}, \end{cases} $$

(35)

where a, x̄ and $\underline{x}$ are unknown. According to the conditions (a) and (b), the solution (30) is $\bar{V} ( x ) \in C^{1} ( 0,\infty )$ and is twice differentiable except at $x = \bar{x}$; namely, we have $\bar{V} ( x ) \in C^{2} ( ( 0,\bar{x} ) \cup ( \bar{x},\infty ) )$. Thus, the solution $\bar{V} ( x )$ is not a classical solution but a solution a.e.

For a, we have the following lemma, which immediately follows from the functional form of the exact solution (30) and Lemma 2.1. The following lemma is useful for determining the sign of the unknown coefficient involved in V̄.

Lemma 3.1

For a in (30), we have $a \ge 0$.

4 Discussion on the system of nonlinear equations

4.1 Existence and uniqueness

In this subsection, we prove unique solvability of the system of nonlinear Eqs. (35) based on an analytical approach, which is inspired from the arguments in the literatures [15, 21]. Because our performance index contains a sum of two monomials of X, which is different from those in the literature, their procedure cannot be directly applied to our problem. The main objective of this section is to prove the following theorem that guarantees unique existence of the triplet of the unknown coefficients, with which we can completely determine V̄.

Theorem 4.1

There exists a unique triplet $( a,\bar{x},\underline{x} )$ to the system of nonlinear equations (35).

Theorem 4.1 is proved in a step by step approach using a series of lemmas. Lemma 4.1 sharpens the result of Lemma 3.1.

Lemma 4.1

For a in (30), we have $a \ne 0$.

According to Lemmas 3.1 and 4.1, we can assume $a > 0$. With a fixed a, define the function g as

$$ g ( x ) = a\beta x^{\beta - 1} + A_{1}Mx^{M - 1} + A_{2}mx^{m - 1} + k_{1} $$

(36)

whose first derivative is

$$ g' ( x ) = a\beta ( \beta - 1 )x^{\beta - 2} + A_{1}M ( M - 1 )x^{M - 2} + A_{2}m ( m - 1 )x^{m - 2}. $$

(37)

Lemma 4.2 presents a technical result on qualitative shape of $g'$.

Lemma 4.2

$g' ( x ) = 0$ has a unique zero $x = \hat{x}$ such that $0 < \hat{x} < \infty$.

Hereafter, we denote the unique x̂ in Lemma 4.2 as $\hat{x} = \hat{x} ( a )$ to indicate its dependence on a. We show dependence of $\hat{x} ( a )$ on a in the next lemma. The lemma indicates a monotone property of $\hat{x} ( a )$.

Lemma 4.3

$$ \frac{\mathrm{d}\hat{x}}{\mathrm{d}a} < 0\quad \textit{for } a > 0. $$

(38)

Next, we consider the profile of $g ( x )$. The following lemma demonstrates that g is unimodal.

Lemma 4.4

$g ( x )$ monotonically decreases for $0 < x < \hat{x}$, takes its extremum at x̂, and monotonically increases for $\hat{x} < x < \infty$. In addition, $\lim_{x \to 0}g' ( x ) = - \infty$ and $\lim_{x \to \infty} g' ( x ) = \infty$. See also Table 1.

Table 1 Profile of $g ( x )$

The proof is omitted since it is by a direct calculation. In fact, by $g' ( \hat{x} ) = 0$, we have

$$ g ( \hat{x} ) = a\beta \frac{m - \beta}{m - 1}\hat{x}^{\beta - 1} + A_{1}M\frac{m - M}{m - 1}\hat{x}^{M - 1} + k_{1}. $$

(39)

Thus, for a such that

$$ g ( \hat{x} ) = a\beta \frac{m - \beta}{m - 1}\hat{x}^{\beta - 1} + A_{1}M\frac{m - M}{m - 1}\hat{x}^{M - 1} + k_{1} < 0, $$

(40)

there are two solutions to $g ( x ) = 0$, $x = \underline{x} ( a )$ and $x = \bar{x} ( a )$. Note that $\underline{x}$, x̂, and x̄ have to satisfy

$$ 0 < \underline{x} ( a ) < \hat{x} ( a ) < \bar{x} ( a ) < \infty. $$

(41)

It will turn out later that the inequality (40) is satisfied under without any additional conditions. Thus, hereafter, we assume (40).

In the next lemma, we show dependence of $\underline{x} ( a )$ and $\bar{x} ( a )$ on a. They are monotone with respect to a.

Lemma 4.5

$$ \frac{\mathrm{d}\underline{x}}{\mathrm{d}a} > 0 \quad \textit{and}\quad \frac{\mathrm{d}\bar{x}}{\mathrm{d}a} < 0\quad \textit{for }a > 0. $$

(42)

Next, we consider the upper bound of a with which the above-mentioned $\underline{x}$ and x̄ exist. Such an upper bound is denoted as â.

The next lemma shows that this upper bound in fact exists.

Lemma 4.6

There exists an upper bound of a with which $\underline{x}$ and x̄ exist.

Hereafter, we represent the range of a as $0 < a < \hat{a} ( k_{1} )$ to indicate its dependence on $k_{1}$. Now, we prove that the pended inequality (40) is satisfied without any additional conditions.

Lemma 4.7

The inequality (40) is satisfied without any additional conditions to $k_{1}$. Thus, there exist unique x̄ and $\underline{x}$ which solve the system of nonlinear equations (35).

Now, we can prove uniqueness and existence of a.

Lemma 4.8

There exists a unique coefficient a solving the system of nonlinear equations (35) at least if $k_{0}$ is sufficiently small.

We prove that the uniqueness and existence hold true also for not small $k_{0}$.

Lemma 4.9

There exists a unique $a^{ *}$ such that $F ( a^{ *} ) = 0$ and $0 < a^{ *} < \hat{a}$ solving (35). Here, $F ( a )$ is the left hand side of (98).

Finally, from Lemmas 4.7 and 4.9, Theorem 4.1 immediately follows.

4.2 Optimality of the exact solution

Uniqueness of the exact solutions of the form (30) was proved in the previous sub-section. In this subsection, we show that the candidate of the solutions satisfies the HJBQVI (12). Let $ax^{\beta} + A_{1}x^{M} + A_{2}x^{m}$ be $\bar{V}_{l} ( x )$ and $- k_{1} ( x - \underline{x} ) - k_{0} + a\underline{x}^{\beta} + A_{1}\underline{x}^{M} + A_{2}\underline{x}^{m}$ be $\bar{V}_{r} ( x )$. By

$$ \bar{V}_{l} ( \bar{x} ) = \bar{V}_{l} ( \underline{x} ) - k_{1} ( \bar{x} - \underline{x} ) - k_{0}, $$

(43)

the exact solution (30) is rewritten as

$$ \bar{V} ( x ) = \textstyle\begin{cases} \bar{V}_{l} ( x )& ( x < \bar{x} ),\\ \bar{V}_{r} = \bar{V}_{l} ( \bar{x} ) - k_{1} ( x - \bar{x} )& ( x \ge \bar{x} ). \end{cases} $$

(44)

The following technical lemma is on the profile of V̄, necessary to consider property of V̄.

Lemma 4.10

$$ \bar{V}_{l}^{\prime} ( x ) \textstyle\begin{cases} > - k_{1},& 0 < x < \bar{x}, \bar{x} < x, \\ = - k_{1},& x = \bar{x}, \underline{x}, \\ < - k_{1},&\underline{x} < x < \bar{x}. \end{cases} $$

(45)

With the help of Lemma 4.10, we show that the candidate solution actually satisfies the HJBQVI (12).

Theorem 4.2

The exact solution (30) satisfies the HJBQVI (12) a.e. for $x \ge 0$.

According to Theorem 4.2, hereafter, we do not distinguish the candidate of the solutions to HJBQVI (30) and the value function (11). Namely, we have

$$ V = \bar{V}. $$

(46)

Next, we prove a mathematical property of the exact solution (30). We prove that the exact solution (30) is a viscosity solution [10], which is an appropriate weak solution to degenerate elliptic and parabolic differential equations. The definition of viscosity solution is as follows.

Definition 4.1

Viscosity super-solution

A function $V \in C [ 0,\infty )$ such that $V ( 0 ) \ge 0$ satisfying (15) is a viscosity super-solution to the HJBQVI (12) if

$$ \min \bigl\{ - \mathcal{L}v ( x ) - Rx^{M} + rx^{m},v ( x ) - \mathcal {M}v ( x ) \bigr\} \ge 0 $$

(47)

for all $x \in ( 0,\infty )$ and for all $v \in C^{2} ( [ 0,\infty ) )$ such that $v ( x ) = V ( x )$ and locally $v \le V$ near x.

Viscosity sub-solution

A function $V \in C [ 0,\infty )$ such that $V ( 0 ) \le 0$ satisfying (15) is a viscosity sub-solution to the HJBQVI (12) if

$$ \min \bigl\{ - \mathcal{L}v ( x ) - Rx^{M} + rx^{m},v ( x ) - \mathcal {M}v ( x ) \bigr\} \le 0 $$

(48)

for all $x \in ( 0,\infty )$ and for all $v \in C^{2} ( [ 0,\infty ) )$ such that $v ( x ) = V ( x )$ and locally $v \ge V$ near x.

Viscosity solution

A function $V \in C [ 0,\infty )$ such that $V ( 0 ) = 0$ satisfying (15) is a viscosity solution to the HJBQVI (12) if it is a viscosity super-solution as well as a viscosity sub-solution.

Viscosity property of the constructed exact solution is checked through Definition 4.1.

Theorem 4.3

The exact solution (30) is a viscosity solution to the HJBQVI (12).

From Theorems 4.1, 4.2, and 4.3, we can prove the following theorem, the most important theorem in this paper.

Theorem 4.4

The value function is the exact viscosity solution (30) to the HJBQVI (12) whose coefficients are uniquely determined from (35). Therefore, the solution of the form (30) is unique.

5 Numerical method for computing the coefficients

In the previous section, we showed that the coefficients $( a,\underline{x},\bar{x} )$ are found uniquely; however, their exact values cannot be calculated analytically. We found that a dynamical system-based approach can be used for approximating the coefficients in a stable manner. The numerical method is presented and its convergence is analyzed, and its performance is examined in this section.

5.1 Dynamical system

Subtracting the middle equation in (35) from the below equation in (35) and solving for a yields

$$ a = \frac{ - A_{1}M ( \bar{x}^{M - 1} - \underline{x}^{M - 1} ) - A_{2}m ( \bar{x}^{m - 1} - \underline{x}^{m - 1} )}{\beta ( \bar{x}^{\beta - 1} - \underline{x}^{\beta - 1} )}. $$

(49)

Substituting (49) into the middle equation of (35) leads to

$$ \begin{aligned}[b] &k_{1} + \biggl[ \frac{ - A_{1}M ( \bar{x}^{M - 1} - \underline{x}^{M - 1} ) - A_{2}m ( \bar{x}^{m - 1} - \underline{x}^{m - 1} )}{\beta ( \bar{x}^{\beta - 1} - \underline{x}^{\beta - 1} )} \biggr]\beta \bar{x}^{\beta - 1}\\ &\quad {}+ A_{1}M\bar{x}^{M - 1} + A_{2}m \bar{x}^{m - 1} = 0, \end{aligned} $$

(50)

and substituting (49) into the above equation of (35) then yields

$$ \begin{aligned}[b] &{-} k_{1} ( \bar{x} - \underline{x} ) - k_{0} + A_{1} \bigl( \underline{x}^{M} - \bar{x}^{M} \bigr) + A_{2} \bigl( \underline{x}^{m} - \bar{x}^{m} \bigr) \\ &\quad {}+ \biggl[ \frac{ - A_{1}M ( \bar{x}^{M - 1} - \underline{x}^{M - 1} ) - A_{2}m ( \bar{x}^{m - 1} - \underline{x}^{m - 1} )}{\beta ( \bar{x}^{\beta - 1} - \underline{x}^{\beta - 1} )} \biggr] \bigl( \underline{x}^{\beta} - \bar{x}^{\beta} \bigr) = 0 \end{aligned}. $$

(51)

By numerically solving the nonlinear Eqs. (50) and (51), x̄ and $\underline{x}$ would be found. In this paper, the nonlinear Eqs. (50) and (51) with an artificial temporal term are proposed as the system of ODEs, a dynamical system, as

$$ \frac{\mathrm{d}\boldsymbol{x}}{\mathrm{d}t} = \boldsymbol{f} ( \boldsymbol{x} )\quad \mbox{with } \boldsymbol{x} = \begin{pmatrix} \bar{x} \\ \underline{x} \end{pmatrix}, $$

(52)

where

$$ \begin{aligned}[b] \boldsymbol{f} ( \boldsymbol{x} )& = \begin{pmatrix} f_{1} ( \bar{x},\underline{x} ) \\ f_{2} ( \bar{x},\underline{x} ) \end{pmatrix} \\ &= \begin{pmatrix} k_{1} ( \bar{x} - \underline{x} ) + k_{0} - h ( \underline{x}^{\beta} - \bar{x}^{\beta} ) - A_{1} ( \underline{x}^{M} - \bar{x}^{M} ) - A_{2} ( \underline{x}^{m} - \bar{x}^{m} ) \\ k_{1} + h\beta \bar{x}^{\beta - 1} + A_{1}M\bar{x}^{M - 1} + A_{2}m\bar{x}^{m - 1} \end{pmatrix} \end{aligned} $$

(53)

and

$$ h ( \bar{x},\underline{x} ) = \frac{ - A_{1}M ( \bar{x}^{M - 1} - \underline{x}^{M - 1} ) - A_{2}m ( \bar{x}^{m - 1} - \underline{x}^{m - 1} )}{\beta ( \bar{x}^{\beta - 1} - \underline{x}^{\beta - 1} )}. $$

(54)

Let $\bar{x} = \bar{x}^{ *}$ and $\underline{x} = \underline{x}^{ *}$ satisfy (35). Then, we have

$$ h \bigl( \bar{x}^{ *},\underline{x}^{ *} \bigr) = a. $$

(55)

The system (52) is numerically integrated until the quasi-steady state is attained with the forward Euler method. The coefficient a can be calculated with (54) using the obtained $\bar{x}^{ *}$ and $\underline{x}^{ *}$. Thus, $V ( x )$ (30) can be obtained. Note that there is a unique equilibrium point in the system (52) by Theorem 4.1 under the assumptions (20) through (22).

5.2 Stability of the equilibrium point

Based on the following easy but pivotal lemma, local stability of the equilibrium point $( \bar{x}^{ *},\underline{x}^{ *} )$ is investigated.

Lemma 5.1

A $2 \times 2$ matrix A is locally asymptotically stable if and only if

$$ \operatorname{tr} A < 0 \quad \textit{and}\quad \det A > 0. $$

(56)

Let the Jacobian at $( \bar{x},\underline{x} )$ be

$$ A = \begin{pmatrix} \frac{\partial f_{1}}{\partial \bar{x}} ( \bar{x},\underline{x} ) & \frac{\partial f_{1}}{\partial \underline{x}} ( \bar{x},\underline{x} ) \\ \frac{\partial f_{2}}{\partial \bar{x}} ( \bar{x},\underline{x} ) & \frac{\partial f_{2}}{\partial \underline{x}} ( \bar{x},\underline{x} ) \end{pmatrix}. $$

(57)

By Lemma 5.1, the following theorem shows local stability of our dynamical system, supporting our approach to find the unknown coefficients through solving the dynamical system.

Theorem 5.1

The equilibrium point $( \bar{x}^{ *},\underline{x}^{ *} )$ in (52) is locally asymptotically stable.

5.3 Numerical experiment

Finally, the system (52) is discretized with the conventional forward Euler method. The parameters are set as $\mu = 1.7 \times 10^{ - 1}$ (1/year), $\sigma = 5.3 \times 10^{ - 1}$ (1/year$^{1/2}$), $m = 1.8$ (-), $M = 0.5$ (-), $\delta = 1.0$ (1/year), $r = 5.0 \times 10^{ - 4}$ (-), $R = 1.0 \times 10^{ - 1}$ (-), $k_{0} = 1.0 \times 10^{1}$ (-) and $k_{1} = 1.0 \times 10^{0}$ (-) [2]. These parameters satisfy the assumptions (20) through (22). The increment for the time integration is set as $\Delta t = 0.01$ for stable temporal evolution of the system. The time integration marches until the error is under the error tolerance as

$$ \mathrm{error} = \max_{\boldsymbol{x}} \bigl\vert \boldsymbol{x}^{n + 1} - \boldsymbol{x}^{n} \bigr\vert < \varepsilon, $$

(58)

where n represents the time step and $\varepsilon = 10^{ - 10}$ is the error tolerance. With the computed x̄ and $\underline{x}$, a is calculated by (54). The initial estimations for the thresholds are set as $\bar{x} = 7500$ and $\underline{x} = 5500$. The computed thresholds are $\bar{x}^{ *} = 7352.93$ and $\underline{x}^{ *} = 5757.82$. The computed $a^{ *}$ is $a^{ *} = 4.39 \times 10^{ - 7} > 0$, which is consistent with Lemma 3.1. The same steady solution can be obtained for different initial estimations. Table 2 shows time evolution of the error, the residuals for each nonlinear Eqs. (35) as

$$\begin{aligned}& \operatorname{Res} 1 = \bigl\vert - k_{1} ( \bar{x} - \underline{x} ) - k_{0} + a \bigl( \underline{x}^{\beta} - \bar{x}^{\beta} \bigr) + A_{1} \bigl( \underline{x}^{M} - \bar{x}^{M} \bigr) + A_{2} \bigl( \underline{x}^{m} - \bar{x}^{m} \bigr) \bigr\vert , \end{aligned}$$

(59)

$$\begin{aligned}& \operatorname{Res} 2 = \bigl\vert a\beta \bar{x}^{\beta - 1} + A_{1}M \bar{x}^{M - 1} + A_{2}m\bar{x}^{m - 1} + k_{1} \bigr\vert , \end{aligned}$$

(60)

and

$$ \operatorname{Res} 3 = \bigl\vert a\beta \underline{x}^{\beta - 1} + A_{1}M\underline{x}^{M - 1} + A_{2}m \underline{x}^{m - 1} + k_{1} \bigr\vert $$

(61)

during the computational period, and the computed thresholds. According to Table 2, the errors and the residuals monotonically decreases as the time marches and the computation ends at $t = 5.5 \times 10^{7}$, indicating that the nonlinear Eqs. (35) are correctly solved; each residual is less than $1.0 \times 10^{ - 8}$. In addition, we numerically confirmed that $\operatorname{tr} A < 0$ and $\det A > 0$, verifying the theoretical result.

Table 2 Time evolution of the error, the residuals and the computed thresholds

6 Conclusions

This paper formulated the impulse control model of an animal population management, presented a candidate of the exact solutions of the HJBQVI, and proved its optimality and unique solvability within a certain class of solutions from a viscosity viewpoint. A numerical method to compute the coefficients for the exact solution to the HJBQVI was also presented and examined. Our future research will address analysis of time-dependent counterpart of the presented impulse control model. Such an extension would be necessary for dealing with seasonal population dynamics.

Appendices

Appendix 1

Proof of Lemma 2.1

If no intervention is performed ($\tau_{1} = \infty$), from the definition of the value function (11),

$$ \mathrm{E} \biggl[ \int_{0}^{\infty} e^{ - \delta s} \bigl( RX_{s}^{M} - rX_{s}^{m} \bigr)\, \mathrm{d}s \biggr] \le V ( x ) $$

(62)

holds true. Since we have

$$ \mathrm{E} \biggl[ \int_{0}^{\infty} e^{ - \delta s}X_{s}^{\gamma} \,\mathrm{d}s \biggr] = \frac{x^{\gamma}}{\delta - \mu \gamma - \frac{1}{2}\sigma^{2}\gamma ( \gamma - 1 )} $$

(63)

by the property of geometric Brownian motion,

$$ \begin{aligned}[b] &\mathrm{E} \biggl[ \int_{0}^{\infty} e^{ - \delta s} \bigl( RX_{s}^{M} - rX_{s}^{m} \bigr)\, \mathrm{d}s \biggr] \\ &\quad = \frac{Rx^{M}}{\delta - \mu M - \frac{1}{2}\sigma^{2}M ( M - 1 )} + \frac{ - rx^{M}}{\delta - \mu m - \frac{1}{2}\sigma^{2}m ( m - 1 )} \\ &\quad = A_{1}x^{M} + A_{2}x^{m} \end{aligned} $$

(64)

holds true. This is the lower bound of $V ( x )$. Since for any $X_{s}$, we have

$$ RX_{s}^{M} - rX_{s}^{m} \le RX_{s}^{M} $$

(65)

and thus

$$ \int_{0}^{\infty} e^{ - \delta s} \bigl( RX_{s}^{M} - rX_{s}^{m} \bigr)\, \mathrm{d}s \le \int_{0}^{\infty} e^{ - \delta s}RX_{s}^{M} \,\mathrm{d}s. $$

(66)

Therefore, we have

$$ \begin{aligned}[b] & \int_{0}^{\infty} e^{ - \delta s} \bigl( RX_{s}^{M} - rX_{s}^{m} \bigr)\, \mathrm{d}s - \sum_{i = 1}^{\infty} e^{ - \delta \tau_{i}}K ( \zeta_{i} ) \\ &\quad \le \int_{0}^{\infty} e^{ - \delta s}RX_{s}^{M} \,\mathrm{d}s - \sum_{i = 1}^{\infty} e^{ - \delta \tau_{i}}K ( \zeta_{i} ) \\ &\quad < \int_{0}^{\infty} e^{ - \delta s}RX_{s}^{M} \,\mathrm{d}s .\end{aligned} $$

(67)

Taking the expectation in both sides of (67) yields

$$ \begin{aligned}[b] J ( x;\eta ) &= \mathrm{E} \Biggl[ \int_{0}^{\infty} e^{ - \delta s} \bigl( RX_{s}^{M} - rX_{s}^{m} \bigr)\, \mathrm{d}s - \sum_{i = 1}^{\infty} e^{ - \delta \tau_{i}}K ( \zeta_{i} ) \Biggr] \\ &\le \mathrm{E} \biggl[ \int_{0}^{\infty} e^{ - \delta s}RX_{s}^{M} \,\mathrm{d}s \biggr] \\ &= A_{1}x^{M}. \end{aligned} $$

(68)

Taking “sup” in the left hand side of (68) leads to

$$\begin{aligned} V ( x ) &= \sup_{\eta \in \mathfrak{A}}J ( x;\eta ) = \sup_{\eta \in \mathfrak{A}} \mathrm{E} \Biggl[ \int_{0}^{\infty} e^{ - \delta s} \bigl( RX_{s}^{M} - rX_{s}^{m} \bigr)\, \mathrm{d}s - \sum_{i = 1}^{\infty} e^{ - \delta \tau_{i}}K ( \zeta_{i} ) \Biggr] \\ & \le A_{1}x^{M}, \end{aligned}$$

(69)

which is the upper bound of $V ( x )$. □

Proof of Lemma 4.1

Assume $a = 0$. From the middle and lower lines of (35), we have

$$ A_{1}Mx^{M - 1} = - k_{1} - A_{2}mx^{m - 1}. $$

(70)

The left hand side of (70) takes ∞ at $x = 0$, monotonically decreases with respect to x and takes 0 at $x = \infty$, while the right hand side of (70) takes $- k_{1} < 0$ at $x = 0$, monotonically increases with respect to x and takes −∞ at $x = \infty$. According to the intermediate value theorem, (70) has a unique solution $\stackrel{\frown}{x}$ such that $0 < \stackrel{\frown}{x} < \infty$. Thus, when $a = 0$, $\stackrel{\frown}{x} = \bar{x} = \underline{x}$ and it is a contradiction. □

Proof of Lemma 4.2

The second derivative of (36) is

$$\begin{aligned} g'' ( x ) ={}& a\beta ( \beta - 1 ) ( \beta - 2 )x^{\beta - 3} + A_{1}M ( M - 1 ) ( M - 2 )x^{M - 3} \\ &{}+ A_{2}m ( m - 1 ) ( m - 2 )x^{m - 3}. \end{aligned}$$

(71)

Since $a\beta ( \beta - 1 ) ( \beta - 2 ) \ge 0$, $A_{1}M ( M - 1 ) ( M - 2 ) \ge 0$ and $A_{2}m ( m - 1 ) ( m - 2 ) \ge 0$, we have

$$ g'' ( x ) > 0,\quad x > 0. $$

(72)

Then, (37) can be rewritten as

$$ \begin{aligned}[b] g' ( x ) &= a\beta ( \beta - 1 )x^{\beta - 2} + A_{1}M ( M - 1 )x^{M - 2} + A_{2}m ( m - 1 )x^{m - 2} \\ &= x^{M - 2} \bigl\{ a\beta ( \beta - 1 )x^{\beta - M} + A_{1}M ( M - 1 ) + A_{2}m ( m - 1 )x^{m - M} \bigr\} , \end{aligned} $$

(73)

which gives $g' ( 0 ) = - \infty$ since $2 - M > 0$. Define $x = \hat{x}$ such that $g' ( x ) = 0$. Then, from (73), we have

$$ a\beta ( \beta - 1 )\hat{x}^{\beta - M} = - A_{1}M ( M - 1 ) - A_{2}m ( m - 1 )\hat{x}^{m - M}. $$

(74)

By the classical intermediate value theorem, (74) has a unique x̂ such that $0 < \hat{x} < \infty$. □

Proof of Lemma 4.3

By differentiating (74) with respect to a,

$$\begin{aligned} & \bigl\{ a\beta ( \beta - 1 ) ( \beta - 2 ) \hat{x}^{\beta - 3} + A_{1}M ( M - 1 ) ( M - 2 ) \hat{x}^{M - 3} + A_{2}m ( m - 1 ) ( m - 2 ) \hat{x}^{m - 3} \bigr\} \frac{\mathrm{d}\hat{x}}{\mathrm{d}a} \\ &\quad = - \beta ( \beta - 1 )\hat{x}^{\beta - 2} \end{aligned}$$

(75)

is obtained. By using (71), (75) can be rewritten as

$$ g'' ( \hat{x} )\frac{\mathrm{d}\hat{x}}{\mathrm{d}a} = - \beta ( \beta - 1 )\hat{x}^{\beta - 2}. $$

(76)

Since $g'' ( x ) > 0$, we obtain

$$ \frac{\mathrm{d}\hat{x}}{\mathrm{d}a} = - \frac{\beta ( \beta - 1 )}{g'' ( \hat{x} )}\hat{x}^{\beta - 2} < 0. $$

(77)

 □

Proof of Lemma 4.5

From the lower of the system of nonlinear Eqs. (35),

$$ a\beta \underline{x}^{\beta - 1} ( a ) + A_{1}M \underline{x}^{M - 1} ( a ) + A_{2}m\underline{x}^{m - 1} ( a ) = - k_{1} $$

(78)

holds true. Differentiating (78) with respect to a leads to

$$ \bigl\{ a\beta ( \beta - 1 )\underline{x}^{\beta - 2} + A_{1}M ( M - 1 )\underline{x}^{M - 2} + A_{2}m ( m - 1 ) \underline{x}^{m - 2} \bigr\} \frac{\mathrm{d}\underline{x}}{ \mathrm{d}a} = - \beta \underline{x}^{\beta - 1}. $$

(79)

By using (73), (79) can be rewritten as

$$ g' ( \underline{x} )\frac{\mathrm{d}\underline{x}}{\mathrm{d}a} = - \beta \underline{x}^{\beta - 1}, $$

(80)

which is equivalent to

$$ \frac{\mathrm{d}\underline{x}}{\mathrm{d}a} = - \frac{\beta \underline{x}^{\beta - 1}}{g' ( \underline{x} )}. $$

(81)

According to Table 1, we have

$$ g' ( \underline{x} ) < 0,\quad \underline{x} < \hat{x} $$

(82)

and thus

$$ \frac{\mathrm{d}\underline{x}}{\mathrm{d}a} = - \frac{\beta \underline{x}^{\beta - 1}}{g' ( \underline{x} )} > 0. $$

(83)

We can calculate dependence of $\bar{x} ( a )$ to a in the similar manner as

$$ \frac{\mathrm{d}\bar{x}}{\mathrm{d}a} = - \frac{\beta \bar{x}^{\beta - 1}}{g' ( \bar{x} )}. $$

(84)

Again according to Table 1, we have

$$ g' ( \bar{x} ) > 0,\quad \hat{x} < \bar{x} $$

(85)

and thus

$$ \frac{\mathrm{d}\bar{x}}{\mathrm{d}a} = - \frac{\beta \bar{x}^{\beta - 1}}{g' ( \bar{x} )} < 0. $$

(86)

The results (84) and (86) indicate that $\underline{x}$ monotonically increases with respect to a, while x̄ monotonically decreases with respect to a. □

Proof of Lemma 4.6

According to (41) with $a = \hat{a}$, we have

$$ \underline{x} ( \hat{a} ) = \hat{x} ( \hat{a} ) = \bar{x} ( \hat{a} ) = y. $$

(87)

By (35) we have

$$ \hat{a}\beta y^{\beta - 1} + A_{1}My^{M - 1} + A_{2}my^{m - 1} = - k_{1}. $$

(88)

Since $g' ( \hat{x} ) = 0$ and $y = \hat{x}$, the equality

$$ \hat{a}\beta ( \beta - 1 )y^{\beta - 1} + A_{1}M ( M - 1 )y^{M - 1} + A_{2}m ( m - 1 )y^{m - 1} = 0 $$

(89)

holds true. Multiplying $\beta - 1 > 0$ by (88) and subtracting (89) from it gives

$$ A_{1}M ( \beta - M )y^{M - 1} + A_{2}m ( \beta - m )y^{m - 1} = - k_{1} ( \beta - 1 ). $$

(90)

Equation (90) is written as

$$ - C_{1}y^{M - 1} + C_{2}y^{m - 1} = k_{1}, $$

(91)

where $C_{1} > 0$ and $C_{2} > 0$, which are constant and not dependent of $k_{1}$. According to the classical intermediate value theorem, (91) has a unique solution $y = \hat{y} ( k_{1} )$ such that $0 < \hat{y} ( k_{1} ) < \infty$ and is not dependent of $k_{1} > 0$ and a. By using $\hat{y} ( k_{1} )$, from (88), we can calculate unique $a = \hat{a} ( k_{1} )$. This is the upper bound of a. If $a > \hat{a} ( k_{1} )$, $\underline{x} ( a ) > \bar{x} ( a )$ holds true since $\underline{x} ( \hat{a} ) = \bar{x} ( \hat{a} )$ and Lemma 4.5. This contradicts (41). Therefore, $\hat{a} ( k_{1} )$ is the upper bound of a with which $\underline{x}$ and x̄ exist. □

Proof of Lemma 4.7

By $g' ( \hat{x} ) = 0$, we have

$$ g ( \hat{x} ) = A_{1}M\hat{x}^{M - 1}\frac{ ( \beta - M )}{ ( \beta - 1 )} + A_{2}m\hat{x}^{m - 1}\frac{ ( \beta - m )}{ ( \beta - 1 )} + k_{1}. $$

(92)

We introduce the function s:

$$ s ( a ) = A_{1}M\hat{x}^{M - 1}\frac{ ( \beta - M )}{ ( \beta - 1 )} + A_{2}m\hat{x}^{m - 1}\frac{ ( \beta - m )}{ ( \beta - 1 )} + k_{1} = g ( \hat{x} ) $$

(93)

whose first derivative is

$$ \frac{\mathrm{d}s}{\mathrm{d}a} = A_{1}M ( M - 1 )\hat{x}^{M - 2} \frac{ ( \beta - M )}{ ( \beta - 1 )}\frac{\mathrm{d}\hat{x}}{\mathrm{d}a} + A_{2}m ( m - 1 ) \hat{x}^{m - 2}\frac{ ( \beta - m )}{ ( \beta - 1 )}\frac{\mathrm{d}\hat{x}}{\mathrm{d}a} > 0. $$

(94)

Since $\hat{x} = \bar{x} = \underline{x} = \hat{y}$ when $a = \hat{a}$, we have

$$ s ( \hat{a} ) = A_{1}M\hat{y}^{M - 1}\frac{ ( \beta - M )}{ ( \beta - 1 )} + A_{2}m\hat{y}^{m - 1}\frac{ ( \beta - m )}{ ( \beta - 1 )} + k_{1}. $$

(95)

By (90), (95) becomes $s ( \hat{a} ) = 0$. Since the first derivative of s is larger than 0, we have

$$ g ( \hat{x} ) = s ( a ) < 0,\quad 0 < a < \hat{a}. $$

(96)

It is proved that the inequality (40) is satisfied under without any additional conditions to $k_{1}$. Thus, there exist unique two solutions to $g ( x ) = 0$, $\underline{x} ( a )$ and $\bar{x} ( a )$ under without any additional conditions to $k_{1}$. □

Proof of Lemma 4.8

From the upper of the system of nonlinear Eqs. (35),

$$\begin{aligned} &a\bar{x} ( a )^{\beta} + A_{1}\bar{x} ( a )^{M} + A_{2}\bar{x} ( a )^{m} \\ &\quad = - k_{1} \bigl( \bar{x} ( a ) - \underline{x} ( a ) \bigr) - k_{0} + a\underline{x} ( a )^{\beta} + A_{1}\underline{x} ( a )^{M} + A_{2}\underline{x} ( a )^{m} \end{aligned}$$

(97)

holds true. Manipulating (97) yields

$$ a\bar{x}^{\beta} + A_{1}\bar{x}^{M} + A_{2}\bar{x}^{m} + k_{1}\bar{x} + k_{0} - a\underline{x}^{\beta} - A_{1} \underline{x}^{M} - A_{2}\underline{x}^{m} - k_{1}\underline{x} = 0. $$

(98)

We define $F ( a )$ as the left hand side of (98). Since $\bar{x} = \underline{x} = y$ when $a = \hat{a}$, $F ( \hat{a} ) = k_{0} > 0$. Then, we have

$$ \frac{\mathrm{d}F}{\mathrm{d}a} = \bar{x}^{\beta} - \underline{x}^{\beta} > 0, \quad 0 < a < \hat{a}. $$

(99)

Here, we used the middle and lower lines of (35). The second derivative of $F ( a )$ is calculated as

$$ \frac{\mathrm{d}^{2}F}{\mathrm{d}a^{2}} = \frac{\mathrm{d}}{\mathrm{d}a} \bigl\{ \bar{x}^{\beta} - \underline{x}^{\beta} \bigr\} = \beta \bar{x}^{\beta - 1} \frac{\mathrm{d}\bar{x}}{\mathrm{d}a} - \beta \underline{x}^{\beta - 1}\frac{\mathrm{d}\underline{x}}{\mathrm{d}a} < 0. $$

(100)

In addition, we have

$$ \frac{\mathrm{d}F}{\mathrm{d}a} ( \hat{a} ) = \bar{x} ( \hat{a} )^{\beta} - \underline{x} ( \hat{a} )^{\beta} = \hat{y}^{\beta} - \hat{y}^{\beta} = 0. $$

(101)

Notice that $F ( 0 ) < F ( \hat{a} ) = k_{0}$ and thus when $k_{0} = 0$, we have $F ( 0 ) < F ( \hat{a} ) = 0$. Therefore, if $k_{0}$ is sufficiently small, then there is a unique $a^{ *}$ such that $F ( a^{ *} ) = 0$ and $0 < a^{ *} < \hat{a}$. □

Proof of Lemma 4.9

We investigate $F ( 0 )$. At first, we investigate $\lim_{a \to + 0}\bar{x} ( a )$ and $\lim_{a \to + 0}\underline{x} ( a )$. From Lemma 4.5,

$$ \bar{x} ( 0 ) > \bar{x} ( a ) > \bar{x} \bigl( a' \bigr) $$

(102)

holds true. From the Lemma 4.5, we have

$$ \underline{x} ( 0 ) < \underline{x} ( a ) < \underline{x} \bigl( a' \bigr) < \infty. $$

(103)

Assume $\bar{x} ( 0 ) < \infty$. Under the limit $a \to + 0$, we have $a\beta \bar{x}^{\beta - 1} \to 0$. From the middle line of (35),

$$ \lim_{a \to + 0} \bigl\{ a\beta \bar{x}^{\beta - 1} + A_{1}M\bar{x}^{M - 1} + A_{2}m\bar{x}^{m - 1} \bigr\} = A_{1}M\bar{x} ( 0 )^{M - 1} + A_{2}m \bar{x} ( 0 )^{m - 1} = - k_{1} $$

(104)

holds true. In addition, from the lower line of (35),

$$ \lim_{a \to + 0} \bigl\{ a\beta \underline{x}^{\beta - 1} + A_{1}M\underline{x}^{M - 1} + A_{2}m \underline{x}^{m - 1} \bigr\} = A_{1}M\underline{x} ( 0 )^{M - 1} + A_{2}m\underline{x} ( 0 )^{m - 1} = - k_{1} $$

(105)

holds true. We define the following function

$$ N ( x ) = A_{1}Mx^{M - 1} + A_{2}mx^{m - 1} + k_{1}. $$

(106)

According to the classical intermediate value theorem, $N ( x ) = 0$ has a unique solution $x = \stackrel{\smile}{x}$ such that $0 < \stackrel{\smile}{x} < \infty$. This indicates $\underline{x} ( 0 ) = \bar{x} ( 0 ) = \stackrel{\smile}{x} < \infty$. From the upper of the system of nonlinear Eqs. (35), since $\underline{x} ( 0 ) = \bar{x} ( 0 ) < \infty$, when $a = 0$, we have $k_{0} = 0$. This result contradicts $k_{0} > 0$. Therefore, $\bar{x} ( 0 ) = \infty$ holds true. We calculate $F ( 0 )$ as

$$ \begin{aligned}[b] F ( 0 ) &= \lim_{a \to + 0} \bigl\{ a \bar{x}^{\beta} + A_{1}\bar{x}^{M} + A_{2} \bar{x}^{m} + k_{1}\bar{x} - a\underline{x}^{\beta} - A_{1}\underline{x}^{M} - A_{2} \underline{x}^{m} - k_{1}\underline{x} + k_{0} \bigr\} \\ &= \lim_{a \to + 0} \bigl\{ a\bar{x}^{\beta} + A_{1}\bar{x}^{M} + A_{2}\bar{x}^{m} + k_{1}\bar{x} \bigr\} + c, \end{aligned} $$

(107)

where $c < \infty$ is a constant independent of a. From the middle line of (35), we have

$$ a\bar{x}^{\beta} = \frac{ - k_{1}\bar{x} - A_{1}M\bar{x}^{M} - A_{2}m\bar{x}^{m}}{\beta}. $$

(108)

Substituting (108) into (107) yields

$$ \begin{aligned}[b] &\lim_{a \to + 0} \bigl\{ a\bar{x}^{\beta} + A_{1}\bar{x}^{M} + A_{2}\bar{x}^{m} + k_{1}\bar{x} \bigr\} + c \\ &\quad = \lim_{a \to + 0}\frac{1}{\beta} \bigl\{ A_{1} ( \beta - M )\bar{x}^{M} + A_{2} ( \beta - m ) \bar{x}^{m} + k_{1} ( \beta - 1 )\bar{x} \bigr\} + c \\ &\quad = - \infty \end{aligned} $$

(109)

and thus

$$ F ( 0 ) = \lim_{a \to + 0} \bigl\{ a\bar{x}^{\beta} + A_{1}\bar{x}^{M} + A_{2}\bar{x}^{m} + k_{1}\bar{x} \bigr\} + c = - \infty. $$

(110)

Again, by the classical intermediate value theorem, there exists a unique $a^{ *}$ such that satisfies $F ( a^{ *} ) = 0$ and $0 < a^{ *} < \hat{a}$ for any $k_{0} > 0$. □

Proof of Lemma 4.10

From the middle and lower lines (35), the middle line of (45) is obvious. Since $\bar{V}_{l}^{\prime} ( x ) + k_{1} = g ( x )$, according to Table 1, we have

$$ \bar{V}_{l}^{\prime} ( x ) > - k_{1}\quad \mbox{in } 0 < x < \bar{x}, \bar{x} < x $$

(111)

and

$$ \bar{V}_{l}^{\prime} ( x ) < - k_{1}\quad \mbox{in } \underline{x} < x < \bar{x}. $$

(112)

These results shows that the upper and lower in (45) are satisfied. □

Appendix 2

This appendix contains the proofs of Theorems 4.2 and 4.3.

Proof of Theorem 4.2

We divide the domain into $( 0,\bar{x} )$ and $[ \bar{x},\infty )$.

• (1) $x \in ( 0,\bar{x} )$

  By the way of constructing the solution (23),

  $$ \mathcal{L}\bar{V}_{l} ( x ) + Rx^{M} - rx^{m} = 0\quad \mbox{in } ( 0,\bar{x} ) $$

  (113)

  holds true. Thus, we should prove

  $$\begin{aligned} &\mathcal {M}\bar{V}_{l} ( x ) - \bar{V}_{l} ( x ) \\ &\quad = \sup _{\zeta > 0} \bigl[ - k_{1}\zeta - k_{0} + \bar{V}_{l} ( x - \zeta ) \bigr] - \bar{V}_{l} ( x ) \le 0\quad \mbox{in } ( 0,\bar{x} ). \end{aligned}$$

  (114)

  When $\zeta^{ *} > 0$, from the first order optimality condition [27] in “sup” operator in (14), $\bar{V}_{l}^{\prime} ( x - \zeta^{ *} ) = - k_{1}$ holds true. From Theorem 4.1, the system of nonlinear Eqs. (35) has unique solution and we have $x - \zeta^{ *} = \bar{x}$ or $x - \zeta^{ *} = \underline{x}$. If $x - \zeta^{ *} = \bar{x}$, $x > \bar{x}$ holds true and this is a contradiction. Thus, we have $\zeta^{ *} = x - \underline{x}$. When formally $\zeta^{ *} = 0$,

  $$ \mathcal {M}\bar{V}_{l} ( x ) - \bar{V}_{l} ( x ) = -k_{0} \leq 0 $$

  (115)

  holds true. We further divide the domain into three parts as follows.

  • (a) $0 < x < \underline{x}$

    Assume $\zeta^{ *} > 0$. Then, $\zeta^{ *} = x - \underline{x} < 0$ holds true and this is a contradiction. Thus, formally $\zeta^{ *} = 0$ holds true. From (115),

    $$ \mathcal {M}\bar{V}_{l} ( x ) - \bar{V}_{l} ( x ) = -k_{0} \leq 0 $$

    (116)

    holds true. This result shows that the condition is satisfied in $0 < x < \underline{x}$.

  • (b) $x = \underline{x}$

    Assume $\zeta^{ *} > 0$. Then, $\zeta^{ *} = \underline{x} - \underline{x} = 0$ holds true and this is a contradiction. Thus, formally $\zeta^{ *} = 0$ holds true. From (115),

    $$ \mathcal {M}\bar{V}_{l} ( \underline{x} ) - \bar{V}_{l} ( \underline{x} ) = -k_{0} \leq 0 $$

    (117)

    holds true. This result shows that the condition is satisfied at $x = \underline{x}$.

  • (c) $\underline{x} < x < \bar{x}$

    Assume $\zeta^{ *} > 0$. Then, we have $\zeta^{ *} = x - \underline{x} > 0$ in this case and the assumption is in fact valid. We then obtain

    $$ \begin{aligned}[b] \mathcal {M}\bar{V}_{l} ( x ) - \bar{V}_{l} ( x ) &= \sup_{\zeta > 0} \bigl[ - k_{1}\zeta - k_{0} + \bar{V}_{l} ( x - \zeta ) \bigr] - \bar{V}_{l} ( x ) \\ &= - k_{1} ( x - \underline{x} ) - k_{0} + \bar{V}_{l} ( \underline{x} ) - \bar{V}_{l} ( x ). \end{aligned} $$

    (118)

    We define the following function as

    $$ T ( x ) = - k_{1} ( x - \underline{x} ) - k_{0} + \bar{V}_{l} ( \underline{x} ) - \bar{V}_{l} ( x ). $$

    (119)

    From (43),

    $$ T ( \bar{x} ) = - k_{1} ( \bar{x} - \underline{x} ) - k_{0} + \bar{V}_{l} ( \underline{x} ) - \bar{V}_{l} ( \bar{x} ) = 0 $$

    (120)

    holds true and we have $T' ( x ) = - k_{1} - \bar{V}_{l}^{\prime} ( x )$. From (45),

    $$ T' ( x ) = - k_{1} - \bar{V}_{l}^{\prime} ( x ) > 0\quad \mbox{in } \underline{x} < x < \bar{x} $$

    (121)

    and thus

    $$ \mathcal {M}\bar{V}_{l} ( x ) - \bar{V}_{l} ( x ) = T ( x ) < 0\quad \mbox{in } \underline{x} < x < \bar{x}. $$

    (122)

• (2) $x \in [ \bar{x},\infty )$

  By the way of constructing the solution (29),

  $$ \mathcal {M}\bar{V}_{r} - \bar{V}_{r} = 0\quad \mbox{in } [ \bar{x},\infty ) $$

  (123)

  holds true. Thus, we should prove

  $$ \mathcal{L}\bar{V}_{r} + Rx^{M} - rx^{m} \le 0 $$

  (124)

  in $( 0,\bar{x} )$. For $\bar{V}_{l} ( x )$,

  $$ \mathcal{L}\bar{V}_{l} ( x ) + Rx^{M} - rx^{m} = 0\quad \mbox{in } [ \bar{x},\infty ) $$

  (125)

  holds true. Substituting (125) into $\mathcal{L}\bar{V}_{r} + Rx^{M} - rx^{m}$ yields

  $$ \begin{aligned}[b] \mathcal{L}\bar{V}_{r} + Rx^{M} - rx^{m} &= \mathcal{L}\bar{V}_{r} - \mathcal{L}\bar{V}_{l} \\ &= \frac{1}{2}\sigma^{2}x^{2} \bigl( \bar{V}_{r}^{\prime \prime} - \bar{V}_{l}^{\prime \prime} \bigr) + \mu x \bigl( \bar{V}'_{r} - \bar{V}_{l}^{\prime} \bigr) - \delta ( \bar{V}_{r} - \bar{V}_{l} ) \end{aligned}. $$

  (126)

  Since $\bar{V}_{r}^{\prime \prime} = 0$ and $\bar{V}_{l}^{\prime \prime} ( x ) = g' ( x )$, by Table 1, we have $\bar{V}_{l}^{\prime \prime} ( x ) = g' ( x ) > 0$ in $x \ge \bar{x}$ and thus

  $$ \bar{V}_{r}^{\prime \prime} - \bar{V}_{l}^{\prime \prime} < 0. $$

  (127)

  Since $\bar{V}_{r}^{\prime} = - k_{1}$ and $\bar{V}_{l}^{\prime} > - k_{1}$ from Lemma 4.10,

  $$ \bar{V}_{r}^{\prime} - \bar{V}_{l}^{\prime} < 0 $$

  (128)

  holds true. We define the following function as

  $$ Q ( x ) = \bar{V}_{r} - \bar{V}_{l} = \bar{V}_{l} ( \bar{x} ) - k_{1} ( x - \bar{x} ) - \bar{V}_{l} ( x ), $$

  (129)

  and

  $$ Q ( \bar{x} ) = \bar{V}_{l} ( \bar{x} ) - \bar{V}_{l} ( \bar{x} ) = 0 $$

  (130)

  at $x = \bar{x}$. The first derivative of (129) is calculated as

  $$ Q' ( x ) = - k_{1} - \bar{V}_{l}^{\prime} ( x ). $$

  (131)

  Since $\bar{V}_{l}^{\prime} \ge - k_{1}$ in $x \ge \bar{x}$ from Lemma 4.10,

  $$ Q' ( x ) = - k_{1} - \bar{V}_{l}^{\prime} ( x ) \le 0 $$

  (132)

  holds true. Thus,

  $$ \bar{V}_{r} - \bar{V}_{l} = Q ( x ) \le 0\quad \mbox{in } x \ge \bar{x}. $$

  (133)

  Therefore, from (127), (128), and (133),

  $$ \mathcal{L}\bar{V}_{r} + Rx^{M} - rx^{m} = \mathcal{L} ( \bar{V}_{r} - \bar{V}_{l} ) < 0\quad \mbox{in } x \ge \bar{x}, $$

  (134)

  leading to (124).

 □

Proof of Theorem 4.3

Except at $x = \bar{x}$, it is clear that the exact solution (30) is a viscosity solution since the exact solution (30) is of the $C^{2}$-class. Thus, we only have to investigate the viscosity property at the point $x = \bar{x}$. We prove V is a sub and supersolution at $x = \bar{x}$.

Since $V_{l}^{\prime \prime} ( x ) = g' ( x )$ in $x < \bar{x}$, by Table 1, we have

$$ V_{l}^{\prime \prime} ( \bar{x} - 0 ) = g' ( \bar{x} - 0 ) > 0 $$

(135)

holds true. In addition, since the exact solution is linear in $x > \bar{x}$, $V_{r}^{\prime \prime} ( \bar{x} + 0 ) = 0$ holds true. From the HJBQVI (12),

$$ - \mathcal{L}V ( x ) - Rx^{M} + rx^{m} = \delta V_{l} - \mu xV_{l}^{\prime} - \frac{\sigma^{2}x^{2}}{2}V_{l}^{\prime \prime} - Rx^{M} + rx^{m} = 0\quad \mbox{in } ( 0,\bar{x} ) $$

(136)

holds true.

• (a) For viscosity sub-solution

  Let v be a test function $v ( \bar{x} ) = V ( \bar{x} )$ and $v ( x ) \ge V ( x )$ near x̄. We should prove

  $$ \min \bigl\{ - \mathcal{L}v ( \bar{x} ) - R\bar{x}^{M} + r \bar{x}^{m},v ( \bar{x} ) - \mathcal {M}v ( \bar{x} ) \bigr\} \le 0. $$

  (137)

  From the HJBQVI (12),

  $$ \min \bigl\{ - \mathcal{L}V ( \bar{x} ) - R\bar{x}^{M} + r \bar{x}^{m},V ( \bar{x} ) - \mathcal {M}V ( \bar{x} ) \bigr\} = 0 $$

  (138)

  holds true. From the definition of the test function and $V \in C^{1} ( 0, + \infty )$, $v' ( x ) = V' ( x )$ holds true near x̄. This leads to

  $$ V ( \bar{x} ) - \mathcal {M}V ( \bar{x} ) = v ( \bar{x} ) - \mathcal {M}v ( \bar{x} ) = 0, $$

  (139)

  showing that

  $$\begin{aligned} &\min \bigl\{ - \mathcal{L}v ( \bar{x} ) - R\bar{x}^{M} + r \bar{x}^{m},v ( \bar{x} ) - \mathcal {M}v ( \bar{x} ) \bigr\} \\ &\quad = \min \bigl\{ - \mathcal{L}v ( \bar{x} ) - R\bar{x}^{M} + r \bar{x}^{m},0 \bigr\} \le 0. \end{aligned}$$

  (140)

• (b) For viscosity super-solution

  Let v be a test function such that $v ( \bar{x} ) = V ( \bar{x} )$ and $v ( x ) \le V ( x )$ near x̄. We have to prove

  $$ \min \bigl\{ - \mathcal{L}v ( \bar{x} ) - R\bar{x}^{M} + r \bar{x}^{m},v ( \bar{x} ) - \mathcal {M}v ( \bar{x} ) \bigr\} \ge 0. $$

  (141)

  Since $v ( x ) = V ( x )$ and $v' ( x ) = V' ( x )$, we have

  $$ \begin{aligned}[b] - \mathcal{L}v ( \bar{x} ) - R\bar{x}^{M} + r \bar{x}^{m} &= \delta v - \mu \bar{x}v' - \frac{\sigma^{2}\bar{x}^{2}}{2}v'' - R\bar{x}^{M} + r \bar{x}^{m} \\ &= \delta V - \mu \bar{x}V' - \frac{\sigma^{2}\bar{x}^{2}}{2}v'' - R\bar{x}^{M} + r\bar{x}^{m} \end{aligned}. $$

  (142)

  By (136), we also have

  $$ \delta V - \mu \bar{x}V' - R\bar{x}^{M} + r \bar{x}^{m} = \frac{\sigma^{2}\bar{x}^{2}}{2}V_{l}^{\prime \prime} ( \bar{x} - 0 ). $$

  (143)

  Combining (142) and (143) gives

  $$ \begin{aligned}[b] - \mathcal{L}v ( \bar{x} ) - R\bar{x}^{M} + r \bar{x}^{m} &= \delta V - \mu \bar{x}V' - \frac{\sigma^{2}\bar{x}^{2}}{2}v'' - R\bar{x}^{M} + r \bar{x}^{m} \\ &= \frac{\sigma^{2}\bar{x}^{2}}{2} \bigl\{ V_{l}^{\prime \prime} ( \bar{x} - 0 ) - v'' ( \bar{x} ) \bigr\} . \end{aligned} $$

  (144)

  Since $V - v \ge 0$ near x̄ and $V ( \bar{x} ) = v ( \bar{x} )$, we arrive at the inequality

  $$ V_{l}^{\prime \prime} ( \bar{x} - 0 ) - v'' ( \bar{x} ) \ge 0, $$

  (145)

  leading to

  $$ - \mathcal{L}v ( \bar{x} ) - R\bar{x}^{M} + r\bar{x}^{m} \ge 0. $$

  (146)

  Thus, the solution to the HJBQVI (12) is a viscosity solution at $x = \bar{x}$. Therefore, the exact solution (30) is a viscosity solution.

 □

Appendix 3

This appendix presents the proof of Theorem 5.1.

Proof of Theorem 5.1

The signs of trA and detA at $( \bar{x}^{ *},\underline{x}^{ *} )$ are firstly analyzed. Since $V_{l}^{\prime \prime} ( x ) = g' ( x )$ in $x < \bar{x}$, Table 1 leads to

$$ V_{l}^{\prime \prime} \bigl( \underline{x}^{ *} \bigr) < 0 \quad \mbox{and}\quad V_{l}^{\prime \prime} \bigl( \bar{x}^{ *} \bigr) > 0. $$

(147)

By differentiating (54) with respect to x̄, we have

$$ \begin{aligned}[b] &\frac{\partial h}{\partial \bar{x}} ( \bar{x},\underline{x} )\beta \bar{x}^{\beta - 1} + h ( \bar{x},\underline{x} )\beta ( \beta - 1 ) \bar{x}^{\beta - 2} + A_{1}M ( M - 1 )\bar{x}^{M - 2} + A_{2}m ( m - 1 )\bar{x}^{m - 2} \\ &\quad = \frac{\partial h}{\partial \bar{x}} ( \bar{x},\underline{x} )\beta \underline{x}^{\beta - 1}, \end{aligned} $$

(148)

which can be rewritten as

$$ \frac{\partial h}{\partial \bar{x}} \bigl( \bar{x}^{ *},\underline{x}^{ *} \bigr)\beta \bar{x}^{ * \beta - 1} + V_{l}^{\prime \prime} \bigl( \bar{x}^{ *} \bigr) = \frac{\partial h}{\partial \bar{x}} \bigl( \bar{x}^{ *}, \underline{x}^{ *} \bigr)\beta \underline{x}^{ * \beta - 1} $$

(149)

when $( \bar{x},\underline{x} ) = ( \bar{x}^{ *},\underline{x}^{ *} )$ by (37). Then, we have

$$ \frac{\partial h}{\partial \bar{x}} \bigl( \bar{x}^{ *},\underline{x}^{ *} \bigr) = \frac{1}{\beta ( \underline{x}^{ * \beta - 1} - \bar{x}^{ * \beta - 1} )}V_{l}^{\prime \prime} \bigl( \bar{x}^{ *} \bigr) < 0. $$

(150)

In the same way, by (147), differentiating (54) with respect to $\underline{x}$ gives

$$ \frac{\partial h}{\partial \underline{x}} \bigl( \bar{x}^{ *},\underline{x}^{ *} \bigr) = \frac{1}{\beta ( \bar{x}^{ * \beta - 1} - \underline{x}^{ * \beta - 1} )}V_{l}^{\prime \prime} \bigl( \underline{x}^{ *} \bigr) < 0. $$

(151)

The components of the Jacobian (57) are calculated as

$$\begin{aligned}& \frac{\partial f_{1}}{\partial \bar{x}} = k_{1} - \bigl( \underline{x}^{\beta} - \bar{x}^{\beta} \bigr)\frac{\partial h}{\partial \bar{x}} + h\beta \bar{x}^{\beta - 1} + MA_{1}\bar{x}^{M - 1} + mA_{2}\bar{x}^{m - 1}, \end{aligned}$$

(152)

$$\begin{aligned}& \frac{\partial f_{1}}{\partial \underline{x}} = - k_{1} - \bigl( \underline{x}^{\beta} - \bar{x}^{\beta} \bigr)\frac{\partial h}{\partial \underline{x}} - h\beta \underline{x}^{\beta - 1} - MA_{1}\underline{x}^{M - 1} - mA_{2} \underline{x}^{m - 1}, \end{aligned}$$

(153)

$$\begin{aligned}& \frac{\partial f_{2}}{\partial \bar{x}} = \beta \bar{x}^{\beta - 1}\frac{\partial h}{\partial \bar{x}} + h\beta ( \beta - 1 )\bar{x}^{\beta - 2} + A_{1}M ( M - 1 ) \bar{x}^{M - 2} + A_{2}m ( m - 1 )\bar{x}^{m - 2}, \end{aligned}$$

(154)

and

$$ \frac{\partial f_{2}}{\partial \underline{x}} = \beta \bar{x}^{\beta - 1}\frac{\partial h}{\partial \underline{x}}. $$

(155)

By (150) and (151), the signs of the components at the equilibrium point are calculated as

$$\begin{aligned}& \left. \frac{\partial f_{1}}{\partial \bar{x}} \right |_{ ( \bar{x},\underline{x} ) = ( \bar{x}^{ *},\underline{x}^{ *} )} = k_{1} - \bigl( \underline{x}^{ * \beta} - \bar{x}^{ * \beta} \bigr)\frac{\partial h}{\partial \bar{x}} \bigl( \bar{x}^{ *},\underline{x}^{ *} \bigr) + V_{l}^{\prime} \bigl( \bar{x}^{ *} \bigr) < 0, \end{aligned}$$

(156)

$$\begin{aligned}& \left. \frac{\partial f_{1}}{\partial \underline{x}} \right |_{ ( \bar{x},\underline{x} ) = ( \bar{x}^{ *},\underline{x}^{ *} )} = - k_{1} - \bigl( \underline{x}^{ * \beta} - \bar{x}^{ * \beta} \bigr)\frac{\partial h}{\partial \underline{x}} \bigl( \bar{x}^{ *},\underline{x}^{ *} \bigr) - V_{l}^{\prime} \bigl( \underline{x}^{ *} \bigr) < 0, \end{aligned}$$

(157)

$$\begin{aligned}& \left. \frac{\partial f_{2}}{\partial \bar{x}} \right|_{ ( \bar{x},\underline{x} ) = ( \bar{x}^{ *},\underline{x}^{ *} )} = \beta \bar{x}^{ * \beta - 1} \frac{\partial h}{\partial \bar{x}} \bigl( \bar{x}^{ *},\underline{x}^{ *} \bigr) + V_{l}^{\prime \prime} \bigl( \bar{x}^{ *} \bigr) < 0, \end{aligned}$$

(158)

and

$$ \left. \frac{\partial f_{2}}{\partial \underline{x}} \right|_{ ( \bar{x},\underline{x} ) = ( \bar{x}^{ *},\underline{x}^{ *} )} = \beta \bar{x}^{ * \beta - 1} \frac{\partial h}{\partial \underline{x}} \bigl( \bar{x}^{ *},\underline{x}^{ *} \bigr) < 0. $$

(159)

Hence, we have (56). Therefore, by Lemma 5.1, the equilibrium point is locally asymptotically stable. If the initial estimation of $( \bar{x},\underline{x} )$ is sufficiently near the equilibrium point $( \bar{x}^{ *},\underline{x}^{ *} )$, the solution of the system of the ODEs (52) converges to $( \bar{x}^{ *},\underline{x}^{ *} )$. □