<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="3.0" xml:lang="en" article-type="research article"><front><journal-meta><journal-id journal-id-type="publisher-id">OJS</journal-id><journal-title-group><journal-title>Open Journal of Statistics</journal-title></journal-title-group><issn pub-type="epub">2161-718X</issn><publisher><publisher-name>Scientific Research Publishing</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.4236/ojs.2014.410080</article-id><article-id pub-id-type="publisher-id">OJS-51474</article-id><article-categories><subj-group subj-group-type="heading"><subject>Articles</subject></subj-group><subj-group subj-group-type="Discipline-v2"><subject>Physics&amp;Mathematics</subject></subj-group></article-categories><title-group><article-title>
 
 
  Estimation of Multivariate Sample Selection Models via a Parameter-Expanded Monte Carlo EM Algorithm
 
</article-title></title-group><contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>hillip</surname><given-names>Li</given-names></name><xref ref-type="aff" rid="aff1"><sub>1</sub></xref><xref ref-type="corresp" rid="cor1"><sup>*</sup></xref></contrib></contrib-group><aff id="aff1"><label>1</label><addr-line>Department of Economics, Office of the Comptroller of the Currency, Washington, DC, USA</addr-line></aff><author-notes><corresp id="cor1">* E-mail:<email>Phillip.Li@occ.treas.gov</email></corresp></author-notes><pub-date pub-type="epub"><day>18</day><month>11</month><year>2014</year></pub-date><volume>04</volume><issue>10</issue><fpage>851</fpage><lpage>856</lpage><history><date date-type="received"><day>6</day>	<month>September</month>	<year>2014</year></date><date date-type="rev-recd"><day>5</day>	<month>October</month>	<year>2014</year>	</date><date date-type="accepted"><day>2</day>	<month>November</month>	<year>2014</year></date></history><permissions><copyright-statement>&#169; Copyright  2014 by authors and Scientific Research Publishing Inc. </copyright-statement><copyright-year>2014</copyright-year><license><license-p>This work is licensed under the Creative Commons Attribution International License (CC BY). http://creativecommons.org/licenses/by/4.0/</license-p></license></permissions><abstract><p>
 
 
  This paper develops a parameter-expanded Monte Carlo EM (PX-MCEM) algorithm to perform maximum likelihood estimation in a multivariate sample selection model. In contrast to the current methods of estimation, the proposed algorithm does not directly depend on the observed-data likelihood, the evaluation of which requires intractable multivariate integrations over normal densities. Moreover, the algorithm is simple to implement and involves only quantities that are easy to simulate or have closed form expressions.
 
</p></abstract><kwd-group><kwd>Multivariate Sample Selection</kwd><kwd> Heckman Correction</kwd><kwd> Incidental Truncation</kwd><kwd> Expectation  Maximization</kwd></kwd-group></article-meta></front><body><sec id="s1"><title>1. Introduction</title><p>Sample selection models, pioneered in [<xref ref-type="bibr" rid="scirp.51474-ref1">1</xref>] - [<xref ref-type="bibr" rid="scirp.51474-ref3">3</xref>] , are indispensable to researchers who use observational data for statistical inference. Among the many variants of these types of models, there is a growing interest in multiva- riate sample selection models. These are used to model a system of two or more seemingly unrelated equations, where the outcome variable for each equation may be non-randomly missing or censored according to its own stochastic selection variable. Applications range from modeling systems of demand equations [<xref ref-type="bibr" rid="scirp.51474-ref4">4</xref>] [<xref ref-type="bibr" rid="scirp.51474-ref5">5</xref>] to house- hold vehicle usage [<xref ref-type="bibr" rid="scirp.51474-ref6">6</xref>] - [<xref ref-type="bibr" rid="scirp.51474-ref8">8</xref>] . A common specification is to assume a correlated multivariate normal distribution underlying both the outcomes of interest and the latent variables in the system.</p><p>There are two dominant approaches in the current literature to estimate these models. One approach is to use maximum likelihood (ML) estimation. However, as noted in the literature, a major hurdle in evaluating the like- lihood is that it requires computations of multivariate integrals over normal densities, which do not generally have closed form solutions. [<xref ref-type="bibr" rid="scirp.51474-ref9">9</xref>] discusses the ML estimation of these models and proposes to use the popular Geweke, Hajivassiliou, and Keane (GHK) algorithm to approximate these integrals in a simulated ML frame- work. While this strategy works reasonably well, the GHK algorithm can be difficult to implement. Another popular approach is to use two-step estimation (see [<xref ref-type="bibr" rid="scirp.51474-ref10">10</xref>] for a survey). In general, there is a tradeoff in the statistical properties and the computational simplicity for these estimators. If efficiency and consistency are of pri- mary concern, then ML estimation should be preferred over two-step estimation.</p><p>The objective of this paper is to develop a simple ML estimation algorithm for a commonly used multivariate sample selection model. In particular, this paper develops a parameter-expanded Monte Carlo expectation maximization (PX-MCEM) algorithm that differs from [<xref ref-type="bibr" rid="scirp.51474-ref9">9</xref>] in a few important ways. First, the PX-MCEM algo- rithm does not use the observed-data likelihood directly, so it avoids the aforementioned integrations. Second, the proposed iterative algorithm does not require the evaluations of gradients or Hessians, which become increa- singly difficult to evaluate with more parameters and equations. Third, the algorithm is straightforward to implement. It only depends on quantities that are either easy to simulate or have closed form expressions. This last point is especially appealing when estimating the covariance matrix parameter since there are non-standard restrictions imposed onto it for identification.</p><p>This paper is organized as follows. The multivariate sample selection model (MSSM) is formulated in Section 2. Section 3 begins with a brief overview of the EM algorithm for the MSSM and continues with the develop- ment of the PX-MCEM algorithm. Methods to obtain the standard errors are discussed. Section 4 offers some concluding remarks.</p></sec><sec id="s2"><title>2. Multivariate Sample Selection Model</title><p>The MSSM is</p><disp-formula id="scirp.51474-formula77"><label>(1)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-1240423x5.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.51474-formula78"><label>(2)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-1240423x6.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.51474-formula79"><label>(3)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-1240423x7.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.51474-formula80"><label>(4)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-1240423x8.png"  xlink:type="simple"/></disp-formula><p>for observations<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x9.png" xlink:type="simple"/></inline-formula>, and equations<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x10.png" xlink:type="simple"/></inline-formula>. In the previous expressions, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x11.png" xlink:type="simple"/></inline-formula>is the continuous outcome of interest for observation <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x12.png" xlink:type="simple"/></inline-formula> and equation<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x13.png" xlink:type="simple"/></inline-formula>. Using similar indexing notation, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x14.png" xlink:type="simple"/></inline-formula>is the latent</p><p>variable underlying the binary selection variable<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x15.png" xlink:type="simple"/></inline-formula>, where <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x16.png" xlink:type="simple"/></inline-formula> denotes an indicator function</p><p>that equals <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x17.png" xlink:type="simple"/></inline-formula> if event <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x18.png" xlink:type="simple"/></inline-formula> is true and 0 otherwise. Sample selection is incorporated by assuming that <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x19.png" xlink:type="simple"/></inline-formula> is</p><p>missing when<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x20.png" xlink:type="simple"/></inline-formula>. Otherwise, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x20.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x21.png" xlink:type="simple"/></inline-formula>is observed and equal to<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x20.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x21.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x22.png" xlink:type="simple"/></inline-formula>. For later use, define <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x20.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x21.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x22.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x23.png" xlink:type="simple"/></inline-formula> and<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x20.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x21.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x22.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x23.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x24.png" xlink:type="simple"/></inline-formula>, where the prime symbol in<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x20.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x21.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x22.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x23.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x24.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x25.png" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x20.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x21.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x22.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x23.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x24.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x25.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x26.png" xlink:type="simple"/></inline-formula>, and in the rest of this paper is used to denote matrix</p><p>transpose.</p><p>Furthermore, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x27.png" xlink:type="simple"/></inline-formula>and <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x27.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x28.png" xlink:type="simple"/></inline-formula> are column vectors of exogenous covariates, and <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x27.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x28.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x29.png" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x27.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x28.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x29.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x30.png" xlink:type="simple"/></inline-formula> are conforming</p><p>vectors of parameters. Define <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x31.png" xlink:type="simple"/></inline-formula> and<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x31.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x32.png" xlink:type="simple"/></inline-formula>. For identification, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x31.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x32.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x33.png" xlink:type="simple"/></inline-formula>must</p><p>contain at least one exogenous covariate that does not overlap with <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x34.png" xlink:type="simple"/></inline-formula> (refer to [<xref ref-type="bibr" rid="scirp.51474-ref11">11</xref>] for these exclusion res-</p><p>trictions). The unobserved errors <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x35.png" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x35.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x36.png" xlink:type="simple"/></inline-formula> are jointly distributed as a</p><p><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x37.png" xlink:type="simple"/></inline-formula>-dimensional multivariate normal with a mean vector of zeros and an unknown covariance matrix of<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x37.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x38.png" xlink:type="simple"/></inline-formula>. Formally, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x37.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x38.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x39.png" xlink:type="simple"/></inline-formula>with</p><disp-formula id="scirp.51474-formula81"><label>. (5)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-1240423x40.png"  xlink:type="simple"/></disp-formula><p>The submatrix <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x41.png" xlink:type="simple"/></inline-formula> is restricted to be in correlation form to identify the parameters corresponding to the latent variables [<xref ref-type="bibr" rid="scirp.51474-ref9">9</xref>] . The other elements of <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x41.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x42.png" xlink:type="simple"/></inline-formula> are restricted such that the matrix is symmetric and positive definite.</p><p>The covariates and binary selection variables are always observed. Without loss of generality, assume that the outcomes for any observation <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x43.png" xlink:type="simple"/></inline-formula> are only missing for the first <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x43.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x44.png" xlink:type="simple"/></inline-formula> equations, where<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x43.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x44.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x45.png" xlink:type="simple"/></inline-formula>. Define</p><p><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x46.png" xlink:type="simple"/></inline-formula>, and let <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x46.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x47.png" xlink:type="simple"/></inline-formula> denote the observed data. The observed-data likelihood derived from (1) through (5) is denoted as<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x46.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x47.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x48.png" xlink:type="simple"/></inline-formula>. See [<xref ref-type="bibr" rid="scirp.51474-ref9">9</xref>] for an exact expression of this likelihood.</p></sec><sec id="s3"><title>3. Estimation</title><sec id="s3_1"><title>3.1. Overview of the EM Algorithm</title><p>The PX-MCEM algorithm is based on the EM algorithm of [<xref ref-type="bibr" rid="scirp.51474-ref12">12</xref>] . The basic idea behind the EM algorithm is to first augment <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x49.png" xlink:type="simple"/></inline-formula> with a set of “missing data” <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x49.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x50.png" xlink:type="simple"/></inline-formula>such that the observed-data likelihood is preserved when the missing data are integrated out of the complete-data likelihood. Formally, the missing data must satisfy</p><disp-formula id="scirp.51474-formula82"><label>, (6)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-1240423x51.png"  xlink:type="simple"/></disp-formula><p>where <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x52.png" xlink:type="simple"/></inline-formula> is the complete-data likelihood to be defined later.</p><p>The EM algorithm then proceeds iteratively between an expectation step (E-step) and a maximization step (M-step) as follows. In iteration <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x53.png" xlink:type="simple"/></inline-formula> of the algorithm, compute in the E-step</p><disp-formula id="scirp.51474-formula83"><label>, (7)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-1240423x54.png"  xlink:type="simple"/></disp-formula><p>where the expectation is taken with respect to the conditional predictive distribution for the missing data,</p><p><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x55.png" xlink:type="simple"/></inline-formula>, and in the M-step, find</p><disp-formula id="scirp.51474-formula84"><label>. (8)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-1240423x56.png"  xlink:type="simple"/></disp-formula><p>Denote the maximal values as<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x57.png" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x57.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x58.png" xlink:type="simple"/></inline-formula>, and<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x57.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x58.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x59.png" xlink:type="simple"/></inline-formula>, and continue on with the algorithm until convergence. The final maximal values are at least local maxima of the observed-data likelihood function.</p><p>For the MSSM, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x60.png" xlink:type="simple"/></inline-formula>consists of all the missing outcomes and latent variables. Specifically,</p><p><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x61.png" xlink:type="simple"/></inline-formula>, where<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x61.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x62.png" xlink:type="simple"/></inline-formula>. Furthermore, denote <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x61.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x62.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x63.png" xlink:type="simple"/></inline-formula> as the vector</p><p>of complete data, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x64.png" xlink:type="simple"/></inline-formula>as a block-diagonal matrix with the rows of covariates corresponding to the elements of <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x64.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x65.png" xlink:type="simple"/></inline-formula> on its block diagonals, and<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x64.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x65.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x66.png" xlink:type="simple"/></inline-formula>. The complete-data likelihood for the MSSM is given by</p><disp-formula id="scirp.51474-formula85"><label>(9)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-1240423x67.png"  xlink:type="simple"/></disp-formula><p>with <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x68.png" xlink:type="simple"/></inline-formula> which is a density function for a <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x68.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x69.png" xlink:type="simple"/></inline-formula>-dimensional multivariate</p><p>normal with mean <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x70.png" xlink:type="simple"/></inline-formula> and covariance<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x70.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x71.png" xlink:type="simple"/></inline-formula>, and</p><disp-formula id="scirp.51474-formula86"><label>. (10)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-1240423x72.png"  xlink:type="simple"/></disp-formula><p>Equation (10) is a degenerate density since conditioning on <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x73.png" xlink:type="simple"/></inline-formula> in <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x73.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x74.png" xlink:type="simple"/></inline-formula> determines <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x73.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x74.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x75.png" xlink:type="simple"/></inline-formula> from (3). Note that the observed-data likelihood from [<xref ref-type="bibr" rid="scirp.51474-ref9">9</xref>] is obtained when <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x73.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x74.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x75.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x76.png" xlink:type="simple"/></inline-formula> is integrated out of (9), hence the condition in (6) holds.</p></sec><sec id="s3_2"><title>3.2. PX-MCEM Algorithm</title><p>The standard EM algorithm using (7) and (8) is difficult to implement for the MSSM as the E-step and M-step are intractable. The PX-MCEM algorithm addresses this issue by modifying the E-step in two ways and leads to an M-step that can be evaluated with closed form quantities. Stated succinctly, the PX-MCEM algorithm is as follows.</p><p>1. Initialize<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x77.png" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x77.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x78.png" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x77.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x78.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x79.png" xlink:type="simple"/></inline-formula>, and the number of Gibbs sampling draws<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x77.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x78.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x79.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x80.png" xlink:type="simple"/></inline-formula>.</p><p>At iteration<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x81.png" xlink:type="simple"/></inline-formula>:</p><p>2. Draw <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x82.png" xlink:type="simple"/></inline-formula> sets of missing data, denoted by<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x82.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x83.png" xlink:type="simple"/></inline-formula>, from <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x82.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x83.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x84.png" xlink:type="simple"/></inline-formula> using Gibbs sampling.</p><p>3. PX-MC E-step: Estimate <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x85.png" xlink:type="simple"/></inline-formula> as</p><disp-formula id="scirp.51474-formula87"><label>. (11)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-1240423x86.png"  xlink:type="simple"/></disp-formula><p>4. PX-MC M-step: Maximize <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x87.png" xlink:type="simple"/></inline-formula> with iterative generalized least squares (IGLS) to</p><p>obtain the maximizing parameters<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x88.png" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x88.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x89.png" xlink:type="simple"/></inline-formula>, and<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x88.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x89.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x90.png" xlink:type="simple"/></inline-formula>.</p><p>5. Reduction step: Apply reduction functions to<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x91.png" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x91.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x92.png" xlink:type="simple"/></inline-formula>, and <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x91.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x92.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x93.png" xlink:type="simple"/></inline-formula> to obtain<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x91.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x92.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x93.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x94.png" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x91.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x92.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x93.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x94.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x95.png" xlink:type="simple"/></inline-formula>, and<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x91.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x92.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x93.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x94.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x95.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x96.png" xlink:type="simple"/></inline-formula>.</p><p>6. Repeat Steps 2 through 5 until convergence. The converged values are the ML estimates<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x97.png" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x97.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x98.png" xlink:type="simple"/></inline-formula>, and<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x97.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x98.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x99.png" xlink:type="simple"/></inline-formula>.</p><p>Each step is described in more detail in the subsequent sections.</p><sec id="s3_2_1"><title>3.2.1. PX-MC E-Step</title><p>Following [<xref ref-type="bibr" rid="scirp.51474-ref13">13</xref>] , the first modification is to expand the parameter space of the complete-data likelihood function from <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x100.png" xlink:type="simple"/></inline-formula> to<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x100.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x101.png" xlink:type="simple"/></inline-formula>. The expanded parameters play similar roles as the original parameters, however <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x100.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x101.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x102.png" xlink:type="simple"/></inline-formula> is expanded into a standard covariance matrix without the correlation restrictions. The parameter-expanded complete-data likelihood function is</p><disp-formula id="scirp.51474-formula88"><label>(12)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-1240423x103.png"  xlink:type="simple"/></disp-formula><p>with<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x104.png" xlink:type="simple"/></inline-formula>, where<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x104.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x105.png" xlink:type="simple"/></inline-formula>, and <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x104.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x105.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x106.png" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x104.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x105.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x106.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x107.png" xlink:type="simple"/></inline-formula></p><p>are defined analogously to <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x108.png" xlink:type="simple"/></inline-formula> and<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x108.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x109.png" xlink:type="simple"/></inline-formula>. The advantage of using (12) instead of (9) is that <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x108.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x109.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x110.png" xlink:type="simple"/></inline-formula> is easier to work with in the PX-MC M-step.</p><p>Second, instead of computing <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x111.png" xlink:type="simple"/></inline-formula> analytically, it is approximated as (11) with Monte Carlo methods and Gibbs sampling. To draw from <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x111.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x112.png" xlink:type="simple"/></inline-formula>, simply draw <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x111.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x112.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x113.png" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x111.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x112.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x113.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x114.png" xlink:type="simple"/></inline-formula> from the conditional distribution <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x111.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x112.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x113.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x114.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x115.png" xlink:type="simple"/></inline-formula> for<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x111.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x112.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x113.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x114.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x115.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x116.png" xlink:type="simple"/></inline-formula>. From (9), we have that</p><disp-formula id="scirp.51474-formula89"><label>, (13)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-1240423x117.png"  xlink:type="simple"/></disp-formula><p>where<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x118.png" xlink:type="simple"/></inline-formula>. For the missing outcomes, it is easy to see from (13) that</p><disp-formula id="scirp.51474-formula90"><label>(14)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-1240423x119.png"  xlink:type="simple"/></disp-formula><p>for<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x120.png" xlink:type="simple"/></inline-formula>, where <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x120.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x121.png" xlink:type="simple"/></inline-formula> is equivalent to <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x120.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x121.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x122.png" xlink:type="simple"/></inline-formula> with <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x120.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x121.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x122.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x123.png" xlink:type="simple"/></inline-formula> removed, and <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x120.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x121.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x122.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x123.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x124.png" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x120.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x121.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x122.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x123.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x124.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x125.png" xlink:type="simple"/></inline-formula> are respectively the conditional mean and variance of <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x120.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x121.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x122.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x123.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x124.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x125.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x126.png" xlink:type="simple"/></inline-formula> given all other elements in <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x120.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x121.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x122.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x123.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x124.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x125.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x126.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x127.png" xlink:type="simple"/></inline-formula> from</p><p><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x128.png" xlink:type="simple"/></inline-formula>.</p><p>Similarly, for the latent variables,</p><disp-formula id="scirp.51474-formula91"><label>(15)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-1240423x129.png"  xlink:type="simple"/></disp-formula><p>for<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x130.png" xlink:type="simple"/></inline-formula>, where <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x130.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x131.png" xlink:type="simple"/></inline-formula> denotes a univariate normal distribution with mean <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x130.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x131.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x132.png" xlink:type="simple"/></inline-formula> and variance <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x130.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x131.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x132.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x133.png" xlink:type="simple"/></inline-formula> truncated to the region<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x130.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x131.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x132.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x133.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x134.png" xlink:type="simple"/></inline-formula>. In (15), <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x130.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x131.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x132.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x133.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x134.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x135.png" xlink:type="simple"/></inline-formula>is <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x130.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x131.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x132.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x133.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x134.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x135.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x136.png" xlink:type="simple"/></inline-formula> with <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x130.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x131.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x132.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x133.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x134.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x135.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x136.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x137.png" xlink:type="simple"/></inline-formula> removed, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x130.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x131.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x132.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x133.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x134.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x135.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x136.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x137.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x138.png" xlink:type="simple"/></inline-formula>is the interval <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x130.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x131.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x132.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x133.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x134.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x135.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x136.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x137.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x138.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x139.png" xlink:type="simple"/></inline-formula> if <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x130.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x131.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x132.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x133.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x134.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x135.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x136.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x137.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x138.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x139.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x140.png" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x130.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x131.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x132.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x133.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x134.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x135.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x136.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x137.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x138.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x139.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x140.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x141.png" xlink:type="simple"/></inline-formula> otherwise, and <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x130.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x131.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x132.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x133.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x134.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x135.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x136.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x137.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x138.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x139.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x140.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x141.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x142.png" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x130.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x131.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x132.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x133.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x134.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x135.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x136.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x137.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x138.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x139.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x140.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x141.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x142.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x143.png" xlink:type="simple"/></inline-formula> are respectively the conditional mean and variance of <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x130.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x131.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x132.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x133.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x134.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x135.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x136.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x137.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x138.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x139.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x140.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x141.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x142.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x143.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x144.png" xlink:type="simple"/></inline-formula> given all other elements of <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x130.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x131.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x132.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x133.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x134.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x135.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x136.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x137.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x138.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x139.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x140.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x141.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x142.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x143.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x144.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x145.png" xlink:type="simple"/></inline-formula> from<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x130.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x131.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x132.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x133.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x134.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x135.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x136.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x137.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x138.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x139.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x140.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x141.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x142.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x143.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x144.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x145.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x146.png" xlink:type="simple"/></inline-formula>.</p><p>The Gibbs sampler recursively samples from the full conditional distributions in (14) and (15) in the usual way. After a sufficient burn-in period, the last <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x147.png" xlink:type="simple"/></inline-formula> draws are used in (11).</p></sec><sec id="s3_2_2"><title>3.2.2. PX-MC M-Step and Reduction Step</title><p>By recognizing that (11) is proportional to the log-likelihood function of a seemingly unrelated regression model with <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x148.png" xlink:type="simple"/></inline-formula> observations and <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x148.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x149.png" xlink:type="simple"/></inline-formula> equations, the maximization can be performed with IGLS. IGLS utilizes the quantities</p><disp-formula id="scirp.51474-formula92"><label>(16)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-1240423x150.png"  xlink:type="simple"/></disp-formula><p>and</p><disp-formula id="scirp.51474-formula93"><label>, (17)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-1240423x151.png"  xlink:type="simple"/></disp-formula><p>where <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x152.png" xlink:type="simple"/></inline-formula> is equivalent to <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x152.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x153.png" xlink:type="simple"/></inline-formula> with <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x152.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x153.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x154.png" xlink:type="simple"/></inline-formula> and<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x152.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x153.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x154.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x155.png" xlink:type="simple"/></inline-formula>. First evaluate (16) with <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x152.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x153.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x154.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x155.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x156.png" xlink:type="simple"/></inline-formula> removed, which amounts to estimating <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x152.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x153.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x154.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x155.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x156.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x157.png" xlink:type="simple"/></inline-formula> equation by equation, and then evaluate (17) based on<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x152.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x153.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x154.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x155.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x156.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x157.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x158.png" xlink:type="simple"/></inline-formula>. Proceed by iterating (16)</p><p>and (17) recursively until convergence. Denote the converged values as<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x159.png" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x159.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x160.png" xlink:type="simple"/></inline-formula>, and<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x159.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x160.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x161.png" xlink:type="simple"/></inline-formula>.</p><p>In the reduction step, set<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x162.png" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x162.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x164.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x162.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x164.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x163.png" xlink:type="simple"/></inline-formula>, and<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x162.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x164.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x163.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x165.png" xlink:type="simple"/></inline-formula>, where <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x162.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x164.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x163.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x165.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x166.png" xlink:type="simple"/></inline-formula> is a <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x162.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x164.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x163.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x165.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x166.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x167.png" xlink:type="simple"/></inline-formula> diagonal matrix with the first <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x162.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x164.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x163.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x165.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x166.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x167.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x168.png" xlink:type="simple"/></inline-formula> diagonals equal to 1 and the re-</p><p>maining <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x169.png" xlink:type="simple"/></inline-formula> diagonals equal to the square root of the last <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x169.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x170.png" xlink:type="simple"/></inline-formula> diagonals of<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x169.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x170.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x171.png" xlink:type="simple"/></inline-formula>. The previous transformations are referred to as the reduction functions, and they are needed because (12) is used instead of (9) in the algorithm [<xref ref-type="bibr" rid="scirp.51474-ref13">13</xref>] .</p></sec></sec><sec id="s3_3"><title>3.3. Standard Errors</title><p>The observed information matrix is</p><disp-formula id="scirp.51474-formula94"><label>, (18)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/5-1240423x172.png"  xlink:type="simple"/></disp-formula><p>where<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x173.png" xlink:type="simple"/></inline-formula>, and <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x173.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x174.png" xlink:type="simple"/></inline-formula> is a column vector denoting the unique elements in<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x173.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x174.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x175.png" xlink:type="simple"/></inline-formula>. Evaluate (18) at the ML estimates, and take the expectation and variance with respect to<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x173.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x174.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x175.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/5-1240423x176.png" xlink:type="simple"/></inline-formula>. These moments are</p><p>estimated by taking additional draws from the Gibbs sampler and constructing their Monte Carlo analogs. The standard errors are the square roots of the diagonals of the inverse estimated quantity in (18).</p></sec></sec><sec id="s4"><title>4. Concluding Remarks</title><p>A new and simple ML estimation algorithm is developed for multivariate sample selection models. Roughly speaking, the implementation of this algorithm only involves iteratively drawing sets of missing data from well- known distributions and using IGLS on the complete data, both of which are inexpensive to perform. By using parameter expansion and Monte Carlo methods, the algorithm only depends on quantities with closed form expressions, even when estimating the covariance matrix parameter with correlation restrictions. This algorithm is readily extendable to other types of selection models, including extensions to various types of outcome and selection variables with an underlying normal structure, and modifications to time-series or panel data.</p></sec><sec id="s5"><title>Acknowledgements</title><p>I would like to thank the referee, Alicia Lloro, Andrew Chang, Jonathan Cook, and Sibel Sirakaya for their helpful comments.</p></sec></body><back><ref-list><title>References</title><ref id="scirp.51474-ref1"><label>1</label><mixed-citation publication-type="other" xlink:type="simple">Heckman, J. (1974) Shadow Prices, Market Wages, and Labor Supply. Econometrica, 42, 679-694.  
http://dx.doi.org/10.2307/1913937</mixed-citation></ref><ref id="scirp.51474-ref2"><label>2</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>Heckman</surname><given-names> J. </given-names></name>,<etal>et al</etal>. (<year>1976</year>)<article-title>The Common Structure of Statistical Models of Truncation, Sample Selection and Limited Dependent Variables and a Simple Estimator for Such Models</article-title><source> Annals of Economic and Social Measurement</source><volume> 5</volume>,<fpage> 475</fpage>-<lpage>492</lpage>.<pub-id pub-id-type="doi"></pub-id></mixed-citation></ref><ref id="scirp.51474-ref3"><label>3</label><mixed-citation publication-type="other" xlink:type="simple">Heckman, J. (1979) Sample Selection Bias as a Specification Error. Econometrica, 47, 153-161.  
http://dx.doi.org/10.2307/1912352</mixed-citation></ref><ref id="scirp.51474-ref4"><label>4</label><mixed-citation publication-type="other" xlink:type="simple">Su, S.J. and Yen, S.T. (2000) A Censored System of Cigarette and Alcohol Consumption. Applied Economics, 32, 729-737. http://dx.doi.org/10.1080/000368400322354</mixed-citation></ref><ref id="scirp.51474-ref5"><label>5</label><mixed-citation publication-type="other" xlink:type="simple">Yen, S.T., Kan, K. and Su, S.J. (2002) Household Demand for Fats and Oils: Two-Step Estimation of a Censored Demand System. Applied Economics, 34, 1799-1806. http://dx.doi.org/10.1080/00036840210125008</mixed-citation></ref><ref id="scirp.51474-ref6"><label>6</label><mixed-citation publication-type="other" xlink:type="simple">Hao, A.F. (2008) A Discrete-Continuous Model of Households’ Vehicle Choice and Usage, with an Application to the Effects of Residential Density. Transportation Research Part B: Methodological, 42, 736-758.  
http://dx.doi.org/10.1016/j.trb.2008.01.004</mixed-citation></ref><ref id="scirp.51474-ref7"><label>7</label><mixed-citation publication-type="other" xlink:type="simple">Li, P. (2011) Estimation of Sample Selection Models with Two Selection Mechanisms. Computational Statistics &amp; Data Analysis, 55, 1099-1108. http://dx.doi.org/10.1016/j.csda.2010.09.006</mixed-citation></ref><ref id="scirp.51474-ref8"><label>8</label><mixed-citation publication-type="other" xlink:type="simple">Li, P. and Rahman, M.A. (2011) Bayesian Analysis of Multivariate Sample Selection Models Using Gaussian Copulas. Advances in Econometrics, 27, 269-288. http://dx.doi.org/10.1108/S0731-9053(2011)000027A013</mixed-citation></ref><ref id="scirp.51474-ref9"><label>9</label><mixed-citation publication-type="other" xlink:type="simple">Yen, S.T. (2005) A Multivariate Sample-Selection Model: Estimating Cigarette and Alcohol Demands with Zero Observations. American Journal of Agricultural Economics, 87, 453-466.  
http://dx.doi.org/10.1111/j.1467-8276.2005.00734.x</mixed-citation></ref><ref id="scirp.51474-ref10"><label>10</label><mixed-citation publication-type="other" xlink:type="simple">Tauchmann, H. (2010) Consistency of Heckman-Type Two-Step Estimators for the Multivariate Sample-Selection Model. Applied Economics, 42, 3895-3902. http://dx.doi.org/10.1080/00036840802360179</mixed-citation></ref><ref id="scirp.51474-ref11"><label>11</label><mixed-citation publication-type="other" xlink:type="simple">Puhani, P.A. (2000) The Heckman Correction for Sample Selection and Its Critique. Journal of Economic Surveys, 14, 53-68. http://dx.doi.org/10.1111/1467-6419.00104</mixed-citation></ref><ref id="scirp.51474-ref12"><label>12</label><mixed-citation publication-type="other" xlink:type="simple">Dempster, A.P., Laird, N.M. and Rubin, D.B. (1977) Maximum Likelihood from Incomplete Data via the EM Algorithm. Journal of the Royal Statistical Society, 39, 1-38. http://dx.doi.org/10.2307/2984875</mixed-citation></ref><ref id="scirp.51474-ref13"><label>13</label><mixed-citation publication-type="other" xlink:type="simple">Liu, C., Rubin, D.B. and Wu, Y.N. (1998) Parameter Expansion to Accelerate EM: The PX-EM Algorithm. Biometrika, 85, 755-770. http://dx.doi.org/10.1093/biomet/85.4.755</mixed-citation></ref></ref-list></back></article>