定義
![相合估計](/img/c/c8d/wZwpmLxgDO3cDM3ETOxYjN1UTM1QDN5MjM5ADMwAjMwUzLxkzLyYzLt92YucmbvRWdo5Cd0FmLzE2LvoDc0RHa.jpg)
![相合估計](/img/e/742/wZwpmLzQzN3YTM3AzN0YzM1UTM1QDN5MjM5ADMwAjMwUzLwczL3gzLt92YucmbvRWdo5Cd0FmL0E2LvoDc0RHa.jpg)
![相合估計](/img/1/543/wZwpmL3gzMxMTM3AjNxYjN1UTM1QDN5MjM5ADMwAjMwUzLwYzLzgzLt92YucmbvRWdo5Cd0FmLwE2LvoDc0RHa.jpg)
![相合估計](/img/9/08a/wZwpmLyEzNyMzM3MTMxcTN1UTM1QDN5MjM5ADMwAjMwUzLzEzLzAzLt92YucmbvRWdo5Cd0FmL0E2LvoDc0RHa.jpg)
設 為 的基於樣本的 的一個估計量,顯然它依賴於樣本n,為表明這種依賴性,可以記之為 。隨著樣本量的變化,可得到一列估計量,一個自然的希望是,當樣本容量無線增加時,估計量能夠依某種意義接近於被估計量的真值。顯然,這是對估計量的起碼要求。相合性就是這樣的一個要求。
相合估計量
弱相合估計,簡稱為相合估計。
![相合估計](/img/e/b10/wZwpmL1UjN5QDNycDN2YjN1UTM1QDN5MjM5ADMwAjMwUzL3QzL2EzLt92YucmbvRWdo5Cd0FmLwE2LvoDc0RHa.jpg)
![相合估計](/img/e/742/wZwpmLzQzN3YTM3AzN0YzM1UTM1QDN5MjM5ADMwAjMwUzLwczL3gzLt92YucmbvRWdo5Cd0FmL0E2LvoDc0RHa.jpg)
![相合估計](/img/1/543/wZwpmL3gzMxMTM3AjNxYjN1UTM1QDN5MjM5ADMwAjMwUzLwYzLzgzLt92YucmbvRWdo5Cd0FmLwE2LvoDc0RHa.jpg)
![相合估計](/img/c/48a/wZwpmLyAjMxUjM5ETM0YTN1UTM1QDN5MjM5ADMwAjMwUzLxEzL4MzLt92YucmbvRWdo5Cd0FmLxE2LvoDc0RHa.jpg)
![相合估計](/img/a/325/wZwpmL2czMzMTO3QjN0kTO0UTMyITNykTO0EDMwAjMwUzL0YzLwQzLt92YucmbvRWdo5Cd0FmL0E2LvoDc0RHa.jpg)
設 為 的基於樣本的 的一個估計量,若對任意固定的 ,都滿足:對於任給的 ,有
![相合估計](/img/9/74d/wZwpmL3QzNwQDNxQzN2YjN1UTM1QDN5MjM5ADMwAjMwUzL0czL1gzLt92YucmbvRWdo5Cd0FmLzE2LvoDc0RHa.jpg)
![相合估計](/img/9/08a/wZwpmLyEzNyMzM3MTMxcTN1UTM1QDN5MjM5ADMwAjMwUzLzEzLzAzLt92YucmbvRWdo5Cd0FmL0E2LvoDc0RHa.jpg)
![相合估計](/img/e/742/wZwpmLzQzN3YTM3AzN0YzM1UTM1QDN5MjM5ADMwAjMwUzLwczL3gzLt92YucmbvRWdo5Cd0FmL0E2LvoDc0RHa.jpg)
![相合估計](/img/7/949/wZwpmL0gDMzEjN5AzNxYjN1UTM1QDN5MjM5ADMwAjMwUzLwczLyUzLt92YucmbvRWdo5Cd0FmLwE2LvoDc0RHa.jpg)
成立,則稱 為 的相合估計量,上述極限式簡記為 。
強相合估計量
![相合估計](/img/c/48a/wZwpmLyAjMxUjM5ETM0YTN1UTM1QDN5MjM5ADMwAjMwUzLxEzL4MzLt92YucmbvRWdo5Cd0FmLxE2LvoDc0RHa.jpg)
若對任何固定的 都有
![相合估計](/img/f/7e0/wZwpmLyczN5cTMycTN2YjN1UTM1QDN5MjM5ADMwAjMwUzL3UzL1gzLt92YucmbvRWdo5Cd0FmLzE2LvoDc0RHa.jpg)
![相合估計](/img/9/08a/wZwpmLyEzNyMzM3MTMxcTN1UTM1QDN5MjM5ADMwAjMwUzLzEzLzAzLt92YucmbvRWdo5Cd0FmL0E2LvoDc0RHa.jpg)
![相合估計](/img/e/742/wZwpmLzQzN3YTM3AzN0YzM1UTM1QDN5MjM5ADMwAjMwUzLwczL3gzLt92YucmbvRWdo5Cd0FmL0E2LvoDc0RHa.jpg)
![相合估計](/img/6/921/wZwpmLwQTM0YzN5YDOxYjN1UTM1QDN5MjM5ADMwAjMwUzL2gzL1IzLt92YucmbvRWdo5Cd0FmL0E2LvoDc0RHa.jpg)
則稱 為 的強相合估計量,上述式子可簡記為 ,這裡a.s.為almost surely的縮寫。
兩者的關係
![相合估計](/img/c/48a/wZwpmLyAjMxUjM5ETM0YTN1UTM1QDN5MjM5ADMwAjMwUzLxEzL4MzLt92YucmbvRWdo5Cd0FmLxE2LvoDc0RHa.jpg)
![相合估計](/img/9/08a/wZwpmLyEzNyMzM3MTMxcTN1UTM1QDN5MjM5ADMwAjMwUzLzEzLzAzLt92YucmbvRWdo5Cd0FmL0E2LvoDc0RHa.jpg)
![相合估計](/img/e/742/wZwpmLzQzN3YTM3AzN0YzM1UTM1QDN5MjM5ADMwAjMwUzLwczL3gzLt92YucmbvRWdo5Cd0FmL0E2LvoDc0RHa.jpg)
![相合估計](/img/9/74d/wZwpmL3QzNwQDNxQzN2YjN1UTM1QDN5MjM5ADMwAjMwUzL0czL1gzLt92YucmbvRWdo5Cd0FmLzE2LvoDc0RHa.jpg)
![相合估計](/img/c/48a/wZwpmLyAjMxUjM5ETM0YTN1UTM1QDN5MjM5ADMwAjMwUzLxEzL4MzLt92YucmbvRWdo5Cd0FmLxE2LvoDc0RHa.jpg)
![相合估計](/img/9/08a/wZwpmLyEzNyMzM3MTMxcTN1UTM1QDN5MjM5ADMwAjMwUzLzEzLzAzLt92YucmbvRWdo5Cd0FmL0E2LvoDc0RHa.jpg)
![相合估計](/img/e/742/wZwpmLzQzN3YTM3AzN0YzM1UTM1QDN5MjM5ADMwAjMwUzLwczL3gzLt92YucmbvRWdo5Cd0FmL0E2LvoDc0RHa.jpg)
若對任意固定的 ,隨機變數序列 依機率收斂於 ;而 則表明對於任何 , 幾乎處處收斂於 ,可以證明,強相合估計量必為相合估計量。
相關定理
定理1
![相合估計](/img/5/0a8/wZwpmLxMDMxUDO1AjNxYjN1UTM1QDN5MjM5ADMwAjMwUzLwYzL4IzLt92YucmbvRWdo5Cd0FmLwE2LvoDc0RHa.jpg)
![相合估計](/img/a/d73/wZwpmL4gjNzYDO2MzNxYjN1UTM1QDN5MjM5ADMwAjMwUzLzczLzgzLt92YucmbvRWdo5Cd0FmL0E2LvoDc0RHa.jpg)
![相合估計](/img/b/3c2/wZwpmLwgDN3kzMwcDOxYjN1UTM1QDN5MjM5ADMwAjMwUzL3gzL1gzLt92YucmbvRWdo5Cd0FmLwE2LvoDc0RHa.jpg)
![相合估計](/img/6/796/wZwpmLxAjM5kTO2YTMxMzM1UTM1QDN5MjM5ADMwAjMwUzL2EzL2AzLt92YucmbvRWdo5Cd0FmL0E2LvoDc0RHa.jpg)
![相合估計](/img/c/d0f/wZwpmLzMTMyIjNwEDOxYjN1UTM1QDN5MjM5ADMwAjMwUzLxgzL2QzLt92YucmbvRWdo5Cd0FmLzE2LvoDc0RHa.jpg)
![相合估計](/img/5/0a8/wZwpmLxMDMxUDO1AjNxYjN1UTM1QDN5MjM5ADMwAjMwUzLwYzL4IzLt92YucmbvRWdo5Cd0FmLwE2LvoDc0RHa.jpg)
設 在參數空間 上連續, 為 的強相合估計量,i=1,2,...,k,則 為 的強相合估計量。
定理2
![相合估計](/img/4/863/wZwpmL2YTM2cTNzgzNxYjN1UTM1QDN5MjM5ADMwAjMwUzL4czL1UzLt92YucmbvRWdo5Cd0FmLwE2LvoDc0RHa.jpg)
![相合估計](/img/e/742/wZwpmLzQzN3YTM3AzN0YzM1UTM1QDN5MjM5ADMwAjMwUzLwczL3gzLt92YucmbvRWdo5Cd0FmL0E2LvoDc0RHa.jpg)
![相合估計](/img/8/efa/wZwpmL3EjNwgjN0kzNxYjN1UTM1QDN5MjM5ADMwAjMwUzL5czLwMzLt92YucmbvRWdo5Cd0FmLwE2LvoDc0RHa.jpg)
![相合估計](/img/2/c34/wZwpmL0IzM1kjM2ITOxYjN1UTM1QDN5MjM5ADMwAjMwUzLykzLyEzLt92YucmbvRWdo5Cd0FmLzE2LvoDc0RHa.jpg)
![相合估計](/img/a/ede/wZwpmL2AjM5MzMzITOxYjN1UTM1QDN5MjM5ADMwAjMwUzLykzL3UzLt92YucmbvRWdo5Cd0FmLyE2LvoDc0RHa.jpg)
![相合估計](/img/e/742/wZwpmLzQzN3YTM3AzN0YzM1UTM1QDN5MjM5ADMwAjMwUzLwczL3gzLt92YucmbvRWdo5Cd0FmL0E2LvoDc0RHa.jpg)
設總體有直到k(k≥2)階的矩 。 可表示為 ,且G為連續函式。記 分別為樣本原點矩和樣本中心矩,則 為 的強相合估計量。
注意:由該定理可知,矩估計量一般是強相合的。
定理3
![相合估計](/img/f/51b/wZwpmLxUDM5AzN5YTNxYjN1UTM1QDN5MjM5ADMwAjMwUzL2UzLyQzLt92YucmbvRWdo5Cd0FmLwE2LvoDc0RHa.jpg)
設分布族 滿足:
(1)X是有限集;
(2)對於不同的參數值θ和θ’,所對應的分布不同;
![相合估計](/img/f/51b/wZwpmLxUDM5AzN5YTNxYjN1UTM1QDN5MjM5ADMwAjMwUzL2UzLyQzLt92YucmbvRWdo5Cd0FmLwE2LvoDc0RHa.jpg)
![相合估計](/img/c/2c0/wZwpmLwcjNyAzMxITOxYjN1UTM1QDN5MjM5ADMwAjMwUzLykzL3IzLt92YucmbvRWdo5Cd0FmLxE2LvoDc0RHa.jpg)
(3) 有共同支撐,即 與θ無關;
![相合估計](/img/1/543/wZwpmL3gzMxMTM3AjNxYjN1UTM1QDN5MjM5ADMwAjMwUzLwYzLzgzLt92YucmbvRWdo5Cd0FmLwE2LvoDc0RHa.jpg)
![相合估計](/img/2/223/wZwpmLyAjNzYzN0kDOxYjN1UTM1QDN5MjM5ADMwAjMwUzL5gzLxEzLt92YucmbvRWdo5Cd0FmLzE2LvoDc0RHa.jpg)
![相合估計](/img/a/435/wZwpmLygTOyIDNzkDOzYTN1UTM1QDN5MjM5ADMwAjMwUzL5gzL3YzLt92YucmbvRWdo5Cd0FmL0E2LvoDc0RHa.jpg)
則對於簡單隨機樣本 ,θ的最大似然估計量 存在,且 為θ的相合估計量。
定理4
![相合估計](/img/f/51b/wZwpmLxUDM5AzN5YTNxYjN1UTM1QDN5MjM5ADMwAjMwUzL2UzLyQzLt92YucmbvRWdo5Cd0FmLwE2LvoDc0RHa.jpg)
設分布族 滿足:
(1)θ為R(一維實空間)中的開集;
(2)不同的參數值θ和θ’,所對應的分布不同;
![相合估計](/img/f/51b/wZwpmLxUDM5AzN5YTNxYjN1UTM1QDN5MjM5ADMwAjMwUzL2UzLyQzLt92YucmbvRWdo5Cd0FmLwE2LvoDc0RHa.jpg)
(3) 有共同支撐A;
![相合估計](/img/5/6ce/wZwpmLwIDM1UTN1YjNxYjN1UTM1QDN5MjM5ADMwAjMwUzL2YzL3EzLt92YucmbvRWdo5Cd0FmLwE2LvoDc0RHa.jpg)
![相合估計](/img/e/ddf/wZwpmL1YTN2MzM3kzNxYjN1UTM1QDN5MjM5ADMwAjMwUzL5czLxMzLt92YucmbvRWdo5Cd0FmLxE2LvoDc0RHa.jpg)
![相合估計](/img/2/0d7/wZwpmLxEzN0kTO5czNxYjN1UTM1QDN5MjM5ADMwAjMwUzL3czLyQzLt92YucmbvRWdo5Cd0FmLyE2LvoDc0RHa.jpg)
![相合估計](/img/1/b3c/wZwpmL1gjN4MTM2cDOxYjN1UTM1QDN5MjM5ADMwAjMwUzL3gzLwgzLt92YucmbvRWdo5Cd0FmLzE2LvoDc0RHa.jpg)
![相合估計](/img/c/f17/wZwpmLwQTMwYTM3kjNxYjN1UTM1QDN5MjM5ADMwAjMwUzL5YzLyEzLt92YucmbvRWdo5Cd0FmLwE2LvoDc0RHa.jpg)
![相合估計](/img/7/2f5/wZwpmLwUDM3YTOyETOxYjN1UTM1QDN5MjM5ADMwAjMwUzLxkzLzAzLt92YucmbvRWdo5Cd0FmLxE2LvoDc0RHa.jpg)
![相合估計](/img/a/435/wZwpmLygTOyIDNzkDOzYTN1UTM1QDN5MjM5ADMwAjMwUzL5gzL3YzLt92YucmbvRWdo5Cd0FmL0E2LvoDc0RHa.jpg)
(4) 對θ的偏導數 在X上存在,並且當簡單隨機樣本 時,似然方程 有且僅有解 ,則 ,即 為θ的相合估計量。
典例
例1
![相合估計](/img/a/656/wZwpmLwcTMyMjN3EzNxYjN1UTM1QDN5MjM5ADMwAjMwUzLxczLwIzLt92YucmbvRWdo5Cd0FmLzE2LvoDc0RHa.jpg)
![相合估計](/img/6/048/wZwpmLyUzM5QzM2cTNxYjN1UTM1QDN5MjM5ADMwAjMwUzL3UzLzYzLt92YucmbvRWdo5Cd0FmLwE2LvoDc0RHa.jpg)
設 ,則 是θ的有偏估計,但它是相合的。
證明:
![相合估計](/img/8/c9a/wZwpmLxQzN4QTM3kjNxYjN1UTM1QDN5MjM5ADMwAjMwUzL5YzL0YzLt92YucmbvRWdo5Cd0FmLyE2LvoDc0RHa.jpg)
![相合估計](/img/9/2ac/wZwpmLwUTO2MDMwMDOxYjN1UTM1QDN5MjM5ADMwAjMwUzLzgzLzAzLt92YucmbvRWdo5Cd0FmLzE2LvoDc0RHa.jpg)
![相合估計](/img/6/0b9/wZwpmLygDN0cjN5MTM3QTN1UTM1QDN5MjM5ADMwAjMwUzLzEzL2gzLt92YucmbvRWdo5Cd0FmLwE2LvoDc0RHa.jpg)
的密度函式為 ,此處 為A的示性函式。故對任意ε>0,有
![相合估計](/img/5/135/wZwpmLzMzN5QjNzADOxYjN1UTM1QDN5MjM5ADMwAjMwUzLwgzL1EzLt92YucmbvRWdo5Cd0FmLzE2LvoDc0RHa.jpg)
![相合估計](/img/6/048/wZwpmLyUzM5QzM2cTNxYjN1UTM1QDN5MjM5ADMwAjMwUzL3UzLzYzLt92YucmbvRWdo5Cd0FmLwE2LvoDc0RHa.jpg)
可見 為θ的相合估計。
例2
![相合估計](/img/3/794/wZwpmLwgDM5czN4cTNxYjN1UTM1QDN5MjM5ADMwAjMwUzL3UzL0MzLt92YucmbvRWdo5Cd0FmLwE2LvoDc0RHa.jpg)
設 ,證明θ的極大似然估計是相合的。
證明:似然函式為
![相合估計](/img/1/694/wZwpmL4UTN1ETMwcTNxYjN1UTM1QDN5MjM5ADMwAjMwUzL3UzLyczLt92YucmbvRWdo5Cd0FmLzE2LvoDc0RHa.jpg)
![相合估計](/img/2/a70/wZwpmLzMTN5QzN0ETOxYjN1UTM1QDN5MjM5ADMwAjMwUzLxkzLzczLt92YucmbvRWdo5Cd0FmLzE2LvoDc0RHa.jpg)
故有
![相合估計](/img/b/495/wZwpmL3ATNwATN1cDOxYjN1UTM1QDN5MjM5ADMwAjMwUzL3gzL4UzLt92YucmbvRWdo5Cd0FmL0E2LvoDc0RHa.jpg)
![相合估計](/img/f/225/wZwpmL4ETN2ADO5AzNxYjN1UTM1QDN5MjM5ADMwAjMwUzLwczLzUzLt92YucmbvRWdo5Cd0FmLwE2LvoDc0RHa.jpg)
![相合估計](/img/e/927/wZwpmL4cjN4AjN5IDOxYjN1UTM1QDN5MjM5ADMwAjMwUzLygzLyEzLt92YucmbvRWdo5Cd0FmLwE2LvoDc0RHa.jpg)
可見為θ的嚴格單調下降函式。又因為
![相合估計](/img/2/2d5/wZwpmLzITM0QzNzQzNxYjN1UTM1QDN5MjM5ADMwAjMwUzL0czLwEzLt92YucmbvRWdo5Cd0FmLyE2LvoDc0RHa.jpg)
![相合估計](/img/7/94b/wZwpmL4YTNwATN4EjNxYjN1UTM1QDN5MjM5ADMwAjMwUzLxYzL0QzLt92YucmbvRWdo5Cd0FmLwE2LvoDc0RHa.jpg)
從而有且僅有一個解。故似然方程的根必為極大似然估計量且是相合估計。