VDPSOHWHVWVRIXQLIRUPLW\LVWKH5D\OHLJKWHVWZKLFKDVVHVVHVWKHYDOXHRIWKH
PHDQUHVXOWDQWOHQJWKȡWRGHWHUPLQHLIWKHGDWDDUHXQLIRUPO\GLVWULEXWHG,Iȡ LVODUJHWKHQXOOK\SRWKHVLVRIXQLIRUPLW\LVUHMHFWHG7KHUHODWHG9WHVW'XUDQG
DQG*UHHQZRRG DVVHVVHVXQLIRUPLW\RIWKHVDPSOHGDWDDJDLQVWWKHVSHFLDO
FDVHRIFOXVWHULQJWRZDUGVDSUHVSHFLILHGGLUHFWLRQDQGLVXVHIXOLQWHVWLQJIRU
DJJUHJDWLRQWRZDUGVDVHQVRU\VWLPXOXV
)LJ'HWHUPLQDWLRQRIDQLPDOKHDGLQJ
'LDJUDPLQGLFDWLQJKRZWKHGLUHFWLRQRIWUDYHORIWKHDQLPDOIURPWKHFHQWUDOUHJLRQRIWKHDUHQDLVGHWHUPLQHG IRU
SDSHUV ,,,97KH EOXHFURVVHVLQGLFDWH ZKHUHWKH DQLPDOKDVUHDFKHGWZR FLUFOHVHTXLYDOHQWWR SUHGHWHUPLQHG
GLVWDQFHVIURPWKHDUHQD FHQWUH
+DYH\RXWKRXJKWDERXWPRGHOOLQJ",QIHUHQFHRIYLVXDO
WRWUHDWWKHVH GDWDLVWRGLVFUHWL]HWKHP EDVHGRQDVHQVLEOHFULWHULRQWRGLVWLQJXLVK
EHWZHHQSDWKVWKDWDUHOLNHO\RULHQWHGDQGWKRVHZKLFKDUHQRW:HKDYHGRQH
WKLVIRUHDFKVHWRIFLUFXODUDUHQDH[SHULPHQWVE\GHPDUFDWLQJDVHFWRURIWKH
DUHQDZLWKLWVPLGSRLQWDWWKHPLGSRLQWRIWKHVWLPXOXVWDUJHW7KHVHFWRUZLGWK
ZDV FKRVHQWR EH ZLGHUWKDQ WKH KDOIZLGWK RI ZLGHVW VWLPXOXVWDUJHW LQ HDFK
H[SHULPHQW7KHVHFWRUZLGWKLVΣ IRU3DSHU,Σ IRUSDSHU,,DQGΣ IRUWKH
VXEVHTXHQW SDSHUV +HDGLQJV ZKLFK IDOO ZLWKLQ WKH VHFWRU DUH FRQVLGHUHG
VXFFHVVIXORULHQWDWLRQDQGWKRVHZKLFKGRQ¶WDUHQRW7KLVLQWURGXFHVDQDUELWUDU\
GLVWLQFWLRQEHWZHHQSRLQWVDWHLWKHUVLGHRIWKHVHFWRUHGJHEXWLWDYRLGVPDNLQJ
WKHSUHFLVHKHDGLQJVRIGLVRULHQWHGDQLPDOVLQIRUPDWLYHHJZKHWKHUDQDQLPDO
KHDGVΣRUΣ DZD\IURPWKHVWLPXOXVWDUJHWDVZRXOGRFFXUZLWKFLUFXODUO\
GLVWULEXWHGGDWD$VWKHDODUPUHVSRQVHH[SHULPHQWLQ3DSHU,,DOUHDG\\LHOGVD
ELQDU\ RXWFRPH DOO RI WKH EHKDYLRXUDO H[SHULPHQWV ZHUH WUHDWHG RI DV ELQDU\
UHVSRQVHGDWDZKLFKRXJKWWRDULVHIURPDELQRPLDOGLVWULEXWLRQ
$Q DOWHUQDWLYH WR QXOO K\SRWKHVLV WHVWLQJ LV WR PRGHO WKH SDUDPHWHUV ZKLFK
JHQHUDWHGWKHGDWDXVLQJDOLNHOLKRRGPRGHO2QHVROXWLRQWRWKHFKDOOHQJHVRI
DYRLGLQJSVHXGRUHSOLFDWLRQZLWKRXWVDFULILFLQJWRRPXFKVWDWLVWLFDOSRZHULVWKH
XVHRIOLQHDUPL[HGPRGHOV,QSDSHUV,DQG,,ZHKDYHXVHGPD[LPXPOLNHOLKRRG
HVWLPDWLRQPHWKRGVWRHVWLPDWHWKHSDUDPHWHUVZKLFKUHVXOWHGLQWKHGLVWULEXWLRQ
RI GDWD 0RUHRYHU DV RSSRVHG WR SUHFHGLQJ PHWKRGV ZKLFK WDNH DFFRXQW RI
UHSHDWHGPHDVXUHVRILQGLYLGXDOVRUJURXSVOLQHDUPL[HGPRGHOVFDQWDNHLQWR
DFFRXQWDOOVRXUFHVRIYDULDWLRQLQDVLQJOHPRGHOVLPXOWDQHRXVO\6RUHQVHQDQG
9DVLVKWK $YDU\LQJHIIHFWIRUWKHYDULDWLRQRILQGLYLGXDOVLVLQFOXGHGIRU
WKHVWDWLVWLFDOPRGHOVLQDOORIWKHSDSHUV
$SSO\LQJDQDEVROXWHWKUHVKROGPRGHORIVLJQDOGHWHFWLRQDOORZVXVWRGHILQHD
FULWLFDO YDOXH RI VWLPXOXV EHORZ ZKLFK D VDOLHQW YLVXDO FXH LV QR ORQJHU
UHFRJQLVHG :KHQ HVWLPDWLQJ VLJQDO GHWHFWLRQ IURP EHKDYLRXU VWDWLVWLFDO
PRGHOOLQJ FDQ IDFLOLWDWH WKLV E\ FKDUDFWHULVLQJ WKH HYLGHQFH DQG FRQVHTXHQW
XQFHUWDLQW\RI\RXUHVWLPDWH0RGHOOLQJWKHUHODWLRQVKLSEHWZHHQWKHUHVSRQVHRI
DQDQLPDOWRDVWLPXOXVLQWKLVLQVWDQFHYLDLQFUHDVHGFRQFHQWUDWLRQWRZDUGVWKH
VWLPXOXVWDUJHWZLWKUHVSHFWWRDFKDQJHLQVWLPXOXVLQWHQVLW\KHUHYLDDFKDQJH
LQVWLPXOXVDUFDQJOHFDQEHLQYHVWLJDWHG XVLQJWKHSV\FKRPHWULFIXQFWLRQȥ(x) )LJ 7KLV LPSRUWDQW SV\FKRSK\VLFDO WRRO LV DQ LPSOHPHQWDWLRQ RI WKH
JHQHUDOL]HG OLQHDU PRGHO ZKLFK FDQ EH PRGHOOHG DFFRUGLQJ WR D YDULHW\ RI
GLVWULEXWLRQVGHSHQGLQJRQWKHUHODWLRQVKLSDQGWKHRXWFRPHGDWDHJD%HUQRXOOL
RUELQRPLDOGLVWULEXWLRQDSSOLHGWRELQDU\RXWFRPHGDWDRUDEHWDGLVWULEXWLRQIRU
SURSRUWLRQGDWDERXQGHGEHWZHHQDQG,Q3DSHUV,DQG,,ORJLVWLFUHJUHVVLRQ
PRGHOVDUHLPSOHPHQWHGXVLQJPD[LPXPOLNHOLKRRGHVWLPDWLRQ
,QWKHFDVHRISURSRUWLRQVWKHSV\FKRPHWULFIXQFWLRQFDQEHIRUPXODWHGDV
ɗሺݔǢ Ƚǡ Ⱦǡ ɀǡ ɉሻ ൌ ߛ ሺͳ െ ߛ െ ߣሻ ή ܨሺݔǢ Ƚǡ Ⱦሻ
ZKHUH Ȗ LVWKHEDVHUDWHWKHUDWHDWZKLFKDQLPDOVZLOOUHVSRQGZKHQQRVWLPXOXV
KDVEHHQSURYLGHGȜ LVWKHODSVHUDWHWKHPD[LPDOUDWHDWZKLFKDQDQLPDOZLOO
UHVSRQGWRDQ\UHOHYDQWYDOXHRIWKHVWLPXOXVDQGF(x;Į,ȕ) LVDIXQFWLRQERXQGHG
EHWZHHQ DQG ZKLFK GHVFULEHV WKH SHUIRUPDQFH RI WKH DQLPDO UHODWLYH WR
VWLPXOXVLQWHQVLW\DQGLVW\SLFDOO\DVLJPRLG:LFKPDQQDQG+LOO
)LJ7KHSV\FKRPHWULFIXQFWLRQ
7KHSV\FKRPHWULFIXQFWLRQWRLGHQWLI\WKHVWLPXOXVLQWHQVLW\UHTXLUHGWRLQVWLJDWHDEHKDYLRXUDOUHVSRQVH
$ VORSH DQG LQWHUFHSW DUH HVWLPDWHG IRU WKLV FXUYH IURP ZKLFK D GHWHFWLRQ
WKUHVKROGFDQEHGHILQHGLQDQXPEHURIZD\V $XVHIXOPHDVXUHLVWKHLQIOHFWLRQ
SRLQWDVLWLVQRWGHSHQGHQWRQDQDUELWUDU\LQWHUYDODQGLWLVDSSURSULDWHZKHQ
WKH ODSVH UDWH DQG EDVH UDWH DUH NQRZQ RU FDQ EH HVWLPDWHG ,GHDOO\ DV
Psychometric function of response to stimulus
PHQWLRQHGDERYHDUREXVWEHKDYLRXUDOUHVSRQVHZRXOGEHDVVD\HGEXWWKLVLVQRW
DOZD\VSRVVLEOHIRUVSHFLHVDQGWD[RQ
%D\HVLDQLQIHUHQFH
7KHODSVHDQGEDVHUDWHVFDQEHIRXQGIURPWKHXSSHUDQGORZHUDV\PSWRWHVRI
WKH UHVXOWDQW UHVSRQVH FXUYH UHVSHFWLYHO\ 7KHVH YDOXHV FDQ EH GLIILFXOW WR
HVWLPDWH ZLWK OLNHOLKRRG PRGHOV 0RUHRYHU OLNHOLKRRG PRGHOV FDQ IDLO WR
FRQYHUJHFRUUHFWO\ZKHQPXOWLSOHHIIHFWVDUHLQFOXGHGDQGFDQVXIIHUIURPLVVXHV
VXFKDVVHSDUDWLRQLQORJLVWLFUHJUHVVLRQPRGHOV7KHUHIRUHLQ 3DSHUV,,,DQG,9
ZH XVHG ORJLVWLF UHJUHVVLRQ PRGHOV XVLQJ %D\HVLDQ PRGHOOLQJ %D\HVLDQ
LQIHUHQFHPHWKRGVDUHKLJKO\IOH[LEOHDQGDOORZIRUWKHKLHUDUFKLFDOPRGHOOLQJ
RIGDWDZLWKUHVSHFWWRPDQ\SUHGLFWRUV0L[HGHIIHFWVPRGHOVFDQSURYLGHPRUH
DFFXUDWHSUHGLFWLRQVWKDQRWKHUDYDLODEOHPHWKRGVIRUIXWXUHREVHUYDWLRQVRIGDWD
*HOPDQ %D\HVLDQLQIHUHQFHLVDIRUPRIVWDWLVWLFDOLQIHUHQFH EDVHGRQDQ
DSSOLFDWLRQRI%D\HVWKHRUHPZKLFKXVHVSUREDELOLVWLFPRGHOOLQJWRLQFRUSRUDWH
SULRUNQRZOHGJHDVZHOODVGDWD8VLQJSUREDELOLVWLFPRGHOOLQJWKHSUREDELOLW\
RIPDQ\GLIIHUHQWK\SRWKHVHVDUHDVVHVVHGLQWKHFRQWH[WRIWKHGDWD
*HQHUDOO\VSHDNLQJ0DUNRYFKDLQ0RQWH&DUOR0&0&LVXVHGWRFDUU\RXW
%D\HVLDQXSGDWLQJ8VLQJWKHVHPHWKRGV%D\HVWKHRUHPLVW\SLFDOO\IRUPXODWHG
DVIROORZV
ሺɅȁݕሻןሺߠሻ ή ሺݕȁߠሻ
ZKHUH\LVWKHRXWFRPHșLVWKHPRGHOSDUDPHWHUZKLFKUHVXOWVLQWKHGDWD pș_yLVWKHSRVWHULRUSUREDELOLW\pșLVWKHSULRUSUREDELOLW\DQGpy_șLVWKH
OLNHOLKRRG 7KH SRVWHULRU SUREDELOLW\ LV WKH GLVWULEXWLRQ RI SUREDELOLW\ RI WKH
K\SRWKHVLVJLYHQWKHRXWFRPHWKHGDWD7KHSULRUSUREDELOLW\LVWKH GLVWULEXWLRQ
RI SUREDELOLW\ HVWLPDWHV RI WKH K\SRWKHVLV EHIRUH WKH GDWD DUH REVHUYHG 7KH
OLNHOLKRRGLVWKHHVWLPDWHGSUREDELOLW\RIREVHUYLQJWKHGDWDJLYHQWKHPRGHO
ZKLFKLVGHULYHGXVLQJPD[LPXPOLNHOLKRRGHVWLPDWLRQ
0&0&LVFRPSXWDWLRQDOO\LQWHQVLYHDQGWKHUHIRUHLWZDVQRWXQWLOUHFHQWO\WKDW
LQFUHDVHG FRPSXWLQJ SRZHU KDV PDGH %D\HVLDQ PRGHOOLQJ IHDVLEOH IRU
ZLGHVSUHDGXVH7KH6WDQODQJXDJH&DUSHQWHUHWDO IDFLOLWDWH%D\HVLDQ
SUREDELOLVWLFPRGHOOLQJXVLQJ+DPLOWRQLDQ0RQWH&DUORZKLFKLVPXFKPRUH
HIIHFWLYHLQVDPSOLQJWKHSDUDPHWHUVSDFHWKDQWKHPHWKRGVZKLFKSUHFHGHGLW
6WDQ LV FRPSXWDWLRQDOO\ IDVW H[WUHPHO\ IOH[LEOH DQG FDQ HIIHFWLYHO\ HVWLPDWH
PRGHOV ZLWK PDQ\ SDUDPHWHUV 7KH LQFOXVLRQ RI SULRU NQRZOHGJH LV WKH NH\
DGYDQWDJHEXWDOVRWKHPRVWSUREOHPDWLFDVSHFWRI%D\HVLDQLQIHUHQFH
)LJ 6XPPDU\RIVLJQDOUHVROXWLRQH[SHULPHQWV
5DQJHVRIUHVROXWLRQLGHQWLILHGLQWKHEHKDYRXUDOH[SHULPHQWVLQWKLVWKHVLV
7KHSULRUUHSUHVHQWHGDVDSUREDELOLW\GLVWULEXWLRQIRUDJLYHQTXDQWLW\LQWKH
PRGHO VXFK DV D SDUDPHWHUWR EHHVWLPDWHG FDQ EH GHULYHGIURP SUHYLRXV RU
SUHOLPLQDU\ GDWD RU IURP RWKHU HYLGHQFH 7KRXJKWIXOO\DSSOLHG DSSURSULDWH
SULRUV PDNH IRUD PRUHUHDOLVWLF PRGHO DQG FDQLQFUHDVH WKHHIILFLHQF\ RI WKH
DQDO\VLVWKH\GRVRE\UXOLQJRXWXQUHDVRQDEOHSRVVLELOLWLHVZKLOHQRWUXOLQJRXW
VHQVLEOH SRVVLELOLWLHV 7KH ILW RI HDFK PRGHO LV WKHQ DVVHVVHG E\ VHYHUDO
LQGHSHQGHQWPHDVXUHVWRHQVXUHWKDWLWKDVFRQYHUJHG%D\HVLDQPHWKRGVH[FHO
ZLWK UHJDUG WR PL[HG HIIHFWV PRGHOV DOVR NQRZQ DV KLHUDUFKLFDO OLQHDU RU
PXOWLOHYHOPRGHOVZKLFKFDQWDNHDFFRXQWRIUDQGRPHIIHFWVDQGKHOS DYRLG
SVHXGRUHSOLFDWLRQ