3RVWJUDGXDWH6FKRRORI9HWHULQDU\6FLHQFH

6]HQW,VWYiQ8QLYHUVLW\

3RVWJUDGXDWH6FKRRORI9HWHULQDU\6FLHQFH

$HWLRORJ\DQGWUHDWPHQWRIFULEELWLQJEHKDYLRXULQKRUVHV

3K'GLVVHUWDWLRQ

:ULWWHQE\

.ULV]WLQD1DJ\

6]HQW,VWYiQ8QLYHUVLW\

3RVWJUDGXDWH6FKRRORI9HWHULQDU\6FLHQFH

6XSHUYLVRU

'U*iERU%RGy3K''LSO(&96

6]HQW,VWYiQ8QLYHUVLW\)DFXOW\RI9HWHULQDU\6FLHQFHV

&OLQLFIRU/DUJH$QLPDOV

$GYLVRUV

'U3pWHU.DEDL3K'

6]HQW,VWYiQ8QLYHUVLW\)DFXOW\RI9HWHULQDU\6FLHQFH 'HSDUWPHQWRI(FRORJ\

'U:DOWHU+HFNHU3K' 3URIHVVRUHPHULWXV

3XEOLVKHGLQFRSLHV7KLVLVWKH«FRS\

&RQWHQWV

6XPPDU\gVV]HIRJODOiV

&KDSWHU *HQHUDOLQWURGXFWLRQ$LPRIVWXGLHV

&KDSWHU

3RVVLEOHLQIOXHQFHRIQHLJKERXUVRQVWHUHRW\SLFEHKDYLRXULQ KRUVHV

&KDSWHU 7UHHEDVHGPHWKRGVDVDQDOWHUQDWLYHWRORJLVWLFUHJUHVVLRQLQ UHYHDOLQJULVNIDFWRUVRIFULEELWLQJLQKRUVHV

&KDSWHU 'LIIHUHQFHV LQ WHPSHUDPHQW WUDLWV EHWZHHQ FULEELWLQJ DQG FRQWUROKRUVHV

&KDSWHU 7KHHIIHFWRIDIHHGLQJVWUHVVWHVWRQWKHEHKDYLRXUDQGKHDUW UDWH YDULDELOLW\ RI FULEELWLQJ KRUVHV ZLWK RU ZLWKRXW LQKLELWLRQ

&KDSWHU )LQDOFRQFOXVLRQV

&KDSWHU 1HZVFLHQWLILFUHVXOWV

&KDSWHU 5HIHUHQFHV

&KDSWHU 3XEOLFDWLRQV

&KDSWHU $FNQRZOHGJHPHQWV

*ORVVDU\

&$57 ± &ODVVLILFDWLRQDQGUHJUHVVLRQWUHH

&% ± 5HIHUULQJWRKRUVHVFULEELWLQJLQWKHWUDGLWLRQDOZD\

&+,1 ± 5HIHUULQJWRKRUVHVXVLQJFKLQLQVWHDGRILQFLVRUV

&16 ± &HQWUDOQHUYRXVV\VWHP

* ± *HOGLQJ

*/0 ± *HQHUDOLVHGOLQHDUPRGHO

*/00 ± *HQHUDOLVHGOLQHDUPL[HGPRGHOV + ± +REE\RUOHLVXUHKRUVHV

+3$D[LV ± 5HIHUULQJWRWKHSLWXLWDU\DGUHQRFRUWLFDOV\VWHP +5 ± +HDUWUDWH

+59 ± +HDUWUDWHYDULDELOLW\

+6 ± +XQJDULDQVSRUWKRUVH

/)+)UDWLR ± 7KHUDWLRRIWKHORZDQGWKHKLJKIUHTXHQF\VSHFWUDOFRPSRQHQWRIWKH+59

0 ± 0DUH

QV ± 1RWVLJQLILFDQW QX ± 1RUPDOLVHGXQLWV

4 ± 4XDUWHUKRUVH

3&$ ± 3ULQFLSDO&RPSRQHQW$QDO\VLV 55 ± %HDWWREHDWLQWHUYDOV

56&3$ ± 5R\DO6RFLHW\IRUWKH3UHYHQWLRQRI&UXHOW\WR$QLPDOV

6 ± 6WDOOLRQ

6S ± 6SRUWRUFRPSHWLWLRQKRUVHV 7+% ± 7KURURXJKEUHG

6XPPDU\

6WHUHRW\SLHVDUHUHSHWLWLYHEHKDYLRXUVLQGXFHGE\IUXVWUDWLRQUHSHDWHGDWWHPSWVWRFRSH DQGRUFHQWUDOQHUYRXVV\VWHPG\VIXQFWLRQDQGPD\VLJQLI\VXERSWLPDOZHOIDUHFRQGLWLRQV

&ULEELWLQJLVSUREDEO\WKHPRVWGHWULPHQWDODEQRUPDOVWHUHRW\S\LQKRUVHVSUHYHQWLRQRI LWV GHYHORSPHQW LV YHU\ LPSRUWDQW 2QFH IL[HG FULEELWLQJ LV GLIILFXOW WR HOLPLQDWH E\

EHKDYLRXUWKHUDS\WKHUHIRUHVHYHUDOPHWKRGVWRLQKLELWLWVSHUIRUPDQFHKDYHEHHQZRUNHG RXW+RZHYHULIFULEELWLQJLVDVWUDWHJ\WRFRSHZLWKVWUHVVWKHHIIHFWVRILQKLELWLRQVKRXOG EHFDUHIXOO\HVWLPDWHG

7KHILUVWVWXG\GLVFXVVHVWKHSRWHQWLDOULVNIDFWRUVIRUHTXLQHVWHUHRW\SLFEHKDYLRXU%\

FRQGXFWLQJ D TXHVWLRQQDLUH VXUYH\ RQ KRUVHV ZH IRXQG WKDW WKHUH LV D SRVVLEOH LQIOXHQFHRIQHLJKERXUV RQVWHUHRW\SLFEHKDYLRXU7KHFRPPRQEHOLHIWKDWH[SRVXUHWRD VWHUHRW\SLFKRUVHLQFUHDVHVWKHULVNRIVWHUHRW\SLFEHKDYLRXUKDVQHYHUEHHQVXEVWDQWLDWHG 7KLVVWXG\UHSRUWVWKHILUVWHPSLULFDOHYLGHQFHIRUWKDWK\SRWKHVLV

7KH VHFRQG VWXG\ FRPSDUHV WKH SHUIRUPDQFH RI WUHHEDVHG PHWKRGV WR WKH ORJLVWLF UHJUHVVLRQPRGHOXVLQJWKHGDWDVHWIURPWKHILUVWVWXG\2XUUHVXOWVVXJJHVWVWKDWWUHHEDVHG PHWKRGV FDQ EH D QHZ DOWHUQDWLYH LQ UHYHDOLQJ ULVN IDFWRUV HYHQ XVHG DORQH RU DFFRPSDQ\LQJWKHORJLVWLFUHJUHVVLRQ

7KH WKLUG VWXG\ FRPSDUHV µ1HUYRXVQHVV¶ µ7UDLQDELOLW\¶ DQG µ$IIDELOLW\¶ WHPSHUDPHQW WUDLWVRIFULEELWLQJDQGFRQWUROKRUVHVE\XVLQJDSUHYLRXVO\YDOLGDWHGTXHVWLRQQDLUH VXUYH\ RQ HTXLQH WHPSHUDPHQW 5HVXOWV VKRZHG WKDW WKH SDVVLYH FRSLQJ VWUDWHJ\ RI FULE ELWHUVLVUHVSRQVLEOHIRUWKHORZHUOHYHORIµ1HUYRXVQHVV¶LQFULEELWLQJKRUVHVFRPSDUHGWR FRQWURO KRUVHV 1R GLIIHUHQFHV ZHUH IRXQG UHJDUGLQJ µ7UDLQDELOLW\¶ RU µ$IIDELOLW\¶ ZKLFK GHPRQVWUDWHVWKDWWKHSUHYLRXVO\UHSRUWHGLPSDLUHGOHDUQLQJRIVWHUHRW\SLFKRUVHVGRHVQRW DIIHFWWKHKRUVH¶VSHUIRUPDQFHRUWUDLQDELOLW\LQDQHJDWLYHZD\

7KHDLPVRIWKHIRXUWKVWXG\ZHUHWRGHYHORSDFULEELWLQJWULJJHULQJVWUHVVWHVWDQGZLWK WKHKHOSRIWKDWWRFRPSDUHWKHVWUHVVFRSLQJDELOLW\DPRQJVWFRQWURODQGFULEELWLQJKRUVHV DQGFULEELWHUVWUHDWHGZLWKFROODURUWKHPRGLILHG)RUVVHOO¶VSURFHGXUH7KHWHVWWULJJHUHG FULEELWLQJ EHKDYLRXU VXFFHVVIXOO\ DQG JDYH UHOLDEOH DQG YDOLG LQIRUPDWLRQ DERXW WKH VHYHULW\RIFULEELWLQJWKHUHIRUHLWLVDXVHIXOLQYHWHULQDULDQSUDFWLFH2YHUDOORXUUHVXOWV VXJJHVWWKDWSHUIRUPDQFHRIRUDOVWHUHRW\SLHVLQDVWUHVVVLWXDWLRQVXFFHVVIXOO\GLPLQLVKHV VWUHVVZKLOHLQKLELWLRQRIVXFKVWHUHRW\S\HOHYDWHVLW7KXVFULEELWLQJPD\EHDWUXHFRSLQJ VWUDWHJ\ ,W LV HPSKDVLVHG WKDW LPSURYLQJ ZHOIDUH HJ ZLWK HQYLURQPHQWDO HQULFKPHQW VKRXOGEHDVLPSRUWDQWDVUHGXFLQJWKHDEQRUPDOVWHUHRW\SLFEHKDYLRXURIKRUVHV

gVV]HIRJODOiV

$V]WHUHRWtSLDHJ\LVPpWOĘGĘYLVHONHGpVPHO\HWIUXV]WUiFLyDVWUHVV]HOYDOyIRO\DPDWRV N]GHOHPpVYDJ\DN|]SRQWLLGHJUHQGV]HUPĦN|GpVpQHN]DYDUDYiOWNLYDODPLQWD]iOODW pOHWPLQĘVpJpQHN DODFVRQ\ V]LQWMpQHN D PXWDWyMD $ ORYDN HJ\LN OHJQDJ\REE J\DNRUODWL MHOHQWĘVpJJHOEtUyV]WHUHRWtSLiMDDOHYHJĘQ\HOpVPHO\V~O\RVHJpV]VpJJ\LSUREOpPiNDWLV RNR]KDW $ OHYHJĘQ\HOpV JiWOiViUD V]iPRV PyGV]HU OpWH]LN OHV]RNWDWQL D ORYDW D]RQEDQ QDJ\RQ QHKp] UyOD $PHQQ\LEHQ D OHYHJĘQ\HOpV YDOyEDQ VHJtWL D Oy VWUHVV]HO V]HPEHQL N]GHOPpWDV]WHUHRWtSLDJiWOiViYDON|UOWHNLQWĘHQNHOOEiQQL

$] HOVĘ YL]VJiODWEDQ NpUGĘtYHV IHOPpUpVW YpJH]WHP NLOHQF PDJ\DURUV]iJL ORYDUGiEDQ Oy YLVHONHGpVpUĘO WDUWiVL N|UOPpQ\HLUĘO $ V]WHUHRWtSLiW PXWDWy Oy V]RPV]pGViJD MHOHQWĘVHQ Q|YHOWH D V]WHUHRWLS YLVHONHGpV HOĘIRUGXOiVL J\DNRULViJiQDN D] HVpO\pW $ ORYDVRN N|]|WW iOWDOiQRVDQ HOWHUMHGW HONpS]HOpV KRJ\ D ORYDN HOWDQXOKDWMiN HJ\PiVWyO D OHYHJĘQ\HOpVW GH MHOHQ YL]VJiODW D] HOVĘ PHO\ HPSLULNXV EL]RQ\tWpNRW V]ROJiOWDW HUUH YRQDWNR]yDQ $ PiVRGLN YL]VJiODWEDQ NpW NODVV]LILNiFLyV PyGV]HUW D G|QWpVL IiW pV D ORJLV]WLNXV UHJUHVV]LyW KDVRQOtWRWWDP |VV]H D] HOVĘ YL]VJiODW DGDWDL VHJtWVpJpYHO .LPXWDWWDPKRJ\DG|QWpVLIDPyGV]HUKDWpNRQ\DQDONDOPD]KDWyD]iOODWRUYRVWXGRPiQ\

WHUOHWpQEHOOpV~MDOWHUQDWtYiWMHOHQWDKDMODPRVtWyWpQ\H]ĘNIHOWiUiViEDQ

$ KDUPDGLN YL]VJiODWEDQ HJ\ NRUiEEDQ PiU YDOLGiOW NpUGĘtY VHJtWVpJpYHO

|VV]HKDVRQOtWRWWDPOHYHJĘQ\HOĘpVNRQWUROOyWHPSHUDPHQWXPiW,JD]ROWDPKRJ\D OHYHJĘQ\HOĘ ORYDN SDVV]tY PHJN]GpVL VWUDWpJLiW KDV]QiOQDN pV H]pUW D ORYDVRN NHYpVEp Ä,MHGĘVQHN´ PLQĘVtWLN ĘNHW D NRQWURO ORYDNKR] NpSHVW $ Ä.pSH]KHWĘVpJ´ pV D Ä%DUiWViJRVViJ´ WHNLQWHWpEHQ QHP YROW NO|QEVpJ D NRQWURO pV OHYHJĘQ\HOĘ ORYDN N|]|WW (]]HO NLPXWDWWDP KRJ\ OHYHJĘQ\HOĘ ORYDN YLVHONHGpVWHV]WHNEHQ PXWDWRWW ÄJ\HQJpEE´

WDQXOiVL NpSHVVpJH pV D V]WHUHRWtSLD MHOHQOpWH QHP EHIRO\iVROMD QHJDWtY LUiQ\ED D Oy WHOMHVtWPpQ\pWYDJ\NpSH]KHWĘVpJpW

$ QHJ\HGLN YL]VJiODWEDQ HOVĘNpQW NLGROJR]WDP HJ\ OHYHJĘQ\HOpVW SURYRNiOy VWUHVV]

WHV]WHW PHO\ PHJEt]KDWyDQ LJD]ROMD D OHYHJĘQ\HOpV MHOHQOpWpW 0DMG D WHV]W VHJtWVpJpYHO YL]VJiOWDPDQ\DNV]tMMDOpVDPyGRVtWRWW)RUVVHOOIpOHPĦWpWWHOJiWROWYDODPLQWDQHPJiWROW OHYHJĘQ\HOĘ pV NRQWURO ORYDN VWUHVV]NH]HOpVL NO|QEVpJHLW $] HUHGPpQ\HN LJD]ROMiN KRJ\ D OHYHJĘQ\HOpV VHJtWL D ORYDW D VWUHVV]HO YDOy PHJN]GpVEHQ $ OHYHJĘQ\HOpV

&KDSWHU

*HQHUDOLQWURGXFWLRQ

6WHUHRW\SLHVDUHUHSHWLWLYHUHODWLYHO\LQYDULDQWDFWLRQVFRQVLGHUHGDEQRUPDOZKHQWKH\

RFFXU ZLWKRXW DQ\ SULPDU\ IXQFWLRQ 0DVRQ 6LQFH IXQFWLRQ RI DQ\ EHKDYLRXU LV VHOGRP REYLRXV 0DVRQ DQG 5XVKHQ UHGHILQHG VWHUHRW\S\ DV UHSHWLWLYH EHKDYLRXU LQGXFHG E\ IUXVWUDWLRQ UHSHDWHG DWWHPSWV WR FRSH DQGRU FHQWUDO QHUYRXV V\VWHP G\VIXQFWLRQ7KLVQHZGHILQLWLRQSRVHVQHZFKDOOHQJHVWRUHVHDUFKDVWKHGHYHORSPHQWRI VWHUHRW\SLHVLVDORQJSURFHVVDQGOLWWOHLVNQRZDERXWWKHLURULJLQSRVVLEOHFHQWUDOQHUYRXV V\VWHPG\VIXQFWLRQVDUHGLIILFXOWWRVWXG\DQGFRSLQJIXQFWLRQRIDEHKDYLRXUGHWULPHQWDO WRWKHKHDOWKRIWKHDQLPDOLVTXHVWLRQDEOH

6WHUHRW\SLFDO EHKDYLRXU LV ZLGHVSUHDG DPRQJVW FDSWLYH DQLPDOV DQG XQJXODWHV DUH WKH PRVW SUHYDOHQW PDPPDOLDQ VWHUHRW\SLHV 'LIIHUHQW RUGHUV RI PDPPDOV W\SLFDOO\ IDYRXU GLIIHUHQW W\SHV RI VWHUHRW\SLHV $PRQJVW XQJXODWHV RUDO VWHUHRW\SLHV DUH PRUH IUHTXHQW ZKHUHDVFDUQLYRUHVXVXDOO\VXIIHUIURPORFRPRWRUVWHUHRW\SLHVHJSDFLQJ([DPSOHVRI VWHUHRW\SLF EHKDYLRXU LQFOXGH SDFLQJ LQ FDSWLYH ODUJH FDWV FLUFXODU VZLPPLQJ LQ FDSWLYH SRODU EHDUV EDUELWLQJ VODWFKHZLQJ FKDLQFKHZLQJ DQG FKDLQ PDQLSXODWLRQ LQ WHWKHUHG SLJV WRQJXHUROOLQJ VKDPFKHZLQJ YDFXXPFKHZLQJ DQG VHOIVXFNLQJ LQ FDWWOH REMHFW OLFNLQJ LQ JLUDIIH DQG RNDSL WUXQNZDYLQJ LQ HOHSKDQWV EDUPRXWKLQJ MXPSLQJ DQG EDUEHULQJ LQ URGHQWV SDFLQJ DQG SHFNLQJ LQ ELUGV SDZOLFNLQJ LQ FDWV DQG SDZFKHZLQJ DQGWDLOFKDVLQJLQGRJV%RGyDQG+HFNHU0DVRQDQG5XVKHQ)LJXUH

0RVW FRPPRQ VWHUHRW\SLHV LQ KRUVHV LQYROYH ZHDYLQJ ER[ZDONLQJ ORFRPRWRU VWHUHRW\SLHVFULEELWLQJDQGZRRGFKHZLQJRUDOVWHUHRW\SLHV$PRQJKRUVHSRSXODWLRQV ZRUOGZLGH8QLWHG6WDWHV&DQDGD8QLWHG .LQJGRP ,WDO\6ZLW]HUODQG DQG6ZHGHQWKH PHDQSUHYDOHQFHRIZHDYLQJER[ZDONLQJFULEELWLQJDQGZRRGFKHZLQJDUHUDQJH DQG 9HFFKLRWWL DQG *DODQWL 0F*UHHY\ HW DO D E /XHVFKHU HW DO 5HGER HW DO 0F%ULGH DQG /RQJ0LOOVHWDO:DWHUVHWDO%DFKPDQQHWDOD3DUNHUHWDO D$OEULJKWHWDO

$V WKH GHILQLWLRQ RI FULEELWLQJ DQG ZRRGFKHZLQJ DUH VRPHWLPHV DPELYDOHQW GLIIHUHQWLDWLQJWKHPLVLPSRUWDQW1DJ\DQG%RGyD)LJXUH &ULEELWLQJXVXDOO\

LQYROYHVVHL]LQJDSURMHFWLRQZLWKWKHLQFLVRUVRUVXSSRUWLQJWKHFKLQFRQWUDFWLQJWKHVWUDS PXVFOHV RI WKH YHQWUDO WKURDW UHJLRQ DQG HPLWWLQJ D JUXQW FDOOHG ³ZLQGVXFNLQJ´

5DGLRJUDSKLF DQG HQGRVFRSLF VWXG\ RI KRUVHV SHUIRUPLQJ FULEELWLQJ UHYHDOHG WKDW WKH FKDUDFWHULVWLF QRLVH RI ZLQGVXFNLQJ FRLQFLGHG ZLWK WKH LQUXVK RI DLU WKURXJK WKH FULFRSKDU\Q[DQGDSSHDUVWREHPRUHOLNHO\DEXUSWKDQDJXOS'XULQJ FULEELWLQJYHU\

OLWWOHDLUJRHVGRZQWKHRHVRSKDJXVDQGPRYHPHQWRIDLULVQRWUHODWHGWRGHJOXWLRQ0RVW SUREDEO\ LW LV SURYRNHG E\ WKH SUHVVXUH JUDGLHQW LQ WKH VRIW WLVVXHV VXUURXQGLQJ WKH RHVRSKDJXVFUHDWHGE\WKHFRQWUDFWLRQRIWKHVWUDSPXVFOHVRIWKHQHFN0F*UHHY\HWDO D 7KH µZLQGVXFNLQJ¶ FRPSRQHQW PDNHV FULEELWLQJ EHKDYLRXU W\SLFDO DQG GLVWLQJXLVKDEOH IURP ZRRGFKHZLQJ 0F*UHHY\ HW DO D E $OEULJKW HW DO 6RPH KRUVHV ZRXOG ZLQGVXFN HYHQ ZLWKRXW WKH XVH RI D VROLG REMHFW 0RUSKRORJLFDO YDULDWLRQ RI WKLV VWHUHRW\S\ H[LVWV HJ VRPH KRUVHV ZRXOG ZLQGVXFN ZLWKRXWWKHXVHRIDVROLGREMHFWRUZRXOGSUHVVWKHLUFKLQDJDLQVWDIL[HGREMHFWDQGDUFK WKHLUQHFNDQGJUXQW7XUQHUHWDO/DPL

:RRGFKHZLQJ LV RIWHQ FRQIXVHG ZLWK FULEELWLQJ DOWKRXJK WKH WZR EHKDYLRXUV DUH GLIIHUHQWLQIRUPDQGFRQVHTXHQFHVWRKHDOWK'XULQJZRRGFKHZLQJWKHZRRGLVHDWHQE\

WKHKRUVHIURPDQXPEHURIGLIIHUHQWVLWHVZLWKLQLWVVWDEOHRULQWKHSDGGRFNDQGLVQHYHU DFFRPSDQLHGE\WKHJUXQWLQJVRXQGFDOOHGZLQGVXFNLQJ0F*UHHY\HWDOE1LFROHW DO :DWHUV HW DO $OEULJKW HW DO ,W KDV EHHQ GHEDWHG ZKHWKHU ZRRG FKHZLQJVKRXOGEHFRQVLGHUDVWHUHRW\S\DVLWFDQEHIUHTXHQWO\VHHQLQWKHILHOGDQGGRHV QRW KDYH VXFK GHWULPHQWDO HIIHFWV RQ KHDOWK DV FULEELWLQJ GRHV 0LOOV DQG 0F'RQQHO +RZHYHULWKDVEHHQVXJJHVWHGWKDWZRRGFKHZLQJDQGFULEELWLQJPLJKWEHUHODWHG EHFDXVH PRVW KRUVHV FKHZHG ZRRG SULRU WR GHYHORSLQJ FULEELWLQJ 1LFRO HW DO :DWHUVHWDO

9DFXXPFKHZLQJLQFDWWOHUHVHPEOHVWKHPRVWWRZLQGVXFNLQJLQKRUVHVZKHUHDVEDU ELWLQJ LQ VRZV VKDUHV WKH PRVW VLPLODULWLHV ZLWK ZRRGFKHZLQJ ,QWHUHVWLQJO\ OLWWOH LQIRUPDWLRQLVDYDLODEOHLQWKHOLWHUDWXUHRQWKHSUHYDOHQFHRIVWHUHRW\SLHVLQRWKHUPHPEHUV RIWKH(TXLGDHIDPLO\DVVHV]HEUDEXWWKHUHLVHYLGHQFHIRUDSDFLQJ]HEUDNHSWLQ]RR

6HOISOXFNHGFRFNDWRR

ZZZDSVXRJXHOSKFD %DUELWLQJVRZ

ZZZDSVXRJXHOSKFD 7UXQNZDYLQJHOHSKDQW ZZZDSVXRJXHOSKFD

3DFLQJWLJHU ZZZDSVXRJXHOSKFD

6HOIVXFNLQJGLDU\FRZ 6HUYHW%DGHPNLUDP

3DZFKHZLQJGRJ ZZZDSVXRJXHOSKFD

:DOOOLFNLQJJLUDIIH

ZZZDSVXRJXHOSKFD %DUPRXWKLQJDQGMXPSLQJ

PLFHZZZDSVXRJXHOSKFD 3DFLQJEHDU ZZZDSVXRJXHOSKFD

7DLOFKDVLQJGRJ ZZZGRJJXLGHQHW

:RRGFKHZLQJKRUVH ZZZDSVXRJXHOSKFD

&ULEELWLQJKRUVH .ULV]WLQD1DJ\

)LJXUH([DPSOHVRIDQLPDOVWHUHRW\SLFEHKDYLRXU

6WHUHRW\SLHV DUHSURYHG WREHH[WUHPHO\ FKDOOHQJLQJWRVWXG\ DQGDV DUHVXOWWKHUHLV VWLOOPXFKGLVDJUHHPHQWDVWRWKHLURULJLQVSUR[LPDWHFDXVHVDQGILQDOFRQVHTXHQFHV

2ULJLQ

/RQJ ODVWLQJ VWHUHRW\SLHV WRJHWKHU ZLWK D YDULHW\ RI RWKHU DEQRUPDO EHKDYLRXU FDQ EH SUHFLSLWDWHGE\ FKURQLFVWUHVVDVDFRQVHTXHQFHRIUHVWULFWHGPLOLHXDWHDUO\DJHLQPDQ\

VSHFLHV0DVRQ7KLVSURFHVVLVUHYHUVLEOHE\HQYLURQPHQWHQULFKPHQWEXWRQO\DW HDUO\OLIHZKLFKWRJHWKHUZLWKQHXURELRORJLFDOHYLGHQFHVXJJHVWVDFULWLFDOSHULRGIRUWKH QHXURSURWHFWLYHHIIHFWVRIFRPSOH[VRFLDODQGSK\VLFDOPLOLHX+DGOH\HWDO

6WUHVV PD\ LQGXFH FKDQJHV LQ PHVRDFFXPEHQV GRSDPLQHUJLF DFWLYLW\ UHVXOWLQJ LQ DQ LPEDODQFHEHWZHHQWKHGLUHFWDQGLQGLUHFWSDWKZD\VRIWKHEDVDOJDQJOLDDQGDQHQKDQFHG HIIHUHQW QHXUDO WUDQVPLVVLRQ IURP WKH VWULDWXP WR WKH FRUWH[ 0F%ULGH DQG +HPPLQJV ,QFRQFRUGDQFHZLWKWKLVFULEELWLQJKRUVHVZHUHUHSRUWHGWRKDYHPRUHGRSDPLQH ' DQG ' UHFHSWRUV LQ WKH YHQWUDO VWULDWXP DV ZHOO DV ORZHU GHQVLW\ RI ' UHFHSWRU VXE\W\SHV LQ WKH FDXGDWH QXFOHXV FRPSDUHG WR FRQWURO KRUVHV 0F%ULGH DQG +HPPLQJV 7KHPHVRDFFXPEHQVGRSDPLQHSDWKZD\LVWKHSULPDU\QHXUDOFHQWHUIRULQLWLDWLRQ DQG FRQWURO RI JRDOGLUHFWHG EHKDYLRXUV HLWKHU DWWDLQLQJ UHZDUGLQJ RU DYRLGLQJ DYHUVLYH VWLPXOL 7KHUHIRUH WKH XSUHJXODWHG PHVRDFFXPEHQV GRSDPLQHUJLF V\VWHP FDQ FDXVH D KLJKO\ PRWLYDWHG VWDWH GLUHFWHG WRZDUG JRDO DWWDLQPHQW HYHQ LQ WKH DEVHQFH RI DQ\ JRDO RULHQWHGVLWXDWLRQZKLFKPD\ODWHUVHUYHDVDEDVLVIRUVWHUHRW\S\GHYHORSPHQW0F%ULGH DQG+HPPLQJV

2Q WKH RWKHU KDQG UHSHWLWLYH EHKDYLRXUV DV QRUPDO GLVSODFHPHQW EHKDYLRXU DUH RIWHQ HOLFLWHG E\ DFXWH VWUHVV FDXVHG E\ LQKLELWLRQ RI WKH DSSHWLWLYH SKDVH RI D JRDO GLUHFWHG EHKDYLRXU +XJKHV DQG 'XQFDQ )RU H[DPSOH QRQVWHUHRW\SLF KRUVHV RIWHQ SHUIRUPHG ZHDYLQJ QRGGLQJ DQG RUDO VWHUHRW\SLHV ZKHQ WKHLU FRPSDQLRQV ZHUH IHG FRQFHQWUDWH &RRSHU HW DO $OWKRXJK VXFK GLVSODFHPHQW EHKDYLRXUV DUH QRW DEQRUPDO WKH\ DUH FRQVLGHUHG SUHUHTXLVLWH IRU VWHUHRW\SLHV :DWHUV HW DO 6HTXHQFHVRIEHKDYLRXUVWDUWLQJZLWKGLVSODFHPHQWIROORZHGE\VWHUHRW\SLFEHKDYLRXUFDQ EHREVHUYHGHYHQLQVWHUHRW\SLFKRUVHV1LQRPL\DHWDO$VPRVWFDUHWDNHUVGRQRW QRWH VXFK PLOG V\PSWRPV VWXGLHV DUH XVXDOO\ QDUURZHG WR WUXH IL[HG VWHUHRW\SLF

3UR[LPDWHFDXVHV

7KH GHYHORSPHQW RI VWHUHRW\SLF EHKDYLRXU LQYROYHV DQ LQWHUSOD\ RI JHQHWLF DQG HQYLURQPHQWDOPHFKDQLVPV)RULQVWDQFHPDUNHGVWUDLQGLIIHUHQFHVLQPLFHLQWHUDFWZLWK VHYHUDO HQYLURQPHQWDO IDFWRUV DIIHFWLQJ WKH GHYHORSPHQW RI EDUEHULQJ (YHQ LQ LQEUHG VWUDLQV RI PLFH FRQVLVWLQJ RI JHQHWLFDOO\ LGHQWLFDO LQGLYLGXDOV EDUEHULQJ DQG VWHUHRW\S\

YDU\ FRQVLGHUDEO\ EHWZHHQ LQGLYLGXDOV VXJJHVWLQJ WKDW VPDOO HQYLURQPHQWDO SHUWXUEDQFH DFWLQJXSRQVLPLODUJHQHWLFSUHGLVSRVLWLRQFDQPDNHLQGLYLGXDOVGLIIHUHQWLDOO\YXOQHUDEOHWR WKH HIIHFWV RI WKH W\SH RI KRXVLQJ *DUQHU HW DO 5HJDUGLQJ FULEELWLQJ LQ KRUVHV FHUWDLQEUHHGVOLNH7KRURXJKEUHGVDUHPRUHOLNHO\WREHDIIHFWHG9HFFKLRWWLDQG*DODQWL /XHVFKHUHWDO5HGERHWDO0DVRQDQG5XVKHQ$OEULJKWHWDO

0DQDJHPHQWPHWKRGVUHVWULFWLQJQDWXUDOEHKDYLRXUKDYHEHHQVXJJHVWHG DVPDMRUULVN IDFWRUV IRU GHYHORSLQJ VWHUHRW\SLF EHKDYLRXU 2UDO VWHUHRW\SLHV FULEELWLQJZLQGVXFNLQJ DQG ZRRGFKHZLQJ DUH PRVWO\ DVVRFLDWHG ZLWK ULFK GLHW DQG WKH UHVWULFWLRQ RI QRUPDO JUD]LQJEHKDYLRXU0F*UHHY\HWDOE:DWHUVHWDO%DFKPDQQHWDOD 3DUNHUHWDOD0F%ULGHDQG+HPPLQJVZKHUHDVORFRPRWRUVWHUHRW\SLHVVXFK DVER[ZDONLQJDQGZHDYLQJPLJKWEHDFWLYDWHGE\VRFLDOLVRODWLRQRULQDGHTXDWHSK\VLFDO H[HUFLVH0F*UHHY\HWDOE%DFKPDQQHWDOD

*DVWURLQWHVWLQDOG\VIXQFWLRQ

(SLGHPLRORJLFDODQGHPSLULFDOVWXGLHVUHYHDOHGWKDWFULEELWLQJLVSULPDULO\ DVVRFLDWHG ZLWKIHHGLQJRIFRQFHQWUDWHVSHUIRUPHGPRVWIUHTXHQWO\GXULQJDQGSDUWLFXODUO\IROORZLQJ FRQVXPSWLRQRIPHDOV7KHSHDNFULEELQJIUHTXHQF\EHJLQVXVXDOO\RQHKRXUDIWHUIHHGLQJ DQG WKH FULEELQJ IUHTXHQF\ PD\ DSSUR[LPDWH HYHQWV SHU KRUVH SHU GD\ +HQGHUVRQ DQG:DUDQ0F%ULGHDQG&XGGHIRUG&RRSHUHWDO&OHJJHWDO

7KH QDWXUH RI WKH UHODWLRQVKLS EHWZHHQ IHHGLQJ FRQFHQWUDWH DQG FULEELWLQJ LV EHLQJ ZLGHO\ LQYHVWLJDWHG DOWKRXJK WKH H[DFW PHFKDQLVP LV QRW ZHOO NQRZQ &ULEELWLQJ PD\

UHSUHVHQW DQ XQVDWLVILHG IRUDJLQJ QHHG +HQGHUVRQ DQG :DUDQ 0F*UHHY\ HW DO EFDXVHGE\IHHGLQJORZILEUHKLJKFDUERK\GUDWHFRQFHQWUDWHGLHWV+RZHYHUVHYHUDO VWXGLHVVXJJHVWWKDWVWHUHRW\SLHVDUHQRWDUHVSRQVHWRQXWULHQWGHILFLWVRUUHGXFHGIRUDJLQJ WLPH SHU VH EXW LQVWHDG FDQ UHSUHVHQW FRSLQJ ZLWK WKH JDVWURLQWHVWLQDO FRQVHTXHQFHV RI FRQVXPLQJFRQFHQWUDWHV*UDLQIHHGLQJFDQFDXVHODUJHLQWHVWLQDODFLGRVLVDQGSHULRGVRI IRRGGHSULYDWLRQLQFUHDVH JDVWULF DFLGVHFUHWLRQDQGFDQFDXVHIRUHJXWXOFHUV -RKQVRQHW

DO 1LFRO HW DO 6XFK OHVLRQV DUH PRUH SUHYDOHQW LQ VRPH EUHHGV HJ 7KRURXJKEUHGVDQGPDQDJHPHQWJURXSVHJUDFHKRUVHV0F*UHHY\HWDOF$OEULJKW HWDO

7KXVRUDOVWHUHRW\SLHVPD\UHIOHFWDPRQJRWKHUVDYLVFHUDOGLVFRPIRUW-RKQVRQHWDO 1LFROHWDO+HPPLQJVHWDO)XQFWLRQRIFULEELWLQJPLJKWEHWRORZHU WKH JDVWULF DFLGLW\ E\ LQFUHDVLQJ VDOLYD SURGXFWLRQ 1LFRO HW DO +HPPLQJV HW DO 0RHOOHUHWDORUWRUHGXFHJXWWUDQVLWWLPHIURPOHYHOVZKLFKRWKHUZLVHZRXOG EH HYHQ ORQJHU 0F*UHHY\ HW DO 5HFHQW VWXGLHV VXJJHVW WKDW XSUHJXODWLRQ RI WUDQVPLVVLRQLQPLGEUDLQGRSDPLQHUJLFSDWKZD\VKDVLPSRUWDQWUROHLQHTXLQHVWHUHRW\S\

GHYHORSPHQW0F%ULGHDQG+HPPLQJV7KHLPSDLUHGEDVDOJDQJOLDIXQFWLRQPLJKW EHDOVRDVVRFLDWHGZLWKYLVFHUDOGLVFRPIRUW0F%ULGHDQG+HPPLQJV+HPPLQJVHW DO HVSHFLDOO\ LQ KRUVHV ZLWK SUHGLVSRVHG JHQRW\SH RU ZLWK HDUO\ OLIH H[SHULHQFHV LQYROYLQJVWUHVV$OEULJKWHWDO0F%ULGHDQG+HPPLQJV

6WHUHRW\SLQJQHLJKERXUV

$FFRUGLQJWRDQHFGRWDOHYLGHQFHH[SRVXUHWRRWKHUKRUVHVHQJDJHGLQVWHUHRW\SLHVLVD ULVNIDFWRUIRUGHYHORSLQJVLPLODUKDELWV+RXSWDQG0F'RQQHO$OWKRXJKFRQWUROOHG H[SHULPHQWV RU HSLGHPLRORJLFDO VWXGLHV KDYH QHYHU VXSSRUWHG VXFK EHOLHIV &RRSHU DQG

$OEHQWRVD7KHEHOLHIWKDWVWHUHRW\SLHVDUHFRQWDJLRXVLVVRZLGHVSUHDGLQRZQHUV WKDW WKH\ RIWHQ LVRODWH VWHUHRW\SLF KRUVHV LQ IDFW RI FULEELWHUV ZHUH LVRODWHG IURP RWKHUKRUVHVDFFRUGLQJWRRQHVWXG\0F%ULGHDQG/RQJ

7KHHIIHFWRIQHLJKERXUVRQKRUVHVZLWKHVWDEOLVKHGVWHUHRW\SLHVLVFRQWURYHUVLDO2QWKH RQHKDQGLWKDVEHHQVXJJHVWHGWKDWDSRVWHULPDJHRIDFRQVSHFLILF0LOOVDQG5LH]HERV DPLUURULQWKHSDGGRFN0F$IHHHWDO0LOOVDQG'DYHQSRUWRUYLVXDO FRQWDFW ZLWK RWKHU KRUVHV &RRSHU HW DO 0LOOV DQG 'DYHQSRUW HIIHFWLYHO\

UHGXFHGWKHWLPHVSHQWLQZHDYLQJ+RZHYHUDQ\WUHDWPHQWLQWKRVHVWXGLHVZDVOLPLWHGWR

± GD\V D VKRUW SHULRG RI WLPH IRU KDELWXDWLRQ 3RVVLEOH IDFLOLWDWLRQ RI ZHDYLQJ E\

H[SRVXUHRIZHDYHUVWRQRQVWHUHRW\SLFKRUVHV&RRSHUHWDOZDVDOVROLPLWHGE\WKH H[SHULPHQWDO GHVLJQ EHFDXVH WKH WZR LQGLYLGXDOV ZLWK KLJKHVW OHYHO RI VWHUHRW\SLHV ZHUH H[SRVHG WR HDFK RWKHU UDWKHU WKDQ WR QRQZHDYHUV LQ WKDW VWXG\ 2Q WKH RWKHU KDQG

&RQVHTXHQFHV

6WHUHRW\SLHV DUH EHOLHYHG WR EH LQGLFDWRUV RI VXERSWLPDO ZHOIDUH FRQGLWLRQV DQG LW LV TXHVWLRQHG ZKHWKHU LW LV D PDODGDSWLYH UHVSRQVH GHWULPHQWDO WR WKH DQLPDO RU D FRSLQJ PHFKDQLVP UHOLHYLQJ VRPH RI WKH VWUHVV ,Q SUHYLRXV VWXGLHV WKH HYLGHQFH IRU D JHQHUDO FRSLQJIXQFWLRQRIFULEELWLQJKDVEHHQGHVFULEHGDVZHDN&RRSHUDQG$OEHQWRVD 0DVRQDQG5XVKHQ(YHQWKRXJKFULEELWLQJEHKDYLRXUZDVVKRZQWREHDVVRFLDWHG ZLWK D UHGXFHG SODVPD FRUWLVRO OHYHO 0F%ULGH DQG &XGGHIRUG DQG D GHFUHDVHG KHDUW UDWH /HEHOW HW DO 0LQHUR HW DO WKH GLIIHUHQFHV LQ VWUHVV SK\VLRORJ\

EHWZHHQFULEELWLQJDQGFRQWUROKRUVHVZHUHXQHTXLYRFDO/HEHOWHWDOIRXQGKLJKHU EDVDO SODVPDEHQGRUSKLQ OHYHO LQ FULEELWHUV WKDQ LQ FRQWUROV KRZHYHU 0F*UHHY\ DQG 1LFRODDQG3HOODQG0F*UHHY\IRXQGQRGLIIHUHQFHVDWDOO3ODVPDFRUWLVRO OHYHOKDVEHHQUHSRUWHGWREHKLJKHU0F*UHHY\DQG1LFRODRUVLPLODU/HEHOWHWDO 3HOO DQG 0F*UHHY\ %DFKPDQQ HW DO E LQ FULEELWHUV DV FRPSDUHG WR FRQWURO KRUVHV 0LQHUR HW DO VXJJHVWHG KLJKHU EDVDO V\PSDWKHWLF DFWLYLW\ /) FRPSRQHQWDQG %DFKPDQQHWDO EUHSRUWHGORZHUYDJDOWRQH+)FRPSRQHQWLQ FULEELWLQJWKDQLQFRQWUROKRUVHVLQUHVW+RZHYHUFRQYLQFLQJFRUUHODWLRQEHWZHHQ+3$

D[LVDFWLYLW\HJFRUWLVROOHYHODQGFRSLQJVW\OHKDYHQRWEHHQDOZD\VIRXQGDVLWPD\

GHSHQGRQWKHW\SHRIVWUHVVRUXVHGDQGLWLVDVVXPHGWREHPRUHUHODWHGWRWKHHPRWLRQDOLW\

WKDQWRWKHFRSLQJVW\OH.RROKDDV,WZDVDOVRVXJJHVWHGWKDWGLIIHUHQFHVEHWZHHQ FULEELWLQJDQGFRQWUROKRUVHVDUHRQO\H[SHFWHGZKHQFULEELWLQJLVSUHYHQWHGDQGKRUVHV DUHFRQIURQWHGZLWKDVWUHVVRUZKLFKWULJJHUVFULEELWLQJ%DFKPDQQHWDO&RRSHU DQG$OEHQWRVDFRQFOXGHGWKDWIXUWKHUUHVHDUFKLVQHHGHGWRLQYHVWLJDWHZKHWKHUWKH FRSLQJ HIIHFW LV WUXO\ FDXVDO LQ WKH GHYHORSPHQW DQG SHUVLVWHQFH RI FULEELWLQJ RU LW LV PHUHO\DEHQHILFLDOVLGHHIIHFW

$PRGHOLQWURGXFHGE\0F%ULGHDQG+HPPLQJVVXPPDUL]LQJWKHLQWHUDFWLRQRI WKH SXWDWLYH IDFWRUV LV SUHVHQWHG LQ)LJXUH 7KH HIIHFW RI D VWHUHRW\SLF QHLJKERXU DQG YLVFHUDOGLVFRPIRUWZHUHDGGHGDVIXUWKHUIDFWRUVWRWKHPRGHO

)LJXUH&RQVLGHUHGFDXVDOIDFWRUVRIFULEELWLQJLQKRUVHV0F%ULGHDQG+HPPLQJV 7KHFRORXUHGULVNIDFWRUVDUHLQFRUSRUDWHGWRWKHPRGHO

+HDOWKEHKDYLRXUDODQGFRJQLWLYHFRUUHODWHVRIFULEELWLQJ

&ULEELWLQJ LV DVVRFLDWHG ZLWK WRRWKHURVLRQ )LJXUH ZHLJKW ORVV DOWHUHG JXW IXQFWLRQVXFKDVGHFUHDVHGLQWHVWLQDOPRWLOLW\0F*UHHY\DQG1LFROD&OHJJHWDO JDVWULF LQIODPPDWLRQ XOFHUDWLRQ 1LFRO HW DO DQG HSLSORLF IRUDPHQ HQWUDSPHQWFROLF$UFKHUHWDO%HFDXVHRIVXFKXQZDQWHGFRQVHTXHQFHVRI FULEELWLQJWKHHFRQRPLFDOYDOXHRIWKHKRUVHPD\GHFUHDVHDQGLWLVDOVRFRQVLGHUHGDQ XQVRXQGQHVV0F%ULGHDQG/RQJ$OEULJKWHWDO

)LJXUH3URIRXQGHURVLRQRIWKHLQFLVRUWHHWKRIDVHYHUHFULEELWHU 3KRWR'U*iERU%RGy

%DVDO JDQJOLD G\VIXQFWLRQ PD\ GLPLQLVK OHDUQLQJ DELOLWLHV )RU H[DPSOH H[SHULPHQWDO LQKLELWRQRIGRSDPLQH'UHFHSWRUVLQKLELWSDVVLYHDYRLGDQFHOHDUQLQJLQFKLFNV.DEDLHW DOZKHUHDVVWLPXODWLRQRIWKHGRSDPLQHUJLFV\VWHPUHVXOWVLQVWHUHRW\SLFEHKDYLRXU LQWKHVDPHVSHFLHV.DEDLHWDO,QKRUVHFULEELWHUVZHUHOHVVVXFFHVVIXOUHTXLUHG ORQJHU WLPH WR SHUIRUP DQ LQVWUXPHQWDO WDVN +DXVEHUJHU HW DO DQG OHDUQHG DVVRFLDWLRQSHUVLVWHGORQJHUGXULQJH[WLQFWLRQ+HPPLQJVHWDOFRPSDUHWRFRQWURO KRUVHV)XUWKHUPRUHFULEELWLQJKRUVHVIDLOHGWRUHFRJQLVHGLIIHUHQFHVLQVKRUWYHUVXVORQJ GHOD\V RI D UHLQIRUFHPHQW LQ DQ LQVWUXPHQWDO FKRLFH SURFHGXUH 3DUNHU HW DO

&RQWUDU\ WR FRQWURO KRUVHV FULEELWLQJ KRUVHV VHHP WR IDYRXU VWLPXOXVUHVSRQVH OHDUQLQJ UDWKHUWKDQUHVSRQVHRXWFRPHOHDUQLQJ3DUNHUHWDO,PSDLUHGOHDUQLQJDELOLWLHVLQ FULEELWLQJKRUVHVREVHUYHGLQEHKDYLRXUDOWHVWVUDLVHWKHTXHVWLRQZKHWKHUWUDLQDELOLW\RI FULEELWLQJKRUVHVKDVDOVREHHQDIIHFWHG3UHYLRXVVWXGLHVVXJJHVWHGWKDWFULEELWLQJKRUVHV ZHUHPRUHVHQVLWLYHWRVWUHVV0LQHURHWDO%DFKPDQQHWDODQGVSHQWOHVV WLPH HDWLQJ DQG UHVWLQJ FRPSDUHG WR FRQWURO KRUVHV ZKLFK PD\ IXUWKHU DIIHFW WKHLU SHUIRUPDQFH0F*UHHY\HWDO+DXVEHUJHUHWDO

3UHYHQWLRQRIFULEELWLQJ

%HFDXVHFULEELWLQJFDQEHGHWULPHQWDOWRWKHDQLPDOVHYHUDOPHWKRGVKDYHEHHQZRUNHG RXW WR GLPLQLVK LWV RFFXUUHQFH 7UHDWPHQW PHWKRGV XVXDOO\ LQFOXGH DWWHPSWV WR SUHYHQW JUDVSLQJ RI REMHFWV WR LQWHUIHUH ZLWK ZLQGVXFNLQJ DQG WR LQWURGXFH SXQLVKPHQW IRU JUDVSLQJ DQG QHFNIOH[LRQ RU VXJJHVW WKH XVH RI DFXSXQFWXUH SKDUPDFHXWLFDOV RSHUDQW IHHGLQJ DQG HQYLURQPHQWDO HQULFKPHQW 1DJ\ DQG %RGy D 6WLOO ZLWK DQ\ RI WKH UHFHQWO\DYDLODEOHWUHDWPHQWDOWHUQDWLYHVLWLVKDUGWRDEROLVKWKLVVWHUHRW\S\)LJXUH,W FDQ EH VSHFXODWHG WKDW WKH DOWHUDWLRQ RI EDVDO JDQJOLD DFWLYLW\ LQ VWHUHRW\SLF KRUVHV LV SHUVLVWHQWHYHQDIWHUWKHVWUHVVRULVUHPRYHG0F%ULGHDQG+HPPLQJV+HPPLQJVHW DO0F%ULGHDQG+HPPLQJVEHFDXVHRIWKHLQYROYHPHQWRIHQGRJHQRSLRLG VHURWRQLQV\VWHPLQWKHSURFHVV'RGPDQHWDO*LOOKDPHWDO0F*UHHY\DQG 1LFROD3HOODQG0F*UHHY\0F%ULGHDQG&XGGHIRUG

7KH PRVW ZLGHVSUHDG WUHDWPHQW LV WKH DSSOLFDWLRQ RI FULEELWLQJ VWUDS FROODU ZKLFK PDNHVIOH[LRQRIWKHQHFNGLIILFXOWDQGWKHUHIRUHWKHWHUPLQDOJUXQWLQJOHVVHDV\WRSHUIRUP +RUVHVRIWHQDGDSWWRWKHSUHVVXUHDSSOLHGE\WKHFROODUZKLFKLVVXEVHTXHQWO\WLJKWHQHG RFFDVLRQDOO\ WR WKH H[WHQW WKDW VNLQ WUDXPD EHFRPHV DSSDUHQW )LJXUH 0F%ULGH DQG

&XGGHIRUG IRXQG WKDW FROODU ZHDULQJ LQFUHDVHG KHDUW UDWH EHWDHQGRUSKLQ DQG SODVPDFRUWLVROOHYHOERWKLQFRQWURODQGFULEELWLQJKRUVHVLQGLFDWLQJWKDWFROODUZHDULQJ SHU VH LPSRVHV VHYHUH VWUHVV WR WKH KRUVH 0RUHRYHU WKH ILUVW GD\ DIWHU ILWWLQJ WKH FROODU IUHTXHQF\RIFULEELWLQJVLJQLILFDQWO\LQFUHDVHGVXJJHVWLQJWKDWWKHPRWLYDWLRQWRSHUIRUP ZLQGVXFNLQJULVHVZKHQSUHYHQWHG0F*UHHY\DQG1LFROE)LJXUH

)LJXUH+RUVHSHUIRUPLQJFULEELWLQJEHKDYLRXULQDQH[DJJHUDWHG

IDVKLRQIROORZLQJLQKLELWLRQ3KRWR.ULV]WLQD1DJ\

7KHPRGLIHG)RUUVHOOVRSHUDWLRQZKLFKLVDVXUJLFDOYHWHULQDU\SURFHGXUHGHVLJQHGWR WUHDWFULEELWLQJLVJDLQLQJSRSXODULW\DPRQJKRUVHRZQHUV)LJXUH7KHPHWKRGZKLFK ZDVGHYHORSHGE\)RUVVHOOLQKDVEHHQPRGLILHGVHYHUDOWLPHVWRLPSURYHHIILFLHQF\

DQG FRVPHWLF DSSHDUDQFH $XHU DQG 6WLFN 5HFHQW WHFKQLTXH LQ XVH LQYROYHV WKH UHPRYDO RI D FP VHFWLRQ RI WKH YHQWUDO EUDQFK RI WKH VSLQDO DFFHVVRU\ QHUYHV ZKLFK LQQHUYDWHWKHVWHUQRPDQGLEXODULVPXVFOHVDQGFPVHFWLRQVRIWKHSDLUHGRPRK\RLGHXV DQG VWHUQRWK\URK\RLGHXV PXVFOHV LQ RUGHU WR UHGXFH WKH GLVWUDFWLQJ IRUFHV DFWLQJ RQ WKH RHVRSKDJXV 2SHUDWHG KRUVHV DUH XQDEOH WR GUDZ WKH ODU\Q[ FDXGDOO\ DQG FRQVHTXHQWO\

FDQQRWHPLWWKHJUXQWLQJVRXQG$XHUDQG6WLFN

7KH PDLQ FRPSOLFDWLRQV RI WKH PRGLILHG )RUVVHOO¶V SURFHGXUH DUH WKH GHYHORSPHQW RI VZDQOLNH QHFN RU ODU\QJHDO KHPLSOHJLD 7KH DVVHVVPHQW RI LWV VXFFHVVUDWH KDV UHYHDOHG LQFRQVLVWHQWUHVXOWVYDU\LQJEHWZHHQ7XUQHUHWDO+DNDVVRQHWDO 6FKRILHOGDQG0XOYLOOH'HODFDOOHHWDO3UHYLRXVVWXGLHVRQWKHVXFFHVVUDWH RI WKH PRGLILHG )RUVVHOO¶V SURFHGXUH UHOLHG XVXDOO\ RQ WKH RZQHU¶V UHSRUWV DQG IRFXVHG VROHO\ RU PDLQO\ RQ WKH GHJUHH RI VWHUHRW\S\LQKLELWLRQ SRVWRSHUDWLYH FRPSOLFDWLRQV DQG VLGHHIIHFWV7KHLPSOLFDWLRQVRIWKHWUHDWPHQWIRUWKHJHQHUDOZHOIDUHRIWKHKRUVHKDYHQRW EHHQ VWXGLHG XQWLO WR GDWH 2QO\ 6FKRILHOG DQG 0XOYLOOH QRWHG WKDW VWHUHRW\S\

HOLPLQDWLRQPD\LQFUHDVHVWUHVV&RQVLGHULQJWKHORZVXFFHVVUDWHUHSRUWHGE\WKHP

WKH\ DOVR VXJJHVWHG WKLV PHWKRG QR ORQJHU WR EH UHFRPPHQGHG IRU WKH WUHDWPHQW RI RUDO VWHUHRW\SLHV LQ KRUVHV 7KH QHHG WR HYDOXDWH QRW RQO\ WUHDWPHQWV LWVHOI EXW DOVR WKH LPSOLFDWLRQV RI D WUHDWPHQW IRU WKH ZHOIDUH RI WKH DQLPDO KDV EHFRPH PRUH DSSDUHQW

&KULVWLDQVHQDQG)RUNPDQ

)LJXUH7KHPRGLILHG)RUVVHOO¶VRSHUDWLRQLQYROYHVWKHP\HFWRP\RIWKHVWHUQRK\RLGHXV VWHUQRWK\URLGHXVDQGRPRK\RLGHXVPXVFOHVDQGWKHUHPRYDORIWKHYHQWUDOEUDQFKHVRIWKH DFFHVVRU\QHUYHV;,FUDQLDOQHUYH

3KRWROHIW.ULV]WLQD1DJ\ULJKW6LPRQ,]LQJ

$LPRIWKHVWXGLHV

7R LQYHVWLJDWH WKH ULVN IDFWRUV RI VWHUHRW\SLF EHKDYLRXU LQ KRUVHV DQG WR VHH ZKHWKHUH[SRVXUHWRDVWHUHRW\SLFQHLJKERXUKDVDVLJQLILFDQWHIIHFW

7RFRPSDUHWKHSHUIRUPDQFHRIFODVVLILFDWLRQPHWKRGVXVHGLQULVNIDFWRUVDQDO\VLV VXFK DV WKH ORJLVWLF UHJUHVVLRQ PRGHO WKH FODVVLILFDWLRQ WUHH DQG WKH FRQGLWLRQDO LQIHUHQFHWUHHPHWKRGV

7R FRQGXFW D TXHVWLRQQDLUH VXUYH\ RQ HTXLQH WHPSHUDPHQW DQG FRPSDUH µ1HUYRXVQHVV¶ µ7UDLQDELOLW\¶ DQG µ$IIDELOLW\¶ EHWZHHQ FULEELWLQJ DQG FRQWURO KRUVHV

7RGHYHORSDFULEELWLQJWULJJHULQJVWUHVVWHVWLQRUGHUWRSURYHWKHSUHVHQFHRIWKLV EHKDYLRXUPRUHDFFXUDWHO\

7RDVVHVVWKHVXFFHVVUDWHRIWKHPRGLILHG)RUVVHOO¶VSURFHGXUHLWVLPSOLFDWLRQIRU WKHZHOIDUHDQGWRFRPSDUHWKHVWUHVVFRSLQJDELOLW\RIVXUJLFDOO\WUHDWHGKRUVHVWR WKDWRIFROODUWUHDWHGFULEELWLQJDQGFRQWUROQRQVWHUHRW\SLFKRUVHV

&KDSWHU

3RVVLEOHLQIOXHQFHRIQHLJKERXUVRQ VWHUHRW\SLFEHKDYLRXULQKRUVHV

,QWURGXFWLRQ

3UHYLRXV VWXGLHV LQGLFDWHG WKDW EUHHG W\SH IHHGLQJ UHJLPH KRXVLQJ DQG PDQDJHPHQW FRQGLWLRQVKDYHDVWURQJHIIHFWRQWKHGHYHORSPHQWRIVWHUHRW\SLHVDQGLWLVDFRPPRQO\

KHOGEHOLHIWKDWKRUVHVPD\OHDUQWRFULEELWHIURPDIIHFWHGKRUVHV+RXSWDQG0F'RQQHO

$OWKRXJKFRQWUROOHGH[SHULPHQWVRUHSLGHPLRORJLFDOVWXGLHVKDYHQHYHUVXSSRUWHG VXFK EHOLHIV &RRSHU DQG $OEHQWRVD 0F%ULGH DQG /RQJ UHSRUWHG RI FULEELWHUVEHLQJNHSWLVRODWHGIURPRWKHUKRUVHV

7KHDLPRIWKLVVWXG\ZDVWRLQYHVWLJDWHULVNIDFWRUVRIVWHUHRW\SLFEHKDYLRXULQKRUVHV :HVKRZWKDWH[SRVXUHWRDVWHUHRW\SLFQHLJKERXUPD\KDYHVLJQLILFDQWHIIHFWRQWKHRGGV RIKRUVHVSHUIRUPLQJDEQRUPDOVWHUHRW\SLHV

0HWKRGV

'DWDFROOHFWLRQ

:H SHUIRUPHG D TXHVWLRQQDLUH VXUYH\ WR GHWHFW SRWHQWLDO ULVN IDFWRUV RI VWHUHRW\SLF EHKDYLRXU FULEELWLQJZLQGVXFNLQJ ZRRGFKHZLQJ ZHDYLQJ DQG ER[ZDONLQJ RQ KRUVHV E\ YLVLWLQJ QLQH ULGLQJ VFKRROV LQ +XQJDU\ %HIRUH DVNLQJ WKH KRUVHRZQHUV WR FRPSOHWH WKH TXHVWLRQQDLUH ZH H[SODLQHG WKHP WKH GHILQLWLRQ RI VWHUHRW\SL\ DQG RWKHU EHKDYLRXUSUREOHPVDFFRUGLQJWR0F*UHHY\HWDOE'XULQJRXU±KVWD\DWHDFK ULGLQJVFKRROZHREVHUYHGVWHUHRW\SLFEHKDYLRXULQDOOKRUVHVUHSRUWHGWRVKRZWKDW7KH VXUYH\LWHPVIRFXVHGRQVXEMHFWYDULDEOHVKRXVLQJPDQDJHPHQWFRQGLWLRQVIRRGUHJLPH

'DWDDQDO\VLV

)ROORZLQJ D GDWDTXDOLW\ FKHFN YDULDEOHV OLNHO\ WR EH VXEMHFW WR UHFRUGLQJ ELDV DQG YDULDEOHVZLWKDIUHTXHQF\PRUHWKDQRIPLVVLQJYDOXHVZHUHH[FOXGHGIURPIXUWKHU LQYHVWLJDWLRQ7KHUHPDLQLQJYDULDEOHVZHUHFODVVLILHGDVEHLQJUHFRUGHGRQDELQDU\RUDQ RUGLQDU\VFDOH

6WHUHRW\SLHV ZHUH GHSHQGHQW YDULDEOHV LQ ILYH VHSDUDWH PRGHOV FULEELWLQJZLQG VXFNLQJ ZRRGFKHZLQJ ZHDYLQJ ER[ZDONLQJ DQG VWHUHRW\SLHV LQ JHQHUDO D GHULYHG YDULDEOHIRUWKHRFFXUUHQFHRIDQ\RIWKHIRXUOLVWHGDEQRUPDOEHKDYLRXUV7KHLQGHSHQGHQW YDULDEOHV LQFOXGHG WKH XVDJH RI WKH KRUVH FRPSHWLWLRQ RU QRQFRPSHWLWLRQ VXEMHFW YDULDEOHVKRXVLQJDQGPDQDJHPHQWFRQGLWLRQVDVVXPPDUL]HGLQ7DEOHSUREOHPDWLF EHKDYLRXU SHUIRUPHG E\ WKH JLYHQ KRUVH DJJUHVVLRQ WRZDUGV KRUVHV DQG SHRSOH GRRU RSHQLQJ RU NQRWXQW\LQJ EHKDYLRXU DQG EHKDYLRXU SUREOHPV GXULQJ ULGLQJ VWHUHRW\SLHV DQGSUREOHPDWLFEHKDYLRXURIWKHµµQHLJKERXUKRUVHV¶¶3RVLWLRQRIWKHKRUVHVLQWKHVWDEOH ZDV DOVR UHFRUGHG VR VSDWLDO SUR[LPLW\ RI VWHUHRW\SLF KRUVHV FRXOG EH FDOFXODWHG +RUVHV QRW IXUWKHU WKDQ WKUHH ER[HV DZD\ DQG LQ WKUHH ER[HV DFURVV WKH DLVOH IDFLQJ WKH JLYHQ LQGLYLGXDO ZHUH FRQVLGHUHG QHLJKERXUV 5LGLQJ VFKRRO ZDV FRQVLGHUHG DV D UDQGRP YDULDEOHDQGLWVHIIHFWZDVFDOFXODWHGZLWKLQWKHVWDWLVWLFDOPRGHOV

7DEOH,WHPVRIWKHTXHVWLRQQDLUHVXUYH\

/HYHOV RI WKH LQGHSHQGHQW IDFWRUV VXEMHFW YDULDEOHV DQG KRXVLQJ DQG PDQDJHPHQW FRQGLWLRQVDQGWKHQXPEHURIQRQFRPSHWLWLRQKRUVHVLQHDFKOHYHOLQEUDFNHWV

D&URVVEHWZHHQWKRURXJKEUHGDQG+XQJDULDQQDWLYHEUHHGV

$JH \HDUV \HDUV \HDUV 0LVVLQJ

YDOXH

*HQGHU 0DOH *HOGLQJ 0DUH

%UHHG 7KRURXJKEUHG +DOIEUHG^D 2WKHU 0LVVLQJ

YDOXH

1XPEHURIKRUVHVRQWKH\DUG 0RUHWKDQ

7\SHRIKRXVLQJ 6WDOO %R[

%HGGLQJ 6WUDZ 6KDYLQJV

)UHTXHQF\RIIHHGLQJURXJKDJHKD\

SHUGD\ WLPHV WLPHV WLPHV

)UHTXHQF\RIIHHGLQJFRQFHQWUDWHV

RDWVSHUGD\ WLPHV WLPHV

'DLO\DPRXQWRIRDWVLQNJ /HVVWKDQ 0RUHWKDQ

7DFWLOHFRQWDFWZLWKRWKHUKRUVHV -XVWVQLIIRUVHH

7RXFK

0RYHIUHHO\LQWKHSDGGRFNZHHNO\ /HVVWKDQRQFH GD\V GD\V 0RUHWKDQ GD\V

:HHNO\ER[UHVW /HVVWKDQ

GD\

0RUHWKDQ

GD\

:HHNO\ULGLQJ /HVVWKDQRQFH WLPHV WLPHV 0RUHWKDQ

WLPHV

1XPEHURIULGHUVXVLQJWKHKRUVH 1RULGHUV ULGHUV 0RUHWKDQ

ULGHUV

'DLO\JURRPLQJWLPHPLQXWHV /HVVWKDQ 0RUHWKDQ 0LVVLQJ YDOXH

6WDWLVWLFDODQDO\VLV

7RGHWHUPLQHZKLFKRIWKHVXUYH\DQVZHUVZHUHWKHEHVWSUHGLFWRUVRIWKHSUHVHQFHRU DEVHQFH RI D VWHUHRW\SLF EHKDYLRXU ILUVW ZH SHUIRUPHG D XQLYDULDWH DQDO\VLV IRU WKH ILYH VWHUHRW\SLFFDWHJRULHVLQGHSHQGHQWO\XVLQJDVLQJOHORJLVWLFPL[HGUHJUHVVLRQJHQHUDOLVHG OLQHDU PL[HG PRGHOV */00 VHSDUDWHO\ IRU DOO IDFWRUV REWDLQHG IURP WKH TXHVWLRQQDLUH 9DULDEOHV ZLWK 3 ZHUH FRQVLGHUHG IRU LQLWLDO LQFOXVLRQ LQ WKH PL[HGHIIHFW PXOWLYDULDWH ORJLVWLF UHJUHVVLRQ PRGHO 9DULDEOHV ODFNLQJ D VWDWLVWLFDOO\ VLJQLILFDQW DVVRFLDWLRQ3!ZLWKWKHSDUWLFXODURXWFRPHYDULDEOHVZHUHH[FOXGHGIURPWKHJLYHQ PRGHOKRZHYHUWKHVDPHYDULDEOHVFRXOGKDYHEHHQLQFOXGHGLQWKHRWKHUPRGHOV

,QWKH*/00WKHHIIHFWRIWKHULGLQJVFKRROZDVWUHDWHGDVDUDQGRPIDFWRUWRFRQWURO IRU SRVVLEOH \DUG HIIHFWV ,Q FDVH RI FULEELWLQJ WKH YDULDQFH RI WKH UDQGRP IDFWRU ZDV QHJOLJLEO\VPDOOFRPSDUHGWRWKHYDULDQFHRIWKHHUURUWHUPVRLQWKLVFDVHZHKDYHXVHG WKHJHQHUDOLVHGOLQHDUPRGHO*/0LQVWHDGRIWKH*/00*/0DQG*/00ZHUHDSSOLHG ZLWK ELQRPLDO HUURU GLVWULEXWLRQ DQG ORJLW OLQN IXQFWLRQ 7KH SHQDOLVHG TXDVL OLNHOLKRRG PHWKRG34/ZDVXVHGWRHVWLPDWHWKHSDUDPHWHUVLQWKH*/00%UHVORZDQG&OD\WRQ 7KHPRGHOVZHUHPDQXDOO\EXLOWXVLQJD EDFNZDUGHOLPLQDWLRQSURFHVV9DULDEOHV ZLWKD3!ZHUHH[FOXGHGH[FHSWLQWKHFDVHRIFULEELWLQJDQGVWHUHRW\SLHVLQJHQHUDO ZKHUH3!ZDVFKRVHQWRHQVXUHEHWWHUSUHGLFWHGYDOXHVE\WKHPRGHOV7KHUHPRYDO RIWKHQRQVLJQLILFDQWIDFWRUVUHVXOWHGPRGHOVZLWKORZHU$NDLNHLQIRUPDWLRQFULWHULRQLQ HDFKFDVHLQWHUSUHWHGDVWKDWWKHH[SODQDWRU\SRZHURIWKHLQLWLDODQGILQDOPRGHOVDUHWKH VDPH7KHH[SRQHQWLDOVRIEFRHIILFLHQWVLQWKHILQDOPRGHOVZHUHLQWHUSUHWHGDVRGGVUDWLRV RIWKHILYHRXWFRPHYDULDEOHV$OODQDO\VLVZDVFDUULHGRXWXVLQJWKH5VWDWLVWLFDOVRIWZDUH ,KDNDDQG*HQWOHPDQ

5HVXOWV

+RXVLQJFRQGLWLRQVDQGSUHYDOHQFHRIEHKDYLRXUDOGLVRUGHUV

,Q WKH SRSXODWLRQ RI KRUVHV VDPSOHG WKH SUHYDOHQFH RI FULEELWLQJZLQGVXFNLQJ ZDV1 ZRRGFKHZLQJZDV1 ZHDYLQJZDV1 DQGER[ZDONLQJZDV1 7KHRFFXUUHQFHRIDQ\RIWKHIRXUOLVWHGDEQRUPDO EHKDYLRXUVVWHUHRW\SLFEHKDYLRXULQJHQHUDOZDV1 $JJUHVVLRQWRZDUGV KRUVHVZDVQRWHGLQ1 RILQGLYLGXDOVDJJUHVVLRQWRZDUGVSHRSOHZDV

1 EHKDYLRXUSUREOHPVGXULQJULGLQJZDV1 DQGGRRURUWLHURSHQLQJ EHKDYLRXURFFXUUHGLQ1

6WHUHRW\SLHV ZHUH PRUH FRPPRQ LQ QRQFRPSHWLWLRQ KRUVHV FRPSDUHG WR FRPSHWLWLRQ KRUVHVRXWRIQRQFRPSHWLWLRQKRUVHVDQGRXWRIFRPSHWLWLRQKRUVHVVKRZHG DEQRUPDO VWHUHRW\SLF EHKDYLRXU F 3 $OWKRXJK WKH ULVN IDFWRUV UHYHDOHGE\WKHILQDOPRGHOVZHUHFRQVLVWHQWFRQFHUQLQJQRQFRPSHWLWLRQKRUVHV1 DQGDOOKRUVHV1 WRHQVXUHUHOLDEOHFODVVLILFDWLRQZHSUHVHQWWKHGDWDRQULVNIDFWRUV DPRQJQRQFRPSHWLWLRQKRUVHV

+RXVLQJFRQGLWLRQVDPRQJQRQFRPSHWLWLRQKRUVHVZHUHVLPLODU7DEOH 7KHUHZDV QR YDULDWLRQ LQ IRUDJH W\SH RQO\ KD\ ZDV RIIHUHG DOO KRUVH¶V GLHW FRQWDLQHG JUDLQV QR LQGLYLGXDOZDVVRFLDOO\LVRODWHGDQGDOOKRUVHVH[FHSWWZRKDGVWUDZEHGGLQJ$OOKRUVHV EXWQLQHLQGLYLGXDOVZHUHULGGHQDWOHDVWWKUHHWLPHVDZHHNPRVWRIWKHPKDGQRUHVWGD\

DQGFRXOGPRYHIUHHO\LQWKHSDGGRFNRUPRUHGD\VDZHHN$OOKRUVHVEXWVL[LQGLYLGXDOV ZHUHQRQWKRURXJKEUHGDQGWKHWRWDOQXPEHURIKRUVHVLQD\DUGZHUHOHVVWKDQLQPRVW FDVHV

5LVNIDFWRUV

8QLYDULDWH*/00VWDWLVWLFVUHYHDOHGIDFWRUVSUHVHQFHRIDZHDYLQJRUFULEELWLQJ RUER[ZDONLQJRUDJJUHVVLYHQHLJKERXUSHUIRUPLQJDJJUHVVLRQWRZDUGVKRUVHVUHFHLYLQJ RDWV PRUH WKDQ WZR WLPHV D GD\ PRUH WKDQ WZR ULGHUV XVLQJ WKH KRUVH SHUIRUPLQJ ER[

ZDONLQJ FULEELWLQJ ZRRGFKHZLQJ RU GRRU DQG WLHU RSHQLQJ EHKDYLRXU DVVRFLDWHG S ZLWK DQ\ RI WKH IRXU VWHUHRW\SLHV 7DEOH (LJKW RI WKRVH IDFWRUV SUHVHQFH RI D ZHDYLQJ RU FULEELWLQJ RU DJJUHVVLYH QHLJKERXU SHUIRUPLQJ DJJUHVVLRQ WRZDUGV KRUVHV UHFHLYLQJRDWVPRUHWKDQWZRWLPHVDGD\PRUHWKDQWZRULGHUVXVLQJWKHKRUVHSHUIRUPLQJ ZRRGFKHZLQJRUER[ZDONLQJUHPDLQHGVLJQLILFDQWLQWKHILQDOPRGHORIWKHPXOWLYDULDWH

*/00V7DEOH 7KHRYHUDOOFODVVLILFDWLRQDFFXUDF\RIWKHILQDOPRGHOVZDV±

(DFK PRGHO FODVVLILHG KRUVHV ZLWKRXW VWHUHRW\SLF EHKDYLRXU PRUH DFFXUDWHO\ ± WKDQ VWHUHRW\SLF KRUVHV ± VXJJHVWLQJ WKDW ULVN IDFWRUV DUH QRW DEVHQW LQ QRUPDO KRUVHV

7DEOH5LVNIDFWRUVRIVWHUHRW\SLHVLQWKHILQDOPXOWLYDULDWHPRGHOV

2XWFRPHYDULDEOH 5LVNIDFWRUV 25 &,DW 3

&ULEELWLQJ ZLQGVXFNLQJ

SUHVHQFHRIDZHDYLQJQHLJKERXU

DJJUHVVLRQWRZDUGVKRUVHV

SUHVHQFHRIDFULEELWLQJQHLJKERXU

SUHVHQFHRIDER[ZDONLQJQHLJKERXU í í QV

SUHVHQFHRIDQDJJUHVVLYHQHLJKERXU í í QV

GRRUDQGWLHURSHQLQJEHKDYLRXU í í QV

ER[ZDONLQJ í í QV

ZRRGFKHZLQJ í í QV

:RRGFKHZLQJ UHFHLYLQJRDWVPRUHWKDQWLPHVDGD\

ER[ZDONLQJ

PRUHWKDQWZRULGHUVXVLQJWKHKRUVH í í QV

:HDYLQJ SUHVHQFHRIDZHDYLQJQHLJKERXU

SUHVHQFHRIDQDJJUHVVLYHQHLJKERXU

PRUHWKDQWZRULGHUVXVLQJWKHKRUVH

%R[ZDONLQJ DJJUHVVLRQWRZDUGVKRUVHV

ZRRGFKHZLQJ

PRUHWKDQWZRULGHUVXVLQJWKHKRUVH

FULEELWLQJ í í QV

SUHVHQFHRIDQDJJUHVVLYHQHLJKERXU í í QV

6WHUHRW\SLHV LQJHQHUDO

SUHVHQFHRIDVWHUHRW\SLFQHLJKERXU

DJJUHVVLRQWRZDUGVKRUVHV

UHFHLYLQJRDWVPRUHWKDQWLPHVDGD\

SUHVHQFHRIDQDJJUHVVLYHQHLJKERXU í í QV

2GGV UDWLRV 25 DQG FRQILGHQFH LQWHUYDOV &, RI WKH VLJQLILFDQW ULVN IDFWRUV IRU VWHUHRW\SLF EHKDYLRXUV LQFOXGHG LQ WKH ILQDO PL[HGHIIHFW PXOWLYDULDWH ORJLVWLF UHJUHVVLRQ 7KH QRQVLJQLILFDQW QV IDFWRUV KDYH QRW EHHQ LQFOXGHG LQ WKH ILQDO PXOWLYDULDWH PRGHO DOWKRXJKWKH\ZHUHSUHVHOHFWHGE\WKHXQLYDULDWHDQDO\VLV

'LVFXVVLRQ

3UHYDOHQFHRIVWHUHRW\SLFEHKDYLRXULQ+XQJDULDQULGLQJVFKRROVZDVQRWGLIIHUHQWIURP WKRVHRIRWKHUFRXQWULHV0F%ULGHDQG/RQJ&KULVWLHHWDO+RZHYHUIDFWRUV DVVRFLDWHGZLWKVWHUHRW\SLFEHKDYLRXUUHYHDOHGE\RXUDQDO\VLVDUHLQDSSDUHQWFRQWUDVWZLWK SUHYLRXVHSLGHPLRORJLFDOVXUYH\V

,WLVQRWVXUSULVLQJWKDWPDQ\ULVNIDFWRUVUHSRUWHGE\RWKHUVZHUHQRWLGHQWLILHGLQRXU VWXG\EHFDXVHPDQDJHPHQWSUDFWLFHVLQWKHVWXGLHGQLQHULGLQJVFKRROVZHUHYHU\VLPLODU DQGODFNHGPRVWRIWKHULVNIDFWRUVLGHQWLILHGE\ SUHYLRXVVWXGLHVDQGRWKHUIDFWRUVOLNH EHKDYLRXURIWKHQHLJKERXULQJKRUVHVKDYHQRWEHHQLQFOXGHGLQSUHYLRXVVXUYH\V

2QO\ WZR PDQDJHPHQW FRQGLWLRQV HPHUJHG DV ULVN IDFWRUV IRU VWHUHRW\SLF EHKDYLRXU )LUVWUHFHLYLQJ FRQFHQWUDWHVPRUHWKDQWZLFHD GD\LQFUHDVHGWKHRGGV RIZRRGFKHZLQJ DQG VWHUHRW\SLF EHKDYLRXU LQ JHQHUDO LQ DFFRUGDQFH ZLWK SUHYLRXV VWXGLHV 0F*UHHY\ HW DO E:DWHUV HW DO %DFKPDQQ HW DO D 6HFRQG KDYLQJ PRUH WKDQ WZR ULGHUVLQFUHDVHGWKHRGGVRIZHDYLQJEXWGLPLQLVKHGWKHRGGVRIER[ZDONLQJ7KHQXPEHU RIULGHUVDVDSRVVLEOHULVNIDFWRUKDVQRWEHHQVWXGLHGSUHYLRXVO\DQGVXFKDELGLUHFWLRQDO HIIHFWLVGLIILFXOWWRH[SODLQDVER[ZDONLQJZDVUHSRUWHGWRFRLQFLGHZLWKZHDYLQJ0LOOV HWDO,QDSUHYLRXVVWXG\1LQRPL\DHWDOIRXQGWKDWFRQWDFWZLWKXQIDPLOLDU ULGHUVLQFUHDVHGWKHLQFLGHQFHRIZHDYLQJKRZHYHUWKH\SURYLGHGQRGDWDRQWKHQXPEHU RI ULGHUV :H FDQ RQO\ VSHFXODWH WKDW KRUVHV ULGGHQ E\ PDQ\ ULGHUV DUH PRUH VWUHVVHG LQFUHDVLQJWKHRGGVRIZHDYLQJEXWDOVRUHFHLYHPRUHH[HUFLVHWKXVUHGXFLQJWKHRGGVRI ER[ZDONLQJ 'LVHQWDQJOLQJ WKH SRVVLEOH HIIHFWV RI QXPEHU RI ULGHUV DPRXQW RI H[HUFLVH DQGULGLQJE\VWUDQJHUVQHHGVIXUWKHULQYHVWLJDWLRQV

$OO RWKHU ULVN IDFWRUV VXFK DV DJJUHVVLRQ WRZDUG KRUVHV RU SUHVHQFH RI D QHLJKERXU SHUIRUPLQJDJJUHVVLRQRUVRPHNLQGRIVWHUHRW\S\DUHEHKDYLRXUDOYDULDEOHV7KHQDWXUHRI WKHUHODWLRQEHWZHHQDJJUHVVLRQDQGVWHUHRW\SLHVLVSRRUO\XQGHUVWRRG'RPLQDQWKRUVHVDUH XVXDOO\ PRUH DJJUHVVLYH DQG DFFRUGLQJ WR WKH ILQGLQJV RI :DWHUV HW DO IRDOV RI GRPLQDQWPDUHVDUHPRUHOLNHO\WRGHYHORSDEQRUPDOEHKDYLRXUSHUKDSVEHFDXVHWKH\DUH VHQVLWLYH WR HYHQ VOLJKW UHVWULFWLRQV 2WKHUV EHOLHYH KRZHYHU WKDW ERWK VWHUHRW\SLHV DQG DJJUHVVLRQDUHDFRPPRQFRQVHTXHQFHRIIUXVWUDWLRQ0LOOVDQG1DQNHUYLV

3UHVHQFH RI DQ DJJUHVVLYH RU VWHUHRW\SLF QHLJKERXU LQFUHDVHG WKH RGGV RI FULE ELWLQJZLQGVXFNLQJ DQG ZHDYLQJ D ILQGLQJ QRW UHSRUWHG SUHYLRXVO\ )LJXUH 7KH SRVVLELOLW\WKDWVWHUHRW\SLFKRUVHVLQSUR[LPLW\WRHDFKRWKHUH[SHULHQFHWKHVDPHVWUHVVRU ZDLWLQJIRUIRRGGLVWULEXWLRQRUWREHGULYHQRXWRIWKHVWDEOHFDQEHUXOHGRXWEHFDXVH WKHSRVLWLRQRIVWHUHRW\SLFKRUVHVZDVUDQGRPLQUHODWLRQWRGLVWDQFHWRWKHJDWHZLQGRZV RU YHQWLODWLRQ RI WKH VWDEOH &DUHWDNHUV UHSRUWHG WKDW SRVLWLRQLQJ RI QHZO\ DUULYHG KRUVHV ZDV GHWHUPLQHG E\ WKH DYDLODELOLW\ RI IUHH VSDFH DQG VWHUHRW\SLF KRUVHV ZHUH QRW GHOLEHUDWHO\SXWFORVHWRHDFKRWKHULQWKHSDGGRFN

(SLGHPLRORJLFDOVWXGLHVDUHQRWGHVLJQHGWRUHYHDOFDXVDOUHODWLRQVWKHUHIRUHZHVKRXOG EHFDUHIXOWRLQWHUSUHWRXUILQGLQJV,WLVSRVVLEOHWKDWIDFWRUVQRWSUHVHQWDWWKHWLPHRIWKH VXUYH\ DUH UHVSRQVLEOH IRU WKH GHYHORSPHQW RI VWHUHRW\SLHV LQ VRPH LQGLYLGXDOV 6RPH H[LVWLQJ IDFWRUV FRXOG KDYH EHHQ RYHUORRNHG )RU H[DPSOH ZH KDYH GDWD RQ WKH GDLO\

IUHTXHQF\RIIHHGLQJURXJKDJHKRZHYHULWLVQRWNQRZQKRZORQJURXJKDJHZDVDYDLODEOH DIWHU LW ZDV SURYLGHG 1HYHUWKHOHVV VXFK SRVVLEOH VDPSOLQJ ELDVHV GR QRW H[SODLQ VLJQLILFDQWDVVRFLDWLRQVEHWZHHQWKHEHKDYLRXURIQHLJKERXUV

7KHHIIHFWRIQHLJKERXUVKDVEHHQUHSRUWHGRQRWKHUVSHFLHVZLWKVWHUHRW\SLFEHKDYLRXU LQ EDQN YROHV&OHWKULRQRP\V JODUHROXV &RRSHU DQG 1LFRO LQ ODERUDWRU\ PLFH

*DUQHUHWDORULQ2UDQJHZLQJHG$PD]RQSDUURWV$PD]RQDDPD]RQLFD*DUQHUHW DO ,Q KRUVHV FRS\LQJ RU REVHUYDWLRQDO OHDUQLQJ DV D PHFKDQLVP RI GHYHORSLQJ VWHUHRW\SLHV LV XQOLNHO\ /LQGEHUJ HW DO KRZHYHU VRFLDO IDFLOLWDWLRQ RU VWLPXOXV HQKDQFHPHQW FDQQRW EH UXOHG RXW $ VWHUHRW\SLF QHLJKERXU VSHQGV OHVV WLPH HDWLQJ DQG UHVWLQJWKDQQRUPDOKRUVHV0F*UHHY\HWDO$VVWHUHRW\SLHVDUHPRUHIUHTXHQWLQ

³GLVWXUEHG´ HQYLURQPHQW RU ZKHQ JHQHUDO DFWLYLW\ RI WKH KRUVHV LV JUHDW &RRSHU HW DO FRQVWDQWPRYHPHQWGXULQJZHDYLQJRUVRXQGSURGXFWLRQGXULQJ ZLQGVXFNLQJE\

VWHUHRW\SLF KRUVHV FDQ PDNH VHQVLWLYH LQGLYLGXDOV UHVWOHVV DQG LQGXFH VWHUHRW\SLF EHKDYLRXU7KHUHLVRQO\DQHFGRWDOHYLGHQFHIRUDSRVVLEOHUROHRIVWLPXOXVHQKDQFHPHQW

&RRSHU HW DO QRWHG WKDW KRUVHV VKRZHG LQWHUHVW LQ DUHDV FULEEHG E\ VWHUHRW\SLF QHLJKERXUV +RUVHV ZKR REVHUYHG FULEELQJ ZHUH QRW VHHQ FULEELQJ WKHPVHOYHV KRZHYHU FRQWDFW RI KRUVHV ZLWK QR VWHUHRW\S\ ZLWK LQGLYLGXDOV SHUIRUPLQJ VWHUHRW\SLF EHKDYLRXU ZDVOLPLWHGWR±GD\VDVKRUWSHULRGIRUWKHHPHUJHQFHRIDEQRUPDOVWHUHRW\S\

7KHSUHFLVHQDWXUHRIWKHSRVVLEOHHIIHFWRIQHLJKERXUVRQVWHUHRW\SLFEHKDYLRXUVKRXOG EH VWXGLHG H[SHULPHQWDOO\ EHIRUH FRQFUHWH VXJJHVWLRQV FDQ EH JLYHQ IRU SUDFWLFDO PDQDJHPHQW+RZHYHUDVWKHPDMRULW\RIPDQDJHUVEHOLHYHWKDWVWHUHRW\SLHVDUHQRWMXVW LQKHULWHGEXWDOVROHDUQHGIURPRWKHUKRUVHV0F%ULGHDQG/RQJZHFDQQRWDYRLG WKH UHVSRQVLELOLW\ WR PDNH VRPH JHQHUDO UHPDUNV 2Q WKH EDVLV RI RXU HSLGHPLRORJLFDO VWXGLHVZHFDQQRWVWDWHWKDWQHLJKERXUVKDYHDFDXVDOHIIHFWRQVWHUHRW\SLFEHKDYLRXURXU DLPLQSUHVHQWLQJWKHVHILQGLQJVZDVWRGUDZDWWHQWLRQWRWKHSRVVLELOLW\RIVXFKHIIHFWVVR WKDWRWKHUUHVHDUFKHUVZRXOGLQFOXGHWKLVYDULDEOHLQWKHLUVXUYH\V(YHQLIVXFKHIIHFWVDUH VXEVWDQWLDWHG E\ RWKHU VWXGLHV LVRODWLQJ VWHUHRW\SLF KRUVHV LV EDG PDQDJHPHQW EHFDXVH VRFLDO GHSULYDWLRQ HQKDQFHV VWUHVV DQG DWWHQXDWHV VWHUHRW\SLF EHKDYLRXU %DJVKDZ HW DO &DUHIXO PRQLWRULQJ RI WKH KRUVHV IRU HDUO\ VLJQV RI HQKDQFHG GLVSODFHPHQW EHKDYLRXULVLPSRUWDQWWRSUHYHQWWKHHVWDEOLVKPHQWRIVWHUHRW\SLHV+RUVHVVXVFHSWLEOHWR GHYHORSLQJ VWHUHRW\SLHV PLJKW EH PRYHG DZD\ IURP VWUHVV DJHQWV LQFOXGLQJ VWHUHRW\SLF QHLJKERXUV

)LJXUH+RUVHVSHUIRUPLQJFULEELWLQJEHKDYLRXULQFRPPXQLW\

3KRWR.ULV]WLQD1DJ\

&KDSWHU

7UHHEDVHGPHWKRGVDVDQDOWHUQDWLYHWRORJLVWLFUHJUHVVLRQLQ UHYHDOLQJULVNIDFWRUVRIFULEELWLQJLQKRUVHV

,QWURGXFWLRQ

&ODVVLILFDWLRQ PHWKRGV UHYHDOLQJ ULVN IDFWRUV RI D FHUWDLQ GLVHDVH SURYLGH QRW MXVW D EHWWHU XQGHUVWDQGLQJ RI WKH GLVHDVH EXW DUH DOVR XVHIXO WR FODVVLI\ LQGLYLGXDOV LQWR ULVN JURXSVZLWKVRPHFHUWDLQW\/RJLVWLFUHJUHVVLRQLVDFRPPRQO\XVHGVWDWLVWLFDOPHWKRGIRU ILQGLQJ ULVN IDFWRUV ZKLFK LV D VWDQGDUG PHWKRG IRU SUHGLFWLQJ D GLFKRWRPRXV GHSHQGHQW YDULDEOH$ORJLVWLFUHJUHVVLRQPRGHOLVDOLQHDUUHJUHVVLRQHTXDWLRQLQZKLFKWKHUHVSRQVH YDULDEOHLVWKHORJRGGV+RVPHUDQG/HPHVKRZ

7KHWUHHEDVHGPHWKRGVVXFKDVWKHFODVVLILFDWLRQDQGUHJUHVVLRQWUHH&$57DQGWKH FRQGLWLRQDO LQIHUHQFH WUHH DQDO\VLV XVH D IRUP RI ELQDU\ UHFXUVLYH SDUWLWLRQLQJ ,I WKH RXWFRPHYDULDEOHLVPHDVXUHGRQDFRQWLQXRXVVFDOHWKHPHWKRGLVFDOOHGUHJUHVVLRQWUHH ZKLOHLQFDVHRIDFDWHJRULFDORXWFRPHYDULDEOHOLNHFULEELWLQJLQWKHSUHVHQWVWXG\LWLV FDOOHGFODVVLILFDWLRQWUHH7UHHEDVHGPHWKRGVVSOLWWKHVDPSOHVWHSE\VWHSLQWRVPDOOHUDQG VPDOOHUJURXSVDFFRUGLQJWRDPDWKHPDWLFDOFRQGLWLRQ7KHUHDUHVHYHUDOYDULDQWVRIWUHH EDVHG PHWKRGV ZLWK GLIIHUHQW VSOLWWLQJ FULWHULD )RU H[DPSOH RQH RI WKH ROGHVW WUHH FODVVLILFDWLRQ PHWKRGV WKH &+$,' WHFKQLTXH XVHV DQ ) WHVW LI WKH GHSHQGHQW YDULDEOH LV FRQWLQXRXVDQGȤLIWKHYDULDEOHLVFDWHJRULFDOWRGHFLGHZKLFKJURXSWRVSOLW.DVV 2XW RI WKH VHYHUDO FULWHULRQ IXQFWLRQV *LQLLQGH[ LV WKH PRVW RIWHQ XVHG .XUW HW DO 7KHEDVLFLGHDLVWRFRQVLGHUDOOSRVVLEOHVSOLWVDQGFKRRVHWKHEHVWSUHGLFWRUDQGWKH EHVW VSOLW WR PD[LPL]H µSXULW\¶ LH KRPRJHQHLW\ RI WKH FKLOG QRGHV 9DULDEOHV PLJKW EH VHOHFWHGUHSHDWHGO\RQGLIIHUHQWOHYHOVRIWKHWUHHDOVRZLWKGLIIHUHQWWKUHVKROGV%UHLPDQ HWDO$IWHUDQLQLWLDOODUJHWUHHLVEXLOWSUXQLQJLVGRQHWRUHPRYHDQ\RYHUILWWLQJWR WKHWUDLQLQJGDWD$QDXWRPDWLFSUXQLQJPHWKRGLVWKHFRVWFRPSOH[LW\SUXQLQJEDVHGRQ FURVVYDOLGDWLRQ,WUHGXFHVWKHQXPEHURIEUDQFKHVRIWKHWUHHYDULDEOHVVHOHFWHGDVULVN

IDFWRUVDQGPLQLPLVHVWKHSHUFHQWDJHPLVFODVVLILHGDWWKHVDPHWLPH$SORWRISHUFHQWDJH PLVFODVVLILHGDJDLQVWWKHQXPEHURIWHUPLQDOQRGHVKHOSVGHWHUPLQHWKHRSWLPDOWUHHVL]H

5HFXUVLYH ILWWLQJ SURFHGXUHV KDYH EHHQ UHSRUWHG WR KDYH WZR IXQGDPHQWDO SUREOHPV RYHUILWWLQJ DQG D VHOHFWLRQ ELDV WRZDUGV FRYDULDWHV ZLWK PDQ\ SRVVLEOH VSOLWV RU PLVVLQJ YDOXHV :KLOH SUXQLQJ SURFHGXUHV DUH DEOH WR VROYH WKH RYHUILWWLQJ SUREOHP WKH YDULDEOH VHOHFWLRQELDVVWLOOVHULRXVO\DIIHFWVWKHLQWHUSUHWDELOLW\RIWUHHVWUXFWXUHGUHJUHVVLRQPRGHOV

&RQGLWLRQDO LQIHUHQFH WUHH LV D UDWKHU QHZ WUHHEDVHG PHWKRG ZKLFK HVWLPDWHV D UHJUHVVLRQ UHODWLRQVKLS E\ ELQDU\ UHFXUVLYH SDUWLWLRQLQJ LQ D FRQGLWLRQDO LQIHUHQFH IUDPHZRUN 7KHUHIRUH LW VHOHFWV YDULDEOHV LQ DQ XQELDVHG ZD\ $ VWDWLVWLFDOO\ PRWLYDWHG VWRSSLQJFULWHULRQHJFTXDGW\SHWHVWVWDWLVWLFVLVXVHGDQGWKHSDUWLWLRQVLQGXFHGE\WKLV UHFXUVLYH SDUWLWLRQLQJ DOJRULWKP DUH QRW DIIHFWHG E\ RYHUILWWLQJ 3DUWLWLRQV REWDLQHG IURP FRQGLWLRQDO LQIHUHQFH WUHHV KDYH EHHQ UHSRUWHG WR EH JHQHUDOO\ FORVHU WR WKH WUXH GDWD SDUWLWLRQ FRPSDUHG WR SDUWLWLRQV REWDLQHG IURP DQ H[KDXVWLYH VHDUFK SURFHGXUH ZLWK SUXQLQJ+RWKRUQHWDO

7UHHEDVHGPHWKRGVKDVEHHQZLGHO\XVHGLQFRPSXWHUVFLHQFHVDQGLWLVDOVRJHWWLQJ PRUHSRSXODULQOLIHVFLHQFHVHJLQKXPDQKHDOWKFDUH:RUWKDQG&URQLQ+RHW DO .XUW HW DO PHGLFDO GHFLVLRQ PDNLQJ +DUSHU RU SV\FKLDWU\

7KRPDV HW DO DV ZHOO DV LQ WKH ILHOG RI HFRORJ\ /RZ HW DO RU DQLPDO EHKDYLRXU.XELQ\LHWDO+RZHYHUDSSOLFDWLRQRIWUHHEDVHGPHWKRGVLQYHWHULQDU\

VFLHQFHVLVQRWVRSUHYDOHQW,QWKLVVWXG\ZHZRXOGOLNHWRVKRZDQH[DPSOHKRZ&$57 DQG FRQGLWLRQDO LQIHUHQFH WUHHV FDQ EH DSSOLHG LQ SUHGLFWLQJ ULVN IDFWRUV RI VWHUHRW\SLF EHKDYLRXULQKRUVHV7RLOOXVWUDWHWKHHIIHFWLYHQHVVRIWUHHEDVHGPHWKRGVDQGWRFRPSDUH WKHPWRORJLVWLFUHJUHVVLRQWKHGDWDVHWRQULVNIDFWRUVRIFULEELWLQJLQKRUVHVSUHVHQWHGLQ

&KDSWHUZDVUHDQDO\]HG 0HWKRGV

'DWD

'DWDRIKRUVHVIRUGHWDLOVVHHXVHGIRUQRQFRPSHWLWLRQSXUSRVHV1 ZDV

&ODVVLILFDWLRQWHFKQLTXHV

/RJLVWLFUHJUHVVLRQ

/RJLVWLFUHJUHVVLRQPRGHOZDVEXLOWDVJLYHQLQ

&ODVVLILFDWLRQWUHHDQGFRQGLWLRQDOLQIHUHQFHWUHH

7KH EULHI GHVFULSWLRQ RI WKH DSSOLHG ELQDU\ UHFXUVLYH SDUWLWLRQLQJ DOJRULWKP RPLWWLQJ WKH PDWKHPDWLFDO GHWDLOV LV DV IROORZV 7KH PHWKRG VWDUWV ZLWK RQH VLQJOH JURXS WKH ZKROH VDPSOH,QWKHILUVWVWHSDQH[SODQDWRU\YDULDEOHDQGDWKUHVKROGLVVHOHFWHGDQGWKHVDPSOH LVVSOLWLQWRWZRJURXSVRQHLQZKLFKWKHYDOXHRIWKHVHOHFWHGH[SODQDWRU\YDULDEOHLVRYHU WKHVHOHFWHGWKUHVKROGDQGWKHRWKHULQZKLFKLWLVEHORZWKHWKUHVKROG7KDWYDULDEOHDQG WKUHVKROGLVVHOHFWHGWKDWOHDGVWRWKHVSOLWZLWKWKHPRVW³SXUH´LHPRVWKRPRJHQHRXV JURXSV ZLWK UHVSHFW WR WKH RXWFRPH YDULDEOH ,Q HDFK VXEVHTXHQW VWHS D JURXS DQ H[SODQDWRU\YDULDEOHDQGDWKUHVKROGLVVHOHFWHGDQGWKHVHOHFWHGJURXSLVVSOLWLQWRWZR EDVHG RQ WKH VHOHFWHG YDULDEOH DQG WKUHVKROG 7KH FULWHULRQ GHILQLQJ WKH KRPRJHQHLW\ RI JURXSV DQG VR GULYLQJ WKH ZKROH SDUWLWLRQLQJ SURFHVV LV FDOOHG WKH VSOLW FULWHULRQ RU VSOLWWLQJIXQFWLRQ7KHUHDUHVHYHUDOVSOLWFULWHULDRIZKLFKZHDSSOLHGWKHPRVWRIWHQXVHG RQH WKH VRFDOOHG *LQL LQGH[ 7KH SURFHVV UHVXOWV LQ D WUHHOLNH VWUXFWXUH RI JURXSV DOVR FDOOHG QRGHV LQ ZKLFK HDFK QRGH KDV WZR ³FKLOG QRGHV´ 7HUPLQDO QRGHV DOVR FDOOHG EUDQFKHVRIWKHWUHHGHILQHWKHFODVVLILFDWLRQRIVXEMHFWV

&ODVVLILFDWLRQWUHHZDVEXLOWE\VSOLWWLQJHDFKQRGHXQWLOLWVFKLOGQRGHVFRQWDLQHGOHVVWKDQ REVHUYDWLRQV*LQLLQGH[ZDVXVHGDVVSOLWWLQJIXQFWLRQDQGIROGFURVVYDOLGDWLRQZDV DSSOLHGWRHYDOXDWHSHUIRUPDQFHRIWKHFODVVLILFDWLRQ$IWHUWKHLQLWLDOODUJHWUHHKDVEHHQ FRQVWUXFWHGSUXQLQJZDVSHUIRUPHGWRUHGXFHWKHVL]HRIWKHWUHH7HQIROGFURVVYDOLGDWLRQ PHDQVWKDWWKHIROORZLQJSURFHGXUHLVUHSHDWHGWHQWLPHVDUDQGRPVDPSOHLVVHOHFWHG IURP WKH GDWD WKH PRGHO LV ILWWHG WR WKH UHPDLQLQJ DQG SUHGLFWLRQ LV PDGH IRU WKH VHOHFWHG IURP WKH ILWWHG PRGHO &ODVVLILFDWLRQ SHUIRUPDQFH LV FDOFXODWHG E\ SRROLQJ FODVVLILFDWLRQUHVXOWVRIWKHWHQUHSOLFDWLRQV

&RQGLWLRQDOLQIHUHQFHWUHHVZHUHFRQVWUXFWHGZLWKFTXDGW\SHWHVWVWDWLVWLFVDQGD ZLWK DQG ZLWKRXW VLPSOH %RQIHUURQL FRUUHFWLRQ (DFK VSOLW QHHGHG WR VHQG DW OHDVW RI WKH REVHUYDWLRQVLQWRHDFKRIWKHWZRFKLOGQRGHV

7R FRPSDUH WKH WKUHH VWDWLVWLFDO DSSURDFKHV ZH H[DPLQHG SUHGLFWLRQ DFFXUDF\ YLD WKH LQGLFHV RI VHQVLWLYLW\ FRUUHFWO\ FODVVLILHG VWHUHRW\SLF KRUVHV DQG VSHFLILFLW\ FRUUHFWO\

FODVVLILHGQRQVWHUHRW\SLFKRUVHVRIWKHPRGHOV$OODQDO\VHVZHUHFDUULHGRXWXVLQJWKH5 6WDWLVWLFDO 6RIWZDUH &$57 DQDO\VLV DQG FRQGLWLRQDO LQIHUHQFH WUHHV DUH LPSOHPHQWHG LQ WKHUSDUW DQGSDUW\ DGGRQ SDFNDJHV WR WKH 5 V\VWHP IRU VWDWLVWLFDO FRPSXWLQJ

5HVXOWV

5LVNIDFWRUV

/RJLVWLFUHJUHVVLRQ

(LJKWYDULDEOHVZHUHVHOHFWHGE\WKHXQLYDULDWH*/0LQWRWKHORJLVWLFUHJUHVVLRQPRGHO EXW WKH ILQDO PRGHO FRQWDLQHG RQO\ YDULDEOHV 7DEOH +RUVHV WKDW ZHUH NHSW LQ WKH QHLJKERXUKRRG RI DQRWKHU FULEELWLQJ RU ZHDYLQJ KRUVH ZHUH PRUH OLNHO\ WR VKRZ FULE ELWLQJ WKHPVHOYHV ZLWK RGGV EHLQJ DQG WLPHV JUHDWHU UHVSHFWLYHO\ +RUVHV ZLWK DJJUHVVLYH EHKDYLRXU WRZDUGV RWKHU KRUVHV KDG WLPHV JUHDWHU ULVN RI SHUIRUPLQJ FULE ELWLQJWKDQQRQDJJUHVVLYHKRUVHV7KHORJLVWLFUHJUHVVLRQPRGHOFODVVLILHGKRUVHVZLWKRXW VWHUHRW\SLF EHKDYLRXU PRUH DFFXUDWHO\ VSHFLILFLW\ WKDQ FULEELWLQJ KRUVHV VHQVLWLYLW\

&ODVVLILFDWLRQDQGUHJUHVVLRQWUHH

)LJXUH VKRZV WKH YDULDEOHV VHOHFWHG E\ WKH &$57 PRGHO EHIRUH )LJXUH D DQG DIWHU )LJXUH E SUXQLQJ 7KH ILUVW UDPLILFDWLRQ SRLQW UHSUHVHQWV WKH ILUVW ULVN IDFWRU VHOHFWHGE\WKHSURFHGXUH,WWHOOVXVWKDWWKHSUHYDOHQFHRIFULEELWLQJEHKDYLRXULVKLJKHU DPRQJVWKRUVHVWKDWKDYHDVWHUHRW\SLFZHDYLQJQHLJKERXUFRPSDUHGWRWKRVHZKRGRQRW KDYHDQ\

7KHOHIWURXWHUHSUHVHQWVDOWRJHWKHU KRUVHVZLWKRXWDQG KRUVHVZLWK FULEELWLQJ EHKDYLRXU WKDW LV SHUFHQW RI WKRVH QRQFRPSHWLWLRQ KRUVHV WKDW KDG VWHUHRW\SLF ZHDYLQJ QHLJKERXU VKRZHG FULEELWLQJ EHKDYLRXU ,Q WKLV URXWH WKH QH[W UDPLILFDWLRQSRLQWLHWKHQH[WSUHGLFWLYHIDFWRUIRXQGE\WKHSURFHGXUHZDVSUHVHQFHRID

+RUVHV WKDW GLG QRW KDYH D ZHDYLQJ QHLJKERXU EXW ZHUH VKRZLQJ DJJUHVVLRQ WRZDUGV RWKHUKRUVHVVHHPHGWRKDYHKLJKHUSUHYDOHQFHRIFULEELWLQJEHKDYLRXUWKDQWKRVHKRUVHV WKDWZHUHFODVVLILHGDVQRWDJJUHVVLYHWRZDUGVRWKHUKRUVHVE\WKHRZQHUV,QRWKHUZRUGV SHUFHQW RXW RI RI WKRVH KRUVHV WKDW ZHUH ODFNLQJ RI D VWHUHRW\SLF QHLJKERXU EXW KDG DJJUHVVLYH WHQGHQFLHV WRZDUGV RWKHU KRUVHV VKRZHG FULE ELWLQJEHKDYLRXU

7RLPSURYHKRPRJHQHLW\RIWKHFKLOGQRGHVWZRPRUHULVNIDFWRUVZHUHVHOHFWHGE\WKH ILQDOSUXQHGWUHHPRGHO)LJXUHE2XWRIWKRVHKRUVHVWKDWVKRZHGDJJUHVVLRQWRZDUGV RWKHUKRUVHVFULEELWLQJEHKDYLRXUVHHPHGWREHPRUHSUHYDOHQWDPRQJVWKRUVHVKRXVHGLQ VWDOOVWHWKHUHGZLWKDURSHLQWKHVWDOOZLWKUHVWULFWHGIUHHPRYHPHQWRUKRXVHGLQER[HV EXWVKRZLQJµHVFDSHEHKDYLRXU¶GRRURSHQLQJRUNQRWXQW\LQJ7KHUHPDLQLQJFULEELWLQJ KRUVHV ZHUH DPRQJVW KRUVHV WKDW KDG QR ZHDYLQJ QHLJKERXU DQG VKRZHG QR DJJUHVVLRQ WRZDUGVRWKHUKRUVHV

&ODVVLILFDWLRQWUHHPHWKRGDIWHUSUXQLQJFODVVLILHGRIKRUVHVZLWKRXWVWHUHRW\SLF EHKDYLRXUDQGRIFULEELWLQJKRUVHVFRUUHFWO\

&RQGLWLRQDOLQIHUHQFHWUHH

%XLOGLQJDWUHHZLWKRXWDQ\FRUUHFWLRQLQFOXGHGPRUHYDULDEOHVDQGQRGHVWKDQWKHWUHH EXLOWXVLQJ%RQIHUURQLFRUUHFWLRQ)LJXUH D6LPLODUO\WRWKHSUXQHGFODVVLILFDWLRQWUHH WKH FRQGLWLRQDO LQIHUHQFH WUHH ZLWK %RQIHUURQL FRUUHFWLRQ FRQWDLQHG ULVN IDFWRUV DQG QRGHV )LJXUH E 7KH LQWHUSUHWDWLRQ RI WKLV WUHH LV VLPLODU WR WKDW RI WKH &$57 PRGHO

&RQGLWLRQDO LQIHUHQFH WUHH ZLWK %RQIHUURQL FRUUHFWLRQ FODVVLILHG RI KRUVHV ZLWKRXW VWHUHRW\SLFEHKDYLRXUDQGRIFULEELWLQJKRUVHVFRUUHFWO\

)LJXUH&ODVVLILFDWLRQWUHHEHIRUHDDQGDIWHUESUXQLQJ

)LJXUH&RQGLWLRQDOLQIHUHQFHWUHHZLWKRXWDDQGZLWKEFRUUHFWLRQ

5LVN IDFWRUV VHOHFWHG E\ WKH DOJRULWKP DUH V\PEROLVHG DV UDPLILFDWLRQ SRLQWV RI WKH FRQGLWLRQDOLQIHUHQFHWUHHDORQJZLWKWKHXQFRUUHFWHGDRUFRUUHFWHGESYDOXHV,QD QRGHVDQGLQEQRGHVDQGDUHWKHWHUPLQDOQRGHV%DUSORWV YLVXDOLVH WKH SUREDELOLW\ RI FULEELWLQJ EHKDYLRXU DQG WKH QXPEHU RI REVHUYDWLRQV ZLWKLQ HDFKVXEJURXSV

'LVFXVVLRQ

$QDO\VHV UHYHDOHG VLPLODU ULVN IDFWRUV LQ DOO PRGHOV &RQWUDU\ WR WKH ILQGLQJV RI +RWKRUQ HW DO ZH IRXQG QR GLIIHUHQFH UHJDUGLQJ WUHH VWUXFWXUH RU SUHGLFWLQJ DFFXUDF\EHWZHHQFODVVLILFDWLRQWUHHDQGFRQGLWLRQDOLQIHUHQFHWUHHPHWKRGV%HU]DOHWDO DOVR UHSRUWHG WKDW GLIIHUHQW VSOLWWLQJ FULWHULD KDG QR VLJQLILFDQW LPSDFW RQ WKH DFFXUDF\RIWKHFODVVLILHUDQGQRVLQJOHVSOLWWLQJFULWHULRQSURYLQJWREHXQLYHUVDOO\EHWWHU WKDQWKHUHVW

5LVN IDFWRUV UHYHDOHG E\ ORJLVWLF UHJUHVVLRQ ZHUH OHVV LQ TXDQWLW\ FRPSDUHG WR WKH QXPEHURIULVNIDFWRUVVHOHFWHGE\&$57DQGFRQGLWLRQDOLQIHUHQFHWUHHPHWKRGVEXWDOO WKUHHPHWKRGVIRXQGWKHWZRPDLQULVNIDFWRUVUHSRUWHGSUHYLRXVO\E\1DJ\HWDO SUHVHQFHRIDZHDYLQJQHLJKERXUDQGDJJUHVVLRQWRZDUGVKRUVHV$FFRUGLQJWRWUHHEDVHG PHWKRGVLWVHHPVOLNHWKDWWKHLQIOXHQFHRIFULEELWLQJQHLJKERXUVRQFULEELWLQJEHKDYLRXU LQ KRUVHV PD\ PDQLIHVW LWVHOI RQO\ LQ VSHFLDO FLUFXPVWDQFHV ZKLFK LV DOVR VXJJHVWHG E\

$OEULJKW HW DO 2WKHU ULVN IDFWRUV VHOHFWHG E\ WKH WUHHEDVHG PHWKRGV DUH DOVR LQ DFFRUGDQFH ZLWK SUHYLRXV ILQGLQJV 7HWKHULQJ DV D PHWKRG RI PDQDJLQJ KRUVHV LV XQVDWLVIDFWRU\ IURP PDQ\ SRLQWV RI YLHZ 1DWLRQDO MRLQW (TXLQH :HOIDUH &RPPLWWHH DQG WKH 563&$ DQG RXU UHVXOWV DOVR VXJJHVW WKDW LI VWDEOH HQYLURQPHQW KDV D UHVWULFWLYH QDWXUH IURP D ORFRPRWRU SHUVSHFWLYH KRUVHV KRXVHG LQ VWDOOV DQG WHWKHUHG ZLWK D URSH KRUVHVVKRZFULEELWLQJEHKDYLRXUPRUHOLNHO\

6RPHULVNIDFWRUVUHSRUWHGE\RWKHUVZHUHQRWLGHQWLILHGLQRXUVWXG\HJWKHHIIHFWRI EUHHG7KLVFRXOGEHGXHWRWKHVPDOOYDULDELOLW\RIEUHHGVLQRXUVWXG\1DJ\HWDO 0RVW KRUVHV ZHUH +XQJDULDQ KDOIEUHHGV ZKLOH WKH QXPEHU RI WKRURXJKEUHGV WKH EUHHG PRVW OLNHO\ WR EH DIIHFWHG E\ VWHUHRW\SLHV $OEULJKW HW DO ZDV DV IHZ DV VL[

+RZHYHU RWKHU VWXGLHV DOVR UHSRUWHG QR GLIIHUHQFH EHWZHHQ EUHHGV ZLWK UHVSHFW WR VWHUHRW\SLF EHKDYLRXU 3DUNHU HW DO D 6RPH RWKHU IDFWRUV RIWHQ PHQWLRQHG LQ DVVRFLDWLRQ ZLWK FULEELWLQJ EHKDYLRXU VXFK DV JDVWURLQWHVWLQDO GLVFRPIRUW :DWHUV HW DO RUEDVDOJDQJOLDG\VIXQFWLRQ0F%ULGHDQG+HPPLQJVZHUHQRWH[DPLQHGLQ WKLVVWXG\

&RPSDUHG WR WKH ORJLVWLF UHJUHVVLRQ WUHHEDVHG PHWKRGV GXH WR WKHLU KLHUDUFKLFDO

GHSHQGLQJ RQ WKH FRQWH[W WKDW LV WKH SUHFHGLQJ IDFWRUV ORFDWHG DERYH LW 7KLV IHDWXUH DOORZVIRUGHWHFWLQJQRQOLQHDUUHODWLRQVKLSVDQGLQWHUDFWLRQVEHWZHHQWKHIDFWRUV

'XHWRWKLVIOH[LELOLW\WKHWUHHPHWKRGKHOSVLQEHWWHUXQGHUVWDQGLQJRIWKHSUREOHPXQGHU VWXG\,QRXUFDVHLWDOVRUHVXOWHGLQEHWWHUSUHGLFWLRQDFFXUDF\WKDQWKHORJLVWLFUHJUHVVLRQ 6SHFLILFDOO\SUHGLFWLRQDFFXUDF\RIFULEELWLQJKRUVHVVHQVLWLYLW\ZDVPXFKEHWWHUE\WKH WUHHEDVHGPHWKRGVWKDQE\WKHORJLVWLFUHJUHVVLRQKRZHYHUVSHFLILFLW\ZHUHRQO\VOLJKWO\

ORZHU7KLVLVLQDFFRUGDQFH ZLWKSUHYLRXVILQGLQJV:RUWKDQG&URQLQ +RHWDO 7KRPDVHWDO

7UHHEDVHG PHWKRGV GR QRW KDYH VWULFW DSSOLFDELOLW\ FRQGLWLRQV OLNH WKH ORJLVWLF UHJUHVVLRQZRUNZHOOZLWKFRPSOH[GDWDVHWVDUHOHVVLQIOXHQFHGE\WKHPXOWLFROOLQHDULW\RI WKHYDULDEOHVDQGKDQGOHWKHPLVVLQJYDOXHVDQGORZSUHYDOHQFHHDVLO\7KHLURXWSXWWKH WUHHGLDJUDPVKRZVWKHSUREDELOLW\RIWKHRFFXUUHQFHRIWKHHYHQWVDQGYLYLGO\LOOXVWUDWHV WKHVWUXFWXUHRIWKHULVNIDFWRUVDQGWKHLUFRPSOH[LQWHUDFWLRQVZKLFKZRXOGEHGLIILFXOWRU HYHQLPSRVVLEOHWRPRGHOE\ORJLVWLFUHJUHVVLRQ7KHUHIRUHLWPDNHVWKHILQGLQJVHDVLHUWR LQWHUSUHWHYHQWRWKRVHZLWKOHVVVWDWLVWLFDOEDFNJURXQG+DUSHU7KRPDVHWDO .XUWHWDO

,Q VXPPDU\ ZH FDQ FRQFOXGH WKDW WUHH EDVHG PHWKRGV HLWKHU &$57 RU FRQGLWLRQDO LQIHUHQFH WUHH DUH XVHIXO WRROV LQ ILQGLQJ ULVN IDFWRUV RU HYHQ IRU GDWD PLQLQJ DORQH RU WRJHWKHUZLWKORJLVWLFUHJUHVVLRQPHWKRG

&KDSWHU

'LIIHUHQFHVLQWHPSHUDPHQWWUDLWVEHWZHHQ FULEELWLQJDQGFRQWUROKRUVHV

,QWURGXFWLRQ

5HFHQW VWXGLHV KDYH VXJJHVWHG WKDW FULEELWLQJ LQ KRUVHV LV DVVRFLDWHG ZLWK OHDUQLQJ GLVDELOLWLHVDQGZLWKUHGXFHGVWUHVVWROHUDQFH6WXGLHVRQUHDFWLRQRIFULEELWLQJKRUVHVWR VKRUWWHUPVWUHVVRUVDUHOLPLWHG0LQHURHWDOIRXQGWKDWFULEELWLQJKRUVHVVKRZHG OHVV UHDFWLYLW\ ZKLOH UHVWUDLQHG ZLWK D OLSWZLWFK +RZHYHU ZKHQ KRUVHV ZHUH H[SRVHG VXGGHQO\ WR WKH UDSLG LQIODWLRQ RI D EDOORRQ FULEELWHUV WHQGHG WR UHDFW VWURQJHU WR WKH VWLPXOXV 0LQHUR HW DO %DFKPDQQ HW DO IRXQG WKDW FULEELWHUV KDG ORZHU EDVDO YDJDO DQG KLJKHU V\PSDWKHWLF WRQH WKDQ FRQWURO KRUVHV UHVXOWLQJ LQ OHVV IOH[LEOH SK\VLRORJLFDOUHDFWLYLW\ZKHQIDFLQJDVWUHVVRU

,WLVDOVRDUHOHYDQWTXHVWLRQZKHWKHULQGLYLGXDOµSHUVRQDOLW\¶GLIIHUHQFHVSOD\DUROHLQ WKH SKHQRPHQRQ 3HUVRQDOLW\ LV RIWHQ GHILQHG DV DQ LQGLYLGXDO¶V GLVWLQFWLYH SDWWHUQ RI EHKDYLRXU WKDW LV FRQVLVWHQW DFURVV WLPH DQG VLWXDWLRQV $QLPDO SHUVRQDOLW\ VWXGLHV HVSHFLDOO\ LQ GRJV DQG KRUVHV KDYH EHFRPH YHU\ SRSXODU LQ WKH ODVW GHFDGH -RQHV DQG

*RVOLQJ /OR\G HW DO EXW GLIIHUHQFHV LQ HTXLQH WHPSHUDPHQW WUDLWV DPRQJ FULEELWLQJDQGFRQWUROKRUVHVDUHQRWZHOOH[DPLQHG

7HPSHUDPHQW WUDLWV FDQ EH PHDVXUHG GLUHFWO\ E\ EHKDYLRXUDO WHVWV /H 6FRODQ HW DO 9LVVHUHWDO/DQVDGHHWDORUE\TXHVWLRQQDLUHVXUYH\VXVLQJWKH VXEMHFWLYHUDWLQJVRIWKHULGHURUKDQGOHUZKRLVIDPLOLDUZLWKWKHKRUVH0RUULVHWDO 0RPR]RZD HW DO /OR\G HW DO 0F*URJDQ HW DO $GYDQWDJHV RI WKH TXHVWLRQQDLUHDUHWKDWLWLVEDVHGRQORQJWHUPREVHUYDWLRQVRIWKHUDWHUVDQGLQDUHODWLYHO\

VKRUWWLPHVHYHUDOWUDLWV FDQEHDVVHVVHG7KH HIILFDF\RITXHVWLRQQDLUHEDVHGDVVHVVPHQW KDV DOUHDG\ EHHQ GHPRQVWUDWHG LQ D YDULHW\ RI VSHFLHV 0RVW DQLPDO VSHFLHV KDYH VKRZQ

0F&UDH EDVHG RQ D ILYHIDFWRU PRGHO µ2SHQQHVV¶ µ&RQVFLHQWLRXVQHVV¶

µ([WUDYHUVLRQ¶ µ$JUHHDEOHQHVV¶ DQG µ1HXURWLFLVP¶ 7KUHH RI WKH ILYH IDFWRUV µ1HXURWLFLVP¶ µ([WUDYHUVLRQ¶ DQG µ&RQVFLHQWLRXVQHVV¶ KDG JRRG LQWHUQDO FRQVLVWHQFL\

DQGLQWHUUDWHUUHOLDELOLWL\EXWUDWHUVIRXQGLWKDUGWRDSSO\µ$JUHHDEOHQHVV¶DQGµ2SHQQHVV¶

WRKRUVHV/OR\GHWDOXVHGWKHUDWLQJPHWKRGRI6WHYHQVRQ+LQGHHWDOWR DVVHVV WKH SHUVRQDOLW\ RI KRUVHV DQG IRXQG VL[ PDLQ IDFWRUV WKDW ZHUH ODEHOOHG µ$Q[LRXVQHVV¶ ZKLFK ZDV VLPLODU WR WKDW RI µQHXURWLFLVP¶ µ([FLWDELOLW\¶ µ'RPLQDQFH¶

VLPLODU WR µ$JUHHDEOHQHVV¶ µ3URWHFWLRQ¶ µ6RFLDELOLW\¶ VKDUHV FRPPRQ LWHPV ZLWK µ([WUDYHUVLRQ¶DQGµ,QTXLVLWLYHQHVV¶UHODWHVWRµ2SHQQHVV¶0F*URJDQHWDOXVHG TXHVWLRQQDLUH LWHPV EDVHG RQ QDWXUDO ODQJXDJH RI KRUVH RZQHUV WR DVVHVV WKH IDFWRU VWUXFWXUHRIKRUVHSHUVRQDOLW\DQGIRXQGWKUHHPDLQIDFWRUVZKLFKUHVHPEOHGWRWKHKXPDQ µ1HXURWLFLVP¶µ([WUDYHUVLRQ¶DQGµ$JUHHDEOHQHVV¶

0RPR]RZD HW DO IRXQG WKUHH PDLQ IDFWRUV ZKLFK ZHUH WHUPHG DV µ$Q[LHW\¶

µ$IIDELOLW\¶ DQG µ7UDLQDELOLW\¶ 7KH µ$Q[LHW\¶ IDFWRU LV VLPLODU WR µ1HXURWLFLVP¶ DQG LV EDVHG RQ LWHPV UHIOHFWLQJ µ1HUYRXVQHVV¶ µ([FLWDELOLW\¶ µ3DQLF¶ µ,QFRQVLVWHQW HPRWLRQDOLW\¶ µ9LJLODQFH¶ µ6NLWWLVKQHVV¶ DQG µ7LPLGLW\¶ µ$IIDELOLW\¶ FRQWDLQV LWHPV DV µ)ULHQGOLQHVV WRZDUG SHRSOH¶ µ&RRSHUDWLRQ¶ µ'RFLOLW\¶ DQG µ)ULHQGOLQHVV WRZDUG KRUVHV¶

DQG VKDUHV VLPLODULWLHV WR µ$JUHHDEOHQHVV¶ µ7UDLQDELOLW\¶ LV EDVHG RQ µ&RQFHQWUDWLRQ¶

µ7UDLQDELOLW\¶µ0HPRU\¶DQGµ3HUVHYHUDQFH¶:LWKWKLVTXHVWLRQQDLUHµ7UDLQDELOLW\¶FRXOG EHPHDVXUHGVHSDUDWHO\ IURPµ$Q[LHW\¶3UHYLRXVVWXGLHVGLGQRWPHDVXUHGµ7UDLQDELOLW\¶

SHUVH0RUULVHWDO/OR\GHWDORUUHYHDOHGDIDFWRUZKLFKFRQWDLQHGLWHPV UHODWHG WR µ7UDLQDELOLW\ µ'RPLQDQFH¶ DQG µ1HXURWLFLVP¶ DV ZHOO µ([WUDYHUVLRQ¶ IDFWRU RI 0F*URJDQHWDO

7RDQVZHUWKHTXHVWLRQVRIWKLVVWXG\WKHSHUVRQDOLW\TXHVWLRQQDLUHRI0RPR]DZDHWDO ZDV FKRVHQ VLQFH LW DOORZHG FRPSDULVRQV RI µ$Q[LHW\¶ µ7UDLQDELOLW\¶ DQG µ$IIDELOLW\¶WUDLWVEHWZHHQFULEELWLQJDQGFRQWUROKRUVHVDQGLWVUHOLDELOLW\DQGYDOLGLW\KDV EHHQSUHYLRXVO\VKRZQ7KHVHIDFWRUVZHUHFRQVHUYHGLQWZRVHSDUDWHVXUYH\VUHSUHVHQWLQJ WUXHWHPSHUDPHQWDOWUDLWV$OOWKUHHWHPSHUDPHQWWUDLWVIRXQGE\0RPR]DZDHWDO KDG VXIILFLHQW LQWHUQDO FRQVLVWHQF\ DQG KRUVHV HYDOXDWHG DV KLJKO\ DQ[LRXV E\ WKH UDWHUV VKRZ JUHDWHU LQFUHDVH LQ KHDUW UDWH DQG GHIHFDWH PRUH RIWHQ GXULQJ H[SRVXUH WR QRYHO VWLPXOLWKDQRWKHUKRUVHV0RPR]RZDHWDO

0HWKRGV

$QLPDOV

)LIW\FRQWURODQGFULEELWLQJKRUVHVZHUHXVHGLQWKLVVWXG\$OOFULEELWLQJKRUVHVKDG SHUIRUPHGVWHUHRW\SLFEHKDYLRXUIRUPRUHWKDQPRQWKV+RUVHVVWD\HGDWGLIIHUHQWULGLQJ VFKRROV:KHUHSRVVLEOHFRQWUROKRUVHVZHUHVHOHFWHGIURPWKHVDPHHVWDEOLVKPHQW+RUVHV ZHUHPDWFKHGDVIDUDVSRVVLEOHIRUEUHHGDQGPDQDJHPHQWURXWLQHDVZHOO$OOKRUVHVZHUH IHGRDWVDQGKD\WZLFHDGD\WXUQHGRXWWRSDVWXUHGDLO\DQGZHUHULGGHQUHJXODUO\

0HDQDJH“6(ZDV “IRUFRQWURODQG“IRUFULEELWLQJKRUVHV*URXSV GLG QRW GLIIHU UHJDUGLQJ DJH W S EUHHG F S JHQGHU

F S XVDJHF S RUWUDLQLQJOHYHOF S

7DEOH

7DEOH1XPEHURIKRUVHVLQHDFKOHYHORIWKHLQGHSHQGHQWIDFWRUV

,QGHSHQGHQW IDFWRUV

/HYHOVRIWKH IDFWRU

1XPEHURI FRQWUROKRUVHV

1XPEHURI FULEELWLQJKRUVHV

%UHHG 7KRURXJKEUHG

+XQJDULDQ

+DOIEUHG

+XQJDULDQ

6SRUW+RUVH

2WKHU

*HQGHU 6WDOOLRQ

*HOGLQJ

0DUH

8VDJH /HLVXUH

&RPSHWLWLRQ

7UDLQLQJ

OHYHO %DVLF

8SSHU

3HUVRQDOLW\TXHVWLRQQDLUH

+RUVH RZQHUV ZHUH DVNHG WR FRPSOHWH D SUHYLRXVO\ YDOLGDWHG HTXLQH WHPSHUDPHQW TXHVWLRQQDLUH GHYHORSHG E\ 0RPR]DZD HW DO ZKR FRPSDUHG WZR VHSDUDWH KRUVH JURXSV ZKLFK FRQVLVWHG RI 7KRURXJKEUHGV RI WKH VDPH DJH EHLQJ NHSW XQGHU VLPLODU

RI WKH HTXLQH WHPSHUDPHQW &RQVLGHULQJ WKDW QRQH RI WKH KRUVHV LQ WKLV VWXG\ KDG EHHQ WUDLQHG DV UDFHKRUVHV WKH µ*DWH HQWUDQFH¶ LWHP ZDV H[FOXGHG IURP WKH RULJLQDO TXHVWLRQQDLUH WKHUHIRUH TXHVWLRQV UHPDLQHG LQ WKH SUHVHQW VXUYH\ )RU HDFK TXHVWLRQ LWHPDGHVFULSWLRQZDVDGGHGDFFRUGLQJWR0RPR]DZDHWDO7KHUHVSRQVHVZHUH RQDVFDOHRIWRZLWKWKHODWWHUEHLQJWKHKLJKHVWUDQNIRUDJLYHQLWHP7DEOH

6WDWLVWLFDODQDO\VLV )DFWRUDQDO\VLV

7R FRQGHQVH WKH LWHPV RI WKH SHUVRQDOLW\ TXHVWLRQQDLUH SULQFLSDO FRPSRQHQW DQDO\VLV 3&$ ZDV XVHG ZLWK 9DULPD[ URWDWLRQ ZLWK (LJHQYDOXH! 7KH QXPEHU RI H[WUDFWHG IDFWRUVZDVGHFLGHGDIWHUYLVXDOLQVSHFWLRQXVLQJWKHUXOHVRIWKH6FUHHWHVW)DFWRUVFRUHV ZHUHFDOFXODWHGE\XVLQJWKH5HJUHVVLRQPHWKRG5HLVHHWDO

7KH.DLVHU0H\HU2ONLQ0HDVXUHRI6DPSOLQJ$GHTXDF\ZDVLQGLFDWLQJWKDWWKH GDWDZDVVXLWDEOHIRUVWUXFWXUHGHWHFWLRQ$YHUDJHFRPPXQDOLWLHVZHUH“6'

&RPSDULVRQRIWKHIDFWRUVWUXFWXUHV

)DFWRUV H[WUDFWHG IURP WKH SUHVHQW VXUYH\ ZHUH FRPSDUHG WR WKH IDFWRU VWUXFWXUHV UHSRUWHGE\0RPR]DZDHWDO7KHFRPSRQHQWVFRUHVIRUHDFKKRUVHZHUHFDOFXODWHG WZRWLPHV)LUVWXVLQJ3&$DVGHVFULEHGDERYH6HFRQGZHFDOFXODWHGVFRUHVDFFRUGLQJWR WKHKRUVHSHUVRQDOLW\PRGHOFUHDWHGE\0RPR]DZDHWDO$QLQGLYLGXDO¶VVFRUHIRU HDFKFRPSRQHQWZDVFDOFXODWHGE\WKHLQGLYLGXDO¶VUDWLQJRQDQLWHPVXPPHGRYHUDOOWUDLW LWHPV 3HDUVRQ¶V FRUUHODWLRQ FRHIILFLHQWV IRU µ$Q[LHW\¶ µ7UDLQDELOLW\¶ DQG µ$IIDELOLW\¶

IDFWRU VFRUHV RI WKH SUHVHQW VXUYH\ DQG WKDW RI 0RPR]RZD HW DO ZHUH WKHQ FDOFXODWHG7DEOH

7DEOH 4XHVWLRQQDLUH LWHPV ZLWK GHVFULSWLRQ DQG WKH IDFWRU ORDGLQJV RI HDFK TXHVWLRQQDLUHLWHP

,WHP 'HVFULSWLRQWKLVKRUVHWHQGWR« 6FDOH

llll )DFWRU )DFWRU )DFWRU )DFWRU )DFWRU 1HUYRXVQHVV EHFRPHQHUYRXVDERXWLQVHFWV

QRLVHVHWF &DOP

1HUYRXV

&RQFHQWUDWLRQ EHWUDLQDEOHDQGXQGLVWXUEHGE\WKH

HQYLURQPHQW 3RRU

([FHOOHQW

6HOIUHOLDQFH EHDWHDVHLIOHIWDORQHDZD\IURP

WKHKHUG 5HVWOHVV

$WHDVH

7UDLQDELOLW\ EHWUDLQHGHDVLO\DQGSURPSWO\ 3RRU

([FHOOHQW

([FLWDELOLW\ JHWH[FLWHGHDVLO\ 1RW H[FLWDEOH

([FLWDEOH BBBB

)ULHQGOLQHVV

WRZDUGSHRSOH EHQHYHUDJJUHVVLYHRUIHDUIXO 8QIULHQGO\

)ULHQGO\

&XULRVLW\ EHLQWHUHVWHGLQQRYHOREMHFWVDQG DSSURDFKWKHP

5DUHO\

)UHTXHQWO\

0HPRU\ PHPRUL]HZKDWLWOHDUQHGRUZDV

WUDLQHG 3RRU

([FHOOHQW

3DQLF JHWH[FLWHGWRDQDEQRUPDOH[WHQW 5DUHO\

)UHTXHQWO\

&RRSHUDWLRQ EHFRRSHUDWLYHZLWKFDUHWDNHUZKHQ

KDQGOHG 5DUHO\

)UHTXHQWO\

,QFRQVLVWHQW

HPRWLRQDOLW\ EHXQSUHGLFWDEOHIURPGD\WRGD\ &RQVLVWHQW

,QFRQVLVWHQW BBBB

6WXEERUQQHVV EHREVWLQDWHRQFHLWUHVLVWVD

FRPPDQG 2EHGLHQW

6WXEERUQ

'RFLOLW\ EHGRFLOHLQJHQHUDO $FWLYH

'RFLOH BBBB

9LJLODQFH EHYLJLODQWDERXWVXUURXQGLQJV 5DUHO\

)UHTXHQWO\

3HUVHYHUDQFH EHSDWLHQWZLWKYDULRXVVWLPXOL ,PSDWLHQW

3DWLHQW BBBB

)ULHQGOLQHVV WRZDUGKRUVHV

LQWHUDFWZLWKRWKHUKRUVHVLQD

IULHQGO\PDQQHU 8QIULHQGO\

)ULHQGO\

&RPSHWLWLYHQHVV EHGRPLQDQWLQDJRQLVWLFHQFRXQWHUV

ZLWKRWKHUKRUVHV 6XERUGLQDWH

'RPLQDQW

6NLWWLVKQHVV JHWVXUSULVHHDVLO\ 1RWVNLWWLVK

6NLWWLVK

7LPLGLW\ EHWLPLGLQDQRYHOHQYLURQPHQW $XGDFLRXV

7LPLG

4XHVWLRQLWHPVDUHOLVWHGDFFRUGLQJWRWKHRUGHULQWKHDFWXDOTXHVWLRQQDLUHVKHHW%ROG IRQW UHSUHVHQWV WKDW WKH LWHP¶V DEVROXWH YDOXH LV PRUH WKDQ ZKLFK LQGLFDWHV WKDW WKH LWHPEHORQJVWRWKHJLYHQIDFWRU(PSW\FHOOVLQGLFDWHWKDWWKHDEVROXWHYDOXHRIWKHIDFWRU

)LJXUH%R[SORWRIµ$Q[LHW\¶Dµ7UDLQDELOLW\¶EDQGµ$IIDELOLW\¶FLQ FRQWURODQGFULEELWLQJKRUVHVXVHGIRUFRPSHWLWLRQRUOHLVXUHSXUSRVHV

'LIIHUHQFHVEHWZHHQJURXSV

'LIIHUHQFHV LQ WKH REWDLQHG IDFWRU VFRUHV DPRQJ FRQWURO DQG FULEELWLQJ KRUVHV ZHUH WHVWHG E\ XVLQJ JHQHUDO OLQHDU PRGHOV ZKHUH µ$Q[LHW\¶ µ7UDLQDELOLW\¶ DQG µ$IIDELOLW\¶

VHUYHGDVGHSHQGHQWIDFWRULQWKHVHSDUDWHPRGHOVDQGWKHHIIHFWRIJURXSFRQWURORUFULE ELWLQJ KRUVHV DJH EUHHG JHQGHU XVDJH WUDLQLQJ OHYHO RI WKH KRUVHV DQG WKHLU SRVVLEOH LQWHUDFWLRQV ZHUH WKH LQGHSHQGHQW IDFWRUV 7KH IDFWRU VFRUHV IRU µ$Q[LHW\¶ µ7UDLQDELOLW\¶

DQGµ$IIDELOLW\¶ZHUHFDOFXODWHGE\DGGLQJWKHVFRUHVRIWKHLWHPVEHORQJLQJWRHDFKIDFWRU DFFRUGLQJWR0RPR]DZDHWDO'LDJQRVWLFSORWVRIWKHUHVLGXDOVDQGVWDQGDUGL]HG UHVLGXDOVZHUHXVHGWRFKHFNWKHQRUPDOLW\DQGYDULDQFHKRPRJHQHLW\DVVXPSWLRQVRIWKH PRGHOV7KHGLVWULEXWLRQRIWKHHUURUWHUPVSURYHGWREHQRUPDO$OODQDO\VHVZHUHFDUULHG RXW XVLQJ WKH 5 6WDWLVWLFDO 6RIWZDUH 5 'HYHORSPHQW &RUH 7HDP 7KH VLJQLILFDQFHOHYHOZDVVHWDWSZKHUHDVDQHIIHFWZDVFRQVLGHUHGDWUHQGZKHQSZDV EHWZHHQDQG

5HVXOWV

&RPSDULVRQRIWKHIDFWRUVWUXFWXUHV

,QWKHSUHVHQWVWXG\LWHPVZHUHJURXSHGLQWRIDFWRUVWKDWDFFRXQWHGIRURIWKH FRPPRQ YDULDQFH )DFWRU FRQVLVWHG RI RXW RI WKH LWHPV OLVWHG DV µ7UDLQDELOLW\¶ E\

0RPR]DZDHWDODQGRIH[WUDLWHPVDVVRFLDWHGZLWKWUDLQDELOLW\µ&RRSHUDWLRQ¶

µ6WXEERUQQHVV¶DQGµ'RFLOLW\¶,QWKHVXUYH\RI0RPR]DZDHWDOµ'RFLOLW\¶

DOVREHORQJHGWRµ7UDLQDELOLW\¶EXWQRWLQWKHVXUYH\)DFWRUFRQVLVWHGRIRXWRIWKH LWHPVOLVWHGDVµ$Q[LHW\¶E\0RPR]DZDHWDODQGRIH[WUDLWHPVµ6HOIUHOLDQFH¶

DQGµ3HUVHYHUDQFH¶%RWKH[WUDLWHPVEHORQJHGWRµ$Q[LHW\¶LQRQHRIWKHWZRVXUYH\VRI 0RPR]DZDHWDO)DFWRUFRQVLVWHGRIRXWRIWKHLWHPVOLVWHGDVµ$IIDELOLW\¶E\

0RPR]DZDHWDODQGRIH[WUDLWHPµ3HUVHYHUDQFH¶

3HDUVRQ¶V FRUUHODWLRQ FRHIILFLHQWV EHWZHHQ WKH IDFWRU VFRUH RI WKH H[WUDFWHG IDFWRUV RI WKLV VWXG\ DQG WKH IDFWRU VFRUHV RI WHPSHUDPHQW WUDLWV FDOFXODWHG DFFRUGLQJ WR WKH IDFWRU

VWUXFWXUHUHSRUWHGE\0RPR]DZDZHUHIRUµ$Q[LHW\¶W S