3$57,,
II
5XQQLQJKHDG7($&+(56¶,16758&7,21$/7$/.
7HDFKHUV¶,QVWUXFWLRQDO7DONLQD3DUWO\6FULSWHG/DQJXDJH,QWHUYHQWLRQ7DUJHWLQJ<RXQJ /DQJXDJH0LQRULW\/HDUQHUV'HYHORSPHQWV2YHU7LPH
5XQQLQJKHDG7($&+(56¶,16758&7,21$/7$/.
$EVWUDFW
'HVSLWHKXJHLQYHVWPHQWVLQLQWHUYHQWLRQVGHVLJQHGWRVXSSRUWRUDOODQJXDJHVNLOOVLQHDUO\
FKLOGKRRGDQGEH\RQGPDQ\RIWKHLQWHUYHQWLRQVIDLOWRLGHQWLI\LPSDFWVRQFKLOGUHQ¶V ODQJXDJHOHDUQLQJ3URJUDPVPD\KDYHOLPLWHGLPSDFWEHFDXVHWKH\GRQRWVXIILFLHQWO\
VXFFHHGLQVXSSRUWLQJWHDFKHUV¶LQVWUXFWLRQDOWDONDQGWKXVPRUHHIILFLHQWO\SURPRWH
FKLOGUHQ¶VODQJXDJHOHDUQLQJ7KHSUHVHQWVWXG\H[DPLQHGWKHH[WHQWWRZKLFKWHDFKHUVLQ 1RUZD\LPSOHPHQWLQJDODQJXDJHLQWHUYHQWLRQSURJUDPGHVLJQHGWRHQKDQFHVWXGHQWV¶
VHFRQGODQJXDJHOHDUQLQJGHPRQVWUDWHGFKDQJHVLQWKHLULQVWUXFWLRQDOWDONRYHUWKHZHHN SURJUDP7KHSURJUDPFRQVLVWHGRIVFULSWHGSDUWVODEHOLQJSLFWXUHVRIWDUJHWHGZRUGV UHSHDWHGH[SRVXUHVDVZHOODVVRIWVFULSWHGSDUWVZRUGUHODWLRQVDQGGHILQLWLRQVDQG PLQLPDOO\VFULSWHGSDUWVQDUUDWLYHVDQGH[SODQDWLRQVWKDWH[WHQGHGWKHKHUHDQGQRZ 7HDFKHUVUHFHLYHGSURIHVVLRQDOGHYHORSPHQWWKDWTXDOLILHGWKHPWRLPSOHPHQWWKHSURJUDP
$QDO\VLVRIPRGLILFDWLRQVLQWHDFKHUV¶LQVWUXFWLRQDOWDONZDVEDVHGRQDXGLRUHFRUGHGVPDOO JURXSLQWHUDFWLRQVFRPSDULQJFKDUDFWHULVWLFVRIWHDFKHUWDONDWWKHEHJLQQLQJDQGHQGRIWKH ZHHNSURJUDP5HVXOWVUHYHDOHGWKDWWHDFKHUV¶LQVWUXFWLRQDOWDONGHYHORSHGWRLQFOXGHPRUH ZRUGGHILQLWLRQVDQGH[WHQGHGGLVFRXUVHWDONFDWHJRULHVDOLJQHGZLWKWKHOHVVVFULSWHGSDUWVRI WKHLQWHUYHQWLRQ&RQYHUVHO\WHDFKHUWDONGXULQJWKHVFULSWHGSDUWVRIWKHSURJUDPGLGQRW FKDQJH
.H\ZRUGVLQVWUXFWLRQDOWDONVFULSWHGFRPSRQHQWVRUDOODQJXDJHOHDUQLQJ LQWHUYHQWLRQV
5XQQLQJKHDG7($&+(56¶,16758&7,21$/7$/.
7HDFKHUV¶,QVWUXFWLRQDO7DONLQD3DUWO\6FULSWHG/DQJXDJH,QWHUYHQWLRQ7DUJHWLQJ<RXQJ /DQJXDJH0LQRULW\/HDUQHUV'HYHORSPHQWV2YHU7LPH
)URPDVRFLDOLQWHUDFWLRQLVWWKHRUHWLFDOSHUVSHFWLYHODQJXDJHOHDUQLQJLVHPEHGGHG ZLWKLQDQGUHVXOWVIURPWKHFRPSOH[LW\RIRUDOLQWHUDFWLRQVWKDWFKLOGUHQSDUWLFLSDWHLQGXULQJ DQGRXWVLGHVFKRRO$XWKRU &ROOHDJXHV+DOOLGD\+RII1LQLR 6QRZ
$EDVLFTXDOLW\RIODQJXDJHLQWHUYHQWLRQSURJUDPVZLWKLQWKHVRFLDOLQWHUDFWLRQLVW DSSURDFKLVWKHWHDFKHU±VWXGHQWODQJXDJHSURPRWLQJLQWHUDFWLRQVWKHSURJUDPVVXSSRUW
'LFNLQVRQ 3RUFKH-XVWLFH-LDQJ 6WUDVVHU0LFKHQHU3URFWRU 6LOYHUPDQ ,QPRGHUQPXOWLOLQJXDOVRFLHWLHVLGHQWLI\LQJTXDOLWLHVRIODQJXDJHLQWHUYHQWLRQ
SURJUDPVWKDWVXSSRUWWHDFKHUFDSDFLW\WRHQJDJHPLQRULW\OHDUQHUVLQODQJXDJHSURPRWLQJ LQWHUDFWLRQLVFUXFLDO
)HDWXUHVRILQWHUDFWLRQVWKDWVXSSRUWODQJXDJHOHDUQLQJKDYHEHHQDGDSWHGLQWR LQWHUYHQWLRQSURJUDPVE\HQFRXUDJLQJFRQYHUVDWLRQVXVLQJVWUDWHJLHVVXFKDVRSHQHQGHG TXHVWLRQV:DVLN%RQG +LQGPDQ=XFNHU-XVWLFH3LDVWD .DGHUDYHN UHLQIRUFHPHQWDQGUHSHWLWLRQV&DUORHWDO5REHUWV 1HDODQGH[SDQVLRQVRI FKLOGUHQ¶VXWWHUDQFHVDQGWKHXVHRIVRSKLVWLFDWHGYRFDEXODU\ZRUGV'LFNLQVRQ 3RUFKH +RZHYHUVWXGLHVH[DPLQLQJWKHHIILFDF\RIODQJXDJHLQWHUYHQWLRQSURJUDPVRQ
FKLOGUHQ¶VRUDOODQJXDJHVNLOOVKDYHUHDFKHGLQFRQVLVWHQWILQGLQJV:DVLNDQG+LQGPDQ IRXQGWKDWDQLQWHUYHQWLRQSURJUDPEDVHGRQWHDFKHUSURIHVVLRQDOGHYHORSPHQWLPSURYHGWKH TXDOLW\RIWHDFKHUV¶LQVWUXFWLRQDOWDONHJPRGHOLQJODQJXDJHRUSURYLGLQJFKLOGUHQ
RSSRUWXQLWLHVWRXVHODQJXDJHDQGWKDWYDULDWLRQLQWKHTXDOLW\RIWHDFKHUWDONZDVDVVRFLDWHG ZLWKFKLOGUHQ¶VODQJXDJHJDLQV0HWDDQDO\VHVE\(OOHPDQ/LQGR0RUSK\DQG&RPSWRQ DQG0DUXOLVDQG1HXPDQUHYHDOHGSRVLWLYHLPSDFWVRIODQJXDJHLQWHUYHQWLRQV RQVRPHRUDOODQJXDJHPHDVXUHVEXWQRWRQRWKHUV2WKHUODQJXDJHLQWHUYHQWLRQVWXGLHVGLG QRWILQGHIIHFWVRQFKLOGRXWFRPHVGHVSLWHKXJHLQYHVWPHQWVHJ<RVKLNDZDHWDO
5XQQLQJKHDG7($&+(56¶,16758&7,21$/7$/.
/DQJXDJH/HDUQLQJDQG6FULSWHG,QWHUYHQWLRQ&RPSRQHQWV
.H\GHFLVLRQVLQWKHFRQVWUXFWLRQRIODQJXDJHLQWHUYHQWLRQSURJUDPVIRU\RXQJ OHDUQHUVFRQFHUQWKHGHWDLOLQJRIWHDFKHUPDQXDOV6RPHLQWHUYHQWLRQSURJUDPVRIIHUGHWDLOHG DQGPDQXDOL]HGJXLGHOLQHVIRUKRZWHDFKHUVVKRXOGLQWHUDFWZLWKVWXGHQWVGXULQJDFWLYLWLHV WKDWLVWKHSURJUDPVDUHVWURQJO\VFULSWHGZKLOHRWKHULQWHUYHQWLRQSURJUDPVDUHOHVVGHWDLOHG ZKHQLWFRPHVWRKRZWHDFKHUV¶LQVWUXFWLRQVDUHVXSSRUWHG:HXVHWKHWHUPVFULSWLQJLQWKLV DUWLFOHWRUHIHUWRSUHVFULEHGUHDGDORXGFRPSRQHQWVZKLFKDUHKLJKO\VWUXFWXUHGZLWKGLVWLQFW VWHSVDQGLQVWUXFWLRQVWRFRPSOHWH6FULSWHGYHUVLRQVXVXDOO\FRQWDLQVWHSE\VWHSLQVWUXFWLRQ IRUWHDFKHUVWRIROORZIURP$WR%HJUHDGLQJRXWHDFKLQVWUXFWLRQGLUHFWO\IURPWKH PDQXDODQGGRQRWRSHQXSIRUIOH[LEOHXVHDQGH[WHQVLRQVRIWKHWDUJHWHGDFWLYLWLHVDQG LQVWUXFWLRQV$QH[DPSOHLVWKHZRUNE\5RJGH0HOE\/HUYnJDQG/HUYnJZKR SURYLGHGWHDFKHUVZLWKGHWDLOHGZRUGE\ZRUGOHVVRQVFULSWVWRIROORZWKURXJKRXWWKH
LQWHUYHQWLRQ2WKHULQWHUYHQWLRQSURJUDPVGHPRQVWUDWHDVRIWHUW\SHRIVFULSWLQJIRUH[DPSOH E\SURYLGLQJVRPHLQWHUYHQWLRQFRPSRQHQWVZLWKVSHFLILHGLQVWUXFWLRQVIRUWHDFKHUVWRIROORZ LHVFULSWHGZRUGGHILQLWLRQVZKLOHDOVRLQYLWLQJWHDFKHUDGDSWDWLRQVWKDWDUHQRW
VSHFLILFDOO\RXWOLQHGUHJDUGLQJZKDWWHDFKHUVVKRXOGHPSKDVL]HHJ1HXJHEDXHU&R\QH 0F&RDFK :DUH(YHQOHVVJXLGHOLQHVIRULQVWUXFWLRQDOWDONLVRIIHUHGLQLQWHUYHQWLRQ SURJUDPVWKDWPRVWO\SURYLGHWHDFKHUVZLWKH[DPSOHVRIDFWLYLWLHVWRVHOHFWIURPZLWKLQWKH WDUJHWHGGRPDLQ:DVLN +LQGPDQ7KHWHDFKHUVXSSRUWLQWKHVHODWWHUSURJUDPVPD\
LQFOXGHLQIRUPDWLRQRQJHQHUDOODQJXDJHHQKDQFLQJVWUDWHJLHVWKDWWHDFKHUVUHFHLYHDVSDUWRI SURIHVVLRQDOGHYHORSPHQWGXULQJZRUNVKRSVEHIRUHWKHLQWHUYHQWLRQDQGWKDWWHDFKHUVDUH HQFRXUDJHGWRXVHLQDIOH[LEOHZD\WKURXJKRXWWKHLPSOHPHQWDWLRQRIWKHLQWHUYHQWLRQ)RU VRPHLQWHUYHQWLRQSURJUDPVDPL[WXUHRIVFULSWHGDQGOHVVVFULSWHGFRPSRQHQWVLVLQFOXGHG .LPHWDO
5XQQLQJKHDG7($&+(56¶,16758&7,21$/7$/.
$OWKRXJKVWXGLHVKDYHUHYHDOHGWKDWWHDFKHUVFDQLPSOHPHQWDSURJUDPZLWKKLJK OHYHOVRIDGKHUHQFHZKHQLWFRPHVWRGHOLYHULQJWKHQXPEHURIOHVVRQVDQGWDUJHWHG
FRPSRQHQWVLQWKHLQWHUYHQWLRQDVLQWHQGHGKLJKLPSOHPHQWDWLRQILGHOLW\GRHVQRWQHFHVVDULO\
UHIOHFWTXDOLW\LQVWUXFWLRQ+DUQ3DULVL 6WRROPLOOHU-XVWLFH0DVKEXUQ+DPUH 3LDQWD/HVVIRFXVPD\EHSODFHGRQWKHG\QDPLFLQWHUDFWLRQVWKDWRFFXUEHWZHHQWKH WHDFKHUDQGWKHVWXGHQWVDQGRQWKHLQIRUPDWLRQSURYLGHGWRVWXGHQWV%RZQH<RVKLNDZD 6QRZ
:HLGHQWLILHGWKUHHVWXGLHVWKDWVKHGOLJKWRQWKHLPSDFWRILQWHUYHQWLRQVFULSWHGQHVV RQWHDFKHUV¶LQVWUXFWLRQDOWDON)LUVW.LPHWDOH[DPLQHGWKHHIIHFWLYHQHVVRIWZR FRQGLWLRQVRIWKHSURJUDP5($'6DQRULJLQDOYHUVLRQZLWKVFULSWHGFRPSRQHQWVDQGDQ DGDSWHGYHUVLRQLQZKLFKWHDFKHUVZHUHRIIHUHGJXLGDQFHRQKRZWRPRGLI\VSHFLILFSDUWVRI WKHSURJUDP)LQGLQJVVKRZHGWKDWWHDFKHUVLQERWKFRQGLWLRQVLPSOHPHQWHGWKHFRUHHOHPHQWV ZLWKKLJKOHYHOVRIILGHOLW\ZKLOHWHDFKHUVLQWKHDGDSWHGFRQGLWLRQDOVRDIIRUGHGH[WHQVLRQV DQGPRGLILFDWLRQVLQOLQHZLWKWKHSURJUDP¶VDLP6WXGHQWVSDUWLFLSDWLQJLQWKHDGDSWHG YHUVLRQSHUIRUPHGEHWWHURQUHDGLQJFRPSUHKHQVLRQWKDQWKHLUSHHUVLQWKHRULJLQDOFRQGLWLRQ DQGZHUHDOVRSURYLGHGZLWKPRUHH[SRVXUHWRFRUHFRPSRQHQWVRIWKHSURJUDPHJORQJHU GXUDWLRQRUH[WHQVLRQVRIDFWLYLWLHV
6HFRQGDUHFHQWVWXG\FRPSDUHGWKHTXDOLW\RILQVWUXFWLRQDOWDONE\H[DPLQLQJ VFULSWHGFRPSRQHQWVDQGWHDFKHUV¶H[WHQVLRQVRIWKHVHFRPSRQHQWVLQUHODWLRQWRVWXGHQWV¶
ODQJXDJHJURZWK1HXJHEDXHUHWDO4XDOLW\RILQVWUXFWLRQDOWDONZDVH[DPLQHGRQWZR OHYHOVVFULSWHGLQVWUXFWLRQVRIGHILQLWLRQVDQGZRUGUHODWLRQVDQGH[WHQVLRQVRIWKHVH
GHILQLWLRQVDQGZRUGUHODWLRQVZKLFKZHUHQRWVFULSWHGEXWLQOLQHZLWKWKHSURJUDP¶VDLP )LQGLQJVUHYHDOHGWKDWDGDSWHGLQVWUXFWLRQDOH[WHQVLRQVZHUHPRVWEHQHILFLDOLQHQKDQFLQJ VWXGHQWV¶ODQJXDJHJURZWK
5XQQLQJKHDG7($&+(56¶,16758&7,21$/7$/.
7KLUGDODUJHVFDOH'DQLVKVWXG\FRPSDUHGWKUHHLQWHUYHQWLRQFRQGLWLRQVWKDWGLIIHUHG LQWKHLUOHYHORIVFULSWLQJVPDOOJURXSDQGODUJHJURXSFRQGLWLRQVZLWKVRIWO\VFULSWHGOHVVRQ SODQVOLQNHGWRODQJXDJHDQGOLWHUDF\DFWLYLWLHVDQGDVPDOOJURXSFRQGLWLRQWKDWGLIIHUHGIURP WKHWZRRWKHUVE\EHLQJRQO\PLQLPDOO\VFULSWHG7KHODWWHULQWHUYHQWLRQFRQGLWLRQSURYLGHG WKHVDPHVFRSHDQGVHTXHQFHRILQVWUXFWLRQVDVIRUWKHRWKHUWZRFRQGLWLRQVEXWZLWKRXWD VFULSWHGSODQWRIROORZ%OHVHVHWDO7KHLPSDFWZDVODUJHULQWKHPLQLPDOO\VFULSWHG FRQGLWLRQFRPSDUHGWRWKHRWKHUWZRFRQGLWLRQV)XUWKHUPRUHWKHPLQLPDOO\VFULSWHGYHUVLRQ FRQWULEXWHGWRJDLQVLQFKLOGUHQ¶VYRFDEXODU\ZLWKODUJHUJDLQVDFKLHYHGE\VHFRQGODQJXDJH OHDUQHUVFRPSDUHGWRWKHLUPRQROLQJXDOSHHUV
,QWHUHVWLQJO\'LFNLQVRQVXJJHVWHGWKDWLQWHUYHQWLRQVPD\QRWKDYHWKHGHVLUHG LPSDFWEHFDXVHWKH\IDLOWRFKDQJHWKHZD\VWHDFKHUVWDONZLWKFKLOGUHQDQGWKXVWKHWHDFKHUV¶
FDSDFLW\WRVXSSRUWFKLOGUHQ¶VODQJXDJHOHDUQLQJ5HOHYDQWLQWKDWUHJDUGLV6PRONRZVNLDQG
*XQQ¶VZRUNWKDWVKRZHGWHDFKHUV¶ZD\VRISURYLGLQJRSSRUWXQLWLHVIRUFODVVURRP OHDUQLQJZHUHVWDEOHRYHUWLPH7HDFKHUV¶LQVWUXFWLRQDOWDONDQGZD\VRILQWHUDFWLQJZLWK VWXGHQWVUHIOHFWWKHLUFXOWXUDOEDFNJURXQGVDQGEHOLHIVDQGVHYHUDOVWXGLHVKDYHGHPRQVWUDWHG WKDWVXFKWDONPD\QRWHDVLO\EHDOWHUHG'LFNLQVRQ &DVZHOO'LFNLQVRQ 3RUFKH +LQGPDQ :DVLN1HXPDQ &XQQLQJKDP
+RZHYHUVWXGLHVRIZKHWKHUWHDFKHUVZKRUHFHLYHSURIHVVLRQDOGHYHORSPHQWDQG SDUWLFLSDWHLQODQJXDJHLQWHUYHQWLRQSURJUDPVDUHDEOHWRPRGLI\WKHLULQVWUXFWLRQDOWDONRYHU WLPHDVWKH\GHOLYHUWKHSURJUDPWRWKHLUVWXGHQWVPD\QRWKDYHGLVWLQJXLVKHGVXIILFLHQWO\
EHWZHHQGHYHORSPHQWVLQLQVWUXFWLRQDOWDONWKDWDUHDVVRFLDWHGZLWKPRUHVFULSWHGSDUWVRIWKH LQWHUYHQWLRQSURJUDPDQGGHYHORSPHQWVLQLQVWUXFWLRQDOWDONWKDWUHVXOWIURPDQGUHIOHFWOHVV VFULSWHGLQWHUYHQWLRQFRPSRQHQWV([DPLQLQJWHDFKHULQVWUXFWLRQDOWDONDOLJQHGZLWK
FRPSRQHQWVWKDWGLIIHULQGHJUHHRISURJUDPVFULSWHGQHVVPD\KHOSWRLGHQWLI\TXDOLWLHVRI
5XQQLQJKHDG7($&+(56¶,16758&7,21$/7$/.
WHDFKHUV¶ODQJXDJHSURPRWLQJLQWHUDFWLRQZLWKVWXGHQWVDQGWKXVDOVRSURYLGHDEDVLVIRU IXWXUHLQWHUYHQWLRQSURJUDPVGHVLJQHGWRVXSSRUWVWXGHQWODQJXDJHOHDUQLQJ
7KH3UHVHQW6WXG\
7KHDLPRIWKHSUHVHQWVWXG\ZDVWRH[DPLQHFKDUDFWHULVWLFVRIWKHLQVWUXFWLRQDOWDONRI WHDFKHUVZKRSDUWLFLSDWHGLQDODQJXDJHLQWHUYHQWLRQSURJUDPDGGUHVVLQJ\RXQJODQJXDJH PLQRULW\VWXGHQWVDQGWRDVVHVVKRZWKHWHDFKHUV¶LQVWUXFWLRQDOWDONGHYHORSHGIURPWKHHDUO\
WRWKHODWHUSDUWVRIWKHLQWHUYHQWLRQSURJUDP7KHWHDFKHUVSDUWLFLSDWHGLQDQLQWHUYHQWLRQ SURJUDPWKDWFRQVLVWHGRIVFULSWHGDQGOHVVVFULSWHGFRPSRQHQWV9DULRXVWHUPVKDYHEHHQ XVHGLQWKHOLWHUDWXUHWRGHVFULEHGHJUHHVRIVFULSWLQJHLWKHURIDQHQWLUHLQWHUYHQWLRQSURJUDP RURIVSHFLILFFRPSRQHQWVRIDSURJUDPVXFKDVRYHUO\DQGKLJKO\VFULSWHG3DUNV %ULGJHV 5KRDGVVRIWVFULSWHG%OHVHVHWDORUODUJHO\XQVFULSWHG1HXJHEDXHUHWDO
*LYHQWKHGLYHUVLW\RIWHUPVDQGUHIOHFWLQJWKHFKDUDFWHULVWLFVRIWKHLQWHUYHQWLRQ
SURJUDPH[DPLQHGZHGLVWLQJXLVKHGEHWZHHQWKUHHOHYHOVRISURJUDPFRPSRQHQWVFULSWHGQHVV VFULSWHGFRPSRQHQWVVRIWO\VFULSWHGFRPSRQHQWVDQGPLQLPDOO\VFULSWHGFRPSRQHQWV
7KHVWXG\ZDVSDUWRIDUDQGRPL]HGFRQWUROOHGZHHNWULDOWDUJHWLQJRUDOODQJXDJH OHDUQLQJLQ\RXQJODQJXDJHPLQRULW\OHDUQHUVLQWKHHDUO\HOHPHQWDU\VFKRRO\HDUV&KLOGUHQ ZKRUHFHLYHGWKHLQWHUYHQWLRQVKRZHGVWDWLVWLFDOVLJQLILFDQWLPSURYHPHQWVLQRUDOODQJXDJH VNLOOVFRPSDUHGWRFKLOGUHQZKRZHUHHQUROOHGLQWKHZDLWLQJOLVWFRQWUROJURXSZLWKDQ RYHUDOOHIIHFWVL]HRILPPHGLDWHO\IROORZLQJWKHLQWHUYHQWLRQ$XWKRUVHWDO7KH LQWHUYHQWLRQSURJUDPLQFOXGHGVFULSWHGFRPSRQHQWVYDULRXVW\SHVRIODEHOLQJZLWKGHWDLOHG JXLGHOLQHVIRULPSOHPHQWDWLRQPRUHVRIWO\VFULSWHGFRPSRQHQWVHJLQYLWDWLRQVWRGHILQHD ZRUGLQZD\VWKDWZHUHQRWSUHVFULEHGRUGHWDLOHGLQWKHJXLGHOLQHVWRWKHWHDFKHUVDQG PLQLPDOO\VFULSWHGFRPSRQHQWVHJWHDFKHULQYLWDWLRQVWRFKLOGUHQWRH[WHQGWKHKHUHDQG QRZUHIOHFWLQJVSHFLILFFKLOGUHQ¶VLQWHUHVWDQGH[SHULHQFH:HH[SHFWHGWKDWWHDFKHUVPD\
XVHPRUHRIWKHOHVVVFULSWHGFRPSRQHQWVDVWKH\JRWWRNQRZWKHVWXGHQWVLQDGGLWLRQWR
5XQQLQJKHDG7($&+(56¶,16758&7,21$/7$/.
VWXGHQWVGHYHORSLQJWKHLUVHFRQGODQJXDJHVNLOOVHYHQZLWKLQWKHVKRUWWLPHVSDQRIHLJKW ZHHNV,IWKLVLVWKHFDVHWKHGHVLJQRILQWHUYHQWLRQVWXGLHVVKRXOGWDNHLQWRFRQVLGHUDWLRQWKDW WHDFKHUWDONPD\GHYHORSGXULQJDQLQWHUYHQWLRQ:HH[DPLQHGKRZWKHFRPSRQHQWVRIWKH LQWHUYHQWLRQSURJUDPYDU\LQJLQGHJUHHVRIVFULSWHGQHVVDSSHDUHGLQWKHWHDFKHUV¶
LQWHUDFWLRQVZLWKVWXGHQWVDQGZKHWKHUZHFRXOGLGHQWLI\DGHYHORSPHQWLQWKHWHDFKHUV¶
XSWDNHRIWKHYDULRXVLQWHUYHQWLRQFRPSRQHQWV0RUHVSHFLILFDOO\ZHDVNHGWKHIROORZLQJWZR UHVHDUFKTXHVWLRQV
54:KDWFKDUDFWHUL]HGWHDFKHUV¶LQVWUXFWLRQDOWDONLQWKHHDUO\DQGODWHSDUWVRIWKH LQWHUYHQWLRQ"
54'LGWHDFKHUVPRGLI\WKHLULQVWUXFWLRQDOWDONGXULQJWKHLQWHUYHQWLRQ"
0HWKRGV 3DUWLFLSDQWV
7KHSDUWLFLSDQWVZHUHIHPDOHWHDFKHUVDQGIHPDOHVWXGHQWV$OO WHDFKHUVZRUNHGDVUHVRXUFHWHDFKHUVLQWKHFKLOGUHQ¶VVFKRROVEXWZHUHQRWWKHLUFODVVURRP WHDFKHUVDQGWKHUHIRUHGLGQRWNQRZWKHVWXGHQWVEHIRUHWKHLQWHUYHQWLRQVWXG\5HVRXUFH WHDFKHUVZHUHPDLQO\UHVSRQVLEOHIRUVHFRQGODQJXDJHVXSSRUWDQGDGDSWLYHHGXFDWLRQLQWKH VFKRROV,Q1RUZD\DIRXU\HDUFROOHJHRUXQLYHUVLW\GHJUHHLVUHTXLUHGWRTXDOLI\DVDWHDFKHU 7KHSDUWLFLSDWLQJWHDFKHUVZHUHH[SHULHQFHGZLWK\HDUV6' RIPHDQWHDFKLQJ H[SHULHQFHLQHOHPHQWDU\VFKRROV$WRWDORIWHDFKHUVSDUWLFLSDWHGLQWKHUDQGRPL]HG FRQWUROOHGVWXG\$XWKRUVHWDOEXWRQHWHDFKHUGLGQRWFRPSOHWHWKHUHTXHVWHGDXGLR UHFRUGLQJVRQZKLFKWKHSUHVHQWVWXG\ZDVEDVHGDQGWKXVZDVQRWLQFOXGHG
3DUWLFLSDWLQJVWXGHQWVZHUHDOOVHFRQGODQJXDJHOHDUQHUVUHFHLYLQJWKHLQWHUYHQWLRQ7R EHLQFOXGHGLQWKHVWXG\WKHFKLOGUHQVFRUHGLQWKHORZHUUDQJH6'EHORZWKHPHDQRU ORZHURQDVWDQGDUGL]HGODQJXDJHWHVWLQ1RUZHJLDQ1RUVN6RP/ ULQJVVSUnN1RUZHJLDQ DVD/DQJXDJHIRU/HDUQLQJ16/&ROOHDJXHV $XWKRU7KHVWXGHQWVKDGDPHDQDJH
5XQQLQJKHDG7($&+(56¶,16758&7,21$/7$/.
RIPRQWKV6' PRQWKV$OWKRXJKWKHFKLOGUHQVSRNHYDULRXVILUVWODQJXDJHV 8UGX$UDELF6RPDOL.XUGLVK7XUNLVKDQG7DPLODFFRXQWHGIRUIRUDPRUHGHWDLOHG GHVFULSWLRQRIWKHWRWDOVDPSOHVHH$XWKRUVHWDO7KHJURXSVKDGDPHDQRI VWXGHQWV6'
,QWHUYHQWLRQ
7KHPDLQSDUWRIWKHSURJUDPKDGFOHDUO\VFULSWHGJXLGHOLQHVIRULPSOHPHQWDWLRQWKH ODEHOLQJRIWKHYLVXDOPDWHULDOZKLOHRWKHUSURJUDPFRPSRQHQWVZHUHSUHVHQWHGDVH[DPSOHV RIODQJXDJHVXSSRUWLQJLQVWUXFWLRQDOWDONVRIWO\VFULSWHGDQGRWKHUVUHSUHVHQWHG
HQFRXUDJHPHQWWRH[WHQGWDONEH\RQGWKHKHUHDQGQRZPLQLPDOO\VFULSWHG7KHOHVVRQ GHVLJQDLPHGDWHQKDQFLQJRUDOODQJXDJHOHDUQLQJDQGDIIRUGLQJVWXGHQWVZLWKDEDVHOLQHRI ZRUGVIRUDFFHVVLQJWKHFXUULFXOXP$VDOOVWXGHQWVKDGORZOHYHOVRIVHFRQGODQJXDJH SURILFLHQF\ZRUGVWKDWZHUHFUXFLDOIRUFRPSUHKHQGLQJDQGOHDUQLQJFXUULFXODUWRSLFVDFURVV VXEMHFWVZHUHFKRVHQLHDFTXLUHHYHU\GD\FRQWHQWZRUGVDOUHDG\NQRZQE\WKHLU
PRQROLQJXDOSHHUV([SOLFLWH[SODQDWLRQVRIZRUGPHDQLQJVXSSOHPHQWHGZLWKYLVXDO PDWHULDOWDUJHWLQJVHPDQWLFFDWHJRULHVVXFKDV³KRPH´RU³KRVSLWDO´DQGZRUGVXVHIXOIRU WDONLQJDERXWWKHPVXFKDVIRU³KRPH´DSDUWPHQWHOHYDWRUDQGKDOODQGIRU³KRVSLWDO´
ZRXQGSDWLHQWDQGDPEXODQFHZHUHWKHPDLQFRQWHQWLQHDFKOHVVRQ7KLVXVDJHRIVHPDQWLF FDWHJRULHVDOLJQVZLWKVWXGLHVGRFXPHQWLQJWKHHIILFDF\RIWHDFKLQJZRUGNQRZOHGJHWKURXJK FRQFHSWXDOFDWHJRULHVVXFKDVLQWHUYHQWLRQVWDUJHWLQJWD[RQRPLFXVDJHVRUWLQJZRUGVLQ KLHUDUFKLFDORUGHU1HXPDQ1HZPDQ 'Z\HUDQGWKRVHH[DPLQLQJWKHHIIHFWVRI WD[RQRPLFDQGWKHPDWLFJURXSV+DGOH\'LFNLQVRQ+LUVK3DVHN *ROLQNRII
3LQNKDP.DHIHU 1HXPDQ&KLOGUHQUHFHLYHGPLQOHVVRQVRYHUFRQVHFXWLYH ZHHNV
7KHSURIHVVLRQDOGHYHORSPHQWWKHWHDFKHUVUHFHLYHGFRPSULVHGDRQHGD\ZRUNVKRS KLQZKLFKWKHUDWLRQDOHDQGWKHDLPIRUWKHLQWHUYHQWLRQZDVSUHVHQWHG7KHLQWURGXFWLRQRI
5XQQLQJKHDG7($&+(56¶,16758&7,21$/7$/.
WKHSURJUDP¶VFRPSRQHQWVZDVFRPELQHGZLWKSUDFWLFHLQVPDOOJURXSVVXSHUYLVHGE\VFKRRO SV\FKRORJLVWV,QWKHODWWHUDFWLYLWLHVWKDWZHUHSDUWRIWKHVFULSWHGFRPSRQHQWVRIWKH
LQWHUYHQWLRQZHUHILUVWGHPRQVWUDWHGIROORZHGE\WKHWHDFKHUVSUDFWLFLQJWKHVNLOOVZLWK VXSHUYLVLRQ7KHVHDFWLYLWLHVZHUHWKHQGLVFXVVHGLQSOHQDU\WRFODULI\DQGSURYLGHIXUWKHU H[DPSOHVLIQHHGHG7HDFKHUVZHUHHQFRXUDJHGWRGUDZVWXGHQWV¶DWWHQWLRQWRZRUGUHODWLRQV DQGGHILQLWLRQVLQDOHVVSUHVFULEHGIRUPWKHVRIWO\VFULSWHGFRPSRQHQWVRIWKHSURJUDPDV ZHOODVWRLQYLWHFKLOGUHQWRWHOODERXWHYHQWVLQDQGRXWVLGHWKHFODVVURRPWKHPLQLPDOO\
VFULSWHGFRPSRQHQWV)LQDOO\WHDFKHUVZHUHWROGWRDGDSWWKHLULQVWUXFWLRQDOWDONEDVHGRQ VWXGHQWV¶SURJUHVVWKURXJKRXWWKHLQWHUYHQWLRQDQGYDULRXVH[DPSOHVZHUHLOOXVWUDWHGDQG GLVFXVVHGLHKRZWRH[WHQGWKHLUODQJXDJHXVHDQGOHYHORIDEVWUDFWLRQ6XSSRUWEH\RQG WKLVZRUNVKRSZDVSURYLGHGE\WHOHSKRQHRUHPDLO
3URFHGXUHV
'DWDFROOHFWLRQ7HDFKHUVDXGLRWDSHGWKHLULQVWUXFWLRQDQGLQWHUDFWLRQZLWKVWXGHQWV GXULQJWKUHHOHVVRQVLQWKHVHFRQGWLPHSRLQWWDQGVHYHQWKZHHNVRIWKHLQWHUYHQWLRQ WLPHSRLQWW:HVHOHFWHGIRUWUDQVFULSWLRQDQGDQDO\VLVWKHILUVWRXWRIWKHWKUHHOHVVRQV LQHDFKUHVSHFWLYHFDWHJRU\DVWKLVZDVWKHOHVVRQZKHQWHDFKHUVLQWURGXFHGIRUWKHILUVWWLPH WKHQHZVHPDQWLFFDWHJRU\WREHZRUNHGZLWK³KRPH´LQZHHNDQG³KRVSLWDO´LQZHHN 7KHDSSUR[LPDWHILUVWPLQRIHDFKOHVVRQZHUHVHOHFWHGIRUWUDQVFULSWLRQW0 PLQ6' W0 PLQ6' 7KLVPDLQSDUWRIHDFKOHVVRQFRQVLVWHGRIWKH VDPHIUDPHZRUNLQZKLFKWKHWDUJHWHGFDWHJRU\DQGLWVUHODWHGZRUGVZHUHLQWURGXFHGIRUWKH ILUVWWLPHWKURXJKODEHOLQJVFULSWHGDFFRPSDQLHGE\FRQYHUVDWLRQVH[WHQGLQJWKHKHUHDQG QRZFKLOGUHQ¶VLQWHUHVWDQGH[SHULHQFHPLQLPDOO\VFULSWHGLQDGGLWLRQWRWDONDERXWZRUG UHODWLRQVDQGGHILQLWLRQVVRIWO\VFULSWHG
7KHDXGLRUHFRUGLQJVZHUHWUDQVFULEHGIROORZLQJWKHIRUPDWRI&RGHVIRUWKH+XPDQ
$QDO\VLVRI7UDQVFULSWV&+$7IURPWKH&KLOG/DQJXDJH'DWD([FKDQJH6\VWHP&+,/'(6
5XQQLQJKHDG7($&+(56¶,16758&7,21$/7$/.
0DF:KLQQH\8WWHUDQFHVZHUHLGHQWLILHGE\LQWRQDWLRQSDXVHVDQGFRQYHUVDWLRQDO WXUQVWKDWLQGLFDWHGDEUHDNLQWKHIORZRIVSHHFK7UDQVFULSWLRQVZHUHOLPLWHGWRXWWHUDQFHVLQ 1RUZHJLDQ:HZHUHQRWDEOHWRLGHQWLI\ZLWKVXIILFLHQWUHOLDELOLW\LQGLYLGXDOVWXGHQW
XWWHUDQFHVLQWKHDXGLRUHFRUGLQJVDQGWKHUHIRUHWKHWUDQVFULSWVGLGQRWGLVWLQJXLVKEHWZHHQ LQGLYLGXDOVWXGHQWVSHDNHUV
&RGLQJVFKHPHGHYHORSPHQWDQGPHDVXUHV7KHDSSOLHGFRGLQJVFKHPHEXLOGVRQ UHFHQWVWXGLHVLQZKLFKIHDWXUHVRIWHDFKHUV¶LQVWUXFWLRQDOWDONZHUHH[DPLQHG:HVRXJKWWR LQFRUSRUDWHWDONFDWHJRULHVWKDWFDSWXUHGDFRQWLQXXPRIODQJXDJHVNLOOVUDQJLQJIURPEDVLF ZRUGOHYHOVNLOOVDWRQHHQGWRH[WHQGHGGLVFRXUVHLQWKHRWKHUGHVFULELQJWKHYDULHW\RI OLQJXLVWLFLQSXWVWXGHQWVPD\EHH[SRVHGWRLQFODVVURRPV
7DONFDWHJRULHVGHYHORSHGWRLGHQWLI\KRZLQWHUYHQWLRQFRPSRQHQWVYDU\LQJLQ VFULSWHGQHVVDSSHDUHGLQWKHFODVVURRP
Talk categories aligned with scripted components of the intervention.7RLGHQWLI\
LQVWUXFWLRQDOWDONWKDWUHIOHFWHGWKHVFULSWHGSDUWVRIWKHLQWHUYHQWLRQZHGHYHORSHGWZR FDWHJRULHVWKDWZHUHGHULYHGDQGDGDSWHGIURP%RZQHHWDO¶VFRQFHSWXDOLQIRUPDWLRQ FDWHJRU\FRQFUHWHLQIRUPDWLRQDERXWZRUGVVLPSOHODEHOLQJDQGHODERUDWHGODEHOLQJ
6LPSOHODEHOLQJ7KLVFDWHJRU\ZDVXVHGIRUODEHOLQJSLFWXUHVHLWKHULVRODWHGE\EDVLF QDPLQJRIWKHWDUJHWHGZRUGV\NHSOHLHU³QXUVH´RUWKURXJKEDVLFVHQWHQFHVGHWWHHUHQ V\NHSOHLHU³WKLVLVDQXUVH´
(ODERUDWHGODEHOLQJ7KLVFDWHJRU\LQFOXGHGLQIRUPDWLRQDERXWWKHPHDQLQJRIDZRUG DVSURYLGHGE\GHVFULELQJLOOXVWUDWLRQVDFWLQJRXWWKHZRUGIDFWVH[DPSOHVDQGLQIRUPDWLRQ RIZKDWZDVQRWFKDUDFWHULVWLFRIWKHWDUJHWHGZRUGHJGHWWHHUQRHEDUQHUUHGGIRU
VSU¡\WH³WKLVLVVRPHWKLQJFKLOGUHQDUHDIUDLGRIDV\ULQJH´
5XQQLQJKHDG7($&+(56¶,16758&7,21$/7$/.
$FRGHZDVJLYHQIRUHDFKXWWHUDQFHWKDWRIIHUHGHLWKHUVLPSOHRUHODERUDWHGODEHOLQJ 7KHFRGLQJDOVRDSSOLHGWRXWWHUDQFHVWKDWUHSHDWHGUHLQIRUFHGRUUHIRUPXODWHGDSUHYLRXV XWWHUDQFHFRGHGDVODEHOLQJ
Talk categories aligned with the softly scripted components of the intervention.7R DGGUHVVLQVWUXFWLRQDOWDONUHIOHFWLQJWKHVRIWO\VFULSWHGSDUWVRIWKHLQWHUYHQWLRQZHGHYHORSHG WZRFDWHJRULHVEXLOGLQJRQGHILQLWLRQDQGZRUGUHODWLRQFDWHJRULHVIURPVWXGLHVE\%RZQHHW DOZKRGLVWLQJXLVKHGEHWZHHQGHILQLWLRQVDQGH[DPSOHVRIZRUGXVDJHDQG
1HXJHEDXHUHWDOZKRDOVRH[DPLQHGGHILQLWLRQVDQGZRUGUHODWLRQV7KHVHFDWHJRULHV FRQFHSWXDOGHILQLWLRQVDQGXVDJHEDVHGH[DPSOHVRIGHILQLWLRQVGLIIHUHGIURPWKHODEHOLQJ FDWHJRULHVSUHYLRXVO\GHVFULEHGLQWKHFRPSOHWHQHVVRILQIRUPDWLRQSURYLGHGLQWKHWHDFKHU JXLGHOLQHV
&RQFHSWXDOGHILQLWLRQV7KLVFDWHJRU\HQFRPSDVVHGLQIRUPDWLRQDERXWZRUGPHDQLQJ SURYLGHGWKURXJKGHYHORSPHQWDOO\UHOHYDQWGHILQLWLRQVVXFKDVV\NHSOHLHUGHWHUKXQVRP SDVVHUSnGHV\NHJLUGHPPDWRJPHGLVLQHU³DQXUVHLVVRPHRQHZKRWDNHVFDUHRISHRSOH WKDWDUHVLFNJLYHVWKHPIRRGDQGPHGLFLQH´7HDFKHUVZHUHQRWRIIHUHGSUHVFULEHG
JXLGHOLQHVIRUFRQFHSWXDOGHILQLWLRQVDQGWKHUHIRUHSURYLGHGVWXGHQWVZLWKWKHWHDFKHUV¶RZQ DGDSWHGYHUVLRQV:KHQWHDFKHUVVSRQWDQHRXVO\RIIHUHGV\QRQ\PVIRUWDUJHWHGZRUGVWKH\
ZHUHDOVRLQFOXGHGLQWKHFRQFHSWXDOGHILQLWLRQVFDWHJRU\VXFKDVLQWKHIROORZLQJGHILQLWLRQ RIDGRFWRUHQOHJHHUGHWVDPPHVRPHQGRNWRU³DGRFWRULVWKHVDPHDVDSK\VLFLDQ´
8VDJHEDVHGH[DPSOHVRIGHILQLWLRQV:HDSSOLHGWKLVFDWHJRU\WRLGHQWLI\FRQWH[W UHODWHGGHPRQVWUDWLRQVRIZRUGXVHVXFKDVLQWKHIROORZLQJH[DPSOHVQnUPDQUHLVHUWLOQRHQ ODQGVnPnPDQWDHQUHLVHYDNVLQHVSU¡\WH³VRPHWLPHVZKHQ\RXWUDYHOWRDQRWKHUFRXQWU\
\RXQHHGWRJHWDYDFFLQH´RUPDQWDURJVnU¡QWJHQELOGHDYWHQQHQHKRVWDQQOHJHQ³ZHFDQ DOVRWDNHDQ[UD\RIWKHWHHWKDWWKHGHQWLVW´7KLVFDWHJRU\ZDVGLVWLQJXLVKHGIURPWKH IRUPHUFDWHJRU\E\OHVVIRUPDOGHVFULSWLRQVWRH[HPSOLI\ZRUGXVDJH
5XQQLQJKHDG7($&+(56¶,16758&7,21$/7$/.
,QDVLPLODUYHLQDVIRUWKHWDONFDWHJRULHVDOLJQHGZLWKWKHVFULSWHGFRPSRQHQWVRIWKH LQWHUYHQWLRQHDFKXWWHUDQFHLGHQWLILHGDVHLWKHUDFRQFHSWXDORUXVDJHEDVHGH[DPSOHRI GHILQLWLRQVZDVFRXQWHG7KLVDOVRDSSOLHGWRXWWHUDQFHVWKDWUHSHDWHGUHLQIRUFHGRU UHIRUPXODWHGDQXWWHUDQFHLGHQWLILHGDVDGHILQLWLRQ
Talk category aligned with the minimally scripted components of the intervention.
7RLGHQWLI\WDONWKDWUHIOHFWHGWKHPLQLPDOO\VFULSWHGFRPSRQHQWVRIWKHLQWHUYHQWLRQDQGWKDW LQYLWHGVWXGHQWFRQWULEXWLRQVH[WHQGLQJWKHKHUHDQGQRZZHGHYHORSHGWKHWDONFDWHJRU\
H[WHQGHGGLVFRXUVHZKLFKLQFOXGHGVHTXHQFHVRIWDONWKDWZHUHH[SODQDWLRQVQDUUDWLYHVRUD FRPELQDWLRQ7KLVFDWHJRU\EXLOWRQWKHGHILQLWLRQRIH[WHQGHGGLVFRXUVHSURYLGHGE\6QRZ 7DERUVDQG'LFNLQVRQ³WDONWKDWUHTXLUHVSDUWLFLSDQWVWRGHYHORSXQGHUVWDQGLQJV EH\RQGWKHKHUHDQGQRZDQGWKDWUHTXLUHVWKHXVHRIVHYHUDOXWWHUDQFHVRUWXUQVWREXLOGD OLQJXLVWLFVWUXFWXUHVXFKDVLQH[SODQDWLRQVQDUUDWLYHVRUSUHWHQG´S8VXDOO\WKLVW\SHRI WDONHPHUJHGIURPWKHWDUJHWHGZRUGVHJDWHDFKHUDVNLQJDIROORZXSTXHVWLRQ³+DV DQ\ERG\EHHQWRDKRVSLWDO"¶RU³:KDWGRHVYDFFLQHPHDQ":KDWGRZHXVHLWIRU"´EXW FRXOGDOVREHLQWURGXFHGE\DFKLOGZKRFRQWULEXWHGDUHODWHGVWRU\RULQWURGXFHGDZRUG DVVRFLDWHGZLWKWKHFDWHJRU\:HPDUNHGLQWKHWUDQVFULSWVZKHUHDVHTXHQFHRIH[WHQGHG GLVFRXUVHVWDUWHGDQGHQGHGDQGFRXQWHGWKHQXPEHURIXWWHUDQFHVZLWKLQWKHVHTXHQFH*LYHQ WKHVHFRQGODQJXDJHVNLOOVRIWKHSDUWLFLSDWLQJVWXGHQWVZHLQFOXGHGDOOXWWHUDQFHVDSSHDULQJ ZLWKLQWKHVHJPHQWDQGXWWHUDQFHVWKDWZHUHVLPSOHFRQILUPDWLRQVHJXWWHUDQFHVDQG QHJDWLRQVDQGUHSHWLWLRQVRIWKHSUHYLRXVXWWHUDQFHHJXWWHUDQFH7KHIROORZLQJH[DPSOH LVDQH[FHUSWIURPDVHTXHQFHLGHQWLILHGDVH[WHQGHGGLVFRXUVHDQGZDVLQWURGXFHGE\WKH WHDFKHUDVNLQJZKHWKHUHYHU\ERG\KDGDKRPH7KHFKLOGUHQIROORZHGXSRQKHUTXHVWLRQE\
FRQILUPLQJDQGGLVDJUHHLQJ7KHWHDFKHUWKHQVWDWHGWKDWPRVWSHRSOHKDYHDKRPH ([DPSOH
([WHQGHG'LVFRXUVH(PHUJLQJIURPWKH&DWHJRU\+RPH
5XQQLQJKHDG7($&+(56¶,16758&7,21$/7$/.
7($ 'HIOHVWHKDUGHW
0RVWSHRSOHKDYHDKRPHSDXVH 7($ 0HQGHWHUNDQVNMHQRHQVRPLNNHKDUGHW
%XWPD\EHWKHUHLVVRPHRQHZKRGRHVQRWKDYHRQH 7($ 9LVNDOVQDNNHRPKMHPRPWLQJVRPYLKDUKMHPPH
:H¶UHJRLQJWRWDONDERXWKRPHDERXWWKLQJVZHKDYHLQDKRPH 7($ 1RHQERULOLVPnKXVRJQRHQERULK¡\HKXV
6RPHOLYHLQVPDOOKRXVHVRWKHUVOLYHLQDSDUWPHQWEXLOGLQJV &KLOG -HJERULK¡\KXV
,OLYHLQDQDSDUWPHQWEXLOGLQJ 7($ -D
<HV
7($ 2JKYRUERU
$QGZKHUHGRHV &+, -HJERURJVnLK¡\HKXV
,OLYHLQDQDSDUWPHQWEXLOGLQJWRR &+, -HJRJVn
0HWRR
7($ 0PRJQRHQERULHWHJHWKXV
PPDQGVRPHOLYHLQWKHLURZQKRXVH
7RNHQVDQGW\SHVRIWDON6WXGLHVXVLQJWRNHQVDQGW\SHVDVLQGLFDWRUVRIWDON TXDQWLW\DQGWDONGLYHUVLW\UHVSHFWLYHO\KDYHW\SLFDOO\UHSRUWHGRQODUJHYDULDWLRQVIURPRQH FODVVURRPWRDQRWKHUUHJDUGLQJWHDFKHUDQGVWXGHQWFRQWULEXWLRQV$XWKRU&ROOHDJXHV $XWKRU7KXVZHGHFLGHGWRXVHWRNHQVDQGW\SHVDVDFRQWUROPHDVXUHRIWDON TXDQWLW\DQGGLYHUVLW\ZKHQH[DPLQLQJGHJUHHVRIVFULSWHGLQVWUXFWLRQV
Tokens.7DONTXDQWLW\ZDVPHDVXUHGE\WKHQXPEHURIWRNHQVWKHVKHHUQXPEHURI ZRUGVXVLQJWKH)5(4RSWLRQLQ&RPSXWHUL]HG&KLOG/DQJXDJH$QDO\VLV&/$1
0DF:KLQQH\
Types.6LPLODUO\WDONGLYHUVLW\ZDVPHDVXUHGE\FDOFXODWLQJWKHQXPEHURIGLIIHUHQW ZRUGVW\SHVLQHDFKWUDQVFULSW7RGHYHORSDWDONLQGH[WKDWGLIIHUHGIURPWKHWRNHQVLQGH[
ZHFUHDWHGDOLVWRIH[FOXVLRQZRUGVDJDLQVWZKLFKDOOWUDQVFULSWVZHUHVFUHHQHG7KHOLVW FRPSULVHGQXPEHUVYRFDOJHVWXUHV³PP´³RL´SHUVRQDOQDPHVDQGWKHPRVWFRPPRQ ZRUGVDFFRUGLQJWRD1RUZHJLDQZRUGIUHTXHQF\OLVW$OOPRUSKRORJLFDOYDULDQWVRIDZRUG ZHUHFRXQWHGDVRQHZRUGW\SHHJMHQWHMHQWHU³JLUO´DQG³JLUOV´+RZHYHUZKHQZRUGV ZHUHGHULYHGIURPWKHVDPHZRUGURRWEXWGLIIHUHGVHPDQWLFDOO\WKH\ZHUHERWKLQFOXGHG
5XQQLQJKHDG7($&+(56¶,16758&7,21$/7$/.
HJP¡UNP¡UNHW³GDUN´DQG³GDUNQHVV´$OOWUDQVFULSWVZHUHH[DPLQHGYLVXDOO\WRFKHFN IRUPLVVSHOOLQJVWKDWPLJKWKDYHRFFXUUHGGXULQJWUDQVFULSWLRQ$VWKHWUDQVFULEHGUHFRUGLQJV YDULHGVRPHZKDWLQGXUDWLRQZHGHYHORSHGDGHQVLW\PHDVXUHIRUWKHWRNHQVQXPEHURI WRNHQVSHUPLQXWHDQGWKHW\SHVQXPEHURIW\SHVSHUPLQXWH
5HOLDELOLW\7KHILUVWDXWKRUDQGDUHVHDUFKDVVLVWDQWLQGHSHQGHQWO\GRXEOHFRGHGRQH WUDQVFULSWDQGGLVFXVVHGWKHDSSOLFDELOLW\RIWKHFRGHV:KHQWKHWZRFRGHUVGLVDJUHHGWKH ILQDOFRGLQJFULWHULDZHUHDUULYHGDWWKURXJKGLVFXVVLRQEHWZHHQWKHP7KHILUVWDXWKRUDQGWKH UHVHDUFKDVVLVWDQWWKHQDVVHVVHGWKHUHOLDELOLW\RIWKHFRGLQJVFKHPHEDVHGRQRIWKH UHFRUGLQJVVL[UHFRUGLQJVLQWRWDOSUHDQGSRVWUHFRUGLQJV,QWHUUDWHUUHOLDELOLW\ZDV
FRPSXWHGXVLQJ&RKHQ¶VNDSSDDQGKDGDPHDQDYHUDJHRIUDQJLQJEHWZHHQDQG ZKLFKLQGLFDWHGVXEVWDQWLDODJUHHPHQW/DQGLV .RFK
$QDO\WLFDO$SSURDFK
,GHQWLI\LQJFKDUDFWHULVWLFVRIWHDFKHUV¶LQVWUXFWLRQDOWDONDQGSRVVLEOHPRGLILFDWLRQVRI WHDFKHUWDONWKURXJKRXWWKHLQWHUYHQWLRQZHUHWKHDLPVRIWKLVVWXG\7RUHVSRQGWR54ZH H[DPLQHGWKHIUHTXHQF\RIWDONFDWHJRULHVLQWKHWHDFKHUV¶LQVWUXFWLRQDOWDONLQWKHHDUO\DQG ODWHSDUWVRIWKHLQWHUYHQWLRQ7RUHVSRQGWR54ZHXVHGSDLUHGVDPSOHWWHVWVWRHVWLPDWH DQGFRPSDUHPRGLILFDWLRQVLQLQVWUXFWLRQDOWDONDWWKHWZRWLPHSRLQWV$OWKRXJKWKHUHVHDUFK TXHVWLRQVDGGUHVVHGWHDFKHUVWKHVWXGHQWJURXSV¶WDONGHYHORSHGGXULQJWKHLQWHUYHQWLRQDQG ZHLQFOXGHGH[DPLQDWLRQRIFKDQJHVLQVWXGHQWJURXSV¶WDONDVDFKHFN$GGLWLRQDOO\
PHDVXUHVRIWRNHQVDQGW\SHVRIWDONIRUWHDFKHUVDQGWKHVWXGHQWJURXSVZHUHLQFOXGHGDV FKHFNSRLQWVZKHQZHH[DPLQHGWKHVFULSWHGDQGOHVVVFULSWHGWDONFDWHJRULHV7KHVHGHFLVLRQV DOORZHGXVWRFRPSUHKHQGWHDFKHUV¶GLVFRXUVHXWWHUDQFHVPRUHIXOO\$VOHVVRQGXUDWLRQ YDULHGDFURVVJURXSVPHDVXUHVRIWDONH[SRVXUHZHUHFDOFXODWHGSHUPLQXWHDQGQR VWDWLVWLFDOO\VLJQLILFDQWGLIIHUHQFHZDVIRXQGEHWZHHQWKHWZRWLPHSRLQWVW S
5XQQLQJKHDG7($&+(56¶,16758&7,21$/7$/.
&RPSOHWHVHWVRIGDWDRQWKHILYHFDWHJRULHVRIWHDFKHUVLQVWUXFWLRQDOWDONPHDVXUHVRI OLQJXLVWLFLQSXWZHUHUHWULHYHGIRUDOOWHDFKHUV
5HVXOWV
7RUHVSRQGWRWKHILUVWUHVHDUFKTXHVWLRQZHSUHVHQWGHVFULSWLYHVWDWLVWLFVRQWKH RFFXUUHQFHRIVLPSOHODEHOLQJHODERUDWHGODEHOLQJFRQFHSWXDOGHILQLWLRQVXVDJHEDVHG H[DPSOHVRIGHILQLWLRQVDQGH[WHQGHGGLVFRXUVHSURGXFHGE\WHDFKHUVVHH7DEOH7KHUH ZDVVXEVWDQWLDOYDULDELOLW\DPRQJWKHWHDFKHUVDFURVVDOOPHDVXUHVDWERWKWLPHSRLQWV$V GLVSOD\HGLQ7DEOHSUHGRPLQDQWWDONFDWHJRULHVLQWKHEHJLQQLQJRIWKHLQWHUYHQWLRQZHUH VLPSOHDQGHODERUDWHGODEHOLQJERWKDOLJQHGZLWKWKHVFULSWHGFRPSRQHQWVRIWKHLQWHUYHQWLRQ 7DONFDWHJRULHVDOLJQHGZLWKVRIWO\VFULSWHGFRPSRQHQWVGHILQLWLRQVDQGXVDJHEDVHG
H[DPSOHVRIGHILQLWLRQVDQGPLQLPDOO\VFULSWHGFRPSRQHQWVH[WHQGHGGLVFRXUVHDSSHDUHG PXFKOHVVIUHTXHQWO\,QFRPSDULVRQWKHOHVVVFULSWHGFRPSRQHQWVZHUHRIWHQXVHGE\WKHHQG RIWKHLQWHUYHQWLRQW
>7DEOHDSSUR[LPDWHO\KHUH@
7KHVHFRQGUHVHDUFKTXHVWLRQVRXJKWWRLGHQWLI\ZKHWKHUFKDQJHVLQWKHDSSHDUDQFHRI WHDFKHUV¶LQVWUXFWLRQDOWDONKDGRFFXUUHGEHWZHHQWKHWZRWLPHSRLQWV7RDVVHVVWKHVHDVSHFWV SDLUHGWWHVWVZHUHFRQGXFWHG6WDWLVWLFDOO\VLJQLILFDQWLQFUHDVHVZHUHIRXQGIRUFRQFHSWXDO GHILQLWLRQVW ±S XVDJHEDVHGH[DPSOHVRIGHILQLWLRQVW ±S DQGH[WHQGHGGLVFRXUVHW ±S +RZHYHUQHLWKHUVLPSOHODEHOLQJ W S RUHODERUDWHGODEHOLQJW S FKDQJHGVWDWLVWLFDOO\
VLJQLILFDQWO\DOWKRXJKWKHODWWHUDSSURDFKHGDVWDWLVWLFDOO\VLJQLILFDQWGHFUHDVH6LPSOH ODEHOLQJDQGHODERUDWHGODEHOLQJZHUHERWKWDONFDWHJRULHVDOLJQHGZLWKWKHVFULSWHG
5XQQLQJKHDG7($&+(56¶,16758&7,21$/7$/.
FRPSRQHQWVRIWKHLQWHUYHQWLRQZKLOHWKHWDONFDWHJRULHVGHPRQVWUDWLQJVWDWLVWLFDOO\
VLJQLILFDQWLQFUHDVHVZHUHDOLJQHGZLWKWKHVRIWO\VFULSWHGDQGPLQLPDOO\VFULSWHGFRPSRQHQWV
$VVWXGHQWV¶ODQJXDJHVNLOOVGHYHORSHGGXULQJWKHLQWHUYHQWLRQ$XWKRUVHWDO ZHDOVRH[DPLQHGKRZWKHVHWDONFDWHJRULHVDSSHDUHGLQVWXGHQWV¶WDONWRFKHFNZKHWKHU PRGLILFDWLRQVLQWHDFKHUWDONUHIOHFWVFKDQJHVLQVWXGHQWWDON6LPLODUIUHTXHQF\SDWWHUQVRI WDONFDWHJRULHVZHUHIRXQGLQWKHVWXGHQWVJURXSVDWWDQGWVHH7DEOH0RUHRYHU
VWDWLVWLFDOO\VLJQLILFDQWSRVLWLYHFRUUHODWLRQVZHUHIRXQGDWERWKWLPHSRLQWVEHWZHHQWHDFKHUV¶
DQGVWXGHQWJURXSV¶XVHRIODEHOLQJWU S WU S DQGH[WHQGHG GLVFRXUVHWU S WU S :HIRXQGSRVLWLYHVWDWLVWLFDOO\
VLJQLILFDQWFRUUHODWLRQVDWWEXWQRWDWWEHWZHHQWHDFKHUV¶DQGVWXGHQWJURXSV¶XVHRI FRQFHSWXDOGHILQLWLRQVWU ±S WU S DQGXVDJHEDVHGH[DPSOHV RIGHILQLWLRQVWU S WU S (ODERUDWHGODEHOLQJZDVSRVLWLYHO\
VWDWLVWLFDOO\VLJQLILFDQWO\FRUUHODWHGRQO\DWWWU S WU ±S )XUWKHUPRUHH[DPLQDWLRQVRIFKDQJHVLQFKLOGUHQ¶VWDONXVLQJSDLUHGVDPSOHGWWHVWVUHYHDOHG VWDWLVWLFDOO\VLJQLILFDQWLQFUHDVHVLQFRQFHSWXDOGHILQLWLRQVW ±S XVDJH EDVHGH[DPSOHVRIGHILQLWLRQVW ±S DQGH[WHQGHGGLVFRXUVHW ± S LQWKHVWXGHQWJURXSVLQDGGLWLRQWRHODERUDWHGODEHOLQJW ±S ,QFRQWUDVWWKHXVHRIVLPSOHODEHOLQJW S GHPRQVWUDWHGD PDUJLQDOO\VWDWLVWLFDOO\VLJQLILFDQWGHFUHDVH
>7DEOHDSSUR[LPDWHO\KHUH@
)LQDOO\ZHXVHGWKHWRNHQGHQVLW\DQGW\SHVGHQVLW\E\WKHWHDFKHUVDQGWKHVWXGHQW JURXSVDVDFKHFNZKHQH[DPLQLQJDQGLQWHUSUHWLQJWKHSUHYDOHQFHDQGPRGLILFDWLRQVRIWKH VFULSWHGDOLJQHGWDONFDWHJRULHV7HDFKHUVSURGXFHGRQDYHUDJHWRNHQVSHUPLQXWH6'
5XQQLQJKHDG7($&+(56¶,16758&7,21$/7$/.
WRNHQVDQGW\SHVSHUPLQXWH6' W\SHVDWW%\WKHHQGRIWKH
LQWHUYHQWLRQWKHPHDQQXPEHURIWRNHQVSHUPLQXWHZDV6' DQGW\SHV SHUPLQXWH6' 6WXGHQWVDVDJURXSSURGXFHGRQDYHUDJHWRNHQVSHUPLQXWH 6' WRNHQVDQGW\SHVSHUPLQXWH6' W\SHVDWEDVHOLQH%\WKHVHYHQWK ZHHNWKHVWXGHQWVSURGXFHGRQDYHUDJHWRNHQVSHUPLQXWH6' DQG W\SHVSHUPLQXWH6' )XUWKHUPRUHWHDFKHUVSURYLGHGWKHVDPHQXPEHURIWRNHQVDW ERWKWLPHSRLQWVW S ZKLOHWKHGLYHUVLW\RIZRUGVXVHGZDVVWDWLVWLFDOO\
VLJQLILFDQWO\KLJKHUDWWW ±S ,QFRPSDULVRQVWXGHQWVDVDJURXS GHPRQVWUDWHGKLJKHUGHQVLW\RIGLIIHUHQWZRUGW\SHVW ±S DQGWDONHG PRUHKLJKHUWRNHQGHQVLW\E\WKHHQGRIWKHLQWHUYHQWLRQW ±S 7KXV WHDFKHUVDOORZHGWKHPVHOYHVWREHOHVVVFULSWHGDVVWXGHQWVDVDJURXSGHYHORSHGLQWRPRUH WDONDWLYHLQWHUDFWLRQSDUWQHUV
'LVFXVVLRQ
7KLVVWXG\H[SORUHGSDWWHUQVRIWHDFKHUV¶LQVWUXFWLRQDOWDONDQGZKHWKHUPRGLILFDWLRQV RIWDONRFFXUUHGLQUHODWLRQWRGHJUHHVRIVFULSWLQJZKHQSDUWLFLSDWLQJLQDQRUDOODQJXDJH LQWHUYHQWLRQIRU\RXQJODQJXDJHPLQRULW\OHDUQHUVLQWKHHDUO\HOHPHQWDU\\HDUV,QUHVSRQVH WR54ZHIRXQGKLJKXVDJHRIODEHOLQJLQWHDFKHUV¶LQVWUXFWLRQDOWDONLQWKHEHJLQQLQJRIWKH LQWHUYHQWLRQZKLOHWKLVIHDWXUHZDVOHVVSURPLQHQWDWWZLWKGHILQLWLRQVDQGH[WHQGHG
GLVFRXUVHHPHUJLQJ,QUHVSRQVHWR54ZHGHPRQVWUDWHGWKDWWHDFKHUVPRGLILHGWKHLU OLQJXLVWLFLQSXWGXULQJWKHLQWHUYHQWLRQSHULRGDVVWDWLVWLFDOO\VLJQLILFDQWFKDQJHVLQ LQVWUXFWLRQDOWDONZHUHIRXQGLQVRIWO\VFULSWHGDQGPLQLPDOO\VFULSWHGLQVWUXFWLRQDOWDON GHILQLWLRQVXVDJHEDVHGH[DPSOHVRIGHILQLWLRQVDQGH[WHQGHGGLVFRXUVH6FULSWHG LQVWUXFWLRQDOWDONODEHOLQJVKRZHGVWDELOLW\WKURXJKRXWWKHLQWHUYHQWLRQ7KHVHUHVXOWVDUH LPSRUWDQWDVVRPHWHDFKHUVWHQGWRVLPSOLI\WKHLUVSHHFKZLWKVHFRQGODQJXDJHOHDUQHUV
5XQQLQJKHDG7($&+(56¶,16758&7,21$/7$/.
ZKLFKGRHVQRWSURYLGHFKLOGUHQZLWKODQJXDJHULFKHQYLURQPHQWVQHHGHGIRUOHDUQLQJ$DUWV 'HPLU9HJWHU.XUYHUV +HQULFKV
'LFNLQVRQGRFXPHQWHGKRZGLIILFXOWLWLVWRFKDQJHWHDFKHUV¶SUDFWLFHVDQG 6PRONRZVNLDQG*XQQUHSRUWHGLQDVLPLODUYHLQRQKLJKVWDELOLW\LQLQVWUXFWLRQRYHU WLPH:HDUJXHWKDWWKHGLVWLQFWLRQEHWZHHQVFULSWHGDQGOHVVVFULSWHGFRPSRQHQWVLQ
LQWHUYHQWLRQVLVLPSRUWDQWWRDGGUHVVDVLWFDQSURYLGHLQVLJKWVLQWRWKHPHFKDQLVPV
XQGHUO\LQJFKDQJH0RUHRYHUGLIIHUHQWOHYHOVRIVFULSWLQJRIIHUWHDFKHUVYDULRXVGLUHFWLRQVIRU HQULFKLQJWKHOLQJXLVWLFLQSXWLQWHDFKHU±VWXGHQWH[FKDQJHVZKLFKFDQVXSSRUWVWXGHQWV¶
ODQJXDJHOHDUQLQJ,QWHUYHQWLRQVWKDWLQFOXGHOHVVVFULSWHGFRPSRQHQWVLQDGGLWLRQWR SUHVFULEHGSDUWVSURYLGHWHDFKHUVZLWKWKHDXWRQRP\DQGIOH[LELOLW\WKDWPDNHLWIHDVLEOHWR DGDSWWRGHYHORSLQJFKLOGUHQ¶VSURJUHVVDQGOHYHORISURILFLHQF\WKURXJKRXWWKHLQWHUYHQWLRQ :HEHOLHYHWKHOHVVVFULSWHGFRPSRQHQWVRIWKHSUHVHQWLQWHUYHQWLRQDOORZHGWHDFKHUVWR LQFRUSRUDWHPRUHDGYDQFHGWDONLQWKHLUH[FKDQJHVZLWKVWXGHQWVZKLOHDOVRLQYLWLQJVWXGHQWV WRHODERUDWHRQWKHLUNQRZOHGJHUHODWHGWRWKHOHVVRQ¶VWRSLF,QWKHOLWHUDWXUHDGDSWDWLRQVRI LQVWUXFWLRQVLQLQWHUYHQWLRQVKDYHUHFHQWO\UHFHLYHGLQFUHDVHGDWWHQWLRQHPSKDVL]LQJDQHHGWR FRQVLGHUWKHSRVVLELOLW\RIIOH[LEOHDGDSWDWLRQVDVDQDFWLYHLQJUHGLHQWLQLQWHUYHQWLRQV
&RPELQLQJGLIIHUHQWOHYHOVRIVFULSWHGLQVWUXFWLRQVFDQDOVRJLYHWHDFKHUVJUHDWHUDJHQF\
ZKLFKPD\HQKDQFHWKHTXDOLW\RIWKHLPSOHPHQWDWLRQDQGVWXGHQWV¶RXWFRPHV.LPHWDO 7KLVSHUVSHFWLYHFRQFXUVZLWKILQGLQJVIURP1HXJHEDXHUDQGFROOHDJXHVZKHUH DGDSWDWLRQVLQWKHIRUPRIH[WHQVLRQVIURPWKHVFULSWHGLQVWUXFWLRQVZHUHWKHPRVWEHQHILFLDO FRPSRQHQWLQSURPRWLQJVWXGHQWV¶ODQJXDJHJURZWK,QDGGLWLRQZKHQ%OHVHVHWDO FRPSDUHGGLIIHUHQWODQJXDJHLQWHUYHQWLRQVYDU\LQJLQWKHLUGHJUHHRIVFULSWLQJWKHOHVV VFULSWHGYHUVLRQZDVWKHPRVWHIIHFWLYHFRPSDUHGWRWKHWZRPRUHVFULSWHGYHUVLRQVZLWK VHFRQGODQJXDJHOHDUQHUVKDYLQJWKHJUHDWHVWJDLQV$IIRUGLQJWHDFKHUVJUHDWHUDJHQF\E\
LQYLWLQJWKHPWRDGDSWWKHLQWHUYHQWLRQWRWKHVSHFLILFVWXGHQWVWKH\ZRUNZLWKPD\SURYLGH
5XQQLQJKHDG7($&+(56¶,16758&7,21$/7$/.
WHDFKHUVZLWKPRUHRSSRUWXQLWLHVWRILQHWXQHWKHLULQWHUDFWLRQVZLWKWKHLUVWXGHQWVFRPSDUHG WRZKHQWKH\DUHDVNHGWRIROORZDPRUHVFULSWHGLQWHUYHQWLRQPDQXDO
6FULSWHGLQWHUYHQWLRQFRPSRQHQWVFDQRIIHUDQRSSRUWXQLW\IRUWHDFKHUVWRDFTXLUHD QHZVNLOOVWRRONLWWKDWFDQEHLQFRUSRUDWHGLQWKHLULQVWUXFWLRQRYHUWLPH7KHUHIRUHLWPD\
OHDGWRFKDQJHVLQWKHLULQVWUXFWLRQDOSUDFWLFHVZKLFKFDQSURPRWHFKLOGUHQ¶VODQJXDJH
OHDUQLQJ1HXJHEDXHUHWDO)XUWKHUPRUHPDQXDOVSURYLGHH[DPSOHVRIKRZWRLQLWLDWH ODQJXDJHULFKLQWHUDFWLRQVZLWKVWXGHQWV)RULQVWDQFHVRPHWHDFKHUVPD\EHOHVVFRPIRUWDEOH DGDSWLQJWKHLQVWUXFWLRQWRVWXGHQWV¶QHHGVGXULQJWKHLQWHUYHQWLRQ7KLVFDQEHGXHWROLPLWHG FRPSHWHQFHRUH[SHULHQFHZLWKVWUDWHJLHVSURPRWLQJODQJXDJHOHDUQLQJ$FFRUGLQJO\VRPH WHDFKHUVPD\SURILWPRUHIURPIROORZLQJDVHWRIVFULSWVWKDQRWKHUVIRUH[DPSOH
XQH[SHULHQFHGWHDFKHUV6FULSWHGJXLGHOLQHVPD\DOVREHDVXSSRUWLQDQLQWURGXFWRU\SKDVHRI DQLQWHUYHQWLRQIRUWHDFKHUVZKRGRQRWNQRZWKHLUVWXGHQWVZKHQWKH\VWDUWZRUNLQJZLWK WKHPVXFKDVZDVWKHFDVHIRUWKHVDPSOHRIWHDFKHUVLQWKHSUHVHQWVWXG\,QWKLVUHJDUGWKLV VDPSOHGLIIHUHGIURPSUHYLRXVVWXGLHVLQZKLFKVWXGHQWV¶FODVVURRPWHDFKHUVXVXDOO\ZHUHWKH PDLQSURYLGHURIWKHLQWHUYHQWLRQ5RJGHHWDO:DVLNHWDO<RVKLNDZDHWDO :RUNLQJZLWKDQXQIDPLOLDUJURXSRIVWXGHQWVDGGVDGGLWLRQDOFKDOOHQJHVZKHQ
LPSOHPHQWLQJDQLQWHUYHQWLRQFKDOOHQJHVVXFKDVEXLOGLQJUHODWLRQVZLWKVWXGHQWVRYHUDVKRUW DPRXQWRIWLPHDQGKDYLQJOLPLWHGLQIRUPDWLRQDERXWVWXGHQWV¶EDFNJURXQGNQRZOHGJHDQG OHYHORISURILFLHQF\7KXVVFULSWLQJFDQEHWKHILUVWVWHSWRLPSURYHWKHTXDOLW\RILQVWUXFWLRQ 6FULSWHGLQWHUYHQWLRQJXLGHOLQHVFDQEHHIILFLHQWDVWKH\UHTXLUHOHVVSUHSDUDWLRQWLPHDQGKHOS WHDFKHUVEHFRQVLVWHQWLQLPSOHPHQWLQJWKHSURJUDPDQGWKXVPD\HDVHHYDOXDWLRQVRI
LPSOHPHQWDWLRQILGHOLW\
+RZHYHUVFULSWLQJPD\UHVWULFWWHDFKHUV¶SURIHVVLRQDODXWRQRP\DQGFUHDWLYLW\DQG UHGXFHLQVWUXFWLRQDOTXDOLW\LIWHDFKHUVEHFRPHIRFXVHGRQIROORZLQJVFULSWHGJXLGHOLQHV UDWKHUWKDQDWWHQGLQJWRLQGLYLGXDOVWXGHQWV¶QHHGV%OHVHVHWDO3DUNV %ULGJHV
5XQQLQJKHDG7($&+(56¶,16758&7,21$/7$/.
5KRDGV7DNLQJWLPHWRH[SODLQZKHQPLVXQGHUVWDQGLQJVRFFXUDQGSURYLGHDGGLWLRQDO LQIRUPDWLRQDUHLQVWUXFWLRQDOTXDOLWLHVWKDWPD\EHQHJOHFWHGLIWHDFKHUVDUHWRRSUHRFFXSLHG ZLWKIROORZLQJDQGJHWWLQJWKURXJKDVFULSWHGSURJUDP7KXVVWURQJO\VFULSWHGJXLGHOLQHVFDQ UHGXFHWKHGHYHORSPHQWDODSSURSULDWHQHVVRIWHDFKHUV¶LQWHUDFWLRQVZLWKVWXGHQWV)LQDOO\WKH RSWLPDOEDODQFHEHWZHHQVFULSWHGDQGOHVVVFULSWHGSDUWVRIDQLQWHUYHQWLRQPD\YDU\
GHSHQGLQJRQHGXFDWLRQDOFXOWXUHVLQVSHFLILFFRXQWULHV6FDQGLQDYLDQFRXQWULHVW\SLFDOO\
YDOXHFKLOGRULHQWHGOHDUQLQJDFWLYLWLHVDQGPDQXDOL]HGSURJUDPVDUHXQFRPPRQ
HPSKDVL]LQJLQVWHDGWKDWWHDFKHUVVKRXOGGHFLGHRQSUDFWLFHVDQGPHWKRGVWKDWILWWKHJURXS WKH\ZRUNZLWK7KLVPD\EHRQHUHDVRQZK\WKHOHVVVFULSWHGYHUVLRQRID'DQLVKSURJUDP ZDVPRUHHIIHFWLYHWKDQWKHVFULSWHGRQHV%OHVHVHWDO
$QLQFOXVLRQFULWHULRQLQWKHVWXG\ZDVWKDWVWXGHQWVGHPRQVWUDWHGVHFRQGODQJXDJH VNLOOVLQQHHGRIVXSSRUWVFRUHGDWOHDVW6'EHORZWKHPHDQ,WLVWKHUHIRUHUHDVRQDEOHWR EHOLHYHWKDWWKHKLJKHUSURSRUWLRQRIODEHOLQJWDONFDWHJRULHVLQWKHHDUO\H[FKDQJHVZDV KHOSIXOLQSURYLGLQJDMRLQWSODWIRUPRIXQGHUVWDQGLQJ7KHQDVWHDFKHUVJRWWRNQRZWKHLU VWXGHQWVEHWWHUDQGWKHVWXGHQWVVWDUWHGWDONLQJPRUHWKHWHDFKHUVDSSDUHQWO\ZHUHPRUHOLNHO\
WRGHPRQVWUDWHWDONWKDWZDVOHVVVFULSWHG7RNQRZDZRUGDOHDUQHUQHHGVWRNQRZWKH FRQFHSWEHKLQGWKHODEHO7KHUHIRUHPHUHO\KHDULQJWKHVDPHZRUGPXOWLSOHWLPHVGXULQJD OHVVRQLVQRWHQRXJKWRIXOO\XQGHUVWDQGWKHFRQFHSWQRUGRHVLWSURYLGHDULFKHUODQJXDJH HQYLURQPHQW$FFRUGLQJWRWKHVRFLDOLQWHUDFWLRQLVWSHUVSHFWLYHRQODQJXDJHOHDUQLQJWKDWWKH SUHVHQWVWXG\LVIUDPHGZLWKLQTXDOLW\IHDWXUHVRIODQJXDJHGHYHORSWKURXJKWKHG\QDPLF LQWHUDFWLRQVEHWZHHQWHDFKHUDQGVWXGHQWVDVTXHVWLRQVDQGEDFNJURXQGH[SHULHQFHVDUH EURXJKWLQWRWKHFRQYHUVDWLRQ+DOOLGD\1LQLR 6QRZ7HDFKHUV¶DELOLW\RI EHLQJUHVSRQVLYHWRDQGIROORZLQJXSRQVWXGHQWV¶FRQWULEXWLRQVSURPRWHODQJXDJHOHDUQLQJ +DQVHQ5HFHQWUHVHDUFKRQTXDOLW\RIOLQJXLVWLFLQSXWKDVVKRZQWKDWWKHPRVW LPSDFWIXOODQJXDJHSUDFWLFHVZHUHWKRVHWDUJHWLQJFRQFHSWXDOLQIRUPDWLRQGHILQLWLRQVDQG
5XQQLQJKHDG7($&+(56¶,16758&7,21$/7$/.
ZRUGUHODWLRQV%RZQHHWDO1HXJHEDXHUHWDO6LOYHUPDQHWDO 0RUHRYHUWKHSUHVHQWVWXG\LQGLFDWHGWKDWIHDWXUHVEXLOGLQJRQFRQFHSWXDOGHILQLWLRQVDQG XVDJHEDVHGH[DPSOHVRIWKHVHLQFRPELQDWLRQZLWKH[WHQGHGGLVFRXUVHFDQKHOSWHDFKHUV FUHDWHHQULFKHGODQJXDJHHQYLURQPHQWVIRUVHFRQGODQJXDJHOHDUQHUV$IIRUGLQJVWXGHQWVZLWK VHPDQWLFFDWHJRULHVDQGVHPDQWLFDOO\UHODWHGZRUGVDOORZVWKHPWRGUDZFRQQHFWLRQVEHWZHHQ ZKDWWKH\DOUHDG\NQRZDQGUHODWHLWWRZRUGVZLWKLQWKHVDPHWRSLF7KLVDOLJQVZLWKVWXGLHV GHPRQVWUDWLQJWKHHIIHFWLYHQHVVRIWHDFKLQJFKLOGUHQFRQFHSWXDOO\DOLJQHGFDWHJRULHV+DGOH\
HWDO1HXPDQHWDO3LQNKDPHWDO5HSHDWHGH[SRVXUHRIWKLVNLQGRI OLQJXLVWLFLQSXWWKHUHIRUHPD\RIIHUDQRSSRUWXQLW\WRJREH\RQGWKHVLPSOHZRUGWROHDUQWKH FRQFHSWEHKLQGWKHZRUGV7KHVHDUHDOOIDFWRUVFUXFLDOLQSURPRWLQJVHFRQGODQJXDJHOHDUQHUV¶
RUDOODQJXDJHVNLOOV8VLQJVHPDQWLFFDWHJRULHVFDQDOVRPDNHLWHDVLHUIRUWHDFKHUVWRWDON DERXWGHILQLWLRQVDQGLQFOXGHH[DPSOHVWKDWFRQQHFWZLWKFKLOGUHQ¶V¶RZQH[SHULHQFHV7KLV PD\OHDGWRWRSLFUHODWHGVWRULHVDQGH[SODQDWLRQVRIIHULQJFKLOGUHQPXOWLSOHRSSRUWXQLWLHVWR HQJDJHLQFRQYHUVDWLRQV
/LPLWDWLRQV
7KLVVWXG\KDGOLPLWDWLRQV)LUVWWKHVPDOOVDPSOHVL]HUHGXFHGWKHVWDWLVWLFDOSRZHURI WKHDQDO\VLV7KHUHIRUHZHZHUHQRWDEOHWRH[SORUHZKHWKHUYDULDWLRQVDFURVVLQGLYLGXDO WHDFKHUV¶LQVWUXFWLRQDOWDONSUHGLFWHGFKLOGRXWFRPHVDERYHWKHHIIHFWRIUHFHLYLQJWKHSURJUDP WKDWSUHYLRXVO\KDVEHHQGHPRQVWUDWHGG ZKHQWKHLQWHUYHQWLRQJURXSZDVFRPSDUHG ZLWKDFRQWUROJURXSVHH$XWKRUVHWDO6HFRQGZHZHUHQRWDEOHWRUHOLDEO\LGHQWLI\
LQGLYLGXDOFKLOGUHQ¶VXWWHUDQFHVLQWKHDXGLRWDSHGREVHUYDWLRQVRILQVWUXFWLRQDOWDONDQG WKHUHIRUHFRGLQJRIWKHFKLOGUHQ¶VXWWHUDQFHVZDVFRQGXFWHGDWWKHJURXSOHYHO:HFDQQRW H[FOXGHWKHSRVVLELOLW\WKDWWKHVWXGHQWJURXSV¶SDUWLFLSDWLRQLQODEHOLQJGHILQLWLRQVDQG H[WHQGHGGLVFRXUVHDWERWKWLPHSRLQWVLQVRPHJURXSVPD\KDYHUHVXOWHGIURPVSHFLILF VWXGHQWV¶FRQWULEXWLRQVZKLOHLQRWKHUJURXSVUHIOHFWHGDSDUWLFLSDWLRQVWUXFWXUHLQZKLFKDOO
5XQQLQJKHDG7($&+(56¶,16758&7,21$/7$/.
VWXGHQWVMRLQHG9LGHRWDSHGREVHUYDWLRQVZRXOGKDYHDOORZHGDPRUHILQHJUDLQHGDQDO\VLVRI WHDFKHU±VWXGHQWLQWHUDFWLRQVDWERWKWLPHSRLQWVDVZHOODVWKHSRVVLEOHGHYHORSPHQWRIWKHVH LQWHUDFWLRQVRYHUWKHLQWHUYHQWLRQSHULRG
&RQFOXVLRQ
7KLVVWXG\DGGUHVVHGFKDUDFWHULVWLFVRIWHDFKHUV¶LQVWUXFWLRQDOWDONLQWKHHDUO\DQGODWH SDUWVRIDQLQWHQVLYHVHFRQGODQJXDJHLQWHUYHQWLRQWKDWKDGGHPRQVWUDWHGVXEVWDQWLDOHIIHFWV RQ\RXQJVHFRQGODQJXDJHOHDUQHUV¶RUDOODQJXDJHVNLOOV:HH[DPLQHGZKHWKHUSRWHQWLDO GHYHORSPHQWVRIWHDFKHUV¶LQVWUXFWLRQDOWDONRYHUWKHWLPHVSDQZHUHDOLJQHGZLWKLQWHUYHQWLRQ FRPSRQHQWVWKDWGLIIHUHGLQGHJUHHRIVFULSWHGQHVV7KHILQGLQJVVXJJHVWHGWKDWGHYHORSPHQWV LQWHDFKHUV¶LQVWUXFWLRQDOWDONLQSDUWLFXODUZHUHGHPRQVWUDWHGZLWKLQWDONFDWHJRULHVDOLJQHG ZLWKWKHOHVVVFULSWHGSDUWRIWKHLQWHUYHQWLRQZKLOHZHIRXQGQRFKDQJHVLQWHDFKHUV¶ODEHOLQJ WDONWKDWZDVDVVRFLDWHGZLWKWKHPRUHVFULSWHGSDUWVRIWKHLQWHUYHQWLRQ3URPRWLQJRUDO ODQJXDJHVNLOOVLQVWXGHQWVUHOLHVRQWHDFKHUVSURYLGLQJODQJXDJHULFKHQYLURQPHQWVZKHUH ZRUGNQRZOHGJHYRFDEXODU\DQGFRQFHSWXDONQRZOHGJHDUHLQFRUSRUDWHGLQWKHWHDFKHUV¶
LQVWUXFWLRQDOSUDFWLFHV6SDUVLW\RIFRQFHSWULFKLQWHUDFWLRQVLQFODVVURRPVRIWHQUHVXOWVLQ IHZHUHQFRXQWHUVZLWKXQIDPLOLDUZRUGVXQGHUO\LQJRUDOFRPSUHKHQVLRQDQGUHDGLQJ FRPSUHKHQVLRQZKLFKDUHSDUWLFXODUO\LPSRUWDQWIRUVHFRQGODQJXDJHOHDUQHUVWRUHDFK SURILFLHQF\9HU\IHZVWXGLHVKDYHH[DPLQHGWKHH[WHQWWRZKLFKWHDFKHUVFKDQJHWKHLU LQVWUXFWLRQDOWDONGXULQJDQLQWHUYHQWLRQ7KLVPD\KDYHLPSOLFDWLRQVIRUWKHGHVLJQRI LQWHUYHQWLRQSURJUDPV)XWXUHUHVHDUFKVKRXOGDGGUHVVKRZPRGLILFDWLRQVLQWHDFKHUV¶
LQVWUXFWLRQDOWDONLQUHODWLRQWRVFULSWLQJDIIHFWFKLOGRXWFRPHV,QSDUWLFXODUPRUHHPSKDVLV VKRXOGEHSODFHGRQILQHJUDLQHGPHWKRGRORJ\DVWKHDQDO\VLVRIWHDFKHU±VWXGHQWLQWHUDFWLRQV
5XQQLQJKHDG7($&+(56¶,16758&7,21$/7$/.
5HIHUHQFHV
$DUWV5'HPLU9HJWHU6.XUYHUV- +HQULFKV/$FDGHPLFODQJXDJHLQVKDUHG ERRNUHDGLQJ3DUHQWDQGWHDFKHULQSXWWRPRQRDQGELOLQJXDOSUHVFKRROHUV/DQJXDJH /HDUQLQJ±GRLODQJ
$XWKRU
$XWKRUVHWDO
$XWKRU &ROOHDJXHV
$XWKRUV &ROOHDJXHV
%OHVHV'+¡MHQ$'DOH363LDVWD6%-XVWLFH/0'\EGDO/+DJKLVK() (IIHFWLYHODQJXDJHDQGOLWHUDF\LQVWUXFWLRQ(YDOXDWLQJWKHLPSRUWDQFHRI VFULSWLQJDQGJURXSVL]HFRPSRQHQWV(DUO\&KLOGKRRG5HDGLQJ4XDUWHUO\
±GRLMHFUHVT
%RZQH-%<RVKLNDZD+ 6QRZ&(([SHULPHQWDOLPSDFWVRIDWHDFKHU SURIHVVLRQDOGHYHORSPHQWSURJUDPLQHDUO\FKLOGKRRGRQH[SOLFLWYRFDEXODU\
LQVWUXFWLRQDFURVVWKHFXUULFXOXP(DUO\&KLOGKRRG5HVHDUFK4XDUWHUO\±
GRLMHFUHVT
&DUOR06$XJXVW'0F/DXJKOLQ%6QRZ&('UHVVOHU&/LSSPDQ' 1«:KLWH&(&ORVLQJWKHJDS$GGUHVVLQJWKHYRFDEXODU\QHHGVRI (QJOLVKODQJXDJHOHDUQHUVLQELOLQJXDODQGPDLQVWUHDPFODVVURRPV5HDGLQJ5HVHDUFK 4XDUWHUO\±GRL554
&ROOHDJXHV $XWKRU
&ROOHDJXHV $XWKRU
'LFNLQVRQ'.7HDFKHUV¶ODQJXDJHSUDFWLFHVDQGDFDGHPLFRXWFRPHVRISUHVFKRRO FKLOGUHQ6FLHQFH±GRLVFLHQFH
5XQQLQJKHDG7($&+(56¶,16758&7,21$/7$/.
'LFNLQVRQ'. &DVZHOO/%XLOGLQJVXSSRUWIRUODQJXDJHDQGHDUO\OLWHUDF\LQ SUHVFKRROFODVVURRPVWKURXJKLQVHUYLFHSURIHVVLRQDOGHYHORSPHQW(IIHFWVRIWKH /LWHUDF\(QYLURQPHQW(QULFKPHQW3URJUDP/((3(DUO\&KLOGKRRG5HVHDUFK 4XDUWHUO\±GRLMHFUHVT
'LFNLQVRQ'. 3RUFKH095HODWLRQEHWZHHQODQJXDJHH[SHULHQFHVLQ SUHVFKRROFODVVURRPVDQGFKLOGUHQ¶VNLQGHUJDUWHQDQGIRXUWKJUDGHODQJXDJHDQG UHDGLQJDELOLWLHV&KLOG'HYHORSPHQW±GRLM [
(OOHPDQ$0/LQGR(-0RUSK\3 &RPSWRQ'/7KHLPSDFWRI YRFDEXODU\LQVWUXFWLRQRQSDVVDJHOHYHOFRPSUHKHQVLRQRIVFKRRODJHFKLOGUHQ$
PHWDDQDO\VLV-RXUQDORI5HVHDUFKRQ(GXFDWLRQDO(IIHFWLYHQHVV±
GRL
+DGOH\(%'LFNLQVRQ'.+LUVK3DVHN. *ROLQNRII50%XLOGLQJ VHPDQWLFQHWZRUNV7KHLPSDFWRIDYRFDEXODU\LQWHUYHQWLRQRQSUHVFKRROHUV¶GHSWKRI ZRUGNQRZOHGJH5HDGLQJ5HVHDUFK4XDUWHUO\±GRLUUT +DOOLGD\0$.7RZDUGVDODQJXDJHEDVHGWKHRU\RIOHDUQLQJ/LQJXLVWLFVDQG
(GXFDWLRQ–GRL
+DQVHQ-(&KDUDFWHULVWLFVRIHGXFDWLRQDOODQJXDJHSUDFWLFHVREVHUYHGLQIRXU WRGGOHUJURXSVLQ1RUZHJLDQ(&(&,QWHUQDWLRQDO-RXUQDORI(DUO\<HDUV(GXFDWLRQ GRL
+DUQ%3DULVL' 6WRROPLOOHU0%DODQFLQJILGHOLW\ZLWKIOH[LELOLW\DQGILW:KDW GRZHUHDOO\NQRZDERXWILGHOLW\RILPSOHPHQWDWLRQLQVFKRRO"([FHSWLRQDO&KLOGUHQ
±GRL
5XQQLQJKHDG7($&+(56¶,16758&7,21$/7$/.
+LQGPDQ$+ :DVLN%$8QSDFNLQJDQHIIHFWLYHODQJXDJHDQGOLWHUDF\
FRDFKLQJLQWHUYHQWLRQLQ+HDG6WDUW7KH(OHPHQWDU\6FKRRO-RXUQDO±
GRL
+RII(+RZVRFLDOFRQWH[WVVXSSRUWDQGVKDSHODQJXDJHGHYHORSPHQW 'HYHORSPHQWDO5HYLHZ±GRLMGU
-XVWLFH-0-LDQJ+ 6WUDVVHU./LQJXLVWLFHQYLURQPHQWRISUHVFKRRO
FODVVURRPV:KDWGLPHQVLRQVVXSSRUWFKLOGUHQ¶VODQJXDJHJURZWK"(DUO\&KLOGKRRG 5HVHDUFK4XDUWHUO\±GRLMHUHVT
-XVWLFH/00DVKEXUQ$-+DPUH%. 3LDQWD5&4XDOLW\RIODQJXDJH DQGOLWHUDF\LQVWUXFWLRQLQSUHVFKRROFODVVURRPVVHUYLQJDWULVNSXSLOV(DUO\
&KLOGKRRG5HVHDUFK4XDUWHUO\±GRLMHFUHVT .LP-6%XUNKDXVHU0$4XLQQ'0*XU\DQ-.LQJVWRQ+& $OHPDQ.
(IIHFWLYHQHVVRIVWUXFWXUHGWHDFKHUDGDSWDWLRQVWRDQHYLGHQFHEDVHGVXPPHU OLWHUDF\SURJUDP5HDGLQJ5HVHDUFK4XDUWHUO\±GRLUUT /DQGLV-5 .RFK**7KHPHDVXUHPHQWRIREVHUYHUDJUHHPHQWIRUFDWHJRULFDO
GDWD%LRPHWULFV±GRL
0DF:KLQQH\%7KH&+,/'(6SURMHFW7RROVIRUDQDO\]LQJWDONUGHG0DKZDK 1-(UOEDXP
0DUXOLV/0 1HXPDQ6%7KHHIIHFWVRIYRFDEXODU\LQWHUYHQWLRQRQ\RXQJ FKLOGUHQ¶VZRUGOHDUQLQJ$PHWDDQDO\VLV5HYLHZRI(GXFDWLRQDO5HVHDUFK
±GRL
0LFKHQHU&-3URFWRU&3 6LOYHUPDQ5')HDWXUHVRILQVWUXFWLRQDOWDON SUHGLFWLYHRIUHDGLQJFRPSUHKHQVLRQ5HDGLQJDQG:ULWLQJ±
GRLV
5XQQLQJKHDG7($&+(56¶,16758&7,21$/7$/.
1HXJHEDXHU6&R\QH00F&RDFK% :DUH67HDFKLQJEH\RQGWKH
LQWHUYHQWLRQ7KHFRQWULEXWLRQRIWHDFKHUODQJXDJHH[WHQVLRQVWRYRFDEXODU\OHDUQLQJ LQXUEDQNLQGHUJDUWHQFODVVURRPV5HDGLQJDQG:ULWLQJ±
GRLV[
1HXPDQ6% &XQQLQJKDP/7KHLPSDFWRISURIHVVLRQDOGHYHORSPHQWDQG FRDFKLQJRQHDUO\ODQJXDJHDQGOLWHUDF\LQVWUXFWLRQDOSUDFWLFHV$PHULFDQ(GXFDWLRQDO 5HVHDUFK-RXUQDO±GRL
1HXPDQ6%1HZPDQ(+ 'Z\HU-(GXFDWLRQDOHIIHFWVRIYRFDEXODU\
LQWHUYHQWLRQRQSUHVFKRROHUV¶ZRUGNQRZOHGJHDQGFRQFHSWXDOGHYHORSPHQW$
FOXVWHUUDQGRPL]HGWULDO5HDGLQJ5HVHDUFK4XDUWHUO\±
GRL554
1LQLR$ 6QRZ&(3UDJPDWLFGHYHORSPHQW2[IRUG(QJODQG:HVWYLHZ3UHVV 3DUNV1 %ULGJHV5KRDGV62YHUO\VFULSWHG([SORULQJWKHLPSDFWRIDVFULSWHG
OLWHUDF\FXUULFXOXPRQDSUHVFKRROWHDFKHU¶VLQVWUXFWLRQDOSUDFWLFHVLQPDWKHPDWLFV -RXUQDORI5HVHDUFKLQ&KLOGKRRG(GXFDWLRQ±
GRL
3LQNKDP$6.DHIHU7 1HXPDQ6%7D[RQRPLHVVXSSRUWSUHVFKRROHUV¶
NQRZOHGJHDFTXLVLWLRQIURPVWRU\ERRNV&KLOG'HYHORSPHQW5HVHDUFK±
GRL
5REHUWV7 1HDO+5HODWLRQVKLSVDPRQJSUHVFKRRO(QJOLVKODQJXDJHOHDUQHU¶V RUDOSURILFLHQF\LQ(QJOLVKLQVWUXFWLRQDOH[SHULHQFHDQGOLWHUDF\GHYHORSPHQW
&RQWHPSRUDU\(GXFDWLRQDO3V\FKRORJ\±
GRLMFHGSV\FK
5RJGH.0HOE\/HUYnJ0 /HUYnJ$,PSURYLQJWKHJHQHUDOODQJXDJHVNLOOVRI VHFRQGODQJXDJHOHDUQHUVLQNLQGHUJDUWHQ$UDQGRPL]HGFRQWUROOHGWULDO-RXUQDORI
5XQQLQJKHDG7($&+(56¶,16758&7,21$/7$/.
5HVHDUFKRQ(GXFDWLRQDO(IIHFWLYHQHVV±
GRL
6LOYHUPDQ5'3URFWRU&3+DUULQJ-5'R\OH%0LWFKHOO0$ 0H\HU$*
7HDFKHUV¶LQVWUXFWLRQDQGVWXGHQWV¶YRFDEXODU\DQGFRPSUHKHQVLRQ$Q
H[SORUDWRU\VWXG\ZLWK(QJOLVKPRQROLQJXDODQG6SDQLVK(QJOLVKELOLQJXDOVWXGHQWVLQ JUDGHV5HDGLQJ5HVHDUFK4XDUWHUO\±GRLUUT
6PRONRZVNL. *XQQ%5HOLDELOLW\DQGYDOLGLW\RIWKHFODVVURRPREVHUYDWLRQVRI VWXGHQWWHDFKHULQWHUDFWLRQV&267,IRUNLQGHUJDUWHQUHDGLQJLQVWUXFWLRQ(DUO\
&KLOGKRRG5HVHDUFK4XDUWHUO\±GRLMHFUHVT 6QRZ&(7DERUV32 'LFNLQVRQ'./DQJXDJHGHYHORSPHQWLQWKH
SUHVFKRRO\HDUV,Q'.'LFNLQVRQ 327DERUV(GV%HJLQQLQJOLWHUDF\ZLWK ODQJXDJH<RXQJFKLOGUHQOHDUQLQJDWKRPHDQGVFKRROSS±%DOWLPRUH0'
%URRNHV
:DVLN%$%RQG0$ +LQGPDQ$7KHHIIHFWVRIDODQJXDJHDQGOLWHUDF\
LQWHUYHQWLRQRQ+HDG6WDUWFKLOGUHQDQGWHDFKHUV-RXUQDORI(GXFDWLRQDO3V\FKRORJ\
±GRL
:DVLN%$ +LQGPDQ$+,PSURYLQJYRFDEXODU\DQGSUHOLWHUDF\VNLOOVRIDW ULVNSUHVFKRROHUVWKURXJKWHDFKHUSURIHVVLRQDOGHYHORSPHQW-RXUQDORI(GXFDWLRQDO 3V\FKRORJ\±GRLD
:DVLN%$ +LQGPDQ$+,QFUHDVLQJSUHVFKRROHUVµYRFDEXODU\GHYHORSPHQW WKURXJKDVWUHDPOLQHGWHDFKHUSURIHVVLRQDOGHYHORSPHQWLQWHUYHQWLRQ(DUO\&KLOGKRRG 5HVHDUFK4XDUWHUO\GRLMHFUHVT
<RVKLNDZD+/H\YD'6QRZ&(7UHYLQR(%DUDWD0&:HLODQG&$UERXU 0&([SHULPHQWDOLPSDFWVRIDWHDFKHUSURIHVVLRQDOGHYHORSPHQWSURJUDPLQ
5XQQLQJKHDG7($&+(56¶,16758&7,21$/7$/.
&KLOHRQSUHVFKRROFODVVURRPTXDOLW\DQGFKLOGRXWFRPHV'HYHORSPHQWDO3V\FKRORJ\
±GRLD
=XFNHU7$-XVWLFH/03LDVWD6% .DGHUDYHN-13UHVFKRROWHDFKHUV¶
OLWHUDODQGLQIHUHQWLDOTXHVWLRQVDQGFKLOGUHQ¶VUHVSRQVHVGXULQJZKROHFODVVVKDUHG UHDGLQJ(DUO\&KLOGKRRG5HVHDUFK4XDUWHUO\
GRLMHFUHVT
7DEOH 7HDFKHUV¶7DON&DWHJRULHVSHU0LQXWH 7LPH7LPH 9DULDEOHQDPH106'0LQ0D[06'0LQ0D[ 6LPSOHODEHOLQJ (ODERUDWHGODEHOLQJ &RQFHSWXDOGHILQLWLRQV 8VDJHEDVHGH[DPSOHVRIGHILQLWLRQV ([WHQGHGGLVFRXUVH
5XQQLQJKHDG7($&+(56¶,16758&7,21$/7$/. 7DEOH 6WXGHQW*URXSV¶7DON&DWHJRULHVSHU0LQXWH 7LPH7LPH 9DULDEOHQDPH106'0LQ0D[06'0LQ0D[ 6LPSOHODEHOLQJ (ODERUDWHGODEHOLQJ &RQFHSWXDOGHILQLWLRQV 8VDJHEDVHGH[DPSOHVRIGHILQLWLRQV ([WHQGHGGLVFRXUVH
III
5XQQLQJKHDG.DUWOHJJLQJDYVSUnNIHUGLJKHWHU
.DUWOHJJLQJDYVSUnNIHUGLJKHWHUIRUHOHYHUSnWULQQ(QYXUGHULQJDY NDUWOHJJLQJVYHUNW¡\HW1RUVN6RP/ ULQJVVSUnN16/
0LD&+HOOHURJ$UQH/HUYnJ 8QLYHUVLWHWHWL2VOR
.$57/(**,1*$9635c.)(5',*+(7(5
6DPPHQGUDJ
.DUWOHJJLQJDYVSUnNIHUGLJKHWHUNDQELGUDWLOWLGOLJLGHQWLILVHULQJDYEDUQVRPWUHQJHUVW¡WWHL VNROHQRJGHUPHGY UHYHLOHGHQGHIRULQQKROGHWLXQGHUYLVQLQJHQ.YDOLWHWHQYHG
PnOHLQVWUXPHQWHQHHUYLNWLJYHGNDUWOHJJLQJ'HQQHVWXGLHQJMHQQRPI¡UWHDQDO\VHUDY UHOLDELOLWHWEHJUHSVYDOLGLWHWRJNULWHULHYDOLGLWHWLNDUWOHJJLQJVYHUNW¡\HW©1RUVN6RP / ULQJVVSUnNª16/VRPHUHQO UHSODQRULHQWHUWVSUnNNDUWOHJJLQJIRUWULQQ16/
YXUGHUHUIHUGLJKHWHULQQHQIRUNDWHJRULVHULQJYRNDEXODUEUHGGHRJG\EGHRJJUDPPDWLNN .RQILUPHUHQGHIDNWRUDQDO\VHULGHQWLILVHUWH16/VRPHQILUHIDNWRUPRGHOO'HWEOHRJVnIXQQHW NRUUHODVMRQHUPHOORP16/RJDQGUHVWDQGDUGLVHUWHVSUnNNDUWOHJJLQJHUVRPXQGHUE\JJHU YDOLGLWHWHQLNDUWOHJJLQJVYHUNW¡\HW
6XPPDU\
/DQJXDJHDVVHVVPHQWFDQEHDYDOXDEOHVRXUFHRILQIRUPDWLRQWRLGHQWLI\VWXGHQWVLQQHHGRI ODQJXDJHVXSSRUW$QDVVHVVPHQWWRRO¶VXVDELOLW\IRUHGXFDWLRQDOSXUSRVHVODUJHO\GHSHQGVRQ XVLQJUHVXOWVWRDGDSWLQVWUXFWLRQWKDWFDQEHQHILWVWXGHQW¶VOHDUQLQJ)RUDQDVVHVVPHQWWRROWR EHFRPHDYDOXDEOHVRXUFHRILQIRUPDWLRQLWPXVWEHERWKUHOLDEOHDQGYDOLG7KLVVWXG\
FRQGXFWHGDQH[DPLQDWLRQRIUHOLDELOLW\FRQVWUXFWYDOLGLW\DQGFULWHULRQYDOLGLW\RIWKH DVVHVVPHQWWRRO³1RUZHJLDQDVD/DQJXDJHIRU/HDUQLQJ´16/7KH16/LVDVWDQGDUGL]HG FXUULFXOXPEDVHGODQJXDJHWHVWIRUVWXGHQWVLQJUDGHVDQGDVVHVVVNLOOVUHODWHGWR
FDWHJRUL]DWLRQYRFDEXODU\EUHDGWKDQGGHSWKDQGJUDPPDU&RQILUPDWRU\IDFWRUDQDO\VLV LGHQWLILHG16/DVDIRXUIDFWRUPRGHO)XUWKHUPRUHFRUUHODWLRQVEHWZHHQ16/DQGRWKHU VWDQGDUGL]HGODQJXDJHWHVWVZHUHIRXQGZKLFKVXSSRUWVLWVYDOLGLW\
.$57/(**,1*$9635c.)(5',*+(7(5
,QQOHGQLQJ
*RGHVSUnNIHUGLJKHWHUHUHWYLNWLJJUXQQODJIRUO ULQJRJGHOWDNHOVHLHWVRVLDO IHOOHVVNDS,GDJHQVIOHUNXOWXUHOOHVNROHHUGHWHQ¡NHQGHDQGHOHOHYHUVRPKDUHWDQQHW PRUVPnOHQQQRUVN%HJUHSHWPLQRULWHWVVSUnNOLJGHILQHUHVRIWHLVNROHVDPPHQKHQJVRPEDUQ VRPKDUHWDQQHWI¡UVWHVSUnNHQQQRUVNHOOHUVDPLVN2SSO ULQJVORYHQV7DOOIRU 6WDWLVWLVNVHQWUDOE\UnYLVHUDWDQGHOHQEDUQPHGYHGWDNRPV UVNLOWQRUVNRSSO ULQJ XWJM¡UDYHOHYWDOOHWLJUXQQVNROHQL1RUJH,2VORXWJM¡UGHQQHJUXSSHQHOHYHU 6WXGLHUYLVHUDWPLQRULWHWVVSUnNOLJHHOHYHUVRPJUXSSHKDUVYDNHUHIHUGLJKHWHUSnVNROHQV VSUnNHQQVLQHHQVSUnNOLJHPHGHOHYHU0HOE\/HUYnJ /HUYnJ'HWWHVWLOOHUXOLNHNUDY EnGHWLOVNROHQRJGHQHQNHOWHHOHYLIRUKROGWLOVSUnNNRPSHWDQVHRJGHWW\GHOLJJM¡U
XWIRUGULQJHQHQnUGHWJMHOGHUWLOUHWWHOHJJLQJLVNROHQ.XQQVNDSRPKYDVSUnNHURJKYRUGDQ VSUnNIHUGLJKHWHUXWYLNOHVRJPnOHVHUDYJM¡UHQGHIRUnLGHQWLILVHUHPLQRULWHWVVSUnNOLJHHOHYHU VRPWUHQJHUVSUnNVW¡WWH%HW\GQLQJHQDYEDUQVQRUVNVSUnNOLJHIHUGLJKHWHURJKYRUGDQ
EDUQHKDJHQRJVNROHQNDQELGUDWLOnVW¡WWHEDUQDVVSUnNXWYLNOLQJO¡IWHVIUHPL
VWRUWLQJVPHOGLQJHQRPWLGOLJLQQVDWVRJLQNOXGHUHQGHIHOOHVVNDS.XQQVNDSVGHSDUWHPHQWHW ,QQHQIRUHQQRUVNNRQWHNVWILQQHVGHWIRUHO¡SLJInNDUWOHJJLQJVYHUNW¡\VRPVNROHQNDQ EHQ\WWHIRUYXUGHULQJDYVSUnNIHUGLJKHWHU'HWHULQJHQI¡ULQJHUIRUKYLONH
NDUWOHJJLQJVYHUNW¡\VRPVNDOOLJJHWLOJUXQQXWRYHUGHQDVMRQDOHRJNRPPXQDOHSU¡YHQHVRP HUREOLJDWRULVNH'LVVHNDUWOHJJLQJHQHPnOHUEDUQDVOHVHIHUGLJKHWHU'HWNDQGHUIRUY UHHQ XWIRUGULQJIRUVNROHQnVHWWHLQQUHOHYDQWHWLOWDNIRUnVW\UNHVSUnNXWYLNOLQJHQKRVEDUQVRP YLVHUPDQJHOIXOOHVSUnNIHUGLJKHWHU
0DQJHOHQSnYHUNW¡\VRPPnOHUVSUnNIHUGLJKHWHUYDUHQDYJUXQQHQHWLOXWYLNOLQJHQDY 1RUVN6RP/ ULQJVVSUnN16/)U¡\HQ$KPDGLQLD+HOOHU 6NMnN)U¡\HQ
$KPDGLQLD+HOOHU6NMnN 1DPYDU0DQVnEHKRYIRUHWLQVWUXPHQWVRPNDUWODEDUQV VSUnNIHUGLJKHWHUXWHQnVWLOOHNUDYWLOOHVHRJVNULYHIHUGLJKHWHU'HQQHDUWLNNHOHQYXUGHUHU
.$57/(**,1*$9635c.)(5',*+(7(5
NRPSRQHQWHQH16/EHVWnUDYJMHQQRPDQDO\VHUDYUHOLDELOLWHWEHJUHSVYDOLGLWHWRJ NULWHULHYDOLGLWHWPHGSnI¡OJHQGHLPSOLNDVMRQHUIRUSUDNVLV
6SUnNHWVEHW\GQLQJIRUVNROHIDJOLJXWYLNOLQJ
6SUnNHUHWNRPSOHNVWIHQRPHQ'HWGHOHVRIWHLPXQWOLJHIHUGLJKHWHUHNVSUHVVLYHRJ O\WWHIHUGLJKHWHULPSUHVVLYHLWLOOHJJWLONRPSRQHQWHQHVHPDQWLNNNXQQVNDSRPRUGRJ VHWQLQJHUJUDPPDWLNNV\QWDNVRJPRUIRORJLIRQRORJLVSUnNO\GHURJSUDJPDWLNNEUXNDY VSUnN'LVVHNRPSRQHQWHQHSnYLUNHUKYHUDQGUHJMHQVLGLJRJJMHQQRPLQQIO\WHOVHUIUD
RPJLYHOVHQH%DUQXWYLNOHUVSUnNHWJMHQQRPVDPVSLOOEnGHVRPDNWLYHGHOWDNHUHRJO\WWHUH 9RNDEXODUGDQQHUJUXQQODJHWIRUVSUnNXWYLNOLQJHQJMHQQRPPXOLJKHWHUIRUnNRPPXQLVHUH WDQNHUPHQLQJHUI¡OHOVHURJEHKRYPHQRJVnYHGHYQHQWLOnV\VWHPDWLVHUHRJNDWHJRULVHUH RUGLV\VWHPHU'HWVNLOOHVRIWHPHOORPYRNDEXODUEUHGGHRJYRNDEXODUG\EGH0HQV
I¡UVWQHYQWHYLVHUWLODQWDOORUGEDUQKDUNMHQQVNDSWLOIRUHNVHPSHOJMHQQRPSHNLQJRJ EHQHYQLQJDYELOGHUYLVHUYRNDEXODUG\EGHQWLONXQQVNDSHQEDUQHWKDURPRUGIRUHNVHPSHO nGHILQHUHHWRUG2UGLQQO ULQJHQKHQJHUQ UWVDPPHQPHGEDUQVJUDPPDWLVNHXWYLNOLQJYHG DWHYQHQWLOnVHWWHVDPPHQRUGWLOHQNOH\WULQJHUIRUXWVHWWHUDWHQYLVVPHQJGHRUGHUO UW
$QWDOORUGHWEDUQIRUVWnURJNDQEUXNHHUWLOKMHOSIRUnKHQWHXWPHQLQJDYHQ\WULQJ6DPWLGLJ NDQHQ\WULQJELGUDPHGNRQWHNVWXHOOVW¡WWHIRUnIRUVWnQ\HRUGHOOHUELGUDWLOG\SHUHNXQQVNDS RPHWRUG'HQQHSDUDOOHOOHXWYLNOLQJHQRJUHODVMRQHQPHOORPYRNDEXODURJJUDPPDWLNN EHNUHIWHVJMHQQRPVLJQLILNDQWK¡\HNRUUHODVMRQHULVWXGLHUDYVSUnNXWYLNOLQJ.OHPHWDO /HUYnJ+XOPH 0HOE\/HUYnJ
7YLOOLQJVWXGLHUYLVHUDWJHQHUSnYLUNHUVSUnNWLOHJQHOVHQ+D\LRX7KRPDV'DOH 3ORPLQVDPWLGLJVRPPLOM¡HWEDUQHWHUHQGHODYVSLOOHUHQVHQWUDOUROOH+DUW 5LVOH\
0HQJGHQRJYDULDVMRQHQDYVSUnNVWLPXOHULQJHQEDUQEOLUHNVSRQHUWIRULWLGOLJDOGHUKDU VDPPHQKHQJPHGVHQHUHVSUnNIHUGLJKHWHU+RII5RZH6DPWLGLJIRUHNRPPHU
.$57/(**,1*$9635c.)(5',*+(7(5
GHWIRUVNMHOOHULVSUnNVWLPXOHULQJHQPHGEDNJUXQQLGHVRVLR¡NRQRPLVNHIRUKROGHQHEDUQ YRNVHURSSL'HWHWDEOHUHVWLGOLJIRUVNMHOOHULVW¡UUHOVHQSnEDUQVRUGIRUUnG+DUW 5LVOH\
'LVVHIRUVNMHOOHQHKDUYLVWVHJnYHGYDUHRYHUWLG0HOE\/HUYnJHWDO6WRUFK :KLWHKXUVW'HWWHHUEHN\PULQJVIXOOWVHWWLO\VDYDWVNROHUHODWHUWHIHUGLJKHWHULVWRU JUDGSUHGLNHUHVDYEDUQHWVRUGIRUUnGLI¡UVNROHDOGHU'LFNLQVRQ 7DERUV'LFNLQVRQ 3RUFKH+MHWODQG%ULQFKPDQQ6FKHUHU 0HOE\/HUYnJ
%DUQP¡WHUDOOHUHGHIUDVNROHVWDUWHWVSUnNSUHJHWDYDEVWUDNVMRQRJVRPNMHQQHWHJQHV DYHWDYDQVHUWYRNDEXODUNRPSOHNVV\QWDNVRJNUDYWLOYDULHUWHSUDJPDWLVNHIHUGLJKHWHU6QRZ 8FFHOOL'HWWHHUIHUGLJKHWHUVRPLNNHHUWHPDVSHVLILNNHPHQVRPJLUPXOLJKHWHUIRU nIRUVWnIDJLQQKROGSnWYHUVDYIDJRPUnGHU)HUGLJKHWHQHHUEHW\GQLQJVIXOOHIRUWLOHJQHOVHDY NXQQVNDSVSHVLHOWPHGWDQNHSnDWGHWDNDGHPLVNHVSUnNHWRJVnHUXQGHUYLVQLQJVVSUnNHWL VNROHQ,O\VDYGHWWHVWLOOHVGHWXIRUKROGVPHVVLJHVWRUHNUDYWLOKYDEDUQVRPHUSnYHLWLOn WLOHJQHVHJHWDQGUHVSUnNVNDOInPHGVHJLO¡SHWDYVNROHGDJHQ'HWWHIRUGLHOHYHQHEnGHHUL HQSURVHVVKYRUHWQ\WWVSUnNVNDOO UHVRJPHVWUHVVDPWLGLJVRPGHQVNROHIDJOLJH
NXQQVNDSHQEOLUIRUPLGOHWRJVNDOWLOHJQHVJMHQQRPHWVSUnNGHIRUHO¡SLJLNNHEHKHUVNHUJRGW QRN
+YRUGDQNDQVSUnNPnOHV"
0nOLQJDYVSUnNIHUGLJKHWHUVWLOOHUNUDYWLOHQRSHUDVMRQDOLVHULQJDYEHJUHSHWVSUnN 'HWWHLQQHE UHUnJM¡UHEHJUHSHWPnOEDUWYHGEUXNDYXOLNHNDUWOHJJLQJVYHUNW¡\VRP
UHSUHVHQWHUHUGHVSUnNOLJHNRPSRQHQWHQH.DUWOHJJLQJDYEDUQVRPWUHQJHUVSUnNVW¡WWHKDQGOHU RIWHRPnLGHQWLILVHUHKYLONHRUGYRNDEXODURJVHWQLQJHUJUDPPDWLNNHWEDUQIRUVWnURJNDQ EUXNHVDPWIRUWHOOHUIHUGLJKHWHUSUDJPDWLNN'HWHUYDQOLJnEUXNHVWDQGDUGLVHUWH
NDUWOHJJLQJVYHUNW¡\IRUnVDPPHQOLNQHEDUQVVSUnNIHUGLJKHWHUPHGKYDVRPHUIRUYHQWHWIRU DOGHUHQ(NVHPSOHUSnVOLNHNDUWOHJJLQJVYHUNW¡\HU%ULWLVK3LFWXUH9RFDEXODU\6FDOH%396
.$57/(**,1*$9635c.)(5',*+(7(5
,,'XQQ'XQQ:KHWWRQ %XUOH\/\VWHU+RUQ 5\JYROGVRPYXUGHUHU LPSUHVVLYWYRNDEXODURJ7HVWIRU5HFHSWLRQRI*UDPPDU752*%LVKRS/\VWHU +RUQVRPPnOHUJUDPPDWLVNIRUVWnHOVH6HOYRPKHQVLNWHQPHGNDUWOHJJLQJVYHUNW¡\HU nJLSUHVLVHPnOLQJHUDYEHJUHSHWVSUnNYLOGHWIRUHNRPPHPnOHIHLO0nOHIHLONDQY UH V\VWHPDWLVNHVNMHYPnOLQJDYEHJUHSHWSnJUXQQDYIRUVQHYHUHOOHUIRUEUHG
RSHUDVMRQDOLVHULQJHOOHUWLOIHOGLJHWLOIHOGLJKHWHUPDQLNNHNDQNRQWUROOHUHVOLNVRPHOHYHQV GDJVIRUPXQGHUNDUWOHJJLQJHQ'HWHUGHUIRUYLNWLJPHGLQIRUPDVMRQRPNRPSRQHQWHQH NDUWOHJJLQJVYHUNW¡\EHVWnUDY
(WVSULQJHQGHSXQNWYHGXWYLNOLQJDYNDUWOHJJLQJVYHUNW¡\KDQGOHURPLQVWUXPHQWHWV NYDOLWHW'HWWHYXUGHUHVXWLIUDVSHVLILNNHNULWHULHUIRUYDOLGLWHWRJUHOLDELOLWHWVRPEDVHUHVSn DQDO\VHUDYNRPSRQHQWHQHLQVWUXPHQWHWEHVWnUDY5HOLDELOLWHWJLULQIRUPDVMRQRPKYRUVWDELOW RJUHSURGXVHUEDUWPnOHLQVWUXPHQWHWHUPnOHVLNNHUKHW7KRUQGLNH 7KRUQGLNH&KULVW 9DOLGLWHWXWWU\NNHULKYLONHQJUDGWHRULHQRJHPSLULHQVRPOLJJHUWLOJUXQQVW¡WWHU WRONQLQJHQDYWHVWUHVXOWDWHQHLQQHQIRUHQVSHVLILNNNRQWHNVW0HVVLFN)RUDWHW NDUWOHJJLQJVYHUNW¡\VNDOKDHQQ\WWHYHUGLEnGHIRUIRUVNQLQJRJSUDNVLVIHOWHWPnGHWY UH UHOLDEHOWRJYDOLG'HUVRPHQWHVWYLVHUVHJnKDODYUHOLDELOLWHWYLOGHQKHOOHULNNHHJQHVHJWLO EUXNGDGHQLNNHHUYDOLGJ\OGLJ6DPWLGLJHUGHWYLNWLJnSnSHNHDWJRGUHOLDELOLWHWLNNHHUHQ JDUDQWLIRUYDOLGLWHWGDHQWHVWNDQYLVHVHJnY UHSnOLWHOLJXWHQDWGHQIDNWLVNPnOHUGHWGHQ HUXWYLNOHWIRUnPnOH7KRUQGLNH 7KRUQGLNH&KULVW,GHQQHDUWLNNHOHQIRNXVHUHVGHW SnEHJUHSVYDOLGLWHWRJNULWHULHYDOLGLWHWLHYDOXHULQJHQDYYDOLGLWHWLNDUWOHJJLQJVYHUNW¡\HW16/
%HJUHSVYDOLGLWHWGUHLHUVHJRPLKYLONHQJUDGNRPSRQHQWHQHPnOHLQVWUXPHQWHWEHVWnUDYHU UHSUHVHQWDWLYHIRUEHJUHSHWGHHUPHQWnPnOH9HGXWYLNOLQJDYHWNDUWOHJJLQJVYHUNW¡\
YXUGHUHVEHJUHSVYDOLGLWHWJMHQQRPHVWLPHULQJDYIDNWRUPRGHOOHU%URZQ )DNWRUDQDO\VHUXQGHUV¡NHUKYDVRPHUIHOOHVYDULDVMRQPHOORPHWVHWWDYYDULDEOHUIRUn YXUGHUHVWUXNWXUHQLNDUWOHJJLQJVYHUNW¡\HW$QDO\VHQHJLULQIRUPDVMRQRPEHJUHSHWLGHWWH
.$57/(**,1*$9635c.)(5',*+(7(5
WLOIHOOHWVSUnNHUEHVWIRUNODUWVRPHQIHOOHVGLPHQVMRQHOOHURPGHWUHSUHVHQWHUHUVHSDUDWH GLPHQVMRQHU)OHUHVWXGLHUILQQHUVW¡WWHIRUDWYDULDVMRQLEDUQVVSUnNIHUGLJKHWHUGDVSHVLHOW YRNDEXODUJUDPPDWLNNRJVSUnNEUXNNDQIRUNODUHVJMHQQRPHQHQGLPHQVMRQDOVSUnNIDNWRU .OHPHWDO7RPEOLQ =KDQJ6LGHQQRUPHUEUXNHVVRPUHWQLQJVOLQMHUIRU WRONQLQJDYHOHYHUVSUHVWDVMRQHUHUGHWYLNWLJnYLWHKYRUYLGWNDUWOHJJLQJVYHUNW¡\HWHU
UHSUHVHQWDWLYWIRUEDUQHJUXSSHQGHWEUXNHVSn'HWWHKDQGOHURPLQYDULDQVLKYLONHQJUDGGHW RSHUDVMRQDOLVHUWHEHJUHSHWNDQVLHVnPnOHGHWVDPPHSnWYHUVDYJUXSSHUHOOHURYHUWLG.OLQH ,IRUVNQLQJVOLWWHUDWXUHQYLVHVGHWWLOJUDGDYLQYDULDQVRJGHWWHPnOHVEDVHUWSn
IDNWRUVWUXNWXUHQQLYnNRQILJXUDOIDNWRUODGQLQJHQHQLYnPHWULVNRJLQWHUVHSW JMHQQRPVQLWWHWQLYnVNDODU'HWODYHVWHQLYnHWIDNWRUVWUXNWXUHQPnY UHRSSI\OWIRUn NXQQHYXUGHUHLQYDULDQVRYHUIDNWRUODGQLQJHQHVRPLJMHQPnY UHRSSI\OWIRUNXQQHYXUGHUH LQYDULDQVRYHULQWHUVHSWHQH3XWQLN %RUQVWHLQ6NDODULQYDULDQVHUHQIRUXWVHWQLQJIRU nNXQQHVDPPHQOLNQHJMHQQRPVQLWWPHOORPJUXSSHU.OLQH'HWEUXNHVRIWHIRUn VDPPHQOLNQHRPGHWRSHUDVMRQDOLVHUWHEHJUHSHWVSUnNPnOHVSnVDPPHPnWHLIRUKROGWLO DOGHUNM¡QQVRVLR¡NRQRPLVNEDNJUXQQRJVSUnNVWDWXV'HUVRPGHWLNNHHUVNDODULQYDULDQV PnGHWEUXNHVIRUVNMHOOLJHQRUPHUGDEHJUHSHWLNNHPnOHVOLNWPHOORPJUXSSHQH
.ULWHULHYDOLGLWHWYXUGHUHUKYRUYLGWPnOHLQVWUXPHQWHWVDPVYDUHUPHGDQGUH
LQVWUXPHQWHUVRPPnOHUGHWVDPPHEHJUHSHWRJRPLQVWUXPHQWHWWLOI¡UHUQ\LQIRUPDVMRQVRP LNNHIDQJHVRSSDYDQGUHYHUNW¡\VRPDOOHUHGHEHQ\WWHVIRUVDPPHIRUPnO,WLOOHJJEHO\VHV KYRUJRGWPnOHLQVWUXPHQWHWNODUHUnLGHQWLILVHUHHOHYJUXSSHQGHWEOHGHVLJQHWIRU7KRUQGLNH 7KRUQGLNH&KULVW.ULWHULHYDOLGLWHWNDQHQWHQY UHVDPWLGLJHOOHUSUHGLNWLY'HWWH DYKHQJHUDYKYRUYLGWWHVWHQHHUIRUHWDWWSnVDPPHWLGVSXQNWHOOHUEHQ\WWHVIRUnIRUXWVL IUHPWLGLJHSUHVWDVMRQHU
,QQHQIRUHQQRUVNNRQWHNVWILQQHVGHWInVWXGLHUDYNYDOLWHWHQYHGPnOHLQVWUXPHQWHU VRPEHQ\WWHVLVNROHQIRUnYXUGHUHEDUQVVNROHIDJOLJHIHUGLJKHWHU$UQHVHQ%UDHNHQ2JGHQ
.$57/(**,1*$9635c.)(5',*+(7(5
RJ0HOE\/HUYnJJMHQQRPI¡UWHLPLGOHUWLGQ\OLJHQXQGHUV¡NHOVHVRPEHO\VWH NYDOLWHWHQSnPnOHLQVWUXPHQWHUEUXNWWLONDUWOHJJLQJDYVRVLDOIXQJHULQJRJOHVHIHUGLJKHWHUL EDUQHVNROHQRJKYRUYLGWUHVXOWDWHQHEOHEHQ\WWHWVRPI¡ULQJHUIRULQQKROGHWLXQGHUYLVQLQJHQ 5HVXOWDWHQHWLONQ\WWHWNYDOLWHWHQYHGPnOHLQVWUXPHQWHQHYLVWHDWPDQJHKDGGHVYDNYDOLGLWHW HOOHUDWGHWLNNHYDUIRUHWDWWQRHQNYDOLWHWVYXUGHULQJDYPnOHLQVWUXPHQWHW'HWWHHUVSHVLHOW EHN\PULQJVIXOOWVHWWLO\VDYDWIOHUHDYGLVVHNDUWOHJJLQJVYHUNW¡\HQHHUK\SSLJEUXNWLVNROHQ 1nUGHWJMDOGWQ\WWHYHUGLHQDYPnOHLQVWUXPHQWHWLKYLONHQJUDGUHVXOWDWHQHYDUUHWWOHGHQGHIRU XQGHUYLVQLQJHQLQGLNHUWHIXQQDWI¡ULQJHUIRUSUDNVLVLVWRUJUDGYDUEDVHUWSnO UHUQHV
XIRUPHOOHYXUGHULQJHUIUHPIRULQIRUPDVMRQHQVRPIUHPNRPDYUHVXOWDWHQHIUDNDUWOHJJLQJHQH
)RUPnOHWPHGVWXGLHQ
,QWHQVMRQHQPHGGHQQHVWXGLHQYDUnJMHQQRPI¡UHHQYXUGHULQJDYNRPSRQHQWHQHL 16/)U¡\HQHWDORJJUDGDYVDPVYDUPHG¡YULJHVSUnNNDUWOHJJLQJHU
.RPSRQHQWHQHL16/EDVHUHVSnWHRUHWLVNHRJSUDNWLVNHWLOQ UPLQJHUWLOVSUnNIRUWLOHJQHOVH DYNXQQVNDS'HQWHRUHWLVNHWLOQ UPLQJHQEDVHUHVSnWHRULHURJVWXGLHURPVSUnNXWYLNOLQJ EnGHJHQHUHOORJWRVSUnNOLJVSUnNXWYLNOLQJ'HWWHOnWLOJUXQQIRUXWYHOJHOVHDYNRPSRQHQWHQHL 16/NDWHJRULVHULQJYRNDEXODURJJUDPPDWLNN'HQSUDNWLVNHWLOQ UPLQJHQWRN
XWJDQJVSXQNWLDWNDUWOHJJLQJVYHUNW¡\HWVNXOOHY UHO UHUSODQRULHQWHUWYHGDWGHWYDUIRUHWDWW DQDO\VHUDYKYLONHNUDYVRPVWLOOHVWLOHOHYHQHVVSUnNIHUGLJKHWHUL.XQQVNDSVO¡IWHW/.
8WGDQQLQJVGLUHNWRUDWHW5HVXOWDWHQHEOHNRPELQHUWPHGDQDO\VHUDYRUGIUDO UHUE¡NHU LIDJHQHQRUVNPDWHPDWLNNVDPIXQQVIDJQDWXUIDJRJ.5/('LVVHDQDO\VHQHOnWLOJUXQQIRU XWYHOJHOVHQDYRUGHQHL16/'HWWHYDURUGEDUQQ¡GYHQGLJYLVLNNHHNVSRQHUHVIRUJMHQQRP GDJOLJGDJVHVDPWDOHU
+HQVLNWHQPHG16/HUnLGHQWLILVHUHHOHYHULEHKRYDYnVW\UNHQRUVNVSUnNOLJH IHUGLJKHWHULEDUQHVNROHQWULQQIRUGHUHWWHUnWLOUHWWHOHJJHRSSO ULQJHQEDVHUWSn
.$57/(**,1*$9635c.)(5',*+(7(5
UHVXOWDWHQHVRPIRUHOLJJHU'HQI¡UVWHYHUVMRQHQDY16/EOHIHUGLJVWLOWL
.DUWOHJJLQJVYHUNW¡\HWKDGGHGDY UWLJMHQQRPHQSLORWHULQJEDUQEOHNDUWODJWKYRU VDPPHQKHQJHUPHOORPUHVXOWDWHUSn16/RSSPRWUHVXOWDWHUSnGHVWDQGDUGLVHUWHVSUnNWHVWHQH 7HVWIRU5HFHSWLRQRI*UDPPDUQGHGLWLRQ752*%LVKRS/\VWHU +RUQ RJGHOSU¡YHQ2UGIRUVWnHOVHIUD:HFKVOHU,QWHOOLJHQFH6FDOHIRU&KLOGUHQWKHGLWLRQ:,6&
,9:HFKVOHUEOHXQGHUV¡NWIRUnPnOHNULWHULHYDOLGLWHW'HWEOHIXQQHWVWHUNH
NRUUHODVMRQHUEnGHPHOORP16/RJ752*U RJPHOORP16/RJ2UGIRUVWnHOVHU 16/EOHGHUHWWHUQRUPHUWSnEDUQ(WWHUDW16/KDGGHY UWLEUXNLRYHUWUHnUEOH GHWIRUHWDWWHQQ\QRUPHULQJ'HQQHUHQRUPHULQJHQYDUKRYHGVDNHOLJEDVHUWSn
WLOEDNHPHOGLQJHUIUDSUDNVLVIHOWHWRJPHGHWIRUPnORPnVXSSOHUHDQWDOOHOHYHUL
QRUPHULQJVJUXQQODJHW'HQQ\HYHUVMRQHQDY16/EOHIHUGLJVWLOWL)U¡\HQHWDO ,GHWWHDUEHLGHWEOHGHWLNNHIRUHWDWWQ\HVDPPHQOLNQLQJHUPHGDQGUHVWDQGDUGLVHUWH
VSUnNWHVWHU16/EOHLPLGOHUWLGEUXNWIRUnLGHQWLILVHUHPLQRULWHWVVSUnNOLJHEDUQLEHKRYDY VSUnNVW¡WWHWLOHQLQWHUYHQVMRQVVWXGLHKYRUGHWRJVnEOHEHQ\WWHWDQGUH
VSUnNNDUWOHJJLQJVYHUNW¡\IRUnYXUGHUHEDUQDVIHUGLJKHWHU+HOOHU/HUYnJ *U¡YHU 9HGnLQNOXGHUHXWYDOJHWIUDLQWHUYHQVMRQVVWXGLHQVDPPHQPHGQRUPHULQJVXWYDOJHWWLO16/
IUDIRNXVHUHUGHQQHVWXGLHQVSHVLHOWSnnEHVYDUHI¡OJHQGHIRUVNQLQJVVS¡UVPnO ,KYLONHQJUDGHUGHQLQGUHNRQVLVWHQVHQL16/WLOIUHGVVWLOOHQGHUHOLDELOLWHW"
,KYLONHQJUDGHUVWUXNWXUHQL16/EHVWIRUNODUWJMHQQRPHQHQIDNWRUPRGHOOHOOHUHQ IOHUIDNWRUPRGHOOEHJUHSVYDOLGLWHW"
,KYLONHQJUDGYLVHU16/LQYDULDQVRYHUVSUnNVWDWXVNM¡QQRJNODVVHWULQQ"
,KYLONHQJUDGHUGHWVDPVYDUPHOORP16/RJDQGUHVWDQGDUGLVHUWHVSUnNNDUWOHJJLQJHU NULWHULHYDOLGLWHW"
.$57/(**,1*$9635c.)(5',*+(7(5
0HWRGH 'HOWDNHUH
,GHQQHVWXGLHQEOHGHWEHQ\WWHWWRXWYDOJ'HWI¡UVWHXWYDOJHWYDU
QRUPHULQJVJUXQQODJHWWLO16/IUDVRPEHVWRGDYHOHYHUWULQQIRUGHOWSn VNROHUDYEDUQHJUXSSHQYDUHQVSUnNOLJHMHQWHUJMHQQRPVQLWWVDOGHU PnQHGHU6$ PnQHGHU'HQQHVHOHNWHULQJHQYDUEDVHUWSnDWXWYDOJHWVNXOOH
JMHQVSHLOHGHQIOHUNXOWXUHOOHSRSXODVMRQHQLVNROHQ'HWEOHJMHQQRPI¡UWHWWLOIHOGLJXWYDOJDY nWWHVNROHUIUDKYHUVNROHJUXSSHL2VORPHGNUDYRPDWDQGHOHQPLQRULWHWVVSUnNOLJHHOHYHU XWJMRUGHDYXWYDOJHWcWWHHOHYHUIUDKYHUVNROHIRUGHOWSnWRWULQQRJWULQQHOOHU RJWULQQEOHWLOIHOGLJYDOJWXWHWWHULQQKHQWLQJDYIRUHVDWWHVVDPW\NNH7RWDOW
PLQRULWHWVVSUnNYDUUHSUHVHQWHUWKYRUXUGXHQJHOVNDUDELVNVRPDOLYLHWQDPHVLVNRJVSDQVN XWJMRUGHcWWHEDUQEOHNDUWODJWSnKYHUDYVNROHQHHQWHQNRPELQDVMRQHQRJ WULQQVHOHYHUHOOHURJWULQQVHOHYHU,QJHQDYEDUQDKDGGHYHGWDNRPVSHVLDOXQGHUYLVQLQJ 2SSO ULQJVORYHQVRJLQJHQDYGHPLQRULWHWVVSUnNOLJHEDUQDKDGGHYHGWDNRPV UVNLOW QRUVNRSSO ULQJ2SSO ULQJVORYHQV
8WYDOJ,,EHVWRGDYEDUQRJWULQQIRUGHOWSnVNROHUDOOH
PLQRULWHWVVSUnNOLJHHOHYHUMHQWHUJMHQQRPVQLWWVDOGHU PnQHGHU6$
PnQHGHU,GHWWHXWYDOJHWEOH16/EHQ\WWHWVRPVFUHHQHUIRUnLGHQWLILVHUHHOHYHUPHG PDQJHOIXOOHQRUVNVSUnNOLJHIHUGLJKHWHUIRUGHOWDNHOVHLHQUDQGRPLVHUWNRQWUROOHUWVWXGLHVRP YXUGHUWHHIIHNWHQDYHQVSUnNLQWHUYHQVMRQ+HOOHUHWDO0LQRULWHWVVSUnNOLJHEDUQVRP VNnUHWVWDQGDUGDYYLNHOOHUPHUXQGHUJMHQQRPVQLWWHWSn16/EOHLQYLWHUWWLOnGHOWDL VWXGLHQcWWHWLOWROYEDUQIUDKYHUDYVNROHQHEOHWLOIHOGLJYDOJWXWHWWHULQQKHQWLQJDY IRUHVDWWHVVDPW\NNH7RWDOWVSUnNYDUUHSUHVHQWHUWKYRUXUGXDUDELVNVRPDOLNXUGLVN W\UNLVNRJWDPLOVNXWJMRUGH$OOHHOHYHQHNYDOLILVHUWHIRUV UVNLOWQRUVNRSSO ULQJHWWHU 2SSO ULQJVORYHQV
.$57/(**,1*$9635c.)(5',*+(7(5
0nOHLQVWUXPHQWHU
1RUVN6RP/ ULQJVVSUnN16/)U¡\HQHWDOEHVWnUDYWHVWOHGG IRUGHOWSnGHOSU¡YHURJPnOHUHOHYHQVIHUGLJKHWHULQQHQIRUNDWHJRULVHULQJYRNDEXODU EUHGGHRJG\EGHRJJUDPPDWLNN'HWWHHURSSJDYHUVRPVWLOOHUNUDYWLOVSUnNIRUVWnHOVH LPSUHVVLYHIHUGLJKHWHURJPXQWOLJHVSUnNIHUGLJKHWHUHNVSUHVVLYHIHUGLJKHWHU
.DWHJRULVHULQJYXUGHUHUHYQHQWLOnVHUHODVMRQHURJV\VWHPDWLVHUHRUGYHGDWEDUQHWSHNHUSn KYLONHELOGHUVRPK¡UHUVDPPHQ'HWWHPnOHVJMHQQRPGHOSU¡YHQHPDWFKLQJDYNDWHJRULHU 0.WHVWOHGGJHQHUDOLVHULQJDYNDWHJRULHU*.WHVWOHGG9RNDEXODUPnOHUVW¡UUHOVHQ SnYRNDEXODUHWJMHQQRPSHNLQJLPSUHVVLYRJEHQHYQLQJDYELOGHUHNVSUHVVLYPHGDQGUH RUGEUHGGHQLHOHYHQVRUGIRUUnG'HWWHYXUGHUHVJMHQQRPGHOSU¡YHQHRUGIRUVWnHOVHLPSUHVVLY 2),WHVWOHGGRUGIRUVWnHOVHHNVSUHVVLY2)(WHVWOHGG$QWRQ\PHUV\QRQ\PHUVWLOOHU NUDYWLOnVDPPHQOLNQHOLNKHWHURJIRUVNMHOOHUPHOORPRUGSnHWPHUDEVWUDNWQLYnRJPnOHU G\EGHQLRUGIRUUnGHWYHGDWEDUQHWVNDOILQQHGHWPRWVDWWHRUGHWHOOHUHWRUGVRPEHW\UGHW VDPPHVRPGHWVRPEOLURSSOHVW'\EGHYRNDEXODUHWPnOHVJMHQQRPGHOSU¡YHQHDQWRQ\PHU
$17WHVWOHGGV\QRQ\PHU6<1WHVWOHGG*UDPPDWLNNYXUGHUHUVHWQLQJVIRUVWnHOVH LPSUHVVLYKYRUHOHYHQInURSSOHVWHQRJHQVHWQLQJIRUVnnSHNHXWULNWLJELOGHWLOVHWQLQJHQ 'HWWHPnOHVJMHQQRPGHOSU¡YHQHDGMHNWLY$'-WHVWOHGGSUHSRVLVMRQHU35(WHVWOHGG SURQRPHQ352WHVWOHGGRJDGYHUE$'9WHVWOHGG$OOHGHOSU¡YHQHL16/HU
ELOGHEDVHUWPHGXQQWDNDYV\QRQ\PHU(WSRHQJJLVIRUKYHUWULNWLJVYDURJQXOOSRHQJIRUIHLO VYDU.DUWOHJJLQJHQWDULJMHQQRPVQLWWPLQXWWHURJDGPLQLVWUHUHVLQGLYLGXHOW
%ULWLVK3LFWXUH9RFDEXODU\6FDOHQGHGLWLRQ%396,,'XQQ'XQQ:KHWWRQ
%XUOH\/\VWHU+RUQ 5\JYROG'HWWHHUHQLPSUHVVLYVSUnNWHVWKYRUEDUQHWInU LRSSJDYHnLGHQWLILVHUHHWRUGVRPEOLUOHVWRSSDYWHVWOHGHUYHGnSHNHXWULNWLJELOGHEDVHUWSn ILUHDOWHUQDWLYHU'HQQRUVNHXWJDYHQDY%396,,EHVWnUDYWHVWOHGG
.$57/(**,1*$9635c.)(5',*+(7(5
&OLQLFDO(YDOXDWLRQRI/DQJXDJH)XQGDPHQWDOVWKHGLWLRQ&(/)6HPHO:LLJ 6HFRUG'HOSU¡YHQ(NVSUHVVLYW2UGIRUUnGNDUWOHJJHUHOHYHQVPXQWOLJH
EHQHYQLQJVIHUGLJKHWHU7HVWOHGHUYLVHUHWRJHWELOGHVRPEDUQHWGHUHWWHUVNDOEHQHYQH 'HOSU¡YHQKDUWHVWOHGG
:HFKVOHU3UHVFKRRODQG3ULPDU\6FDOHRI,QWHOOLJHQFHWKHGLWLRQ:336,,9 :HFKVOHU:HFKVOHU,QWHOOLJHQFH6FDOHIRU&KLOGUHQWKHGLWLRQ:,6&,9:HFKVOHU 'HOSU¡YHQ2UGIRUVWnHOVHPnOHUHOHYHQVHYQHWLOnJLHQGHILQLVMRQHOOHUHQIRUNODULQJDY HWRUGHNVSUHVVLY7HVWOHGHUOHVHURSSHWRJHWRUGIRUEDUQHW'HQQHGHOSU¡YHQLQQHKROGHU WHVWOHGG0HGEDNJUXQQLEDUQDVVSUnNIHUGLJKHWHUEOHHQNRPELQDVMRQEHVWnHQGHDYRUGIUD 2UGIRUVWnHOVHL:336,,9RJ:,6&,9EHQ\WWHW'HQQHYHUVMRQHQKDUWLGOLJHUHEOLWWEUXNWL QRUVNHVWXGLHUVRPYXUGHUWHHIIHNWHQDYVSUnNLQWHUYHQVMRQHU+DJHQ0HOE\/HUYnJ /HUYnJ5RJGH0HOE\/HUYnJ /HUYnJ
7HVWIRU5HFHSWLRQRI*UDPPDUQGHGLWLRQ752*%LVKRS/\VWHU +RUQ HUHQLPSUHVVLYVSUnNWHVWVRPNDUWOHJJHUHOHYHQVIRUVWnHOVHDYJUDPPDWLNN6HWQLQJHU EOLUOHVWRSSHQHWWHUHQRJEDUQHWVRSSJDYHHUnSHNHXWULNWLJELOGHEDVHUWSnILUHDOWHUQDWLYHU 7HVWHQEHVWnUDYWHVWOHGG
%XV6WRU\5HQIUHZHUHQQDUUDWLYWHVWVRPPnOHUHOHYHQVHYQHWLOnJMHQIRUWHOOH HQKLVWRULHHWWHUnKDInWWGHQRSSOHVWHNVSUHVVLY6HOYHKLVWRULHQEOLUIRUWDOWDYWHVWOHGHUYHG EUXNDYELOGHVW¡WWHELOGHU7HVWHQLQQHKDUWHVWOHGG
3URVHG\UH
'DWDJUXQQODJHWIRUGHQQHVWXGLHQEOHLQQKHQWHWRYHUWRSHULRGHUK¡VWHQRJ K¡VWHQ(OHYHQHLXWYDOJ,EOHNDUWODJWPHG16/K¡VWHQ.DUWOHJJLQJHQEOHIRUHWDWW SnVNROHQRJJMHQQRPI¡UWDYSHGDJRJLVNSV\NRORJLVNHUnGJLYHUHPHGWHVWNRPSHWDQVH 6DPWOLJHWHVWOHGHUHKDGGHJMHQQRPJnWWRSSO ULQJVNXUVHWL16/RJEHQ\WWHW
.$57/(**,1*$9635c.)(5',*+(7(5
NDUWOHJJLQJVYHUNW¡\HWLSUDNVLVLIRUNDQWDYGDWDLQQVDPOLQJHQ8WYDOJ,,EOHNDUWODJWPHG16/
RJGHIHPVWDQGDUGLVHUWHVSUnNWHVWHQH%396,,(NVSUHVVLYW2UGIRUUnGIUD&(/)
2UGIRUVWnHOVHIUD:336,,9:,6&,9752*RJ%XV6WRU\K¡VWHQ.DUWOHJJLQJHQ JMHQQRPI¡UWSnVNROHQDYI¡UVWHIRUIDWWHUVRPWLGOLJHUHKDUMREEHWVRPSHGDJRJLVN
SV\NRORJLVNUnGJLYHU
$QDO\VHU
5nVNnUHUEOHEHQ\WWHWLDOOHDQDO\VHQH)RUnEHVYDUHGHWI¡UVWHIRUVNQLQJVVS¡UVPnOHW EOHGHWI¡UVWIRUHWDWWDQDO\VHUDYGHQLQGUHNRQVLVWHQVHQVDPYDULDVMRQPHOORPLWHPHQHL16/
YHGEUXNDY&URQEDFKVDOSKDYHUGLHURYHUYXUGHUHVVRPWLOIUHGVVWLOOHQGH.OLQH 'HWDQGUHIRUVNQLQJVVS¡UVPnOHWEOHDGUHVVHUWJMHQQRPNRQILUPHUHQGHIDNWRUDQDO\VHUIRUn XQGHUV¡NHVWUXNWXUHQL16/$QDO\VHQHEOHXWI¡UWL0SOXVYHUVMRQ0XWKpQ 0XWKpQ 5HVXOWDWHQHEOHGHUHWWHUDQDO\VHUWEDVHUWSnNULWHULHUIRUIDNWRUODGQLQJHU
IDNWRUODGQLQJHUSnVW¡UUHOVHPHGHOOHUVW¡UUHHQQHOOHUEOLURIWHUHJQHWVRP EHW\GQLQJVIXOOHRJILWLQGHNVHUVRPJLULQIRUPDVMRQRPLKYLONHQJUDGGHQHVWLPHUWH IDNWRUPRGHOOHQSDVVHUWLOGHREVHUYHUWHGDWDHQH%URZQ+XRJ%HQWOHU DQEHIDOHUYHUGLHUUXQGWVRPWLOIUHGVVWLOOHQGHSnWKH5RRW0HDQ6TXDUHRI(UURURI
$SSUR[LPDWLRQ506($&RPSDUDWLYH)LW,QGH[&),RJ7XFNHU/HZLV,QGH[7,/E¡U OLJJHSnHOOHUK¡\HUHPHQVWKH6WDQGDUGL]HG5RRW0HDQ6TXDUH5HVLGXDO6505E¡U Y UHPLQGUHHQQ.MLNYDGUDWGLIIHUDQVHWHVWEOHEUXNWIRUnWHVWHIRUVNMHOOHQPHOORP IDNWRUPRGHOOHQH'HQWHVWHUKYRUYLGWNRUUHODVMRQHQHPHOORPIDNWRUHQHHUVLJQLILNDQW IRUVNMHOOLJIUD6LGHQNMLNYDGUDWGLIIHUDQVHWHVWHUVHQVLWLYIRUXWYDOJVVW¡UUHOVHEOH YXUGHULQJHQDYIDNWRUPRGHOOHQHVXSSOHUWPHG%D\HVLDQLQIRUPDVMRQVNULWHULXP%,&%,&
EUXNHVIRUnVDPPHQOLNQHPRGHOOHUKYRUPRGHOOHQPHGODYHVW%,&YHUGLKDUEHVWWLOSDVQLQJ .OLQH'HWWUHGMHIRUVNQLQJVVS¡UVPnOHWEOHEHVYDUWJMHQQRPDQDO\VHUDYLQYDULDQVYHG
.$57/(**,1*$9635c.)(5',*+(7(5
EUXNDYIOHUJUXSSHNRQILUPHUHQGHIDNWRUDQDO\VHU)RUXWYDOJHWEOHGHWJMHQQRPI¡UW DQDO\VHUIRUVSUnNVWDWXVNM¡QQRJDOGHUVWULQQPHQVGHWIRUXWYDOJHWNXQYDUPXOLJn DQDO\VHUHLQYDULDQVIRUNM¡QQSnJUXQQDYXWYDOJVVW¡UUHOVHQYDUWULQQVHOHYHU7LO VOXWWEOHGHWIRUHWDWWHQVDPPHQOLNQLQJDY16/RJGHIHPVWDQGDUGLVHUWHVSUnNWHVWHQH%396 ,,(NVSUHVVLYW2UGIRUUnGIUD&(/)2UGIRUVWnHOVHIUD:336,,9:,6&,9752*RJ
%XV6WRU\JMHQQRPNRUUHODVMRQHOOHDQDO\VHUIRUnEHVYDUHGHWIMHUGHIRUVNQLQJVVS¡UVPnOHWRP NULWHULHYDOLGLWHW
5HVXOWDWHU
'HVNULSWLYLQIRUPDVMRQRPJMHQQRPVQLWWVWDQGDUGDYYLNRJUHOLDELOLWHWHUIUHPVWLOWL WDEHOOPHQVWDEHOOYLVHUNRUUHODVMRQHQHPHOORPGHOSU¡YHQHL16/6RPGHWIUHPNRPPHU DYWDEHOOHUGHWIRUVNMHOOHUPHOORPGHWRXWYDOJHQHQnUGHWJMHOGHUNRUUHODVMRQHUPHOORP GHOSU¡YHQHL16/'HOSU¡YHQHPDWFKLQJDYNDWHJRULHURJJHQHUDOLVHULQJDYNDWHJRULHU NRUUHOHUHULOLWHQJUDGPHGGH¡YULJHGHOSU¡YHQHLXWYDOJHWVDPPHQOLNQHWPHG XWYDOJHW1nUGHWJMHOGHUGHWI¡UVWHIRUVNQLQJVVS¡UVPnOHWLKYLONHQJUDGGHQLQGUH
NRQVLVWHQVHQL16/HUWLOIUHGVVWLOOHQGHYLVHUUHVXOWDWHQHWLOIUHGVVWLOOHQGHLQGUHNRQVLVWHQVIRU EHJJHXWYDOJHQHPHG&URQEDFKVDOIDRYHUVHWDEHOO
>7DEHOOLQQKHU@
>7DEHOOLQQKHU@
I hvilken grad er strukturen i NSL best forklart gjennom en en-faktormodell eller en fler-faktormodell (begrepsvaliditet)?
)RUnNXQQHYXUGHUHVWUXNWXUHQL16/EOHGHWI¡UVWHVWLPHUWIDNWRUPRGHOOHUIRU XWYDOJHWKYRUHQHQIDNWRUPRGHOOIRUVSUnNEHVWnHQGHDYDOOHGHGHOSU¡YHQHL16/EOH