• No results found

5.7 V ALIDITY AND R ELIABILITY C ONCERNS

5.7.1 Qualitative Research

7KH UHVHDUFK TXHVWLRQV RI WKLV WKHVLV UHTXLUH D PL[HG SURFHVV RI YDOLGDWLRQ XVLQJERWKTXDOLWDWLYHDQGTXDQWLWDWLYHDSSURDFKHVWRYDOLGDWLRQ

5.7.1 Qualitative Research

5.7.1.1 Focus Group Interviews

)RFXVJURXSLQWHUYLHZVZHUHXVHGDVDVRXUFHRIGDWDIRU3DSHUV,,,DQG,9 )RFXVJURXSUHVHDUFKLVYXOQHUDEOHWRZHDNQHVVHVLQWKHZRUNLQJSURFHVV LQ WKHSURJUHVVLRQIURPSODQQLQJDQGGHVLJQWKURXJKWKHDFWXDOGDWDFROOHFWLRQ WR GDWD DQDO\VLV DQG LQWHUSUHWDWLRQ 7KLV GLVFXVVLRQ IRFXVHV SULPDULO\ RQ GHVFULSWLYHLQWHUSUHWLYHDQGWKHRUHWLFDOYDOLGLW\-RKQVRQ'HVFULSWLYH YDOLGLW\ UHIHUV WR WKH IDFWXDO DFFXUDF\ RI DQ DFFRXQW DV UHSRUWHG E\ WKH UHVHDUFKHUV ,QWHUSUHWLYH YDOLGLW\ UHIHUV WR WKH GHJUHH WR ZKLFK WKH UHVHDUFK SDUWLFLSDQWV¶ YLHZSRLQWV WKRXJKWV IHHOLQJV LQWHQWLRQV DQG H[SHULHQFHV DUH DFFXUDWHO\ XQGHUVWRRG DQG UHSRUWHG E\ WKH UHVHDUFKHU )LQDOO\ WKHRUHWLFDO YDOLGLW\ UHIHUV WRWKH GHJUHH WKDW D WKHRUHWLFDO H[SODQDWLRQ GHYHORSHG IURP D UHVHDUFKVWXG\ILWVWKHGDWDDQGWKHUHIRUHLVFUHGLEOHDQGGHIHQVLEOH-RKQVRQ

Descriptive validity: 7KH UHFRUGLQJ RI LQWHUYLHZV DQG WUDQVFULSWLRQ RI UHFRUGLQJV KHOSHG WR HQVXUH GHVFULSWLYH YDOLGLW\ 7KH ZULWWHQ UHFRUGV ZHUH VXSSOHPHQWHGZLWKREVHUYDWLRQVRILQWHUDFWLRQVIURPQRWHV7KHUHZDVDULVN RI RPLWWLQJ SRLQWV WKDW ZHUH HVVHQWLDO IRU XQGHUVWDQGLQJ WKH LQWHUYLHZV 0D[ZHOO$QDO\VHVRILQWHUDFWLRQVLQWKHLQWHUYLHZVDOVRLQFOXGHGWKH JURXSV¶SRVVLEOHFRQIRUPLW\DQGFRQFHLYDEO\IDOVHFRQVHQVXVHV$FFXUDF\LQ WKH UHFRUGV RI ZKDW ZDV VDLG DQG GRQH ZDV LPSRUWDQW WR HQVXUH GHVFULSWLYH YDOLGLW\-RKQVRQ

Interpretive validity:5HVHDUFKHUELDVWKHULVNRIDOORZLQJSHUVRQDOYLHZVDQG SHUVSHFWLYHV WR DIIHFW GDWD FROOHFWLRQ DQG LQWHUSUHWDWLRQ WKURXJK VHOHFWLYH REVHUYDWLRQVDQGVHOHFWLYHUHFRUGLQJRILQIRUPDWLRQ-RKQVRQ0D[ZHOO ZDV UHOHYDQW WR WKLV UHVHDUFK EHFDXVH RI P\ IRUPHU H[SHULHQFH DV D PDQDJHURIDWRXULVWRUJDQL]DWLRQZLWKUHJXODUFRQWDFWZLWKGLUHFWRUV,VKRXOG QRW LQIOXHQFH WKH UHVSRQGHQWV LQ WKH VHQVH RI DVNLQJ OHDGLQJ TXHVWLRQV RU H[SUHVVLQJ TXHVWLRQV DQG FRPPHQWV LQ OHDGLQJ ZD\V VXFK DV EULQJLQJ P\

RZQ RSLQLRQV RU H[SHULHQFHV LQWR WKH LQWHUYLHZV 5HIOH[LYLW\ LQ WHUPV RI

FULWLFDO VHOIUHIOHFWLRQ ZDV QHFHVVDU\ WR GHDO ZLWK SRWHQWLDO ELDVHV DQG SUHFRQFHSWLRQV-RKQVRQ )RUWKLVUHDVRQWKHPRGHUDWRU¶VUROHLQWKH IRFXVJURXSLQWHUYLHZVIRUPHGDQDWXUDOSDUWRIWKHDQDO\VHVWRUHGXFHELDV VWHPPLQJIURPP\UROH

2Q WKH RWKHU KDQG P\ SHUVRQDO EDFNJURXQG IURP WKLV SDUW RI WKH WRXULVP LQGXVWU\ DQG IRUPHU H[SHULHQFH ZLWK FRUSRUDWH JRYHUQDQFH PDGH LW HDVLHUWR DVNUHOHYDQWTXHVWLRQVDQGIROORZXSRQZKDWZDVVDLGGXULQJWKHLQWHUYLHZV )RUPXODWLQJTXHVWLRQVDQGVWDWHPHQWVUHSKUDVLQJZKDWSDUWLFLSDQWV KDGVDLG LQ WKHLU RZQ ZRUGV SURSRVLQJ YLHZV WR HOLFLW D UHVSRQVH DQG VHOHFWLQJ DQG FKDOOHQJLQJVSHDNHUVDUHLPSRUWDQWWHFKQLTXHVWRNHHSWKHJURXSRQWRSLFWR SXVK WKH WRSLF EH\RQG ZKDW KDV DOUHDG\ EHHQ VDLG DQG WR H[SORUH WKH XQGHUO\LQJFRQGLWLRQVV\VWHPDWLFDOO\0DFQDJKWHQ 0\HUV+RZHYHU LIWKHRSLQLRQVH[SUHVVHGE\WKHSDUWLFLSDQWVDSSHDUWRKDYHEHHQSODQWHGE\

WKH PRGHUDWRU GLUHFWO\ RU WKURXJK VRPH LPSOLFLW LQIOXHQFH WKHQ YDOLGLW\ LV FDOOHGLQWRTXHVWLRQ$VVRFLDWHGZLWKWKLVUHVHDUFKZDVDULVNRIUHDFWLYLW\WKH LQIOXHQFH RI WKH UHVHDUFKHU RQ WKH VHWWLQJ RU LQGLYLGXDOV VWXGLHG 0D[ZHOO ([SOLFLWQHVV DERXW VXFK LQHYLWDEOH UHVHDUFKHU ELDVHV LV D PLQLPXP UHTXLUHPHQW0LOHV +XEHUPDQ=DKUDDQG5\DQUHIOHFWRQWKH UHVHDUFKHU DV DQ DFWRU DQG DXGLHQFH LQ WKH ZRUOG RI WRXULVW RUJDQL]DWLRQV VWDWLQJWKDW³NQRZOHGJHDFTXLVLWLRQEHFRPHVDSURFHVVRIDJHQGDVHWWLQJDQG WKH UHVHDUFKHU EHFRPHV DQ DFWRU DV ZHOO DV REVHUYHU SDUWLFLSDQW DV ZHOO DV E\VWDQGHU\HWWUDGLWLRQDOO\UHVHDUFKUHTXLUHVGHWDFKPHQW´S

&ROODERUDWLRQ ZLWK D FRDXWKRU ODFNLQJ VLPLODU IDPLOLDULW\ ZLWK WKH UHVHDUFK FRQWH[WUHGXFHGWKHHIIHFWRIUHVHDUFKHUELDVWKURXJKLQYHVWLJDWRUWULDQJXODWLRQ -RKQVRQ :H GHWHUPLQHG WKH LQWHUYLHZ FRQWHQW DQG GHYHORSHG WKH LQWHUYLHZ JXLGH WRJHWKHU UHYLHZHG WUDQVFULSWV DQG GLVFXVVHG SDUWV RI GDWD FRGLQJ DQG DQDO\VHV WRJHWKHU , ZDV FKDOOHQJHG RQ WKH EDVLV RI H[SOLFLW LQWHUSUHWDWLRQV DQG UHVXOWV RQ D FRXSOH RI RFFDVLRQV EXW ZH IRXQG IHZ VLJQLILFDQWUHDVRQVWRIHDUUHVHDUFKHUELDVRUUHDFWLYLW\LQWKHUHVXOWV

3DUWLFLSDQWV LQ D JURXS LQWHUYLHZ PD\ EH PRWLYDWHG WR SURYLGH VRFLDOO\

DFFHSWDEOH UHVSRQVHV WR FRQIRUP WR JURXS QRUPV %HFDXVH WKH IRFXV JURXS LQWHUYLHZ LV DQ DUWLILFLDO VHWWLQJ IDOVH FRQVHQVXV DPRQJ WKH SDUWLFLSDQWV LVD SRVVLEOH HIIHFW 6WHZDUW HW DO 7KLV HIIHFW PD\ EH JUHDWHU LQ D JURXS WKDQLQDQRQ\PRXVVXUYH\TXHVWLRQQDLUHVRULQGLYLGXDOLQWHUYLHZVDQGLWPD\

EH HYHQ JUHDWHU DPRQJ GLUHFWRUV ZKHQ VRPHRQH ZLWK GRPLQDQW LQIOXHQFH PRGHUDWRU PDQDJHU RU RWKHU UHVSRQGHQW LV SUHVHQW 7KH H[FOXVLRQ RI PDQDJHUV IURP LQWHUYLHZV ZDV LQWHQGHG WR UHGXFH WKLV VRXUFH RI HUURU +RZHYHUWKLVUHPRYHGWKHSRVVLELOLW\RIREVHUYLQJLQWHUHVWLQJGLIIHUHQFHVRI RSLQLRQEHWZHHQGLUHFWRUVDQGPDQDJHUV

,W LV GLIILFXOW WR SUHGLFW LQ DGYDQFH HIIHFWV VXFK DV UHDFWLYLW\ VRFLDOO\

DFFHSWDEOHUHVSRQVHVIDOVHFRQVHQVXVGRPLQDWLRQE\NH\UHVSRQGHQWVRUWKH SRVVLEOHZD\VLQZKLFKUHVSRQGHQWVDGMXVW7RPLQLPL]HWKLVULVNRIELDVZH FKRVHJURXSVIRUWKHLQWHUYLHZVWKDW,GLGQRWNQRZSHUVRQDOO\)XUWKHUPRUH ZH FKRVH WR GR WKH LQWHUYLHZV ZLWK HVWDEOLVKHG ERDUG JURXSV ZKHUH WKH LQWHUYLHZVDOORZHGUHVSRQGHQWVWRUHDFWDQGEXLOGXSRQWKHUHVSRQVHVRIRWKHU ERDUG PHPEHUV 7KLV LV ZKDW QDWXUDOO\ RFFXUV LQ WKH ERDUGURRP DV ERDUG PHPEHUV DUH H[SHFWHG WR GLVFXVV DQG FKDOOHQJH SURSRVHG GHFLVLRQV LQGHSHQGHQWO\DQGWRFRQWULEXWHWRWKHVXFFHVVRIERDUGPHHWLQJV(SVWHLQ 5R\,QWKHERDUGURRPDQGLQWKHIRFXVJURXSUHVSRQGHQWVSUHVHQWHG GHIHQGHGDQGMXVWLILHGWKHLUSURSRVDOVDQGPHWFRXQWHUDUJXPHQWVIURPRWKHU GLUHFWRUV2QWKHRWKHUKDQGUXQQLQJIRFXVJURXSVLQDERDUGGXULQJDERDUG PHHWLQJFRXOGDFWLYDWHWKHXVXDOJURXSG\QDPLFVLQWKHERDUGZKLFKLQLWVHOI FRXOG DIIHFW WKH DQVZHUV DQG EH D SRVVLEOH VRXUFH RI ELDV 7KH YDOLGLW\ RI IRFXV JURXS GDWD LV DIIHFWHG E\ WKH H[WHQW WR ZKLFK SDUWLFLSDQWV IHHO FRPIRUWDEOH DERXW RSHQO\ FRPPXQLFDWLQJ WKHLU LGHDV YLHZV RU RSLQLRQV 6WHZDUWHWDO

*URXSWRJURXSYDOLGDWLRQJXLGHGWKHLQWHUSUHWDWLRQRIGDWD%\DQDO\]LQJKRZ PDQ\ JURXSV RU SHRSOH LQ HDFK ERDUG PHQWLRQHG D WRSLF DQG KRZ PXFK HQHUJ\ D VSHFLILF WRSLF JHQHUDWHG DPRQJ WKH SDUWLFLSDQWV WRSLFV ZHUH LGHQWLILHGWKDWGHVHUYHGHPSKDVLV0RUJDQ*URXSWRJURXSYDOLGDWLRQ JDYH JURXQGV IRU KLJKOLJKWLQJ WKH XQDQLPLW\ RQ ERDUG UROHV DQG UHVSRQVLELOLWLHVDVDNH\ILQGLQJRIWKLVVWXG\DQGGLVFXVVLQJWRSLFVUHODWHGWR IXQGLQJ DQG UHVRXUFHV 7KLV W\SH RI YDOLGDWLRQ LV D ZD\ WR LGHQWLI\ ERWK FRQVHQVXVDQGFRQWURYHUVLHV,QWHUPVRILQWHUSUHWLYHYDOLGLW\-RKQVRQ GLUHFW TXRWDWLRQV DUH XVHG IUHTXHQWO\ LQ 3DSHU ERWK YHUEDWLP IURP LQGLYLGXDO GLUHFWRUV DQG ORZ LQIHUHQFH GHVFULSWRUV RI FRQYHUVDWLRQ EHWZHHQ VHYHUDOGLUHFWRUV

Theoretical validity: ,Q WHUPV RI WKHRUHWLFDO YDOLGLW\ WKH UHVHDUFK TXHVWLRQV WKDW WKH IRFXV JURXS VWXG\ VHHNV WR DQVZHU DUH WUHDWHG LQ WZR ZD\V 7KH LQWHUSUHWDWLRQ RI ZKDW ERDUGV RI GLUHFWRUV LQ WRXULVW RUJDQL]DWLRQV GR ZDV JXLGHGE\WKHFDWHJRUL]DWLRQRIERDUGUROHVE\=DKUDDQG3HDUFHZKLOH WKHTXHVWLRQRIZKRPWKHGLUHFWRUVVHHWKHPVHOYHVZRUNLQJIRUZDVDQDO\]HG E\ PHDQVRIHOHPHQWVRIWKUHHWKHRUHWLFDOSHUVSHFWLYHVDJHQF\VWDNHKROGHU DQG VKDUHKROGHU 7KH ILUVW HQWDLOHG WKH SRVVLELOLW\ RI H[SORULQJ ZKHWKHU WKLV FRPPRQFDWHJRUL]DWLRQRIERDUGUROHVZDVSUHVHQWLQFRUSRUDWHJRYHUQDQFHRI WRXULVWRUJDQL]DWLRQV7KHODWWHUFDQEHFRQVLGHUHGWKHRU\WULDQJXODWLRQZKLFK SURYLGHVLQVLJKWVDQGH[SODQDWLRQVWKDWDUHPRUHFRJHQW-RKQVRQ

5.7.1.2 Case Study

7KH FDVH VWXG\ SUHVHQWHG LQ 3DSHU ,9 GLIIHUV VOLJKWO\ IURP WKH RWKHUV LQ LWV PHWKRGRORJ\DQGDSSURDFKWRFRUSRUDWHJRYHUQDQFH7KHYDOLGLW\RIWKHFDVH VWXG\LVKHUHDVVHVVHGDJDLQVWZKDW*LEEHUW5XLJURNDQG:LFNLUHJDUG DV ULJRURXV FDVH VWXGLHV JLYLQJ DWWHQWLRQ WR LQWHUQDO YDOLGLW\ FRQVWUXFW YDOLGLW\H[WHUQDOYDOLGLW\DQGUHOLDELOLW\+RZHYHUYDOLGLW\FRQFHUQVDUHQRW SUHVHQWHG YHU\ WKRURXJKO\ LQ WKH SXEOLVKHG SDSHU PDNLQJ WKLV VWXG\ WKH ZHDNHVW LQ WKH WKHVLV LQ WKLV DVSHFW 7KLV VWXG\ KDV D UDWKHU GHVFULSWLYH FKDUDFWHUDQGWKHWKHRUHWLFDOYDOXHRI3DSHU,9ZRXOGXQGRXEWHGO\EHUDLVHG LI LW GLVFXVVHG YDOLGLW\ DQG UHOLDELOLW\ LVVXHV H[SOLFLWO\ 'HVFULSWLYH YDOLGLW\

-RKQVRQLVVWUHQJWKHQHGWKURXJKWKHDFFXUDF\ RIGHVFULSWLRQVXVHRI ORZLQIHUHQFHGHVFULSWRUVDQGWDEOHVWRSUHVHQWGDWD

Internal validity: ,QWHUQDO YDOLGLW\ UHIHUV WR WKH FDVXDO UHODWLRQVKLSV EHWZHHQ YDULDEOHVDQGUHVXOWV*LEEHUWHWDO³WKHLVVXHLVZKHWKHUWKHUHVHDUFKHU SURYLGHVDSODXVLEOHFDXVDODUJXPHQWORJLFDOUHDVRQLQJWKDWLVSRZHUIXODQG FRPSHOOLQJHQRXJKWRGHIHQGWKHUHVHDUFKFRQFOXVLRQV´S$FFRUGLQJ WR *LEEHUW HW DO D FOHDU UHVHDUFK IUDPHZRUN SDWWHUQ PDWFKLQJ DQG WKHRU\ WULDQJXODWLRQ FDQ HQKDQFH WKH LQWHUQDO YDOLGLW\ RI FDVH VWXGLHV ,Q DOO WKHVH DUHDV LPSURYHPHQWV FRXOG KDYH EHHQ PDGH WR UDLVH WKH FDVH VWXG\

EH\RQG WKH GHVFULSWLYH 7KH XVH RI PXOWLSOH UHVHDUFKHUV LQYHVWLJDWRU WULDQJXODWLRQ SDUWLFXODUO\ LQ WKH LQWHUSUHWDWLRQ RI GDWD ZRXOG KDYH KHOSHG VWUHQJWKHQWKHFRQFOXVLRQVDQGLQFUHDVHWKHVWXG\¶VWUXVWZRUWKLQHVVFI.YDOH %ULQNPDQQ 7KDW VDLG <LQ FODLPV WKDW LQWHUQDO YDOLGLW\ LV OHVVUHOHYDQWIRUGHVFULSWLYHDQGH[SORUDWLYHFDVHVWXGLHVVXFKDVWKLV

'HILQLQJDQDQDO\WLFDOIUDPHZRUNDVSUHVHQWHGLQ6HFWLRQDQGVSHFLI\LQJ WKHRUHWLFDOSURSRVLWLRQVGRQRWPHDQWKDWVWXGLHVPXVWIROORZDULJLGUHVHDUFK GHVLJQ<LQ2QWKHFRQWUDU\WKLVODVWVWXG\RISXEOLFVHFWRUSRZHUZDV LQFOXGHG LQ WKH WKHVLV SDUWO\ EHFDXVH RI LQLWLDO HYLGHQFH IURP WKH SUHYLRXV VWXGLHV&DVHVWXGLHVDUHFRQVLGHUHGPRVWDSSURSULDWHZKHQNH\YDULDEOHVDQG WKHLU UHODWLRQVKLSV DUH H[SORUHG LQ WKH HDUO\ SKDVHV RI D QHZ PDQDJHPHQW WKHRU\ *LEEHUW HWDO 'HVSLWHLWV HVWDEOLVKHG SRVLWLRQ LQ PDQDJHPHQW WKHRU\ FRUSRUDWH JRYHUQDQFH KDV QRW EHHQ WKH IRFXV RI PXFK UHVHDUFK RQ WRXULVW RUJDQL]DWLRQV DQG HVSHFLDOO\ QRW LQ VWXGLHV RI WKH LQIOXHQFH RI WKH SXEOLFVHFWRU$FDVHVWXG\H[DPLQHVSKHQRPHQDLQWKHLUFRQWH[WVUDWKHUWKDQ LQGHSHQGHQWO\ ZKLFK *LEEHUW HW DO HPSKDVL]H DV D NH\ GLIIHUHQFH IURP RWKHU UHVHDUFK PHWKRGV 7KH SLORW VWXG\ DQG WKH LQLWLDO H[SORUDWLYH LQWHUYLHZV ZLWK GLUHFWRUV GLVFRYHUHG WKDW WKH SXEOLF VHFWRU LV RI FUXFLDO LPSRUWDQFHWRWKHWRXULVWRUJDQL]DWLRQV¶FRUSRUDWHJRYHUQDQFHDQGVXSSRUWIRU WKLV ILQGLQJ ZDV IRXQG LQ SUHYLRXV UHVHDUFK 7KXV D FDVH VWXG\ GHVLJQ ZDV FKRVHQ IRU 3DSHU ,9 WR LQYHVWLJDWH SXEOLF VHFWRU SRZHU DW D PDFUR OHYHO IRFXVLQJRQWKHV\VWHPRIFRUSRUDWHJRYHUQDQFHLQDFRXQWU\

Construct validity: $FFRUGLQJ WR *LEEHUW HW DO FRQVWUXFW YDOLGLW\ LQ TXDOLWDWLYHUHVHDUFKUHIHUVWRWKHH[WHQWWRZKLFKDVWXG\LQYHVWLJDWHVZKDWLW FODLPV WR LQYHVWLJDWH WKH FRQFHSWXDOL]DWLRQ RU RSHUDWLRQDOL]DWLRQ RI UHOHYDQW FRQFHSWV ³3RZHU´ DQG ³SXEOLF VHFWRU´ DUH NH\ FRQFHSWV LQ 3DSHU ,9 FRQFHSWXDOL]HGZLWKLQWKHFRUSRUDWHJRYHUQDQFHIUDPHDVIROORZV

,QWKHILHOGRIRUJDQL]DWLRQVDQGLQWKLVVWXG\LWLVLQHYLWDEOHWRDVVRFLDWHWKH FRQFHSW RI SRZHU ZLWK IRUPDO UROHV LW UHIHUV WR D FKDUDFWHULVWLF RI DQG WKH RIILFLDO DQG IRUPDO ULJKWV DWWDFKHG WR D SRVLWLRQ LQ WKH FKDLQ RI FRPPDQG +DQGHO*DUQHVS

,WFDQEHGLIILFXOWWRGLVWLQJXLVKWKHDFWLYLWLHVRIHOHFWHGRIILFLDOVIURPWKRVH RI WKH SXEOLF DGPLQLVWUDWLRQ DQG DXWKRULWLHV +DOO 7KXV WKLV VWXG\

XVHV³SXEOLFVHFWRU´DVDFROOHFWLYHWHUPWKDWHPEUDFHVSXEOLFDXWKRULWLHVRQ DOOOHYHOVDVZHOODVEXUHDXFUDFLHVRUDJHQFLHVWKDWHQDFWDQGLPSOHPHQWWKH GHFLVLRQRISROLWLFLDQV*DUQHVS

$VFULELQJ SRZHU WR IRUPDO UROHV DQG WUHDWLQJ WKH SXEOLF VHFWRU DV D XQLWDU\

VWUXFWXUH GHILQH WKH VWXG\¶V IRFXV %URDGHU GHILQLWLRQV RI SRZHU FRXOG KDYH KHOSHGLQLGHQWLI\LQJPDWWHUVWKDWFRXOGEHMXVWDVVLJQLILFDQW)XUWKHUPRUHLW

ZRXOG DOVR EH YDOXDEOH WR GLVWLQJXLVK EHWZHHQ SXEOLF DFWRUV :LGHU FRQFHSWXDOL]DWLRQ ZRXOG WKXV EH LQWHUHVWLQJ EXW WKH VHOHFWHG GHILQLWLRQV DUH QRW D WKUHDW WR YDOLGLW\ TXLWH WKH FRQWUDU\ LV WUXH LQ WHUPV RI WKHLU RSHUDWLRQDOL]DWLRQ &RQVWUXFW YDOLGLW\ LV IXUWKHU LQFUHDVHG E\ XVLQJ PXOWLSOH VRXUFHV RI GDWD DQG PXOWLSOH UHVHDUFK PHWKRGV GDWD WULDQJXODWLRQ DQG PHWKRGVWULDQJXODWLRQ-RKQVRQ

External validity *HQHUDOL]DELOLW\ LQ D VWULFW VHQVH ZDV QRW WKH SXUSRVH RI HLWKHURIWKHTXDOLWDWLYHVWXGLHVLQWKLVWKHVLV:KHUHVWDWLVWLFDOJHQHUDOL]DWLRQ UHIHUV WR WKH JHQHUDOL]DWLRQ RI HPSLULFDO GDWD WR D SRSXODWLRQ WKH H[WHUQDO YDOLGLW\LVVXHLQWKLVFDVHLVZKHWKHULWLVSRVVLEOHWRJHQHUDOL]HWKHUHVXOWVWRD EURDGHU WKHRU\ *LEEHUW <LQ 2Q RQH KDQG WKH FDVH VWXG\ LQ SDSHU ,9 FDQ EH VHHQ DV D PXOWLSOH FDVH VWXG\ XVLQJ GDWD IURP YDULRXV RUJDQL]DWLRQV2QWKHRWKHUKDQGWKHFRQWH[WXDOIDFWRUVDWWKHPDFUROHYHODUH UHODWHGWRDVLQJOHFDVHLQRQHFRXQWU\$QDO\VHVDQGUHVXOWVDUHFORVHO\OLQNHG WR WKLV FRXQWU\ DQG IHZ DWWHPSWV DUH PDGH WR UDLVH WKH DQDO\VLV WR D PRUH JHQHUDODQGWKHRUHWLFDOOHYHO7KHGHVFULSWLYHFKDUDFWHUOLPLWVWKHFDVHVWXG\LQ WHUPV RI H[WHUQDO YDOLGLW\DQGLW FDQ RQO\ EHFRQVLGHUHGDVWDUWLQJ SRLQW IRU WKHRU\ GHYHORSPHQW FRQFHUQLQJ FRUSRUDWH JRYHUQDQFH DQG SXEOLF VHFWRU LQIOXHQFH

Reliability$UHFRPPHQGDWLRQWRHQKDQFHWKHUHOLDELOLW\RIWKHDQDO\VHV DQG HQKDQFH FDVH VWXG\ TXDOLW\ LV WR FRQVWUXFW D FDVH VWXG\ GDWDEDVH DQG WR VHSDUDWHWKHHYLGHQFHIURPWKHUHVHDUFKHU¶VLQWHUSUHWDWLRQLQILQGLQJV*LEEHUW HW DO <LQ 7KH TXDOLWDWLYH GDWD ZHUH RUJDQL]HG LQ :RUG DQG ([FHOILOHVDQGWKHTXDQWLWDWLYHGDWDLQDQ6366ILOH'RFXPHQWVZHUHXVHG IRUFRQWHQWDQDO\VHVWKDWLQYROYHGFDWHJRUL]LQJDQGFODVVLI\LQJVWDWHPHQWVDQG PDNLQJFKURQRORJLHVZLWKUHOHYDQWLQIRUPDWLRQ<LQ)RU3DSHU,9WKH VXUYH\ GDWD LQWHUYLHZV DQG DUFKLYDO GDWD ZHUH SODFHG LQWR RQH FDVH GHVFULSWLRQ ,Q WKH SDSHU WKH ILQGLQJV ZHUH SUHVHQWHG LQ WKH UHVXOWV VHFWLRQV ZLWKLQWHUSUHWDWLRQVRIILQGLQJVLQWKHGLVFXVVLRQVVHFWLRQVWRGLVWLQJXLVKWKHP FOHDUO\<LQ