FFI-rapport 2011/01020
Faryab Survey – wave 3
Bård Eggereide and Elin Marthinussen
Norwegian Defence Research Establishment (FFI) 31 May 2011
2 FFI-rapport 2011/01020
FFI-rapport 2011/01020
1122
P: ISBN 978-82-464-1913-8 E: ISBN 978-82-464-1914-5
Keywords
PRT
Spørreundersøkelse Afghanistan Operasjonsanalyse
Approved by
Frode Rutledal Project Manager
Espen Skjelland Director
FFI-rapport 2011/01020 3
English summary
The Faryab Survey wave 3 was conducted in April 2011 by the agency Afghan Center for Socio- Economic and Opinion Research (ACSOR). The questionnaire used in the survey has been developed by the Norwegian Defence Research Establishment (FFI) in co-operation with the Norwegian-led Provincial Reconstruction Team Maimanah (PRT Maimanah). It consists of approximately 50 questions covering the three main areas: Security, development and
governance, in line with both the Norwegian and the NATO-led International Security Assistance Force (ISAF) strategies.
In total, 1208 people in Faryab were interviewed. These ranged between 18 and 83 years of age.
50 % of the respondents were male and 50 % female.
The result from the survey shows a split perception on the security situation in Faryab. The national security forces, ANP and ANA, are seen as important security actors. Still, more than one out of three believes neither the police nor the army can operate by themselves and need the support from international forces.
Almost two out of three of the respondents say that aid projects (that have benefited the community) have been implemented in their area the last year. The biggest problems in the province are considered to be unemployment and illiteracy.
The respondents generally have a good impression of the provincial government. Nevertheless, 4 out of 5 state that corruption is a problem amongst the provincial government officials.
Despite the significant number of respondents in the survey, every poll suffers from limitations and biases. To get a better understanding of the uncertainty and gain a better picture of
development trends over time, FFI has an ambition to continue to conduct regularly surveys.
4 FFI-rapport 2011/01020
Sammendrag
Faryab Survey wave 3 ble gjennomført i april 2011 av Afghan Center for Socio-Economic and Opinion Research (ACSOR). Spørreskjemaet som ble brukt er utviklet av Forsvarets
forskningsinstitutt (FFI) i samarbeid med det norsk-ledede Provincial Reconstruction Team Maimanah (PRT Maimanah). Meningsmålingen består av ca. 50 spørsmål som dekker de tre hovedområdene: sikkerhet, utvikling og styresett, i tråd med strategiene som er lagt av norske myndigheter og den NATO-ledede International Security Assistance Force (ISAF).
Total ble 1208 personer intervjuet i Faryab. Disse var mellom 18 og 83 år. 50 % av respondentene var menn og 50 % kvinner.
Resultatet av meningsmålingen viser en delt oppfatning av sikkerhetssituasjonen i Faryab. De nasjonale sikkerhetsstyrkene blir sett på som viktige sikkerhetsaktører. Likevel mener mer enn en av tre at verken politiet eller hæren kan operere på egen hånd, men har behov for støtte fra internasjonale styrker.
Nesten to av tre respondenter sier at bistandsprosjekter har vært gjennomført i deres område det siste året. De største problemene i provinsen er arbeidsledighet og analfabetisme.
Respondentene har generelt et godt inntrykk av den provinsielle regjeringen. Imidlertid mener omtrent fire av fem at korrupsjon er et problem blant de provinsielle myndighetene.
På tross av det betydelige antall respondenter som ble intervjuet, er enhver spørreundersøkelse beheftet med begrensninger og usikkerhet. For å få et bedre innblikk i usikkerheten og få et bedre bilde av utviklingstendensene over tid legger derfor FFI opp til å gjennomføre slike undersøkelser regelmessig i Faryab.
FFI-rapport 2011/01020 5
Contents
Preface 6
1 Introduction 7
2 Faryab Survey Wave 3 7
2.1 Interview sample 8
2.2 Survey coverage 8
2.3 Advantages and disadvantages 9
3 Demographics 9
3.1 Age distribution 9
3.2 Gender 10
3.3 Ethnicity 10
3.4 Living standard 11
3.5 Literacy and education 12
4 Main findings 12
4.1 Security 13
4.1.1 Security situation 13
4.1.2 Key security actors 14
4.2 Development 16
4.3 Governance 18
5 Conclusions 18
References 20
6 FFI-rapport 2011/01020
Preface
This report is written under the auspices of the project "Analysis support to military operations"
(ANTILOPE) at the Norwegian Defence Research Establishment (FFI). The aim of this project is to establish a pool of personnel with expertise to provide operational analysis support to the Norwegian units. The purpose is to improve the ability and pace in the decision making process during planning and execution of military operations.
As part of ANTILOPE, FFI has deployed operational analysts with the Norwegian-led PRT (Provincial Reconstruction Team) to Afghanistan since December 2008. PRT Maimanah is one of 27 PRTs across Afghanistan and a part of NATO’s International Security Assistance Force (ISAF). One of the main tasks for the analyst is to carry out comprehensive progress assessments of the situation. This includes both civilian and military issues. In order to embrace the Afghan society in the assessment, FFI in cooperation with PRT Maimanah, has developed a survey to be held in the Faryab province.
This report documents the main findings of the third wave completed in April 2011. Most of the analysis and assessment of the results will be given in separate reports. This also includes a comparison with wave 1 and 2, which is a topic for further analysis.
FFI-rapport 2011/01020 7
1 Introduction
Norway has been the lead nation of PRT Maimanah in the Faryab province since 2005.1 The PRT is sited in Maimanah, the provincial capital of Faryab. As part of this contribution, a strategy for the Norwegian civilian and military effort in Faryab has been developed [1]. The main goal in the strategy is to support the Afghan government in their effort to ensure stability, security and development. The strategy also emphasizes afghanisation, meaning that the Norwegian effort, both in terms of security, development and good governance, should be based on Afghan values.
Assessments of the situation and progress in the society are needed in order to analyse the value of the effort in Afghanistan. In this case, and in line with the afghanisation approach, it is
important to include the population of Faryab. An extensive survey has therefore been carried out in the province in order to better understand the population and their perception of their own situation. The Faryab Survey wave 3 is the third in line conducted in Faryab. It was carried out in April 2011 – about 6 and 12 months after the previous waves [2, 3]. The current level of ambition is to carry out surveys twice a year with the aim of tracking the development in the province.
This report consists of five chapters. Chapter 2 gives a brief overview of the survey and the third wave. This includes the method of sample selection, the geographical coverage and a short discussion of possible advantages and disadvantages. Chapter 3 gives the demographics of the respondents in the survey. This covers the age, gender and ethnicity distribution, the living standard and literacy level. Chapter 4 is the main chapter of the report and presents the main findings of the survey. The chapter is divided into security, development and governance issues.
The last chapter gives the conclusions.
2 Faryab Survey wave 3
Country: Afghanistan Study: Faryab, wave 3
Field Dates: April 7th–April 15th, 2011 Sample Size: 1148 (1208 incl. booster) Research Provider: ACSOR-Surveys Number of Interviewers: 48
The Faryab Survey wave 3 was conducted in April 2011 by the agency Afghan Center for Socio- Economic and Opinion Research (ACSOR). The agency utilizes civil Afghans to do in-depth interviews. The interviewers are about 50 % male/female and a mix of ethnicities to match the
1 The PRT is part of the International Security Assistance Force (ISAF) in Afghanistan and is a joint military-civilian unit. The mission statement is to “assist Government of Afghanistan in Faryab province in building security, governance and promote development in order to establish a safe and well governed Afghanistan.”
8 FFI-rapport 2011/01020
respondents. Quality controls are provided from the central office in Kabul in order to assure that the standards are maintained.
The questionnaire employed in the survey has been developed by the Norwegian Defence Research Establishment (FFI) in cooperation with PRT Maimanah. It consists of approximately 50 questions covering the three main areas: security, development and governance, in line with the Norwegian and the NATO-led International Security Assistance Force (ISAF) strategy. Only minor modifications have been made compared to the questionnaire employed in wave 1 and 2.
2.1 Interview sample
In total, 1208 people in Faryab were interviewed in wave 3. This includes a booster of 60 in one specific area of interest in the province.
The respondents are selected using a multi-stage random stratification process which has four layers:
• Province – the interview sample is distributed based on the urban/rural characteristics in the province.
• District – the sample is distributed between the province districts based on the population estimates for each district.
• Settlement – a simple random selection of the known settlements in each district (neighbourhoods in the cities). (There is no population data on settlement sizes, thus the sample can not be distributed based on settlement sizes.)
• Household – a random walk method is used to select the households in which the in- depth interviews will take place.
There were two constrictions in the final selection of the respondents:
• The respondents had to be 18 years or older.
• The sample should have approximately 50 % male and 50 % female respondents.
2.2 Survey coverage
The interviews took place in 13 of Faryab’s 15 districts.2
2 Faryab has originally 14 districts. ISAF and PRT Maimanah included Ghowrmach district (originally Badghis province) into the PRT’s area of responsibility in 2009.
Ghowrmach (due to security issues) and Kuhestan (due to transportation issues – winter closed roads) has not been covered in the survey.
FFI-rapport 2011/01020 9 2.3 Advantages and disadvantages
One of the major advantages with the Faryab Survey is the large number of respondents. The size of the sample makes it possible to reduce uncertainty of the analysis to an acceptable level, also below province level. On province level the worst-case sampling error would be 2.8 %.3 There are, nevertheless, challenges specific to polls in conflict zones that might increase the uncertainty to the results.
The main aspect of the Faryab Survey is randomness. This is a challenge for surveys in general, but in particular for surveys in Afghanistan due to the poorly documented geography, bad infrastructure and instable security situation. 13 of the original 128 randomly selected villages had to be replaced due to:
1. It was controlled by Taliban (6 villages).
2. It was out of reach (transportation problems) (6 villages).
3. It could not be found (1 village).
That is, some of the most underdeveloped villages (when it comes to infrastructure at least) and areas with a high threat level have not been included in the survey (see also Section 2.2). This will, to some extent, affect the questions about development and security. On the other hand, the fact that villages are assessed to be too hard to reach or too dangerous gives by itself an indication of the development or security situation in these areas of the province.
3 Demographics
The Faryab Survey has 12 questions on demographics. This chapter summarises the main findings of these questions.
3.1 Age distribution
The respondents ranged between 18 to 83 years of age (Figure 3.1). The life expectancy in Afghanistan is about 45 years.4
The age distribution shows peaks at the age of 20, 25, 30, 35, and so on. One contributing factor to this is the estimation of the age by the interviewer: the interviewer estimates the age if the interviewee does not know it. The age is then to a large extent estimated to a round number.
However this only covers a small fraction of the respondents. The pronounced peaks may therefore indicate that many do not know their real age and estimate it to a round number themselves.
3 The sampling error applies if the respondents are sampled in a simple random sampling procedure. Since a random stratification process has been employed (Section 2.1), it also will affect the sampling error.
4 CIA World Factbook
10 FFI-rapport 2011/01020
Figure 3.1 Age distribution of the Faryab Survey wave 3. The vertical blue line marks the life expectancy in Afghanistan.
3.2 Gender
It is of high importance to include the female perspective of the situation into the Faryab study.
The survey therefore has 50 % male and 50 % female respondents. ACSOR utilises female interviewers exclusively to interview female respondents.
3.3 Ethnicity
The ethnicity distribution is shown in Figure 3.2. The distribution is:
• 75 % Uzbek
• 11 % Turkmen
• 7 % Tajik
• 4 % Pashtun
• 3 % other
Figure 3.2 Ethnicity distribution of the Faryab Survey wave 3.
0 10 20 30 40 50 60 70 80
18 20 22 24 26 28 30 32 34 36 38 40 42 44 46 48 50 52 54 56 58 60 62 64 66 68 70 72 74 76 78 80 82
0 % 10 % 20 % 30 % 40 % 50 % 60 % 70 % 80 %
Afghan Tajik Pashtun Uzbek Turkmen Arab Sadat
FFI-rapport 2011/01020 11
A population census has not been conducted in Afghanistan since 1979. In the meantime millions of people have been displaced. The ethnicity profile in Afghanistan therefore relies on estimates.
The ethnicity distribution of wave 3 is slightly different than the estimated ethnicity profile of Faryab.5
3.4 Living standard
For instance, it is stated in the Faryab provincial profile that 13 % of the population speak Pashtu, while only 4 % consider themselves to be Pashtun in the survey. Presuming the provincial profile gives the right distribution this indicates an under representative Pashtun fraction in wave 3. It is known that there is a majority of Pashtuns in some of the more insecure areas. As such it is reasonable to assume that replacement of sampling points in these areas (due to security issues) may be one reason for the lower fraction of Pashtuns in the survey.
The interviewers made an assessment of the living standard for each interviewee. The standard is divided into five categories:
1. High quality road, access to water and electricity 6 to 7 days per week 2. Good road, access to water and electricity 4 to 5 days per week 3. Fair road, access to water and electricity 1 to 3 days per week 4. Poor road, access to water and electricity 1 day a week
5. Poor or no road, no or very infrequent access to water and electricity
Figure 3.3 Assessed living standard. The standard of roads, water and electricity accessibility is categorised into 5 categories (1 is the best, 5 is the worst).
Figure 3.3 shows that 67 % of the respondents fell into the two poorest categories. These live in areas with poor or no road and with little or no access to water and electricity (not more than one day a week). Even though this is about the same as in wave 1 and 2, there has been a shift from
5 Faryab Provincial Profile:
0 % 10 % 20 % 30 % 40 % 50 % 60 %
1 2 3 4 5
12 FFI-rapport 2011/01020
category 5 to category 4. Only 14 % of the respondents fell into the top two categories and live in areas with good road conditions and with access to water and electricity 4–7 days a week.
3.5 Literacy and education
When it comes to literacy, 29 % replied they can read and write. This is about the same as the Afghanistan average where 28 % are said to be literate.6 The literacy among the respondents in Faryab corresponds to the education level (see Figure 3.4): 71 % say they are illiterate and 72 % have no schooling.
Figure 3.4 Highest level of education of the respondents.
4 Main findings
The results of the survey show that 55 % are positive to the general progress in the province and feel that the situation in Faryab generally is going in the right direction (Figure 4.1).7 However, as many as 25 % feel the opposite.
6 CIA World Factbook.
7 The percentages in the report are calculated as a percentage of those who have an opinion (that means that persons that answers Refused or Do not know are removed).
0 % 10 % 20 % 30 % 40 % 50 % 60 % 70 % 80 %
No formal / no schooling
1st to 6th grade
7th to 9th grade
10th to 12th grade
University Other
FFI-rapport 2011/01020 13
Figure 4.1 Result on the question: In which direction do you think things in Faryab today are going?
The subsequent sections in this chapter summarise the main findings from the Faryab Survey wave 3 categorised into three main areas: Security, development and governance.
4.1 Security
4.1.1 Security situation
About 49 % of the respondents who believe the situation is going in the right direction (Figure 4.1) justify this by saying that the security has improved or that the Taliban no longer exists in their area (Figure 4.2).
Figure 4.2 Main reasons to why things are going in the right direction.
The perception of the security situation is stated more directly through another question. When asked how satisfied the respondent is with the security situation, 74 % reply that they are
somewhat or very satisfied (Figure 4.7). 41 % say the situation has improved, while 13 % express
0 % 10 % 20 % 30 % 40 % 50 % 60 %
Right direction Wrong direction
Some in right, some in wrong
Refused Don't know
0 % 5 % 10 % 15 % 20 % 25 % 30 % 35 %
14 FFI-rapport 2011/01020
the opposite. Only 8 % respond that lack of security is the biggest problem in their local area (Figure 4.6).
4.1.2 Key security actors
48 % of the respondents consider the Afghan National Police (ANP) to be an important security provider in their districts (Figure 4.3), whereas 22 % express the same about the Afghan National Army (ANA). The higher response to ANP is probably not due to a better impression of the police compared to the army (as stated later in the report), but can possibly be explained by their area of responsibility: ANP is recruited locally and has the whole province as their responsibility area, while ANA is focusing on the problem areas. Thus, ANA has less visibility compared to ANP.
Figure 4.3 Result on the question: Who provides security in your district? (Note: this was a multi-answer question, i.e. the respondent could answer more than one actor as the provider of security)
Only 4 % believe that international forces provide most security. The aim of the international forces in Faryab is to support, partner with and mentor the national forces and, as such, it is positive that the people recognise ANSF as the security provider rather than the international forces. However, as many as 24 % respond that the people themselves provide security in their area (Figure 4.3). This may indicate that the national security actors are not present in these areas or they are not doing a good enough job.
ANP
73 % agree that ANP has sufficient forces in their area while 27 % express the opposite. Still, 87 % agree they help to improve the security (Figure 4.4). At the same time, 34 % believe that ANP can not operate on their own and need support from international forces.
0 % 5 % 10 % 15 % 20 % 25 % 30 % 35 % 40 % 45 % 50 %
FFI-rapport 2011/01020 15 Figure 4.4 Responses on four statements related to ANP.
All in all, the respondents have a good impression of the Afghan police. 86 % believe that the police are leaving a good impression on the people. And 92 % agree that ANP is honest and fair to the Afghan citizens. This confidence in ANP is confirmed through another question: 89 % say they will report crimes to the police while 11 % respond they will not. However, it is important to notice that even though the respondents believe the police are improving security and are honest and fair, they also believe ANP are corrupt: 65 % respond that corruption is a problem amongst police officers in their area. This discrepancy might be due to several reasons, especially cultural factors: the expectations of the ANP might be low, the corruption is part of how the society functions and so on.
ANA
The perceptions of ANA are about the same as of ANP. 63 % agree that ANA has sufficient forces in their area while 37 % feel the opposite. Still, 87 % believe they help improve the security (Figure 4.5). At the same time, 39 % believe that ANA can not operate on their own and need support from international forces.
Figure 4.5 Responses on four statements related to ANA.
All in all, the respondents have a good impression of the Afghan army. 82 % believe that the army is leaving a good impression on the people. And 91 % agrees that ANA is honest and fair to the Afghan citizens. (Corruption amongst ANA was not included in the questionnaire.)
Strongly agree Agree somewhat Disagree somewhat Strongly disagree
Strongly disagree Disagree somewhat Agree somewhat Strongly agree
-100 % -80 % -60 % -40 % -20 % 0 % 20 % 40 % 60 % 80 % 100 %
ANP is honest and fair
with the Afghan people ANP helps improve security
-100 % -80 % -60 % -40 % -20 % 0 % 20 % 40 % 60 % 80 % 100 %
ANP is unprofessional and poorly trained
ANP needs the support of foreign troops and cannot
operate by itself
Strongly agree Agree somewhat Disagree somewhat Strongly disagree
Strongly disagree Disagree somewhat Agree somewhat Strongly agree
-100 % -80 % -60 % -40 % -20 % 0 % 20 % 40 % 60 % 80 % 100 %
ANA is honest and fair with the Afghan people
ANA helps improve security
-100 % -80 % -60 % -40 % -20 % 0 % 20 % 40 % 60 % 80 % 100 %
ANA is unprofessional and poorly trained
ANA needs the support of foreign troops and cannot
operate by itself
16 FFI-rapport 2011/01020
International forces
Even though only 4 % believe that international forces provide most security, the respondents in Faryab recognise a need for international support to the national security forces (Figure 4.4 and 4.5). The international military forces are generally well regarded by the people of Faryab. 60 % reply that they have a good impression of the international forces and their efforts in the province.
4.2 Development
As much as 28 % of the respondents that believe the situation is going in the right direction (Figure 4.1) justify this by saying that this is due to reconstruction, i.e. development of the province (Figure 4.2). Also, 64 % of the respondents say that aid projects (to the benefit of the community) have been implemented in their area in the last year. Of these 41 % say (as first or second mentioned) these projects are construction of wells, while corresponding number for road construction, bridges and schools are 40 %, 31 % and 30 % respectively.
Figure 4.6 Biggest problem in the local area.
As illustrated in Figure 4.6, the biggest problem in the province is by far unemployment (26 %).
In comparison, 8 % respond that lack of security is the biggest problem. Lack of water (either for drinking or irrigation) is another big concern in the province. A response rate of 11 % makes this the third biggest problem, despite the fact that the majority of aid projects are construction of wells (in line with the discussion above). Illiteracy is the second biggest problem (12 %) These results are confirmed in the questions on how satisfied the respondents are with The availability of jobs, The availability of clean water and The availability of water for irrigation (Figure 4.7): 74 % are dissatisfied with the job opportunities, 40 % with the supply of clean water and 53 % with the supply of irrigation water. Only 17 % feel that job opportunities have
improved the last year, while 37 % think that it has deteriorated. 33 % and 26 % believe, respectively, that the availability of clean water and water for irrigation has improved. The
0 % 5 % 10 % 15 % 20 % 25 % 30 %
FFI-rapport 2011/01020 17
respondents also express their discontent with job opportunities for women: 77 % are dissatisfied with education and job opportunities for women.
i security at schools viii supply of electricity
ii security situation ix condition of the roads
iii availability of education for children x availability of water for irrigation iv ability to move safely xi availability of products in the markets v availability of clinics and hospital xii condition at the facility of detention vi availability of clean water xiii availability of jobs
vii availability of medicines Xiv education and job opportunities for women Figure 4.7 How satisfied are you with the...?
The respondents are more satisfied with the education opportunities in their area and the security at the schools: 66 % are satisfied with the education opportunity for the children (Figure 4.7) and 78 % with the security at the schools. 41 % say that the education opportunities have improved (14 % it has deteriorated), and 49 % that the security at schools has gotten better (10 % it has gotten worse). Education is one of the main focuses in the Norwegian development aid.
The satisfaction with electricity and health clinics is divided. 51 % are satisfied with the supply of electricity, while 62 % are satisfied with the availability of clinics and hospitals. 35 % believe the supply of electricity has improved the last year. On the other hand, 23 % believe it has
deteriorated. This might indicate an improvement in some areas of the province, while there are areas where the supply of electricity is a bigger problem.
18 FFI-rapport 2011/01020
4.3 Governance
When asked who has most influence in their local area, the government, opposing government elements or neither, 80 % respond the government and 10 % Opposing Government Elements (Figure 4.8). 76 % believe the government is doing an overall good job at the provincial level.
And 61 % agree that the government, in the last year, has satisfactorily addressed the needs of their community (39 % disagree).
Figure 4.8 Who has most influence in your mantaqa (local area)?
The apparently good impression of the provincial government is somewhat contradicted by the fact that 82 % states that corruption is a moderate to big problem amongst the provincial government officials. This is the same situation as seen when looking at the Afghan police (see Section 4.1.2).
When it comes to justice and the rule of law, 49 % would go to an Afghan state court if they had a dispute. 29 % would go to the local Shura/Jirga and 17 % of the respondents would take the dispute to both. 5 % would not use any in case of a dispute.
5 Conclusions
The survey shows a split perception on the security situation in Faryab. Many are satisfied with the situation as it is today, and have seen an improvement. But a lot of respondents feel the opposite: They are not satisfied with the security situation. The split opinion could indicate a deterioration of the situation in some areas of the province while there is progress in other. This is a setback compared to the first survey in April 2010, which showed a fairly good perception of the security situation, but consistent with the findings in the second survey in October 2010.
However, only a small fraction of the population in Faryab considers security to be the biggest problem in the local area.
FFI-rapport 2011/01020 19
The national security forces, ANP and ANA, are seen as important security actors. Still, more than one out of three believes neither the police nor the army can operate by themselves and need the support from international forces. However, compared to the previous waves, the perception of ANA’s professionalism and level of training has improved significantly.
Almost two out of three respond that aid projects have been implemented in their area the last year that have benefited the community. Most of these projects are said to be construction of wells. Despite of this, lack of water is seen as the third biggest problem. Unemployment is regarded as the biggest problem and illiteracy as the second biggest problem. This represents a change from wave 1 where lack of electricity was the second biggest problem. The respondents are more satisfied with the education opportunities in the province. This is one of three sectors Norwegian development aid is concentrated on.
The respondents generally have a good impression of the provincial government. Nevertheless, 82 % states that corruption is a moderate to big problem amongst the provincial government officials. The same perceptions are seen for the Afghan police as well.
20 FFI-rapport 2011/01020
References
[1] Utenriksdepartementet, Forsvarsdepartementet and Justisdepartementet, "A strategy for comprehensive Norwegian civilian and military efforts in Faryab province, Afghanistan ", 2009.
[2] Elin Marthinussen, Frode Rutledal, Bård Eggereide and Alf Christian Hennum, "Faryab Survey – wave 1", FFI-rapport 2010/02511, 2010.
[3] Elin Marthinussen, Frode Rutledal, Bård Eggereide and Alf Christian Hennum, "Faryab Survey – wave 2", FFI-rapport 2010/02530, 2010.