Evaluation of a new evidence-based approach to informative research

2 [Document title] [Document subtitle] [Date] [Company name] [Company address] [Date] [Company name] [Company address] Executive Summary 2 Introduction 2 Purpose and rationale for the evaluation 2 Data collection and its relevancy: 3 Methodology: 3 Desk review 3 Interviews of key informants 3 Group discussion 3 Consent 4 Rigor of evidence and triangulation 4 Limitation 4 Underlying values and principles 4 Stakeholder of NGOs and other organization 5 Criteria used to evaluate actions and achievements 5

[Document title]
[Document subtitle]
[DATE]
[Company name]
[Company address]

1
Table of Contents
Executive Summary.....................................................................................................................................2
Introduction.................................................................................................................................................2
Purpose and rationale for the evaluation....................................................................................................2
Data collection and its relevancy:................................................................................................................3
Methodology:..............................................................................................................................................3
Desk review.............................................................................................................................................3
Interviews of key informants...................................................................................................................3
Group discussion.....................................................................................................................................3
Consent...................................................................................................................................................4
Rigor of evidence and triangulation.........................................................................................................4
Limitation................................................................................................................................................4
Underlying values and principles.................................................................................................................4
Involvement of NGOs and other organization.............................................................................................5
Criteria used to evaluate actions and achievements...................................................................................5
IFRC Framework..........................................................................................................................................6
Inclusion of health sector in the evaluation................................................................................................7
Findings and achievements.........................................................................................................................8
Conclusion:..................................................................................................................................................9
References...................................................................................................................................................9
1

2
Executive Summary:
Australia has a long-term relationship with Myanmar and supports it by providing funds through
various programmes. It has supported Myanmar during the transition period to democracy.
Myanmar is still facing substantial humanitarian challenges, despite positive development. It is
prone to inter communal tensions, natural disasters and armed dispute in different parts of
country. Humanitarian attention is needed for situations of protracted crisis with numbers of
displaced individual and humanitarian needs. This report provides evaluation of humanitarian
assistance provided by Australia in response to crisis that occurred in Myanmar during 2014 to
2017.
This evaluation report focuses on the relevance, efficiency of Australia assistance with a special
emphasis on displacement in Rakhine and Kachin states. It also shows the Australian approach to
humanitarian assistance in protracted crisis situation in Myanmar.
Introduction:
This report briefs the recommendations and findings of the evaluation of Australian assistance in
regard to the crises in Myanmar, since 2014 to 2017. This humanitarian assistance forms a larger
aid program which covers peace, development and humanitarian programs in Myanmar.
Australia has been one of the oldest donor to Myanmar and has always offered support during its
transition to democratic government in the recent times. Eve after gaining independence, the
country still faces challenging humanitarian condition. The country is also prone to natural
disasters, armed conflicts in certain parts of the country, inter communal tensions. These types of
situation create a crisis which demands humanitarian attention. This evaluation report will
analyses the effectiveness, relevance and efficiency of Australian assistance which particularly
focused on displacement in Rakhine and Kachin states. This report mainly focusses on the
performance of the humanitarian program in regard to the current strategies and priorities.
Purpose and rationale for the evaluation:
The purpose of this evaluation report is to review the relevance, effectiveness and efficiency of
Australian humanitarian assistance to Myanmar. The current situation in Myanmar is
characterized by the current scenario in three different contexts: conflict in the northern region,
ongoing communal tensions and displacement of people in Rakhine state and displacement of
refugee in the camps of Thailand. Hence, this evaluation report mainly covers the humanitarian
assistance in two of these states which are Rakhine in south west and Kachin and Shan states in
northern Myanmar. The rationale for the evaluation was to check the appropriateness and
relevancy of the assistance provided in these two states. It also analyzes the effectiveness and
efficiency of the assistance. Lastly, the Australian assistance in restoring the local and national
leadership.
2

3
Data collection and its relevancy:
The Australian humanitarian act was conducted on the basis of various data and information it
had on the two states of Myanmar i.e. Rakhine and Kachin. The DFAT’s collected data on
number of displaced people in these two states, number of children who were not accompanied
by the parents or family members, the data on domestic violence, data on generic based violence
and reproductive and health related problems in women, girls etc. These data were the basis in
which the aids were distributed in different sectors to help the people’s in need.
The Shan and Kachin states had more than 120,000 people who were in the need of assistance
which also included 98,000 displaced people because of the conflict (Annan, 2017). The 50% of
these displaced people live outside the reach of government where the access to assistance was
least. Around 77 to 78% of camp resident in Kachina state were women and children. Similarly,
over 400,000 people in Rakhine needed assistance. The communal violence of 2012 displaced
145,000 people and among these 120,000 remain displaced till the mid of 2017. 79% of people
in IDP camps were women and children. The security operations of 2016 and 2017 further
displaced 20,000 people and approximately 70,000 displaced to Bangladesh. These data helped
in planning and successful implementation of humanitarian assistance.
Methodology: This section used both qualitative and quantitative approach to triangulate
key findings. The qualitative approach included stakeholder interviews, group discussions and
desk review. While the quantitative data set included OCHA financial tracking system and
Australian humanitarian funding allocations. There were also short sight visits in the state of
Rakhine and Kachin to capture the actual experience of the people affected in this region (About
OCHA Myanmar, n.d.).
Desk review
In this review, 113 documents were analyzed which included strategic documents, UN and
implementing partner strategy documents, proposals and papers etc.
Interviews of key informants
The semi structured interview included 27 women and 19 men. While the key informants
included 21 implementing partner representative, 13 DFAT staff, 2 donor and 3 other
stakeholders.
Group discussion
This was conducted to capture the view of the affected population on the service or assistance
provided and the way in which the groups (sex segregated) participated in and influenced the
partner programs. Out of 107 representatives involved in group discussion, 6 communities which
represented internal displaced camp and community population in Rakhine and Kachin were the
consultant. The other consultation included 7 representatives from disabled people organization
in Yangon. The main objective of this discussion was to understand the barrier and priorities for
persons who were living with disabilities in condition of protracted crisis.
3

4
Consent
All the participants of this evaluation were informed before the data collection process. The
consent for taking photographs were also taken. The process for the person with disabilities was
explained through translators.
Rigor of evidence and triangulation
All the figures and facts used in the report were verified through triangulation
Limitation
The entire evaluation was completed in 3 months’ time. Due to time constraints, the visits to
Rakhine and Kachin were briefed and only selected partner sites were visited. The reports of
partner varied in detail, format and comprehensiveness.
Due to this the evaluation could not validate all the partner activities and outputs or present the
complete analysis of the efficiency and effectiveness of every partner program.
Underlying values and principles
The Australian humanitarian program is based on the essential values of solidarity and humanity.
Its objective and implementation are based on the underlying principle of impartially,
independence, non-discrimination and neutrality (Aid Investment Plan Myanmar: 2015-2020,
2015).
In general, the aid is distributed without any discrimination, ethnic group, color, race, sex, age,
ethnic group, nationality or political beliefs (Myanmar Humanitarian Crisis, n.d.).
The main criteria for humanitarian aid is need. The department of foreign affairs and trade
(DFAT’s) identified disability inclusion, women’s empowerment, gender equality, protection
and monitoring evaluation and learning as priorities and central to all of Australian aid to
Myanmar (Review of Australia’s Humanitarian assistance to Myanmar, 2017). The Australian
aid shifted its focus on gender protection and equality in the past couple of years by funding
protection partner. This step contributed in ensuring safety and dignity of women, men, girls,
boys among several states in Myanmar. DFAT’s along with other organizations provided support
mainly in the state of Rakhine and Kachin in response to protracted crisis (Development
assistance in Myanmar, n.d.).
The European Commission unlike Australia DFAT’s provides all kinds of support at the
time of need regardless of politics and relation between the European Union and the country
which is affected (Development Assistance, n.d.). Therefore, the European Union is nonpolitical
in character to which it adds value to the humanitarian efforts. The European Union gives more
important to the principle of neutrality in its own work and in those attached with it. Lastly, we
can conclude that the main objective or aim of organization providing humanitarian aid to human
and gives priority in maintaining or restoring safety and dignity of affected population.
4

5
Involvement of NGOs and other organization
The NGOs and other organization which participated in the evaluation are ICRC, CARE,
UNFPA, DRC, UNICEF, BRAC, IOM, Action Against hunger etc.
Each organization had their own role and function in helping the peoples of Myanmar.
United Nations International Children's Emergency Fund (UNICEF): It played major part in
providing food, shelter, water with a target to protect the children and women. In order to avoid
the distribution of water on daily basis, this organization installed water pumps and deep tube
wells in the camps. It also provided supplements and therapeutic foods to malnourished children
along with vaccination to 15000 children to prevent measles, polio and rubella.
UNHCR: This organization has been working with Rohingya migrants since 1978. It provides
shelter materials, emergency aid, protection and help the unaccompanied children, survivors of
rape and trauma.
BRAC: it directly serves the refuge population and also trains them as volunteers. Its main aim
is to focus on health, protection of women and girls and education
World Food Program (WFP): WFP is an UN agency that distributes energy biscuits to migrants
in Bangladesh.
Doctors without Borders: It helps in treating ailments like diarrheas, injuries, serve
dehydration, sexual violence etc.
Save the Children: It is an independent organization focusing mainly on children right and
improvement in the children’s health it also helps by distributing tents, hygiene kits, cooking kits
to the Rohingya. Its main aim is to help children especially those who are not accompanied by
their parents or family members.
Hence, along with department of foreign affairs and trade, these organizations also play foreign
affairs and trade, these organizations also play s important role in helping the displaced refugee.
Criteria used to evaluate actions and achievements
To evaluate the actions and achievements were whether effective, appropriate and efficient, it
was measured on 3 criteria.
 Was the assistance provided by Australian humanitarian to protracted crisis in Myanmar
were relevant and appropriate?
 Was the assistance provided to protracted crisis in Myanmar effective and efficient?
5

6
 Did the Australia’s humanitarian assistance helped in restoring the local and national
leadership?
IFRC Framework
The purpose of International Federation Red Cross and Red Crescent Society is to guide on how
the evaluations are managed, planned, implemented or conducted and used. This framework is
mainly formed to promote useful, reliable, ethical evaluations which contribute to organization
accountability, learning and its mission to serve those who are in need (Burma: Ensure Aid
Reaches Rohingya, 2017).
Its committed to transparency and provide publicly accessible document to all those members so
that they can understand properly and shows their involvement in the evaluation process. The
framework also shows IFRC’s involvement and commitment to improve the significance and
utility of evaluation, designing formidable and practicing legitimate actions as leading actor in
the humanitarian sector (Adam, 2017).
The IFRC defines evaluation as a systematic and objective assessment of a completely or an
ongoing project, program or policy its modelling or desired results. The main aim of IFRC is to
establish the significance and completion of objectives, its development efficiency, its
effectiveness, effect and sustainability. The process of evaluation should provide information
which are useful and credible which enable the organization in making correct decision
beneficial for donors and recipients. The key purpose of IFRC secretariat are:
1. Improving and ultimately its mission to help the people in need
The evaluation of current process helps to improve the organization performance by correct
assessment of success and failures. This evaluation also helps the management and decision-
making processes like policy and programme design, budgeting, programming, planning,
implementation and lastly reporting. This also helps to rectify the impact and relevance of
results, proper use of resources and which helps helps in maximizing the satisfaction level and
output of the work.
2. It contributes in organizational learning
The evaluation process forms the framework for learning and helps in proper management and
delivering of services and programmes. They also provide chance to reflect upon and discuss the
learning and experience to enhance the collaboration so that the organization can gain full benefit
from what they do, how they do to build their strength as a leader in humanitarian field.
3. Transparency and accountability
The periodic evaluation must be transparent and accountable to the stakeholders at various levels
like donors, beneficiaries, partner organization and governments nation societies and other key
partners in the humanitarian sector. The evaluation also helps in identifying whether the work is
done as per the terms of agreement in compliance to established standards. This also provides
opportunities to the beneficiaries to give their feed back and inputs related to work so that the
organization can adapt according to the changing needs
6

7
4. Promotion and celebration:
The evaluation through reliable sources can be used for the mobilization of resources, advocate
and realizing and celebrating the organization achievements. The promotion through evaluation
is often not considered as a marketing agenda because the evaluation provides unbiased and
independent assessment of organization performance and its results which adds credibility to
accomplishments. This helps in promotion of humanitarian act on global level eventually
benefitting those people in need.
The Australian humanitarian assistance differed in its framework than IFRC as it mainly focuses
on its services in the states of Kachin and Rakhine. It prioritized on gender equality and women
empowerment instead of serving other fractions as well who are also in the need of aid to sustain
their daily life.
It also had limited time due to visit in all the sits in Kachin and Rakhine state due to which the
evaluation could not validate all the implementing activities going in those places. This further
led to discrepancy in reporting format, details which is vital for organization so that it can
improve its short comings and work on the mission to help the people in need. in overall
evaluation process could not analyses the efficiency and effectiveness of partner programs and
thus making the evaluation program in efficient.
Inclusion of health sector in the evaluation
The Australian assistance in health sector was less in comparison to other areas like protection,
food security, shelter, livelihoods, education and water. It contributed to 15 hospitals and reached
over 18,000 through mobile clinics. It also aims to protect the people from injuries and harms.
These includes wounding, killing, torture, protection from exploitation and coercion, cruel and
inhumane treatment and protecting people from deliberate deprivation like denial of food,
medical care, shelter or water.
The DFAT’s also priorities the protection agencies to address the issues related to protection.
The organization increased its investment that focuses on gender-based violence and sexual and
reproductive health of both women and girls. the protection concern also addressed issues like
human trafficking, risk of alcoholism, drug use domestic and gender-based violence.
Although the disability inclusion was almost absent from Australian assistance programmes with
an exception of providing support to person with physical disability who can access ICRC
supported medical centers which was originally for mine victim but how its serving all the
members with rehabilitation needs. The programs to engage the people with psycho-social
disability is very rare but UNFPA supports women and girls with mental health needs.
The evidence suggest that the partners are beginning to consider disability inclusion in their
future programs. The request from the DRC to Australia in amending its contract in order to
carry out a disability analysis and is also working with UNHCR to search people with disabilities
and design programs according to their needs. The engagement of handicap international by the
partners to provide training on disability shows the increased awareness and long-term goal of
the organization to work in this area.
7

8
Findings and achievements
The achievements of Australia assistance in regard to the protracted crisis in Myanmar was more
than the noticeable. The Australian assistance amounted to more than 40 million to the crises and
has helped more than 500,000 people per ear. Australian humanitarian act has made noticeable
contribution in various sectors by infusing funds through a different range of partners like UN
and NGOs that have good track in delivering effective services to those in need by upholding
humanitarian principle. The key achievements of Australian assistance in response to protracted
crisis in Myanmar since 2014 are: -
It reached in total of 200,000 people in Rakhine and Kachin states with food, relief and cash
items.
The shelter was provided to more than 90,000 individuals.
The improved production capacity and resilience for over 6000 households.
More than 10,000 households got unconditional monetary transactions.
It also provided support to more than 15000 people in understanding the risk of end mines.
It provided support to more than 100,000 women to access gender-based violence support and
sexual and reproductive services.
It also trained more than 1,700 security and justice personnel in safe response towards gender-
based violence and its prevention.
It helped more than 95,000 people with improved access to water facilities.
It also helped in training teachers and providing proper support to provide safe school
environment, free of violence.
It contributed in establishing more than 20 temporary learning spaces to facilitate 3700 students.
It provided support to more than 15 hospitals and also reached more than 180,000 through
mobile clinics.
France has contributed more than 2.3 million euro in an international effort to help the needs of
Rakhine state. This humanitarian aid which France funded through French NGO’s is directed to
help the displaced people and those who were affected by violence. It also provides food aid to
the displaced people of Rakhine state (Humanitarian aid in Myanmar, n.d.)Bur. The amount
dedicated for the food aid in 2017 as 865,000 euros. It is also providing support of 900,000 euros
to the people migrated towards Bangladesh border (Myanmar/Burma, 2018).
8

9
The European Union is also one of the major contributor in providing aid to support the
humanitarian act. The European commissioner declared 12 million euros in 2015, out of which
5.2 million were spent on sanitation and providing food aid to the people of Rakhine state. The
European Union is additionally providing 3.8 million euros to the refugee staying in Bangladesh
(EU steps up humanitarian assistance in Bangladesh and Myanmar, 2017).
The United States of America also declare aid package of 32 million dollars to help the Rohingya
who fled Myanmar due to violence to the violence to neighboring Bangladesh US (Kosinski,
Cohen, & Gaouette, 2017). Britain declared an amount of 25 million to help the affected people
in both countries i.e. Myanmar and Bangladesh. Canada provide 2.5 million dollars aid for the
women and children of Rohingya tribe Canada (Abedi, 2017).
Conclusion:
From the above paper it is apparent that, the condition of people living in the state of Rakhine
and kachin is critical and demands humanitarian assistance. More than 520,000 in these are in
need of assistance. The communal tensions, armed conflict in specific areas of the country and
violence have forced people to live miserable life and migrating to neighbouring countries. The
Australian humanitarian aid focused its attention and attention in these two states and help
people in every possible way. The department of foreign affairs and trade though different
organisation infused funds in different areas to maximize the output of humanitarian assistance.
The report also showed the limitations of evaluations along with its relevance, efficiency and
effectiveness.
References
9

10
2017 Myanmar Humanitarian Response Plan: January - December 2017. (2016, December 5).
Retrieved from Reliefweb: https://reliefweb.int/report/myanmar/2017-myanmar-
humanitarian-response-plan-january-december-2017
Abedi, M. (2017, September 15). Canada to provide $2.5M in humanitarian aid for Rohingya
women, children. Retrieved from Global News:
https://globalnews.ca/news/3747560/canada-humanitarian-aid-rohingya-muslims-
myanmar/
About OCHA Myanmar. (n.d.). Retrieved from OCHA: http://www.unocha.org/myanmar/about-
ocha-myanmar
Adam, D. (2017, September 14). UK announces additional aid for victims of Burma violence.
Retrieved from GOV.UK: https://www.gov.uk/government/news/uk-announces-
additional-aid-for-victims-of-burma-violence
Aid Investment Plan Myanmar: 2015-2020. (2015, 30 September). Retrieved from Department of
Foreign Affairs and Trades : http://dfat.gov.au/about-us/publications/Pages/aid-
investment-plan-aip-myanmar-2015-20.aspx
Burma. (n.d.). Retrieved from Humanitarian Aid Relief Trust:
https://www.hart-uk.org/locations/burma/
Burma/Myanmar Humanitarian Aid. (n.d.). Retrieved from People in Need Czech Republic:
https://www.clovekvtisni.cz/en/what-we-do/humanitarian-aid-and-development/burma-
myanmar/humanitarian-aid
Burma: Ensure Aid Reaches Rohingya. (2017, September 11). Retrieved from Human Rights
Watch: https://www.hrw.org/news/2017/09/11/burma-ensure-aid-reaches-rohingya
Development Assistance. (n.d.). Retrieved from Australian Embassy Myanmar:
http://myanmar.embassy.gov.au/rang/cooperation.html
Development assistance in Myanmar. (n.d.). Retrieved from Department of Foreign Affairs and
Trade: http://dfat.gov.au/geo/myanmar/development-assistance/Pages/development-
assistance-in-myanmar.aspx
EU steps up humanitarian assistance in Bangladesh and Myanmar. (2017, December 9).
Retrieved from European Commission: https://ec.europa.eu/echo/news/eu-steps-
humanitarian-assistance-bangladesh-and-myanmar_en
Humanitarian Action for Children. (2017). Retrieved from UNICEF:
https://www.unicef.org/hac2017/
Humanitarian aid in Myanmar. (n.d.). Retrieved from France Diplomatie:
https://www.diplomatie.gouv.fr/en/country-files/myanmar/humanitarian-aid-in-burma-
myanmar/
10

11
Kosinski, M., Cohen, Z., & Gaouette, N. (2017, September 22). US to provide $32 million in aid
to Rohingya fleeing Myanmar. Retrieved from CNN politics:
https://edition.cnn.com/2017/09/20/politics/us-aid-rohingya-myanmar/index.html
Letter to Ministers: Myanmar: Australia must push Letter to Ministers: Myanmar: Australia
must push for an independent investigation into alleged gross human rights violations in
northern Rakhine State. (2017). Retrieved from Australian Council for International
Development.
Myanmar Humanitarian Crisis. (n.d.). Retrieved from Australian Council for International
Development: https://acfid.asn.au/content/myanmar-humanitarian-crisis
Myanmar/Burma. (2018, April 11). Retrieved from European Commission:
http://ec.europa.eu/echo/files/aid/countries/factsheets/myanmar_en.pdf
Review of Australia’s Humanitarian assistance to Myanmar. (2017, December 21). Retrieved
from Australian Government: Department of Foreign Affairs and Trade:
http://dfat.gov.au/about-us/publications/Pages/review-of-australias-humanitarian-
assistance-to-myanmar.aspx
U.S. Humanitarian Assistance in Response to the Crisis in Rakhine State, Burma. (2017,
September 20). Retrieved from U.S. Department of State:
https://www.state.gov/r/pa/prs/ps/2017/09/274283.htm
11