Request for Proposals on Methodological Experiments with Telephone Surveys in India

Background:

The National Council of Applied Economic Research (NCAER) is India’s oldest and largest independent, non-profit, economic research institute. It does grant-funded research, commissioned studies for governments and industry, and is one of the few think tanks globally that also collect primary data. NCAER has set up a National Data Innovation Centre (NDIC) to serve as a laboratory for experiments in data collection, interfacing with partners in think tanks, Indian and international universities, and government. NDIC forms an important core of NCAER’s long-standing data collection activities. NCAER has partnered with the Universities of Maryland and Michigan for the NDIC. Initial funding for NDIC is provided by the Bill & Melinda Gates Foundation.

Current Request for Proposals: 

Historically, household surveys in low- and middle-income countries (LMICs) have been carried out by conducting face-to-face interviews. Despite the advances in computer-assisted personal interviewing (CAPI) technologies, household surveys still tend to be costly and resource-intensive because of their complexity (Dabalen et al. 2016). The process of designing and implementing a survey and producing a clean dataset that is ready for analysis often takes several months. Moreover, to accurately capture certain rapidly changing conditions (e.g., seasonal employment or the outbreak of disease) and to reduce recall biases in certain types of data (e.g., consumption expenditure or more specifically, out-patient health expenditure), it becomes imperative to conduct more frequent surveys, which in turn, limits the use of face-to-face surveys. The widespread use of mobile phones in India offers a new opportunity to remotely conduct surveys with increased efficiency and reduced cost.

Therefore, the focus of the current RFP is to seek proposals on data collection experiments involving phone surveys across the following themes: household income and expenditure, labour force participation, financial inclusion, health insurance and out-of-pocket expenditure, gender equality and empowerment, other forms of social inequality, and agriculture.

The proposals on these themes should ideally focus on generating evidence in the context of the following specific areas relevant to phone surveys:

Sampling frame for mobile phone surveys: What would be an ideal sampling frame for mobile phone surveys that is representative of the target population? Can a random digit dialing (RDD) sampling frame, commonly used in developed countries, be a viable alternative in India? Or is a two-step approach entailing a face-to-face baseline survey combined with follow-up survey rounds conducted through mobile phones a better alternative? How can we address the issue of imperfections in the sampling frame, such as under coverage and duplication, in the analysis of phone survey data (Valliant, Dever and Kreuter 2013)? How can we reduce bias and adjust for selectivity due to mobile ownership?

Non-response bias and measurement bias in telephone surveys: How to evaluate the accuracy of different modes of data collection (face-to-face versus. telephone interviewing)? How to design a study that would allow for estimation of non-response bias and measurement bias separately leading to a more effective comparison?

Comparison between face-to-face surveys and phone surveys: In the case of certain types of data collection requiring high-frequency surveys, which of the two approaches, face-to-face surveys or phone surveys, produces better data in terms of data accuracy, timeliness, cost-effectiveness, and analysis of the attrition rate? Further, how can the attrition rates in phone surveys be reduced?

Appropriate length of survey questionnaire for phone surveys: One of the constraints of a mobile phone survey is the limited number of questions that can be asked over a phone. What is the ideal length of a questionnaire for phone surveys? How can the drawback of phone surveys be overcome in the case of long questionnaires?

Comparison between different phone-based modes of data collection: Compare the data quality and data collection efficiency of phone surveys using electronic forms, SMS, interactive voice response (IVR), and live voice interface (computer-assisted telephone interviewing) on the basis of attrition, data quality, and technical and logistical considerations.

Variation in mobile phone coverage across regions: How can the heterogeneity in mobile phone ownership and network coverage across states and districts in India be incorporated while drawing inferences based on a phone survey?

Impact of respondent and interviewer characteristics: Access to telephone may be limited by age and gender. How would this constraint affect the representativeness of the sample? Do attrition rates differ by respondent characteristics? Does the gender of the interviewer affect response rates?

Survey of sensitive behaviour: Can phone surveys reduce bias and improve reporting for sensitive behaviours (e.g., contraceptive use, domestic violence, and practice of gender-, caste- and religion-based discrimination) relative to face-to-face surveys?

Mixed-mode data collection methods: How can multiple modes of data collection be combined to reduce biases in a cost-effective manner, especially for geographical regions lacking optimal mobile phone access and network coverage?

Eligibility 

Applicants affiliated to any academic or research institutes, non-profit organisations, and private companies that have experience in primary data collection and have offices within India are eligible to apply. We hope that the successful applicants will be able to collaborate with NCAER researchers in the future activities, allowing NCAER and the Centre to expand its network and the skill sets of professionals associated with it.

Funding

The Centre will support a budget of up to Rs. 20 lakh (inclusive of all applicable taxes) for a period of 12 months. The budget should clearly indicate the actual needs and modes of utilisation of the funding for the proposed project. There is a provision for two such grants. Only one grant from each applicant will be considered for funding.

Application Procedure 

All applications must be emailed to Ms Arpita Kayal, Program Manager, NDIC (akayal@ncaer.org) in a single PDF document (font ‘Georgia’, size 12) with the following components:

A) The proposal (no longer than 6 pages in single space) on research work falling under the focus areas outlined above. The proposal should include the following sections:

1. Project Summary

2. Specific Aim(s)

3. Research Strategy, which would further specify:

a. Significance

b. Innovation

c. Approach and Implementation Plan

4. Expected Outcomes

5. Potential Challenges and Alternative Strategies

6. Timeline

7. Budget and budget justification

8. Institutional background

(The proposal page limit is exclusive of the budget and institutional background.)

B) Curriculum Vitae of the key research staff who will undertake the proposed work.

Last Date for Submission of Proposals has lapsed 

Expression of interest

Applicants interested in participating in this RFP may let Ms Arpita Kayal (akayal@ncaer.org) know of their interest. We expect to set up an information sharing phone call with potential applicants during early August.

Selection Criteria

The selection of proposals will be based on the merit of the proposal and the CVs of the research team. And, the merit of the proposal will be judged on the basis of the following criteria:

  • Alignment of the proposal with the RFP
  • Innovativeness in methods
  • Rigour and feasibility of approach
  • Clarity of thought
  • Clarity in writing

Expected Output

It is expected that a report on methodology and results will be submitted to the Centre to be placed on NCAER’s website. Successful applicants are encouraged to submit their results for journal publication. The study instruments and anonymised data set will be also placed in the public domain for free online download.

References

Dabalen, Andrew, Alvin Etang, Johannes Hoogeveen, Elvis Mushi, Youdi Schipper, and Johannes von Engelhardt. 2016. Mobile Phone Panel Surveys in Developing Countries: A Practical Guide for Microdata Collection. The World Bank.

Valliant, Richard, Jill A Dever, and Frauke Kreuter. 2013. Practical Tools for Designing and Weighting Survey Samples. Springer.

The Impact of Groundwater Accessibility on the Performance of Firms

A seminar on “The Impact of Groundwater Accessibility on the Performance of Firms” with Dr Sheetal Sekhri, Department of Economics, University of Virginia, USA will be held at NCAER on July 17, 2018.

This presentation is based on the joint work of Sheetal Sekhri with Jiahua Liu. In this paper, the authors evaluate the impact of groundwater accessibility on the performance of firms. The authors use a physical limitation that discontinuously raises the cost of accessing groundwater at a depth of 8 meters to examine how such a jump in the cost of groundwater access affects firm outcomes. Employing nationally representative Micro, Small, and Medium Enterprise Census data along with groundwater measures from observation wells in India in a regression discontinuity design framework, the authors find that firm outcomes worsen in areas where the cost of groundwater access is high. The authors examine mechanisms and find that evidence weighs in favour of groundwater inaccessibility changing the composition of firms for the micro, small, and medium enterprises as opposed to the dampening of demand due to a decline in the agricultural sector. The authors do not find evidence of forward linkages in the agricultural and industrial sectors.

Sheetal Sekhri is an Associate Professor and Director of Graduate Studies at the Department of Economics, University of Virginia, USA. She is also a Fellow at the International Growth Centre, London School of Economics. Her fields of interest are development economics, applied microeconomics, environmental and natural resource economics. Her research focuses on the delivery of public services and safety nets, higher education and skill development, and water-related issues in India.

She has a BS from Iowa State University, and an MA and PhD in Economics from Brown University.

For queries, please contact Ms Sudesh Bala at sbala@ncaer.org or on 91-11-2345-2722.

The Impact of Groundwater Accessibility on the Performance of Firms

seminar on “The Impact of Groundwater Accessibility on the Performance of Firms” with Dr Sheetal Sekhri, Department of Economics, University of Virginia, USA will be held at NCAER on July 17, 2018.

This presentation is based on the joint work of Sheetal Sekhri with Jiahua Liu. In this paper, the authors evaluate the impact of groundwater accessibility on the performance of firms. The authors use a physical limitation that discontinuously raises the cost of accessing groundwater at a depth of 8 meters to examine how such a jump in the cost of groundwater access affects firm outcomes. Employing nationally representative Micro, Small, and Medium Enterprise Census data along with groundwater measures from observation wells in India in a regression discontinuity design framework, the authors find that firm outcomes worsen in areas where the cost of groundwater access is high. The authors examine mechanisms and find that evidence weighs in favour of groundwater inaccessibility changing the composition of firms for the micro, small, and medium enterprises as opposed to the dampening of demand due to a decline in the agricultural sector. The authors do not find evidence of forward linkages in the agricultural and industrial sectors.

Sheetal Sekhri is an Associate Professor and Director of Graduate Studies at the Department of Economics, University of Virginia, USA. She is also a Fellow at the International Growth Centre, London School of Economics. Her fields of interest are development economics, applied microeconomics, environmental and natural resource economics. Her research focuses on the delivery of public services and safety nets, higher education and skill development, and water-related issues in India.

She has a BS from Iowa State University, and an MA and PhD in Economics from Brown University.

For queries, please contact Ms Sudesh Bala at sbala@ncaer.org or on 91-11-2345-2722.

Environmental Catastrophes and Mitigation Policies in a Multi-region World

A seminar on “Environmental Catastrophes and Mitigation Policies in a Multi-region World” with Professor Avinash Dixit, Professor Emeritus at Princeton University was held at NCAER on July 12, 2018.

In his Presentation, Professor Dixit discussed his joint paper with Timothy Besley (LSE) which presents a simple model for assessing the willingness to pay for reductions in the risk associated with catastrophic climate change. The model is extremely tractable and applies to a multi-region world but with global externalities and has five key features. First, neither the occurrence nor the costs of a catastrophic event in any one year are precisely predictable. Second, the probability of a catastrophe occurring in any one year increases as the levels of greenhouse gases in the atmosphere increase. Third, greenhouse gases are a worldwide public bad with emissions from any one country or region increasing the risks for all. Fourth, there is two-sided irreversibility; if nothing is done and the problem proves serious, the climate, economic activity and human life will suffer permanent damage, but if we spend large sums on countermeasures and the problem turns out to be minor or even non-existent, we will have wasted resources unnecessarily. Fifth, technological progress may yield partial or even complete solutions. The framework proposed by the authors can be used to give a sense of the quantitative significance of mitigation strategies. The paper illustrates this for a core set of parameter values.

Avinash Dixit is John J. F. Sherrerd ’52 University Professor of Economics Emeritus at Princeton University. Before joining Princeton in 1981, he was assistant professor at the University of California, Berkeley, a fellow of Balliol College, Oxford, and professor at the University of Warwick. He has held visiting professorships at MIT, and visiting scholar positions at the IMF, the LSE, the Institute for International Economic Studies in Stockholm, and the Russell Sage Foundation. Dixit’s research interests include microeconomic theory, game theory, international trade, industrial organization, growth and development theories, public economics, political economy, and the new institutional economics.

Dixit was President of the Econometric Society in 2001, and of the American Economic Association in 2008. He was elected to the American Academy of Arts and Sciences in 1992, the National Academy of Sciences in 2005, the American Philosophical Society in 2010, and was elected a Corresponding Fellow of the British Academy in 2006. He received the Indian Econometric Society’s Mahalanobis Memorial International Medal in 1985. He was awarded the Padma Vibhushan by the President of India in 2016. Dixit delivered the 15th Annual NCAER India Policy Forum Lecture 0n July 10, 2018. Dixit studied for a BSc in mathematics and physics at St. Xavier’s College Bombay, at Corpus Christi College Cambridge, for a BA in mathematics, and at the Massachusetts Institute of Technology for a PhD in economics.

The India Policy Forum 2018

NCAER’s 15th India Policy Forum was held in New Delhi on July 10-11, 2018. The conference brought together a distinguished gathering of researchers, policymakers, politicians, industry participants and the media. The Union Minister for Commerce and Industry Suresh Prabhu  addressed the opening session of the two-day conference.

Dr Shekhar Shah, NCAER’s Director-General, welcoming Shri Prabhu, said: “This is the 15th India Policy Forum. Over the years we have addressed some of the most topical challenges facing the Indian economy.  This year’s IPF is a good example, covering the range of macroeconomic and microeconomic issues that India faces. We are discussing India’s growth experience but also the issue of women in the labour force.  What is unique about the IPF is that it is a place where research and policymaking meet, with each side benefitting from the discussions that happen.  The Commerce Minister’s presence is testimony to the importance of such a forum for meeting the economic policy challenges that India faces.”

Shri Suresh Prabhu, Union Minister of Commerce and Industry, thanked the IPF delegates for their sustained contribution to Indian economic policymaking. He said, “I have to make policy as well as implement it. But policymaking shouldn’t be the sole domain of government. We should try to get as much input as possible from all stakeholders, and particularly from organizations like NCAER where experts can think about issues in a dispassionate manner, and therefore offer the appropriate policy advice. Policies if not framed rightly, even if we implement them in toto, will obviously give us disastrous results. So the first and most fundamental issue is how to frame policy, and I think we in the government are always looking for ideas so that we frame the right policies around those ideas.” Click here to view the video.

The aim of the India Policy Forum is to promote robust, original economic policy and empirical research on India. Five papers, representing a unique combination of intense scholarship and policymaker engagement, were presented at the 2018 IPF. On day one, the first session dealt with Impact of Tax Breaks on Household Financial Saving, followed by a discussion on India’s Growth Story built around an analysis of 50 years of macroeconomic data. The final session dealt with Quantifying India’s Climate Vulnerability.  These three papers were followed by the IPF Policy Roundtable on “India’s Healthcare Reforms: Getting to Health For All,” involving a detailed discussion of the Ayushman Bharat National Health Protection Program. On day two, the first session dealt with Women and Work in India: Descriptive Evidence and a Review of Potential Policies, which investigates the key facts of women’s participation in workforce, followed by the last session on What Drives India’s Exports and What Explains the Recent Slowdown? New Evidence and Policy implications. This was followed by the IPF Roundup discussions in a session titled, Policy Priorities for 2019-24: What are these IPF papers telling us?

In the evening of the 10th, the Annual IPF Lecture on “How Can India Avoid Losing its Race to Prosperity?” was delivered by Professor Avinash K. DixitPadma Vibhushan awardee and Professor Emeritus at Princeton University. The Lecture was chaired by Chair by Dr Shantayanan Devarajan, Chief Economist, The World Bank.

 

 

The 15th India Policy Forum ended with a special 15th Anniversary event on Wednesday evening featuring a conversation with Arvind Subramanian, Chief Economic Adviser to the Government of India, talking with NCAER Non-resident Senior Fellow and University of California, San Diego, Professor Karthik Muralidharan. Click here to view the video.

About the India Policy Forum: The NCAER India Policy Forum is organised annually in New Delhi and promotes rigorous, world-class, empirical economic research on India with commissioned papers, an annual summer conference leading to an international journal, and the Annual IPF Lecture. The IPF provides a unique combination of intense scholarship and policymaker engagement at its summer conference. As India’s policy challenges become ever more complex, besides original empirical research the IPF now also features expert review articles that define the best available, research-based, policy guidance on issues of topical importance. An international Advisory Panel and an international Research Panel guide the IPF, with many panel members joining the summer conference. The IPF’s current editors are Shekhar Shah (NCAER), Barry Bosworth (Brookings), and Karthik Muralidharan (UC, San Diego). The IPF enters its 15th year in 2018, and for its first decade was a partnership with the Brookings Institution in Washington DC.

Archive:
The India Policy Forum 2017
The India Policy Forum 2016
The India Policy Forum 2015

    Get updates from NCAER