Final Disposition Codes
Final Disposition Codes for Random Digit Dialing Telephone Surveys |
Code |
Conversion for Cell Phone |
1. Interview |
1.0 |
|
Complete (I) |
1.10 |
|
Partial (P) |
1.20 |
Demographic questions completed plus one NCD Question |
2. Eligible, Non-interview |
2.0 |
|
Non-contact (NC) |
2.20 |
Consented and completed Demographic questions but broke off before NCD questions began |
3. Unknown Eligibility, Non-interview |
3.0 |
|
Unknown if housing unit (UH) |
3.10 |
|
Not attempted or worked |
3.11 |
|
Always busy |
3.12 |
Phone busy or network busy/down |
No answer |
3.13 |
|
Telephone answering device (don’t know if housing unit) |
3.14 |
Voicemail |
Telecommunication technological barriers (e.g., call blocking) |
3.15 |
Call blocking |
Technical phone problems |
3.16 |
Bad audio quality (i.e., static, poor reception), Unable to connect because of network issues, Breakoff by respondent due to technical difficulties before Demographic questions began |
Ambiguous operator message |
3.161 |
|
Other (UO) |
3.90 |
Breakoff before Demographic questions were complete, Pressed 3 to refuse the interview, Unable to understand language of interview, Immediate hang up, Temporarily out of service, or Part-time fax/data line, Out of coverage area |
4. Not Eligible |
4.0 |
|
Fax/data line |
4.20 |
Dedicated fax/data line |
Nonworking/disconnected number |
4.30 |
|
Nonworking number |
4.31 |
|
Disconnected number |
4.32 |
|
Temporarily out of service |
4.33 |
|
Pagers |
4.44 |
|
Nonresidence |
4.50 |
|
Business, government office |
4.51 |
|
Institution |
4.52 |
|
Group quarters |
4.53 |
|
Person not household resident |
4.54 |
|
No eligible respondent |
4.70 |
Less than 18 years old |
Quota filled |
4.80 |
|
Other |
4.90 |
Phone or SIM (subscriber identity module) card not used |
A.2 Margin of Error for Key Survey Estimates
Background
Measures of statistical precision of estimates are incorporated here to assist with analysis. For example, a sample mean will be distinctive for various samples of a similar size taken from the same population, resulting in mean estimates that are all slightly different than the true population parameter. Sampling error is a major behind the distinction between an estimate and the true population parameter. The sampling methodology recommended as a part of the NCD Mobile Phone Survey allow analysts to measure of the precision of estimates. To characterize these measures, the symbol P signifies the parameter being evaluated (e.g., the prevalence rate of persons who always or often eat processed foods that are high in salt). represents the estimate of the population parameter.
An estimate of statistical precision is the variability of the estimate, composed as V(P ̂). The variability of estimates is a marker of how much sample estimates would differ among all the conceivable samples drawn from the same sample design. The standard error of the estimate is . The relative standard error of the estimate is:
.
measures accuracy with respect to effect size. As a result, it is standardized (a.k.a., without unit) which makes it useful for comparing indicators.
The measure of precision countries should report in the NCD Mobile Phone Survey is the MOE, characterized as , where Z is a measure of the level of certainty for the measure and is the standard error of . is interpreted as:
We are 95% confident that the reported value () is within the amount MOE() of .
NCD Mobile Phone Survey analysts are urged to report the value of MOE() for all key estimates.
Data Sources
The final weighted data file used for analysis should be used for these calculations.
Computational Software
Estimates of population parameters and variability must account for sample design. Estimates must be weighted, and incorporate the use of stratification, naturally occurring clustering, without-replacement sampling, and sample weights. Failure to do so contributes to biased estimates as well as inappropriate interval estimates and tests of significance. Therefore, NCD Mobile Phone Survey country analysts are strongly urged to use analysis software that allows one to fully account for the sample design used to produce the survey data. It implies the use of software that incorporates a widely accepted approach to variance estimation.
Two statistical organizations globally have developed computer software to analyze data from complex samples like the NCD Mobile Phone Survey. These software programs will not only produce survey estimates (i.e., ), but they can also produce estimates of precision (i.e., usually either V() or SE()) that appropriately account for key design features in the NCD Mobile Phone Survey, namely naturally occurring clustering, the use of stratification, and varying selection probabilities (i.e., sample weights). Refer to Section 3.2 in the Data Management and Analysis Plan Manual for a description of these statistical software packages.
The NCD Mobile Phone Survey analysts provide technical assistance for use of the following statistical software packages: Stata and R.
More Information
For additional details on the statistical definitions provided earlier, refer to the Encyclopedia of Survey Research Methods by Paul Lavrakas. The website sponsored by the Survey Research Methods Section of the American Statistical Association also has additional software information (available from URL: www.hcp.med.harvard.edu/statistics/survey-soft).
Computation
Output from the software listed earlier will report a value of , as well as its estimated variance, denoted by V(), or its standard error, written as SE(). From these reported values, one can compute the estimate MOE for , as
.
Interpretation
The value of MOE() reported for is interpreted as follows:
We are 95% confident that the estimated value () is within the amount MOE() of .
A.3 Estimates of Sampling Errors
The respondents in the NCD Mobile Phone Survey in [country] make up just a single sample of all the conceivable samples that could have been chosen from the same population, utilizing the sample sampling design. Sampling errors are a measure of the precision between every single conceivable sample. Despite the fact that the degree of precision is not known precisely, it can be evaluated from the survey data.
The following sampling error measures are presented for each of the selected indicators:
- Value (R). Weighted prevalence estimate of the indicator.
- Standard error (SE). Sampling errors are measured by the standard errors for a particular estimate or indicator. Standard error of an estimate is the square root of the variance of that estimate.
- Sample size (n). Total number of observations used to calculate the prevalence estimate (R).
- Design effect (Deff). The design effect is the ratio of the actual variance of an indicator, under the sampling method used in the survey, to the variance calculated under the assumption of simple random sampling. A Deff value of 1.0 indicates that the sample design is as efficient as a simple random sample, while a Deff value above 1.0 indicates the increase in the standard error due to the use of a more complex sample design. In general, for a well-designed survey, Deff usually ranges from 1 to 3. It is common, however, for Deff to be much larger, up to 7 or 8.
- Relative standard error (RSE). Also known as coefficient of variation (CV), this is the ratio of the standard error to the value of the indicator.
- MOE. Margin of error is calculated as the product of the desired confidence measure and the standard error of the estimate. The level of confidence is usually based on a value (Z) of the standard normal distribution. For example, for a 95% level of confidence, use Z = 1.96.
- Confidence limits (R±1.96SE). Calculated to show the interval within which the true value for the population can be reasonably assumed to fall. For any given statistic calculated from the survey, the value of that statistic will fall within a range of plus or minus two times the standard error of the statistic in 95% of all possible samples of identical size and design.
Calculation of Standard Error
The NCD Mobile Phone Survey [year] sample is the result of a two-phase stratified design, so it is necessary to use complex formulae for estimating standard errors. For the calculation of standard errors from NCD Mobile Phone Survey [country] data, [statistical software version] was used. The Successive Difference Replication (SDR) and model-assisted variance estimation methods should be used for survey estimates. Analysts can use the output from the appropriate statistical software package to obtain the standard errors. Currently, there are only two software packages that support a two-phase stratified design. Stata employs the SDR method with the sdr option in the svy module. R employs the model-assisted method with the twophase function in the survey package, as well as within the functionality of the osDesign package.
The results are presented in this appendix for the country as a whole and for sex. For each variable or indicator, the type of statistic (mean, proportion, or rate) and the base population are given in Table A.4. In addition to the standard error (SE) described earlier, Table A.5 includes the value of the estimate (R), the sample size, the design effect (Deff), the relative standard error (RSE, MOE, and the 95% confidence limits (R±1.96SE) for each variable or indicator.
A.4 List of Indicators for Sampling Errors, NCD Mobile Phone Survey [country] [year]
Indicator |
Estimate |
Base Population |
|
Current Tobacco Smokers |
Proportion |
Adults ≥ 18 years old |
|
Current Daily Tobacco Smokers |
Proportion |
Adults ≥ 18 years old |
|
Current Smokeless Tobacco Users |
Proportion |
Adults ≥ 18 years old |
|
Current Daily Smokeless Tobacco Users |
Proportion |
Adults ≥ 18 years old |
|
Current Tobacco Users |
Proportion |
Adults ≥ 18 years old |
|
Current Alcohol Drinkers |
Proportion |
Adults ≥ 18 years old |
|
Heavy Episodic Drinkers |
Proportion |
Adults ≥ 18 years old |
|
Average number of days fruits are consumed |
Proportion |
Adults ≥ 18 years old |
|
Average number of servings of fruit consumed per day |
Proportion |
Adults ≥ 18 years old |
|
Average number of days vegetables are consumed |
Proportion |
Adults ≥ 18 years old |
|
Average number of servings of fruit consumed per day |
Proportion |
Adults ≥ 18 years old |
|
Consume less than five servings of fruits and vegetables per day |
Proportion |
Adults ≥ 18 years old |
|
Always or often add salt or salty sauce to food before eating or as they’re eating |
Proportion |
Adults ≥ 18 years old |
|
Always or often add salt or salty seasoning when cooking or preparing foods |
Proportion |
Adults ≥ 18 years old |
|
Always or often eat processed foods high in salt |
Proportion |
Adults ≥ 18 years old |
|
Previously diagnosed with raised blood pressure/hypertension |
Proportion |
Adults ≥ 18 years old |
|
Currently taking medication for raised blood pressure/hypertension |
Proportion |
Adults ≥ 18 years old who reported they were told by doctor or other health care worker that they have raised blood pressure or hypertension |
|
Previously diagnosed with raised blood glucose/diabetes |
Proportion |
Adults ≥ 18 years old |
|
Currently taking medication for raised blood glucose/diabetes |
Proportion |
Adults ≥ 18 years old who reported they were told by doctor or other health care worker that they have raised blood sugar or diabetes |
A.5 Example Table for Reporting Sampling Errors
Indicator |
Estimate (R) |
Standard Error (SE) |
Sample size (n) |
Design Effect (Deff or Deft) |
Relative Standard Error (SE/R) |
Margin of Error (MOE) |
Lower 95% Confidence Limit |
Upper 95% Confidence Limit (R+1.96SE) |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|