CHAPTER 1: Research Methodology

In keeping with the directive allowing each state to determine the appropriate methodology in gathering information for establishing prevalence rates, we have elected not to adopt the conventional methods used in most CSAT-funded surveys-that is, personal interviews, conducted face-to-face or via telephone, with a sample of the population. Instead, for this study we have employed an indirect approach that makes use of key informants to obtain information on an entire community.

The methodology we have chosen is, admittedly, more problematic, and the epidemiological data may be challenged as little better than "second-hand" or "mere hearsay" and the prevalence rates derived from the data regarded as corrupted. There is an obvious appeal in personal interviews done with a well-designed instrument: they are neat, simple to administer and can generate good figures.

Even so, we believe that the problems with the direct interview method in Micronesia outweigh its advantages. In many Pacific societies, personal interviews on life problem areas are not culturally appropriate and often yield information that is not reliable. Micronesians dislike talking about their own problems or those of other members of their family to outsiders. Whatever promises may be made, anonymity is impossible and confidentiality extremely rare in small island societies. In past surveys that have dealt with culturally sensitive subjects (eg, child abuse, suicide), we have had reason to suspect the reliability of information derived in direct interviews, or even with the individual's family. In these studies we have found it preferable to rely on information supplied by others in the community outside the immediate family. Hence, we have adopted the same data collection procedures for this report that we have successfully employed in other studies in Micronesia.

Another difference in approach is the way in which subjects were chosen. Rather than using random selection, as many epidemiological surveys do, we opted to survey everyone-men, women and children-in several preselected communities from each state. The communities were chosen with an eye to providing a good representation of the various ethnic groups, religious backgrounds, and stages of relative acculturation as measured by position on the rural-urban residence scale. Each community selected contained between 200 and 400 persons, including children. All members of each household were screened for any alcohol and drug users, past or present, and individual forms were completed for all of those with a history of alcohol or drug use. The questionnaire form in the interviews was adapted from the core instrument prepared by the National Technical Center for Substance Abuse Needs Assessment (NTC). (The survey interview forms can be found in Appendix 3 of this report.)

Our preference for a community survey approach rather than random sampling is grounded in the social realities of a Pacific society. The community survey yields a picture of the behavioral patterns of a social group rather than an individual isolate. In a place like Micronesia, with its enormous stress on social interaction and communal norms of behavior, we are likely to derive information that will better help us understand the etiology of the drinking and drug problem in the lives of individuals and suggest more effective forms of prevention and treatment.

The coded individual data were entered in the computer and a check was made against the 1994 census for FSM to verify that the data represented at least 5 percent of the total population and that the distribution of the persons surveyed corresponded to the breakdown of the general population by state, gender, age-cohort, residence and ethnicity. Where there appeared to be significant over- or under-representation in any of these categories, adjustments were made to compensate for the differences before calculating prevalence rates and making projections on treatment.

All general population figures used for comparative purposes in this study were taken from the 1994 FSM census and used without adjustment for population growth. Since the census, taken in September 1994, preceded the start of our survey (May 1996) by less than 20 months, the increased accuracy of the population data did not seem proportional to the effort involved in making such adjustments. This is all the more true since yearly population growth has declined substantially everywhere in the FSM, as the recent census indicates.

The survey instrument allowed us to generate two types of prevalence rates: lifetime prevalence and point prevalence within the last 12 months. The current prevalence rate is by far the more important and more reliable of the two, and it is this that will be presented in the tables. Where there is no indication to the contrary, the reader can assume that the twelve-month point prevalence rate is referred to in all figures. Where significant findings appear, lifetime prevalence rates will be given as well.

Selection of Representative Communities

The communities to be surveyed were chosen so as to provide a good balance of ethnicity, religion, and position on the scale of distance from modernization. The selection process aimed at picking a broad geographical range within a state. Hence, we attempted to select some communities that contained large pockets of off-islanders and an ethnic mix, and others that were made up almost exclusively of the ethnic majority; some strongly Protestant communities and others that were predominantly Catholic; some in or close to the main town, others at a considerable distance from the town and its amenities. We attempted to make this selection with an eye to the composition of the population of the state, but without adopting rigorous statistical norms.

Each community constituted a village or, if the village was too large to be surveyed in its entirety, an identifiable section of a village. (The ideal community size was established at between 200 and 400 persons of all age groups.) All households within this area were interviewed to avoid any hidden bias that might be at work in random selection.

The total number of communities surveyed was proportionate to the size of the state population; they totaled three in Kosrae, five in Yap, seven in Pohnpei, and nine in Chuuk. The ideal total state sample sizes, at 5 percent of the population, would have been: Chuuk 2,650; Pohnpei 1,770; Yap 560; and Kosrae 370.

In fact, the survey samples in all the states exceeded these numbers. The actual sample size for each state was: Pohnpei 2,284; Kosrae 450; Chuuk 2,857; Yap 952 (Tables showing the breakdown of the state samples for each age group and sex are found in Appendix 4. The comparative breakdown of the general population and the survey sample into age groups and sex by percentage is also included in the appendix.)

The communities sampled in each state and the sample size for each are given below. Additional background on the communities and their characteristics can be found in Appendix 2.

Pohnpei: Enipein (369), Saladek (428), Sokehs (302), Ohmine (382), Mesihsou (264), Palipowe (293), Mokil (246)

Kosrae: Lelu (212), Utwa (125), Malem (113)

Chuuk: Kuchua (293), Seletiw (351), Sapuk (323), Tunnuk (316), Sopou (294), Sapore (318), Nomwin (307), Nama (354), Foup (301)

Yap: Maa/Thol (213), Ngolog (214), Kanifay (216), Falalop (150), Mogmog (159)

Sample Stratification

The interview data for each state were checked against the population figures for that state from the FSM census of 1994 to ensure that the data represented a 5 percent sample. The interview data were then cross-checked by sex, age, ethnicity, and position on the urban-rural scale to determine whether it was representative of the percentage of the state population as presented in the FSM census. Where the data for sex and age was under-representative or over-representative, it was weighted accordingly in calculating any projections for the general population.

The study excluded all children below the age of 10. It was decided to make the cut-off point 10 rather than 15 since we believed that in using the latter age we would run the risk of eliminating boys and girls in their young teens who might be inhaling gas and glue. The results of the survey not only supported this belief but indicated that some of those in their early teens use alcohol as well.

The age matrix used in our tables has been adapted from the standard US matrix so as to conform better to the life-cycle of the Micronesian societies studied. The age cohorts used here are: 10-14, 15-19, 20-29, 30-44, 45-64, and 65+. A breakdown into five-year age cohorts in the teens is helpful since during these years many young islanders begin using drugs and alcohol. On the other hand, the age of 18 is not a significant boundary marker for Micronesians as it is for Americans. In many cases the most intense period of alcohol and drug use comes during the 20s. The next 15 years of life, between the ages of about 30 and 44, mark young adulthood and are a transitional time for many male islanders. Often a heavy drug user or drinker will modify his intake or cease altogether as he approaches the age of responsible maturity. By the age of 45 or so, a man is expected to attain full maturity and exercise control over the impulses that may have dominated his life as a young man.

The numerically significant ethnic groups in the states of FSM are these: Yapese, Yapese Outer Islander, Chuukese, Chuukese Western Island, Mortlockese, Pohnpeian, Pingelapese, Mokilese, Nukuoroan, Kapingamarangi, Kosraean, American, Chinese, and Filipino. Not all are identified in the results of the survey, either because the sample size was too small to be reliable or because those surveyed were not always identified by their ethnic origins. Many Mortlockese surveyed on Pohnpei, for instance, were identified as "Pohnpeian" rather than "Mortlockese" even if both parents had been born in the Mortlocks.

The urban-rural spectrum can be roughly divided into three categories: town dwellers, village dwellers, and inhabitants of the outer atolls. Town dwellers are those who live in or near the port towns, the commercial centers that enjoy a relatively modern living standard not found elsewhere. The village dwellers are those who reside in the rural areas of the high islands, often at some distance from the town. Local food is eaten there and little wage employment is to be found. Finally, the coral atolls, which often lie hundreds of miles away from the state capitals, have the simplest life-style and the fewest amenities of modern life. Their contacts with the population centers are tenuous and infrequent.

Interview Methods

The field investigator, a Micronesian with long work experience in the FSM National Government, selected between two to four persons to serve as key informants for each community. In one or two cases, the informants were expatriates with an intimate knowledge of the community, but usually they were Micronesians residing in the community who were familiar enough with the families to possess detailed information on all the members of the households and were willing to do so on the guarantee that they and the information they furnished would be held strictly in confidence. Church ministers and older persons with a high position in the community were excluded in favor of younger adults who might be more knowledgeable about the behavior of that segment of the population engaged in drug use. An attempt was made to include at least one female informant to ensure adequate coverage of women in the community.

Working with the field investigator, the informants completed a sheet on each household listing all the members of the household, their age and sex, their religion and ethnicity. Next to each name the informants indicated whether that person had ever used drugs in his/her life. This preliminary survey of the community served as a screen to identify individuals about whom more detailed information was to be collected.

Once the household survey forms were finished, an individual interview sheet was completed for any individual known to have been using alcohol or drugs at any time. In addition to basic biodata-sex, age, marital status, educational background, occupational status, and travel abroad-the sheet recorded detailed information on the type of drugs used, the frequency and extent of use, the seriousness of the problem, and the kind of treatment sought, if any. The interview protocol used was a heavily modified and abbreviated form of the core instrument designed by NTC.

It should be noted that the names were retained on these interview sheets, as well as in the computer files, so that any additional information that might be found from additional sources such as court records, police files, and case reports, might be added to the individual's record. We felt that names were necessary if we were ever to compile some "thick data" on individual users that might help us determine key factors that put persons at risk for substance abuse problems. Once the data collection was completed, however, the names were deleted from the files to maintain confidentiality.

Although we were confident that a key informant methodology was far more suited to Micronesia than direct interviews, the reliability of third-person interview data remained a serious question. As a check on the reliability of our data, therefore, we conducted direct personal interviews with a small sample (10-12 persons) from each community. These persons were a convenience sample, but selected to include a male and female from each of the major age cohorts employed in this study. This yielded about 200 direct interviews throughout the four states. A random preliminary check was then made to determine the extent of discrepancies between the direct interviews and the third-person interviews. In this preliminary comparison of the interview results for ten persons, the correspondence of the data was strikingly close. There were no discrepancies at all in the reports on the type of drugs used and surprisingly little on the amount consumed; the greatest variation appeared in the reported frequency of drug use, with the third-person interview reporting a lower frequency than the direct personal interview.

Another check of the different interview sheets was made of 20 more persons after all the data were entered in the computer, but this check produced results very close to the first one. Given the positive results of these informal checks, we decided against doing a more careful tally of the discrepancies on the grounds that they were not significant enough to justify the time and trouble. The close correspondence seen in these reliability checks confirmed our judgment that sound data could be gathered by a key informant study in communities that are as small and closely knit as the ones that we were studying in Micronesia.

Data Processing and Analysis

As the interviews in each community were completed, they were checked for completeness and consistency by the field investigator. When this was done, the survey results were entered on the computer in a dBASE IV file, with a field for each of the questions asked. A computer record was established for all individuals surveyed, even those who had no history of drug use of any kind, so that statistical tables could be more easily generated.

When all the computer entries for a state were completed, the computer entries were checked for keying errors through the use of the EpiInfo 6 statistical frequency function. When any errors were corrected in the dBASE IV file and the record numbers for each community were checked against the original interview forms, we began generating tables on the use of each drug. Tables showing age-sex distribution of current drug users were first generated, and then tables indicating the frequency and amount of the drug consumed.

After the tables were reviewed, the decision was made as to what correlations should be examined. Numbers and percentages for such correlations were generated from the dBase IV file, but further statistical operations to determine the confidence level and p-value were performed through the EpiInfo 6 program. These were used in the tables and narrative only to the degree that was deemed appropriate.

Projections of total current drug users on the island were made on the basis of the sex-age breakdowns of the survey data, since age and sex correlated more strongly with drug use than any other factors. Each age-sex group of persons surveyed was compared with the same group in the general population to derive the percentage of the sample before projections were made for the users in this category.

Collection of Other Data

Despite the reporting requirements that are built into most US federal program grants, data collection and maintenance remains uneven in the FSM. This hampered us in our attempt to gather data on social indicators of alcohol and drug abuse. Figures on alcohol imports by quantity and type were not available; only figures on the dollar amount of imports could be obtained. Deaths due to alcohol-related illness, accidents, homicide and suicide were recorded by the state departments of health services, but the criteria used in determining these deaths seems to have varied from state to state. In the initial data obtained from Chuuk, for example, the list of alcohol-related diseases was longer and the number of deaths in each category much larger than one would project. Moreover, the number of suicides recorded by the states was fewer in almost every case than the number generated by the author from the data-base he has maintained on suicide cases for the past twenty years.

In the end, we used whatever reliable data we could get on social indicators of drug and alcohol abuse. Where possible, we attempted to get figures for the past five years. Social indicators for which reasonably good data was found are: yearly alcohol imports by dollar value; per capita yearly expenditures on alcohol; alcohol-related deaths (as recorded by the hospitals); arrests for alcohol-related crimes as a percentage of total arrests; suicides occurring while under the influence of alcohol or drugs as percentage of total suicides.