Using Facebook to Locate Sample Members

Locating and retaining sample members is a challenge for any longitudinal study. If sample members are lost to follow-up, the potential for non-response bias increases and power for analyses decreases. Survey researchers have several tools available to locate sample members and a new one has emerged: the internet. This article reports on the use of social media—in particular, Facebook—to contact participants in a longitudinal study and encourage them to complete a telephone interview. Individuals we located on Facebook were significantly more likely to be white, have attended at least some college, and have higher household incomes than the rest of the study sample.

We then identify two categories of completed interviews associated with Facebook: those achieved (1) as a direct result of our Facebook contact and (2) seemingly because they were influenced by the Facebook contact. There were no significant differences on several demographic measures for the former group, but the latter shows differences in race/ethnicity, education, age, and household income—and not always in expected directions. We conclude that Facebook can be an effective tool for locating and contacting sample members who have not replied to more traditional attempts to reach them.

The internet’s presence in American life has become pervasive: nearly 70% of U.S. households have internet service (U.S. Census Bureau 2010), and more than 95% of U.S. adults accessed the internet in the past year (World Bank 2011). The widespread availability of the internet means that social networking sites—such as Facebook, MySpace, or LinkedIn – have become an integral part of many users’ internet experience. The most commonly used one is Facebook with over 157 million visitors in May 2011 alone (Lipsman 2011), and more than 750 million active users (Facebook Statistics 2011). As social networking sites (SNS) have extended their reach into the population, survey researchers have attempted to leverage them, but little research on methods or results has been published. One longitudinal study reported a 4.6% reduction in attrition by using Facebook and MySpace to locate and contact sample members (Nwadiuko et al. 2010). Another study used Facebook and MySpace to locate sample members; of 406 messages sent to SNS, 29 (7.1%) resulted in completed interviews (Perkins, Granger, and Saleska 2009). Both studies surveyed young adults, a group with particularly high rates of SNS usage (Wilkinson and Thelwall 2010). Both studies were conducted several years ago so would not have benefited from SNS expansion (since 2009 Facebook’s user base has grown by 200% (Foster 2010)).

Study Description

SEED for Oklahoma Kids (SEED OK) is a random assignment experiment to test the impacts of giving every child a savings account at birth, “seeded” with an initial deposit and offering additional funds to match deposits. A random sample was drawn from birth records in Oklahoma, stratified by geographic location, with oversamples of American Indians, Hispanics, and African Americans. RTI conducted baseline telephone interviews with the sampled child’s mother shortly after birth and a follow-up survey 3 years later.

The follow-up survey first attempted to contact sample members through mailings, e-mail, and telephone. When a sample member could not be reached, the case was assigned to field staff who attempted to locate sample members in person and encourage them to call in to complete the survey.

As field personnel were attempting in-person locating, two project staff used Facebook to attempt to locate and contact non-respondents. The locators used their own personal Facebook accounts; we considered setting up new accounts solely to locate and contact sample members but felt that messages from a new Facebook account with few or no friends might look like ‘spam’ to recipients.

Each locator had basic information about sample members including full name, best known address, age, e-mail address, and child’s name. Locators used Facebook’s built- in search feature to locate sample members.

Once the locator found a profile that appeared to be the sample member, she sent a message to the sample member. A Facebook message is not public and can be viewed only by the message’s sender and recipient. The message said we were looking for someone with the sample member’s name who participated in the SEED OK survey about three years ago, and asked that if we had the right person she call a toll-free number to complete the interview.

Results

Locators attempted to find 919 sample members on Facebook, all of whom had not been reached through previous telephone or mail attempts. This group was significantly more likely to be American Indian or Hispanic (compared to African American or Caucasian), have not attended college, be single, and be over 30 years old.^[1]

Of the 919 we tried to locate on Facebook, we found profiles and sent messages to 294 sample members (32%).^[2] Our efforts were more successful in locating some demographic groups than others. As shown in Exhibit 1, study participants located through Facebook were significantly more likely to be white, have attended at least some college, and have higher household incomes.^[3]

Since the study was attempting to locate and contact sample members by phone and in person concurrently with the Facebook locating effort, we cannot tease apart the unique effect of the Facebook message on survey completion rates. We can, however, credit the Facebook message as contributing to a completed interview if it was our last contact with the sample member before she completed the interview. Of 294 sample members, 92 (31%) received a Facebook message and then completed an interview. Thus, sending a Facebook message eliminated the need for further in-person or telephone outreach by 10% (92 of 919 non-respondents). These Facebook completes represent 4% of all completed interviews.

We next examined Facebook completes by demographic characteristics (Exhibit 2). Although there were differences in characteristics for sample members located through Facebook, there are no statistically significant differences in characteristics for sample members who completed interviews.

Although we attribute only 92 completed interviews directly to the Facebook effort, there is some evidence that the Facebook communication helped sway sample members to respond to phone and in-person attempts to locate them. Of those contacted on Facebook, 215 of 294 (73 percent) ultimately completed an interview for the study — significantly more than those we attempted to locate on Facebook but could not, suggesting the Facebook message may have had some influence on the respondent’s decision to complete the interview. Those who ultimately completed the interview after being contacted through Facebook were significantly different from the rest of the sample on race/ethnicity, education, age, and income. Exhibit 2 shows comparisons between (1) completes directly attributed to Facebook and all other completed interviews and (2) completes influenced by Facebook contact (including those directly attributed) and all other completed interviews. As an example, the race/ethnicity of interviews completed as a direct result of contact with Facebook users (column 1) was not significantly different from the race/ethnicity of all other completed interviews (column 2), but the race/ethnicity of those whose completion of the interview may have been influenced by the Facebook message (column 3) was significantly different from all others (column 4).

We then examined whether the Facebook completes differed from the rest of the sample on an important outcome variable: whether they had saved for their child’s education.^[4] Those who ultimately completed the interview after being contacted through Facebook were not significantly more likely to have savings for their child’s college education.

We also constructed logistic models that included all variables from the above analyses (Exhibits 1 and 2), but we quickly ran into problems with intercorrelation, small cell sizes (often less than 5 or 10 cases), and large standard errors. We believe multivariate analyses are important for understanding the relationships at play and hope that other studies will soon have enough cases to warrant this type of investigation.

Conclusions

Facebook can be an effective tool for locating and contacting sample members who have not replied to more traditional attempts to reach them. This kind of Facebook effort can increase overall response rates and can be particularly effective for certain demographic groups, namely younger and more highly educated sample members—essentially mirroring the population of Facebook users.

We had greater success locating and contacting sample members through SNS than previous studies, most likely because of increased use of SNS (particularly Facebook) since the previous studies were fielded. Importantly, Facebook was effective in locating sample members across a range of demographic characteristics.

Sample members who were contacted through Facebook and subsequently completed the follow-up interview were significantly different from those contacted in some other way. This difference suggests that we were able to reach segments of the sample through Facebook that we might not have otherwise been able to contact, potentially reducing non-response bias.