This report is organized in four sections. The first section discusses the sample design. The next

Similar documents
The 2010 Jewish Population Study of Metropolitan Chicago METHODOLOGY REPORT

Appendix B: Survey methodology

NUMBERS, FACTS AND TRENDS SHAPING THE WORLD FOR RELEASE DECEMBER 30, 2013

The World Wide Web and the U.S. Political News Market: Online Appendices

ABOUT THE STUDY Study Goals

2017 Greater Washington Jewish Community Demographic Study

2017 Greater Washington Jewish Community Demographic Study

HIGH POINT UNIVERSITY POLL MEMO RELEASE 3/31/2015

NEWS AND RECORD / HIGH POINT UNIVERSITY POLL MEMO RELEASE 3/29/2018

HIGH POINT UNIVERSITY POLL MEMO RELEASE 11/29/2017 (UPDATE)

HIGH POINT UNIVERSITY POLL MEMO RELEASE 4/7/2017 (UPDATE)

2017 Greater Washington Jewish Community Demographic Study

NEWS AND RECORD / HIGH POINT UNIVERSITY POLL MEMO RELEASE 3/1/2017

Jewish Community Study

The 2007 Jewish Community Study of the Lehigh Valley. Main Report Volume I: Chapters 1-7

The 2018 Jewish Federation of Metropolitan Detroit Population Study: A Portrait of the Detroit Community

Protestant pastor views of Islam

HIGH POINT UNIVERSITY POLL MEMO RELEASE 2/10/2017 (UPDATE)

2016 GREATER HOUSTON JEWISH COMMUNITY STUDY

Jury Service: Is Fulfilling Your Civic Duty a Trial?

Christians Say They Do Best At Relationships, Worst In Bible Knowledge

RECOMMENDED CITATION: Pew Research Center, July, 2014, How Americans Feel About Religious Groups

Nigerian University Students Attitudes toward Pentecostalism: Pilot Study Report NPCRC Technical Report #N1102

Brandeis University Maurice and Marilyn Cohen Center for Modern Jewish Studies

Recoding of Jews in the Pew Portrait of Jewish Americans Elizabeth Tighe Raquel Kramer Leonard Saxe Daniel Parmer Ryan Victor July 9, 2014

Muhlenberg College/Morning Call. Lehigh Valley/Trump/Presidential Election Poll

JEWISH EDUCATIONAL BACKGROUND: TRENDS AND VARIATIONS AMONG TODAY S JEWISH ADULTS

Jewish Community Study

Miracles, Divine Healings, and Angels: Beliefs Among U.S. Adults 45+

HIGH POINT UNIVERSITY POLL MEMO RELEASE (UPDATE) 3/2/2016

South-Central Westchester Sound Shore Communities River Towns North-Central and Northwestern Westchester

NJPS Methodology Series UJC Research Department

MISCONCEPTIONS FUEL DEEP UNPOPULARITY OF COMMON CORE

20 SCIENCE BAROMETER 17

Number of Jews in the world with emphasis on the United States and Israel

U.S. Catholics Express Favorable View of Pope Francis

Protestant pastor views of denominations

January Parish Life Survey. Saint Paul Parish Macomb, Illinois

COMMUNITY STUDY FULL FINDINGS CONNECTING OUR JEWISH COMMUNITY

Introduction to Statistical Hypothesis Testing Prof. Arun K Tangirala Department of Chemical Engineering Indian Institute of Technology, Madras

EMBARGOED FOR RELEASE: Saturday, August 19 at 10:00 a.m.

August Parish Life Survey. Saint Benedict Parish Johnstown, Pennsylvania

A Portrait of Jewish Columbus

Muhlenberg College/Morning Call 2016 Pennsylvania Election Survey November Version

Jewish Community Study

POLITICS AND MEDIA SHAPE VIEWS OF WAR ON CHRISTMAS

THE CATHOLIC CHURCH IN CRISIS New Jersey Residents Blame Church Leaders

Views on Ethnicity and the Church. From Surveys of Protestant Pastors and Adult Americans

CONSPIRACY THEORIES PROSPER: 25% OF AMERICANS ARE TRUTHERS

FACTS About Non-Seminary-Trained Pastors Marjorie H. Royle, Ph.D. Clay Pots Research April, 2011

While Most Americans Believe in God, Only 36% Attend a Religious Service Once a Month or More Often. by Humphrey Taylor

occasions (2) occasions (5.5) occasions (10) occasions (15.5) occasions (22) occasions (28)

The 2002 Pittsburgh Jewish Community Study FINAL REPORT. United Jewish Federation of Greater Pittsburgh. in partnership with the

U.S. Catholics See Sex Abuse as the Church s Most Important Problem, Charity as Its Most Important Contribution

The 2017 Indianapolis Jewish Population Study: A Portrait of the Indianapolis Jewish Community

Faith Communities Today

Survey of Iraqi Public Opinion October 23 30, 2010

Torah Code Cluster Probabilities

Studying Religion-Associated Variations in Physicians Clinical Decisions: Theoretical Rationale and Methodological Roadmap

Usage of Islamic Banking and Financial Services by United States Muslims

DATA TABLES Global Warming, God, and the End Times by Demographic and Social Group

Module - 02 Lecturer - 09 Inferential Statistics - Motivation

WBUR Boston Area Poll Survey of 509 Registered Voters Field Dates: April 10-13, 2015

Muhlenberg College Public Health Program 2018 Pennsylvania Public Health Poll. Key Findings

Stewardship, Finances, and Allocation of Resources

YouGov June 13-14, US Adults

Social Services Estimating Conference: Impact of Patient Protection and Affordable Care Act

University System of Georgia Survey on Student Speech and Discussion

NATIONAL: U.S. CATHOLICS LOOK FORWARD TO POPE S VISIT

No Religion. Writing from the vantage. A profile of America s unchurched. By Ariela Keysar, Egon Mayer and Barry A. Kosmin

EXECUTIVE SUMMARY. The mandate for the study was to:

The sample includes 660 interviews among landline respondents and 351 interviews among cell phone respondents.

QCAA Study of Religion 2019 v1.1 General Senior Syllabus

Union for Reform Judaism. URJ Youth Alumni Study: Final Report

Religious affiliation, religious milieu, and contraceptive use in Nigeria (extended abstract)

Introduction to Inference

National Jewish Population Survey : A Guide for the Perplexed* Charles Kadushin Benjamin T. Phillips Leonard Saxe

Logical (formal) fallacies

Jewish Population of Broward County

Catholic attitudes toward birth control in five countries: United States, Ireland, Colombia, Kenya, and the Philippines

THE SEVENTH-DAY ADVENTIST CHURCH AN ANALYSIS OF STRENGTHS, WEAKNESSES, OPPORTUNITIES, AND THREATS (SWOT) Roger L. Dudley

In Our Own Words 2000 Research Study

Does your church know its neighbours?

Protestant Pastors Views on the Environment. Survey of 1,000 Protestant Pastors

Tuen Mun Ling Liang Church

College Students. The 2018 Jewish Federation of Metropolitan Detroit Population Study: A Portrait of the Detroit Community

Pastor Attrition: Myths, Realities, and Preventions. Study sponsored by: Dr. Richard Dockins and the North American Mission Board

The Changing Population Profile of American Jews : New Findings

Religion in Public Schools

Working Paper No Two National Surveys of American Jews, : A Comparison of the NJPS and AJIS

EMBARGOED FOR RELEASE: Tuesday, January 23 at 4:00 p.m.

WBUR Boston Area Poll Survey of 509 Registered Voters Field Dates: April 10-13, 2015

Multiple Streams: Diversity Within the Orthodox Jewish Community in the New York Area

THE INSTITUTE FOR JEWISH POLICY RESEARCH THE POLITICAL LEANINGS OF BRITAIN S JEWS APRIL 2010

Results from the Johns Hopkins Faculty Survey. A Report to the Johns Hopkins Committee on Faculty Development and Gender Dr. Cynthia Wolberger, Chair

New Research Explores the Long- Term Effect of Spiritual Activity among Children and Teens

A Comprehensive Study of The Frum Community of Greater Montreal

Pastor Search Survey Text Analytics Results. An analysis of responses to the open-end questions

AMERICANS, CATHOLICS REACT TO REPORTS OF CHILD ABUSE BY PRIESTS April 28-May 2, 2010

CSSS/SOC/STAT 321 Case-Based Statistics I. Introduction to Probability

Transcription:

2 This report is organized in four sections. The first section discusses the sample design. The next section describes data collection and fielding. The final two sections address weighting procedures and the response rate to the survey. I. Sample Design In keeping with previous studies of the Baltimore Jewish Community, the sample was drawn in succession from mutually exclusive groups as indicated below. 1. Jewish Listed Landline Frame: This sampling frame was provided by the Jewish Federation of Howard County and included names and home telephone numbers for 2,970 unique households in the Howard County area. Of the households including a landline number, 2,139 were randomly selected and called in the course of interviewing. This sample was assumed to yield the highest incidence of Jewish households. For efficiency and to reduce unnecessary cost expenditures, the majority of interviews were collected from this sampling frame. A total of 204 interviews were completed with respondents from the Jewish Listed Landline Frame. 2. Published RDD Sample, A second sampling frame was created from all remaining telephone numbers published in a public directory (N=73,948). 5,668 numbers were drawn as the sample from this frame, from which 36 interviews were completed with Jewish households. 3. Unpublished RDD Sample: The third sampling frame consisted of all remaining phone numbers in the Howard County area (N= 24,145 remaining households). 22,708 numbers

3 were drawn as the sample for this frame. Marketing Systems Group then utilized their CSS procedure to identify numbers that were non-working or linked to a business, and scrubbed out from the sample 15,390 of these records. Overall, 13 interviews were completed from this sample frame. II. Field Preparations, Fielding and Data Processing Questionnaire: The questionnaire was developed by UAI researchers along with the Howard County Jewish Federation and the SSRS project teams. The core of the questionnaire replicated questions appearing in previous Jewish population surveys conducted by UAI and SSRS. In addition, the Howard County Jewish Federation added questions uniquely tailored to address areas of interest. These questions focused on involvement in Jewish learning and the household s current and past financial situation (e.g., whether financial cost prevented the respondent/household from participating in Jewish programs). The topics covered by the questionnaire were: Topics Household Level Respondent Level Residency and mobility Religious identity and parentage Respondent demographics, household composition and adult demographics Children under 18: Number, ages, Jewish education/upbringing Jewish information/education, ritual behavior, Jewish & Israel attachment Childhood/teen-age experiences of respondent

4 Synagogue membership, religious service attendance, Jewish study, and Israel Effects of economic recession on participation in Jewish programs, travel to Israel, synagogue membership Volunteering Health and social service needs/status Elderly Philanthropy Additional demographics Prior to the field period SSRS programmed the study into CfMC Computer Assisted Telephone Interviewing (CATI) system. Extensive checking of the program was conducted to ascertain that all skip patterns were followed. The CATI program: The field period for this study was April 28, 2010 through June 14, 2010. The interviewing was conducted by SSRS/Social Science Research Solutions in Media, PA. All interviews were conducted using the CATI system. The CATI system ensured that questions followed logical skip patterns and that complete dispositions of all call attempts were recorded. Interviewer training: CATI interviewers received both written materials on the survey and formal training. The written materials were provided prior to the beginning of the field period and included:

5 1. An annotated questionnaire that contained information about the goals of the study as well as detailed explanations of why questions were being asked, potential obstacles to be overcome in getting good answers to questions, and respondent problems that could be anticipated ahead of time as well as strategies for addressing them. 2. A list of pronunciations for specific Jewish terms that appear in the survey. 3. An interviewer guide, providing project specifications and background information about the Howard County Jewish Federation and the survey. 4. A list of Frequently Asked Questions (FAQs) along with standard answers to the FAQs. Interviewer training was conducted before the survey was officially launched. Call center supervisors and interviewers were walked through each question in the questionnaire. Interviewers were given instructions to help them maximize response rates and ensure accurate data collection. They were also instructed to complete the basic religious screening question ( Is there anyone in the household who considers himself or herself to be Jewish? ) even with reluctant respondents, to allow as accurate an account as possible of household Jewish status even where no completed interviews were anticipated. In order to maximize survey response, SSRS enacted the following procedures during the field period: Instituting a call rule of original plus no less than 5 callbacks before considering a sampling unit "dead."

6 Varying the times of day, and the days of the week that call-backs are placed using a programmed differential call rule. Explaining the purpose of the study and assuring respondents that there were no ulterior motives (namely, fundraising) underlying this survey. Permitting respondents to set the schedule for a call-back. Instructing interviewers to attempt completing the single-question Jewish identity screener with all respondents, even if they were about to break-off before the screener. Including phone dispositions for under 18 and not in Howard County for all three strata so that interviewers could use these dispositions when necessary even if the respondent was not asked all of the screener questions. Data collection: Beyond the data collected from Jewish household respondents, the survey was designed to collect information from all respondents (Jewish or otherwise) at a level that would allow an accurate estimate of Jewish household membership in the Greater Baltimore area. In total 2,234 Jewish status screeners were collected: 375 screeners with households in which at least one adult in the household was Jewish and 1,859 where no Jewish adults resided in the household. In order to calculate the number of Jewish people in the population, we asked all households for the total number of adults and children who live in the household. For Jewish respondents completing the interview, additional questions were asked to determine the number of Jewish adults and children

7 living in the household. The responses allowed us to estimate the total number of Jewish people in each household and then to sum the number of Jews and non-jews altogether. 1 Household and person level demographic information were also collected from both Jewish and non-jewish households. The demographic information for Jewish households was collected in the main interview. Since asking all non-jewish households for demographics would be costprohibitive, demographic information for this group was collected from a random subsample of households (n=82). This number was adjusted to represent all non-jewish households in the weighting process. Data Reduction: The importance of coding, the process whereby raw data are converted into meaningful categories, cannot be minimized. SSRS employs only experienced coders. Each one is trained thoroughly by the Coding Supervisor prior to beginning work on a study. Before this training process begins, the Coding Supervisor is briefed and an in-depth review of the unique features of the study is held with the project direction staff. Once interviewing is under way, the Coding Department begins transcribing verbatim answers to the open-ended questions. Codes are constructed by the Coding Supervisor or Study Director based on a minimum sample of 20% of respondents. 1 Non-response to this question was high since this is the point where many of those who provided a response to the Jewish status screener broke off. Missing values were replaced for non-jewish households with the mean values for non-jewish households in their particular sampling frame. Missing values for Jewish households, were replaced with the mean value for Jewish households in their particular sampling frame.

8 Codes are built on a frequency of 3% or more. If an answer does not meet the specified frequency, list sheets of Other Responses are maintained. These listings are updated frequently. If they show an emergence of some response which justifies creation of a new category code, such a code is established. All codes are compiled in a question-by-question coding manual, which is reviewed in a detailed training session. This training session encompasses the following areas: Discussion of the study's background and objectives. Each coder is made aware of how the coding function fits into the overall analytic scheme. Question-by-question and column-by-column instruction. The entire coding manual is carefully reviewed, with special emphases placed on any problem areas or special features of the project. Review of open-ended codes. This ensures that each code is thoroughly understood by the staff. Designation of Jewish households: In the estimates detailed below, households were considered Jewish if the respondent said that either they or another adult in the household was Jewish and no information to the contrary was available. For those screening as Jews, follow up questions were designed to discern between those considering themselves Jewish in the conventional sense and those broadly defined as Messianic, meaning their Jewish identity is rooted in a Christian tradition. For example, respondents defining themselves as Jewish and something else were asked how they considered themselves Jewish. If their response discussed being completed Jews or made reference to Jesus as the messiah, they were regarded as Messianic and not counted as Jewish for the purposes of the survey. In all, three respondents were determined to be Messianic in the course of the interview and in analysis after the fact. In addition, 19 respondents were identified

9 as being of Jewish heritage. These were respondents who were not actively Jewish (nor anyone else in their household), but had Jewish parentage. Four cases, identified as borderline Jewish households, were coded as non-jewish (either Messianic, Jewish heritage, or non-jewish) after review of all their responses (open- and closed-ended) by UAI researchers and the SSRS research team. For non-jews and Jews who did not interview beyond the screener, there was no possibility of verification for their screener information. Therefore, there is a possibility that for several among those reporting no Jewish adults in their household, there may have some cases were Jews were present and vice versa. III. Weighting Procedures A weight was applied to all 1,991 screener interviews in order to correct for probability of selection, non-response and sampling design. The weighting procedure included the following stages: 1. Development of Universe Household Counts. The total number of counts of Published and Unpublished RDD households had to be adjusted for duplication. All Jewish Published records were also cross-matched to ascertain whether they were Published or Unpublished; these numbers were then subtracted from the Published RDD and Unpublished RDD frames.

10 We developed universal household counts by county by first taking the Claritas 2010 estimate of total households in Howard County and subtracting the Jewish Published records from that total and then the number of Published RDD records available, with remaining households falling into the Unpublished RDD strata. Household Type Total Households Fed List Landline 2,970 Listed RDD 73,948 Unlisted RDD 24,145 TOTAL 101,063 1. Development of Sample Counts. To be able to weight the data to the universal household counts, at its very core, is a simple re-balancing procedure where the percent of sample is made to weight to the percent of the universe in the table above. This of course meant attaining the identical table in the sample. The sample table for completes is as follows: Household Type Total Completes Fed List Landline 204 Listed RDD 36 Unlisted RDD 13 TOTAL 253 Once sample universe and sample counts were attained, the formal weighting procedure could commence:

11 1. Correction for probability of telephone selection. (i) each case was given a weight equal to the number of phones they answer (t), capped at three, meaning this could range from one to three; (ii) each case was given a weight representing the likelihood of selection within their sampling frame (f=n sample /N frame ); (iii) the likelihood that numbers in the sampling frame are eligible, as defined by being in the Howard-county area (r). The weight for probability of selection correction was calculated as: B i =(f i *t i *r i ) -1. This weight was utilized only in frames where respondents would be reached by multiple phones, namely the RDD frames. 2. Correction for probability of Jewish Listed selection. (i) each case in the Jewish Listed frame was given a weight equal to the probability of being selected, since Jewish Listed cell phones were oversampled at a fraction of 0.3426 while Jewish Listed landlines were sampled at a fraction of 0.0638. This weight was then balanced and all other cases (sample other than Jewish Listed sample) received a weight of 1.0. 3. Non-response (Household) correction. In order to correct for the possibility that survey nonresponse was correlated with any variable of interest, and to attain accurate household counts for demography, we employed a weighting class correction applying the two variables known for all sample members and the population, as discussed earlier in this report: county and sampling frame. This was accomplished by calculating the population household percentage for each of the strata and then dividing, in each strata, the percentage in the known household population by the percentage in the sample. The ratio between the population percentage and the weighted sample percentage produced the primary household weight.

12 4. Composite household base-weight. The final composite household base weight is a product of the three corrections noted above: phone, Jewish Listed selection, and non-response. 5. Jewish weights and Population weights. During data analysis, UAI created Jewish person and all persons [population] weights based upon the number of Jewish persons and all persons in each household. 6. Projected weights. All weights have been constructed to provide projections/extrapolations to the Jewish community in Howard County the number of Jewish households, the number of Jewish persons, and the number of all people (including non-jews) in the household. In the data file, these numbers are 7,517 Jewish households, 17,227 Jewish persons in those households, and 20,404 people (including non-jewish household members). In the survey report summaries, these numbers are rounded to: 7,500 Jewish households, 17,200 Jews and 20,400 total people living in Jewish households in Howard County. Error Estimates The unweighted margin of error based on Jewish and non-jewish screener completes (n=9,932) is ±2.17%. The unweighted margin of error for survey completes (at the 95% confidence level) for a sample size of 253 is ±6.30%. With a design effect of 1.94, the sampling error of the survey responses (at the traditional 95% confidence level) is ±8.59%; thus,.survey data from all 253 completed Jewish household interviews have a maximum survey sampling error of ±8.6%.

13 Applying the weights: In addition to producing the population estimates, the household or person weight should be used when analyzing the data to assure the data are more representative than the raw counts. We should note that the two weights represent a somewhat different population. Using the household weight produces estimates of the distribution of responses among Jewish households (e.g., what percentage of Jewish households keep kosher), while the Jewish weight produces estimates for the numbers and percentages of all Jews living in the 7,500 Jewish Howard County households (e.g., what percentage of Jews, living in Jewish households, reside in households that keep kosher). IV. Response Rate The response rate for this study was calculated to be 28.9% using AAPOR s RR3 formula. A full sample disposition follows. RR3 = Cat 1 / (Cat 1) + (Cat 2) + e(cat 3) Response Rate 3 (RR3) estimates what proportion of cases of unknown eligibility is actually eligible. In estimating e, one must be guided by the best available scientific information on what share eligible cases make up among the unknown cases and one must not select a proportion in order to boost the response rate. The AAPOR calculator utilizes proportional representation, which is the number of eligible cases found during the survey divided by the total number of eligible and ineligible cases (cat 1 & 2 / cat 1, 2 and 4).

14 Sample Disposition, 2010 Jewish Community Study of Howard County: Disposition FED LIST RDD Unpub. RDD Pub. Total Eligible, interview (Category 1) Complete 204 36 13 253 Eligible, non-interview (Category 2) Refusal 15 6 7 28 Break off 27 5 9 41 Other eligible, non-interview 6 4 0 10 Unknown eligibility, no interview (Category 3) Always busy 11 21 38 70 No answer 331 1,112 2,788 4,231 Answering Machines 936 1,779 175 2,890 Refusal - Unknown eligibility 190 786 332 1,308 No screener completed 8 73 29 110 Not eligible (Category 4) Language Barrier 0 0 0 0 Fax/data line 37 243 1,551 1,831 Non-working number 286 175 14,645 15,106 Special technological circumstances 0 0 0 0 Non-residence 33 117 2,486 2,636 No eligible respondent 55 1,269 634 1,958 Blocked Calls 0 42 1 43 Total Phone Numbers Called 2,139 5,668 22,708 30,515 Total Jewish ID 268 65 42 375 Total Non-Jewish ID 55 1,228 576 1,859 Not Identified 1 57 34 92 Cooperation Rate 3 82.93% 76.60% 44.83% 78.57% Response Rate 3 24.7% 26.9% 29.8% 28.9%