Appendix A
Data Collection Process and Research Methodology
Determining Valuation Methodologies
Partners and Dr. Ram Cnaan interviewed experts and reviewed
relevant literature to determine the best methodology for assessing the
monetary value of each economic impact. Even when a contribution could
be quantified, translating the numbers into monetary values was often
difficult. Moreover, congregational contributions are often difficult to
separate from other factors—family, community, government—and even
more difficult to evaluate across time. This project’s efforts to measure the
value of a congregation had to wrestle with these complexities. As we
attempted to do so, we found that many important contributions could not
be measured using current methodologies. In some of these cases, we came
up with proxy measurements, and in other cases we noted the
congregation’s contribution but did not attempt to monetize it. For a
detailed explanation, see “If you do not count it, it does not count: a pilot
study of valuing urban congregations” published in the Journal of
Management, Spirituality, and Religion.
Selecting Congregations
In each of the three cities, Partners had developed a comprehensive
inventory of all purpose-built worship sites constructed 50 or more years
ago, including 722 congregations in Philadelphia, 717 in Chicago and 345
in Fort Worth. From those inventories, Dr. Cnaan selected randomized
lists of congregations that would be asked to participate in the study.
Ultimately we surveyed and analyzed 30 participants in Chicago, 40 in
Philadelphia, and 20 in Fort Worth (which has a much smaller pool of
congregation buildings that meet the age criteria).
Interview Process and Protocols
Partners’ staff and interns served as field researchers in each of the
cities, and were provided with in-depth training in data collection and
recording procedures by Dr. Cnaan. Cnaan and the senior research team
also observed the initial interviews to ensure the reliability and conformity
of recorded responses. Cnaan was assisted by Partners’ staff with
experience from previous research projects.
To secure interviews, letters were mailed and repeated calls made to
each selected congregation; if the appropriate congregational
representative could not be reached via three phone calls (and emails), data
collectors visited the physical site to meet with congregational leaders. If a
congregation declined or was unable to participate, or the congregation was
28