A recent article (Mahr, 2022) published online by Politico quotes Rachel Walensky, the head of the CDC, regarding the fact that “the CDC alone would not be able to bring Covid-19 under control, and called for broader investment in public health at the state and local levels.”
“I actually really think many people have thought this is CDC’s responsibility, to fix public health [and] the pandemic,” Walensky said. “The CDC alone can’t fix this. Businesses have to help, the government has to help, school systems have to help. This is too big for the CDC alone.”
Walensky provides here a good point of entry into an alternative, ecosystem-based approach to addressing a transformation of the CDC and of public health efforts in general. The crux of the matter comes to a head in this statement:
“This year, the agency has struggled to strike a balance between the competing interests of a virus that continues to find ways to evade vaccines and natural immunity, and a public that is weary of taking the sort of precautions that federal and state governments have mandated.”
There are two themes of particular interest here: the competing interests of the virus and the public, and the public’s weariness with mandated precautions. These competing interests conflict in their fundamental orientation to relationships. The virus evolves via bottom-up emergent processes that adapt resiliently on the fly to changing circumstances by means of easily communicable and contagious contact methods. The public, in contrast, is able to change only via more belabored and mechanical processes imposed from the outside in, and from the top down. Where information flows quickly and efficiently in a standardized way throughout all the individuals inhabiting the virus’s multilevel networked ecology, much of the crucial information in the public domain is communicated only in incommensurable and incomparable terms that not only result in cumbersome miscommunications but even open the door to private interests’ self-serving efforts at spreading misinformation.
Balancing the virus’s and the public’s competing interests is as difficult and challenging as it is because the public interest is encumbered by institutions unable to deal with the virus on its own terms. But just as it is sometimes necessary to fight fire with fire, here it may be necessary to fight viruses virally. What does this mean?
Consider this: the virus is structured in terms of a formal genotype, a standardized phenotype, and an adaptive mutability harnessed by natural selection in a seemingly endless process of innovative evolution.
But public healthcare institutions, like institutions in general, are not structured as social ecologies giving rise to productively evolving communicable social contagions of innovative care. Instead, these institutions are counterproductively structured so as to make themselves particularly vulnerable to epidemics of misinformation. I would like to propose that this vulnerability emerges as a product of the ecological fallacy (Alker, 1969; Rousseau, 1985; Sedgwick, 2015), which involves a failure to create knowledge infrastructures sensitive to the differences between the forest and the trees, or between the map and the territory. Referred to by Whitehead (1925, pp. 52-58) as the fallacy of misplaced concreteness, Bateson’s (1972, 1978; Star & Ruhleder, 1996) concept of the “ecology of mind” stressed the epistemological error made when individuals’ cognitive processes are disconnected from the relationships in which they are embedded.
This error is virtually endemic as a primary feature of the dominant paradigm of statistical modeling in epidemiology and public health. This paradigm takes uncontrolled variations in the meaning of numeric differences for granted as an insuperable constraint. Numbers are assumed to automatically be quantitative, even though it is patently obvious that having ten rocks in no way guarantees one of possessing more rock mass than someone else with two rocks. This contradictory situation is routinely and systematically ignored in the vast majority of statistical comparisons of test scores and survey ratings. Though this is not always the case (Barney & Fisher, 2016; Fisher & Stenner, 2016; Stenner, et al., 2013, 2016), in general, quantitative methods in education, psychology, and the social sciences mistakenly assume that theoretically rigorous and reproducible interval-level measurement is impossible.
Scientific alternatives to accepting the constant confusion of incommensurable instrument-dependent ordinal units, however, have been available for decades (Rasch, 1960, 1961, 1977; Wright, 1977, 1997; Narens & Luce, 1986; Andrich & Marais, 2019; Fisher & Wright, 1994) but are rarely put to use in systematic applications. Interest in developing such applications has increased in recent years as the metrological potentials of advanced measurement modeling have become more widely known (Cano, et al., 2019; Fisher & Cano, 2022; Mari & Wilson, 2014; Mari, et al., 2021; Pendrill, 2014, 2019; Pendrill & Fisher, 2015).
Keeping everyone connected so they can think together in common languages sets up possibilities for virally communicable, evolving contagions of care. These kinds of social forms of life need to be created to be reproductively viable, with genotypic, phenotypic, and mutability characteristics analogous to those of biological forms of life (Pattee, 1985, 2012).
These characteristics correspond to developmental and semiotic levels of complexity, where formal theories and concepts, abstract instruments and words, and concrete data and things are integrated within systems, systems of systems (metasystems), and in paradigmatic supersystems (Commons & Bresette, 2006; Nöth, 2018). The hierarchy of these levels is not one in which lower levels are homogeneously reduced to monotonous sameness in higher levels, as though they are subjected to some kind of purification. Instead, higher levels integrate stochastic patterns repeating over time and space at lower levels in forms that remain identifiable but not identical across different groups of individuals (Fisher, 2020a, 2021a).
The genotype’s formal encapsulation of the conceptual instructions for organizing a standardized phenotype’s morphology comprises an explanatory model, a theory, predicting the structure and function of the physical form of a social or biological body. The predictive power of thermodynamics then experimentally validates the empirical performances of thermometers, just as the predictive power of syntactic and semantic complexity experimentally validates the empirical performances of reading comprehension tests.
The repeatability and reproducibility of the formal theory and abstract instrumentation comprising the genotypes and phenotypes of social forms of life provide scientifically defensible confidence that workable partnerships have been established between them and human interests. The explanatory and theoretical models involved are, however, probabilistic, meaning that the concrete data never conform exactly with expectations. No matter how improbable an observation might be, it is likely to occur at some expected frequency. When a form of life executes a reproductive strategy involving trillions or quadrillions of opportunities for possible mutations to occur, it actually becomes highly unlikely that improbable combinations will NOT happen. The problem of fighting a virus virally is one of creating the social ecologies in which highly improbable creative improvisations offering evolutionary innovations become likely to occur.
We tend to systematically ignore unique local variations in physical variables like time, temperature, mass, etc. because they are either negligible or deeply embedded in the environment, like the daily shifting in the shadows cast by the sun, or the differences in the time the sun sets when traveling across a time zone.
But when anomalies are encountered in research, the evolutionary potentials of mutable concrete observations come into their own. Just as perturbations in the orbit of Uranus led to the discovery of Neptune, so also did a misplaced lead plate reveal x-rays; a nonsticking glue yielded Post-It Notes; and a dead culture in a Petri dish, penicillin. To systematically create contexts in which we can make the unexpected as obvious as possible, we need to make our expectations as clear and widely distributed as possible.
The disclosure of anomalies has long been recognized as a primary function of measurement in science (Cook, 1914/1979, pp. 400, 427-439; Kuhn, 1961/1977, p. 219; Rasch, 1960, p. 124). Not enough has been done to systematically construct measurements calibrated in common metrics with expectations focused clearly enough to make unexpected results stand out and demand explanation. Even so, Latour (2004, p. 217) recognized that:
“Social sciences may become as scientific…as the natural sciences, on the condition that they run the same risks, which means rethinking their methods and reshaping their settings from top to bottom on the occasion of what those they articulate say. [The] …general principle becomes: devise your inquiries so that they maximize the recalcitrance of those you interrogate.”
In the domains of education and social science, consistent inconsistencies in test and survey data speak to the presence of multiple constructs and opportunities for clarifying communications by addressing them one at a time. Once each construct has been formally described by a predictive theory and explanatory model that accounts for variation in items’ empirically estimated scale locations at fit-for-purpose levels of uncertainty, precision, and reliability (De Boeck & Wilson, 2004; Embretson, 2010; Fischer, 1973; Fisher & Stenner, 2017; Stenner, et al., 2013, 2016), they may then be combined in multidimensional arrays or indexes (Wilson & Gochyyev, 2020) that are more interpretable and meaningful than nonlinear, ordinal, sample-dependent, and ecologically fallacious scores could ever be.
When inconsistencies do not accumulate to a level contradicting either the construct theory or the instrument calibrations, they may nonetheless point toward new and actionable information useful in applications or pointing in as-yet unexplored new directions. For instance, when an identifiable gender or ethnic subgroup expresses disagreement on Caliper’s (Morrison & Fisher, 2018-2022) generally agreeable partnership items while agreeing with the generally more disagreeable systems items, a previously inaccessible opportunity for revealing and negating institutionally systemic bias may be in hand.
Such opportunities are made available by not treating each item as a separate universe reported as a mean rating in a long list of numbers. Instead, a theory of how the measured construct changes provides a narrative account that informs interpretation, situating all the items together in a shared quantitative frame of reference. Now, the theoretically and empirically validated models of the measured construct constitute an ecological environment giving voice to any and all unique concrete expressions.
There is, then, a general failure in our institutions to conceive problems in terms of participatory social ecologies involving communications structured by semiotic levels of hierarchical complexity (i.e., as heterogenously distributed boundary objects; see Bowker, et al., 2015; Fisher, 2020a, 2022c; Fisher & Wilson, 2015; Star & Griesemer, 1989; also see Fisher & Stenner, 2018). Though this domain is inherently conceptually challenging, it is no more technically difficult than a good many other areas of human endeavor in which huge successes have been won.
Returning now to the second point concerning the public’s weariness with mandated precautions, what is the alternative to force-feeding solutions to a public largely unable to comprehend or appreciate the epidemiology of infection rates and the efficacy of vaccines? What differences will follow from culturing participatory social ecologies that do not commit the epistemological error of assuming that concrete numeric counts can be safely assumed to be abstract quantities? How might effective social contagions of communicable care invigorate a public worn and weary with tiresome efforts that pay back only intangible returns? How can institutionalized systems of incentives and rewards be restructured to captivate imaginations and inspire new entrepreneurial innovations? How might the complexities of public health measures and management be made accessible to everyday people in the same way that no understanding of thermodynamics is required to make good use of thermometers? How can instruments be designed, calibrated, and distributed so that the imaginative level of the entire population is lifted without altering the intelligence or vision of any individuals (following here Whitehead’s (1925, p. 107) description of the change in scientists’ thinking in the wake of the quantum revolution in physics; also see Hankins & Silverman, 1999; Latour, 1987, pp. 247-257).
A playful absorption into the flow of language games provides the energetic, labor-saving lift that fuels the economy of language (Banks, 2004; Fisher, 2004, 2020a, 2022b/c; Franck, 2002, 2019). Shared languages and common metrics prethink the world for us, sparing us the trouble of creating our own languages and translating between them. Linguistic standards, metrologically traceable unit quantities, and currency unions all leverage the same principle of virally communicable meaning (Fisher, 2012a/b, 2020, 2021a/b, 2022a/b/c). Efficient markets obtain their virally communicable shifts in capital flows in large part because high quality measurement standards are incorporated in legally defensible property rights and financial accountability systems (Allen & Sriram, 2000; Ashworth, 2004; Barber, 1987; Barzel, 1982; many others). There are no logical or moral reasons for not trying to create similar markets for human, social, and natural capital; in fact, making the effort would be far more logical and moral than not trying.
By mapping a trajectory of citizen involvement and empowerment in public health initiatives, as is measured and managed in the Caliper assessment of ecosystem success (Morrison & Fisher, 2018-2022) individuals could be systematically, socially, and financially motivated to see where they stand relative to personal and societal goals, to their past accomplishments, to what they should do next, and to any exceptional opportunities for leverage-able remediation or advantageous strengths. Community and organizational initiatives could ascertain the typical cost of achieving certain outcomes and could reward lean innovations that improve quality by removing wasteful resource investments.
Entrepreneurs could mount solutions that function across previously siloed sectors, expanding new markets for previously intangible assets. Because processes and outcomes are measured in an objective unit quantity, they need not be produced internally but can be purchased in market transactions. Because skills and performances are represented formally and abstractly independent of the individuals involved, fair prices can support profitable returns on investments. The alignment of human, social, and environmental values with financial values will make it impossible to extract monetary profits when genuine wealth is being destroyed (Fisher, 2012a/b, 2020a, 2021b).
References
Alker, H. R. (1969). A typology of ecological fallacies. In M. Dogan, S. Rokkan (Eds.) Quantitative ecological analysis in the social sciences. MIT Press, Cambridge, pp. 69-86.
Allen, R. H., & Sriram, R. D. (2000). The role of standards in innovation. Technological Forecasting and Social Change, 64, 171-181.
Andrich, D., & Marais, I. (2019). A course in Rasch measurement theory: Measuring in the educational, social, and health sciences. Cham, Switzerland: Springer.
Ashworth, W. J. (2004, November 19). Metrology and the state: Science, revenue, and commerce. Science, 306(5700), 1314-1317.
Banks, E. (2004). The philosophical roots of Ernst Mach’s economy of thought. Synthese, 139(1), 23-53.
Barber, J. M. (1987). Economic rationale for government funding of work on measurement standards. In R. Dobbie, J. Darrell, K. Poulter & R. Hobbs (Eds.), Review of DTI work on measurement standards (p. Annex 5). London: Department of Trade and Industry.
Barney, M., & Fisher, W. P., Jr. (2016). Adaptive measurement and assessment. Annual Review of Organizational Psychology and Organizational Behavior, 3, 469-490. Retrieved from https://www.annualreviews.org/doi/abs/10.1146/annurev-orgpsych-041015-062329
Barzel, Y. (1982). Measurement costs and the organization of markets. Journal of Law and Economics, 25, 27-48.
Bateson, G. (1972). Steps to an ecology of mind: Collected essays in anthropology, psychiatry, evolution, and epistemology. Chicago: University of Chicago Press.
Bateson, G. (1978, Spring). Number is different from quantity. CoEvolution Quarterly, 17, 44-46 [Reprinted from pp. 53-58 in Bateson, G. (1979). Mind and Nature: A Necessary Unity. New York: E. P. Dutton.]. Retrieved from http://www.wholeearth.com/issue/2017/article/295/number.is.different.from.quantity
Bowker, G., Timmermans, S., Clarke, A. E., & Balka, E. (Eds). (2015). Boundary objects and beyond: Working with Leigh Star. Cambridge, MA: MIT Press.
Cano, S., Pendrill, L., Melin, J., & Fisher, W. P., Jr. (2019). Towards consensus measurement standards for patient-centered outcomes. Measurement, 141, 62-69. Retrieved from https://doi.org/10.1016/j.measurement.2019.03.056
Commons, M. L., & Bresette, L. M. (2006). Illuminating major creative scientific innovators with postformal stages. In C. Hoare (Ed.), Handbook of adult development and learning (pp. 255-280). Oxford, UK: Oxford University Press.
Cook, T. A. (1914/1979). The curves of life. New York: Dover.
De Boeck, P., & Wilson, M. (Eds.). (2004). Explanatory item response models: A generalized linear and nonlinear approach. (Statistics for Social and Behavioral Sciences). New York: Springer-Verlag.
Embretson, S. E. (2010). Measuring psychological constructs: Advances in model-based approaches. Washington, DC: American Psychological Association.
Fischer, G. H. (1973). The linear logistic test model as an instrument in educational research. Acta Psychologica, 37, 359-374.
Fisher, W. P., Jr. (2004, October). Meaning and method in the social sciences. Human Studies: A Journal for Philosophy and the Social Sciences, 27(4), 429-454.
Fisher, W. P., Jr. (2012). Measure and manage: Intangible assets metric standards for sustainability. In J. Marques, S. Dhiman & S. Holt (Eds.), Business administration education: Changes in management and leadership strategies (pp. 43-63). New York: Palgrave Macmillan.
Fisher, W. P., Jr. (2012, June 1). What the world needs now: A bold plan for new standards [Third place, 2011 NIST/SES World Standards Day paper competition]. Standards Engineering, 64(3), 1 & 3-5 [http://ssrn.com/abstract=2083975].
Fisher, W. P., Jr. (2020a). Contextualizing sustainable development metric standards: Imagining new entrepreneurial possibilities. Sustainability, 12(9661), 1-22. Retrieved from https://doi.org/10.3390/su12229661
Fisher, W. P., Jr. (2020b). Measuring genuine progress: An example from the UN Millennium Development Goals project. Journal of Applied Measurement, 21(1), 110-133.
Fisher, W. P., Jr. (2021a). Bateson and Wright on number and quantity: How to not separate thinking from its relational context. Symmetry, 13(1415). Retrieved from https://doi.org/10.3390/sym13081415
Fisher, W. P., Jr. (2021b). Separation theorems in econometrics and psychometrics: Rasch, Frisch, two Fishers, and implications for measurement. Journal of Interdisciplinary Economics, OnlineFirst, 1-32. Retrieved from https://journals.sagepub.com/doi/10.1177/02601079211033475
Fisher, W. P., Jr. (2022a). Aiming higher in conceptualizing manageable measures in production research. In N. Durakbasa & M. G. Gençyilmaz (Eds.), Digitizing production systems: Selected papers from ISPR2021, October 07-09, 2021 online, Turkey (pp. xix-xxxix). Berlin: Springer Verlag. Retrieved from https://link.springer.com/book/10.1007/978-3-030-90421-0/1.pdf
Fisher, W. P., Jr. (2022b). Foreword: Koans, semiotics, and metrology in Stenner’s approach to measurement-informed science and commerce. In W. P. Fisher, Jr. & P. J. Massengill (Eds.), Explanatory models, unit standards, and personalized learning in educational measurement: Selected papers by A. Jackson Stenner (pp. ix-lxx). Cham: Springer.
Fisher, W. P., Jr. (2022c). Measurement systems, brilliant results, and brilliant processes in healthcare: Untapped potentials of person-centered outcome metrology for cultivating trust. In W. P. Fisher, Jr. & S. Cano (Eds.), Person-centered outcome metrology: Principles and applications for high stakes decision making. Cham: Springer.
Fisher, W. P., Jr., & Cano, S. (Eds.). (2022). Person-centred outcome metrology: Principles and applications for high stakes decision making. Springer Series in Measurement Science & Technology. Cham: Springer. Retrieved from https://link.springer.com/book/9783031074646
Fisher, W. P., Jr., & Stenner, A. J. (2016). Theory-based metrological traceability in education: A reading measurement network. Measurement, 92, 489-496. Retrieved from http://www.sciencedirect.com/science/article/pii/S0263224116303281
Fisher, W. P., Jr., & Stenner, A. J. (2017, September 18). Towards an alignment of engineering and psychometric approaches to uncertainty in measurement: Consequences for the future. 18th International Congress of Metrology, 12004, 1-9. Retrieved from https://doi.org/10.1051/metrology/201712004
Fisher, W. P., Jr., & Stenner, A. J. (2018). Ecologizing vs modernizing in measurement and metrology. Journal of Physics Conference Series, 1044(012025), [http://iopscience.iop.org/article/10.1088/1742-6596/1044/1/012025].
Fisher, W. P., Jr., & Wilson, M. (2015). Building a productive trading zone in educational assessment research and practice. Pensamiento Educativo: Revista de Investigacion Educacional Latinoamericana, 52(2), 55-78. Retrieved from https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2688260
Fisher, W. P., Jr., & Wilson, M. (2020). An online platform for sociocognitive metrology: The BEAR Assessment System Software. Measurement Science and Technology, 31(034006). Retrieved from https://iopscience.iop.org/article/10.1088/1361-6501/ab5397/meta
Fisher, W. P., Jr., & Wright, B. D. (Eds.). (1994). Applications of probabilistic conjoint measurement. International Journal of Educational Research, 21(6), 557-664.
Franck, G. (2002). The scientific economy of attention: A novel approach to the collective rationality of science. Scientometrics, 55(1), 3-26.
Franck, G. (2019). The economy of attention. Journal of Sociology, 55(1), 8-19.
Hankins, T. L., & Silverman, R. J. (1999). Instruments and the imagination. Princeton, New Jersey: Princeton University Press.
Kuhn, T. S. (1961). The function of measurement in modern physical science. Isis, 52(168), 161-193. (Rpt. in T. S. Kuhn, (Ed.). (1977). The essential tension: Selected studies in scientific tradition and change (pp. 178-224). Chicago: University of Chicago Press. Retrieved from https://www.journals.uchicago.edu/doi/abs/10.1086/349468)
Latour, B. (1987). Science in action: How to follow scientists and engineers through society. New York: Harvard University Press.
Latour, B. (2004). How to talk about the body? The normative dimension of science studies. Body & Society, 10(2-3), 205-229.
Mahr, K. (2022, August 17). CDC director orders agency overhaul, admitting flawed Covid-19 response. Politico. Retrieved from https://www.politico.com/news/2022/08/17/cdc-agency-overhaul-covid-19-response-00052384?cid=apn
Mari, L., & Wilson, M. (2014, May). An introduction to the Rasch measurement approach for metrologists. Measurement, 51, 315-327. Retrieved from http://www.sciencedirect.com/science/article/pii/S0263224114000645
Mari, L., Wilson, M., & Maul, A. (2021). Measurement across the sciences. Cham: Springer.
Morrison, J., & Fisher, W. P., Jr. (2018). Connecting learning opportunities in STEM education: Ecosystem collaborations across schools, museums, libraries, employers, and communities. Journal of Physics: Conference Series, 1065(022009). doi:10.1088/1742-6596/1065/2/022009
Morrison, J., & Fisher, W. P., Jr. (2019). Measuring for management in Science, Technology, Engineering, and Mathematics learning ecosystems. Journal of Physics: Conference Series, 1379(012042). doi:10.1088/1742-6596/1379/1/012042
Morrison, J., & Fisher, W. P., Jr. (2020, September 1). The Measure STEM Caliper Development Initiative [Online]. In http://bearcenter.berkeley.edu/seminar/measure-stem-caliper-development-initiative-online, BEAR Seminar Series. BEAR Center, Graduate School of Education: University of California, Berkeley.
Morrison, J., & Fisher, W. P., Jr. (2021). Caliper: Measuring success in STEM learning ecosystems. Measurement: Sensors, 18, 100327. Retrieved from https://doi.org/10.1016/j.measen.2021.100327
Morrison, J., & Fisher, W. P., Jr. (2022). Caliper: Steps to an ecologized knowledge infrastructure for STEM learning ecosystems in Israel. Acta IMEKO, in press.
Narens, L., & Luce, R. D. (1986). Measurement: The theory of numerical assignments. Psychological Bulletin, 99(2), 166-180.
Nöth, W. (2018). The semiotics of models. Sign Systems Studies, 46(1), 7-43.
Pattee, H. H. (1985). Universal principles of measurement and language functions in evolving systems. In J. L. Casti & A. Karlqvist (Eds.), Complexity, language, and life: Mathematical approaches (pp. 268-281). Berlin: Springer Verlag. Retrieved from https://core.ac.uk/download/pdf/33894060.pdf#page=282
Pattee, H. H. (2012). Causation, control, and the evolution of complexity. In H. H. Pattee & J. Raczaszek-Leonardi (Eds.), Laws, language and life: Howard Pattee’s classic papers on the physics of symbols with contemporary commentary (pp. 261-274). Dordrecht: Springer.
Pendrill, L. R. (2014). Man as a measurement instrument [Special Feature]. NCSLi Measure: The Journal of Measurement Science, 9(4), 22-33. Retrieved from http://www.tandfonline.com/doi/abs/10.1080/19315775.2014.11721702
Pendrill, L. R. (2019). Quality assured measurement: Unification across social and physical sciences. Cham: Springer.
Pendrill, L., & Fisher, W. P., Jr. (2015). Counting and quantification: Comparing psychometric and metrological perspectives on visual perceptions of number. Measurement, 71, 46-55. doi: http://dx.doi.org/10.1016/j.measurement.2015.04.010
Rasch, G. (1960). Probabilistic models for some intelligence and attainment tests (Reprint, with Foreword and Afterword by B. D. Wright, Chicago: University of Chicago Press, 1980). Copenhagen, Denmark: Danmarks Paedogogiske Institut.
Rasch, G. (1961). On general laws and the meaning of measurement in psychology. In J. Neyman (Ed.), Proceedings of the fourth Berkeley symposium on mathematical statistics and probability: Volume IV: Contributions to biology and problems of medicine (pp. 321-333 [http://www.rasch.org/memo1960.pdf]). Berkeley, California: University of California Press.
Rasch, G. (1977). On specific objectivity: An attempt at formalizing the request for generality and validity of scientific statements. Danish Yearbook of Philosophy, 14, 58-94. Retrieved from https://www.rasch.org/memo18.htm
Rousseau, D. M. (1985). Issues of level in organizational research: Multi-level and cross-level perspectives. Research in Organizational Behavior, 7(1), 1-37.
Sedgwick, P. (2015). Understanding the ecological fallacy. BMJ, 351.
Star, S. L., & Griesemer, J. R. (1989, August). Institutional ecology, ‘translations,’ and boundary objects: Amateurs and professionals in Berkeley’s Museum of Vertebrate Zoology, 1907-39. Social Studies of Science, 19(3), 387-420.
Star, S. L., & Ruhleder, K. (1996, March). Steps toward an ecology of infrastructure: Design and access for large information spaces. Information Systems Research, 7(1), 111-134.
Stenner, A. J., Fisher, W. P., Jr., Stone, M. H., & Burdick, D. S. (2013, August). Causal Rasch models. Frontiers in Psychology: Quantitative Psychology and Measurement, 4(536), 1-14. doi: 10.3389/fpsyg.2013.00536
Stenner, A. J., Fisher, W. P., Jr., Stone, M. H., & Burdick, D. S. (2016). Causal Rasch models in language testing: An application rich primer. In Q. Zhang (Ed.), Pacific Rim Objective Measurement Symposium (PROMS) 2015 Conference Proceedings (pp. 1-14). Singapore: Springer.
Whitehead, A. N. (1925). Science and the modern world. New York: Macmillan.
Wilson, M., & Gochyyev, P. (2020, February). Having your cake and eating it too: Multiple dimensions and a composite. Measurement, 151(107247).
Wright, B. D. (1977). Solving measurement problems with the Rasch model. Journal of Educational Measurement, 14(2), 97-116 [http://www.rasch.org/memo42.htm].
Wright, B. D. (1997). A history of social science measurement. Educational Measurement: Issues and Practice, 16(4), 33-45, 52 [http://www.rasch.org/memo62.htm]. Retrieved from https://doi.org/10.1111/j.1745-3992.1997.tb00606.x