Field Identity, Public Engagement, and Self-Critique: The Reflexive Commitments of Neglect Studies


Executive Summary

This paper concludes the series by addressing the questions that the preceding papers have deferred: what the field is to be called, how it should present itself to non-specialist audiences, how it should distinguish its work from adjacent enterprises that share some of its concerns but operate by different standards, and how it should examine its own attention patterns with the same scrutiny it applies to other fields. The paper proceeds from the premise that a field whose central business is the rigorous identification of neglected questions cannot afford to be itself a producer of unfounded claims, of unexamined assumptions, or of the same blind spots it documents elsewhere.

The paper develops seven arguments. The first is that the naming question, deferred throughout the series, must be settled deliberately because the name shapes how the field is received by external audiences and what it becomes internally. The second is that public-facing scholarship is intrinsic to the field’s mission rather than incidental to it, and that the public engagement must be conducted with the same methodological seriousness as the field’s scholarly work. The third is that the field must distinguish its rigorous identification of neglect from grievance scholarship, contrarianism, and conspiracy thinking, and that the distinction depends on professional discipline that the field’s institutions must support. The fourth is that internal pluralism — the field’s hospitality to scholars whose underlying commitments differ — is a methodological requirement rather than a political accommodation, since the patterns of neglect cut across the political spectrum and a field that addresses neglect on only one side will misidentify the patterns it studies. The fifth is that the field requires a built-in reflexive program to examine its own attention patterns, with the program operating through established procedures rather than depending on the goodwill of individual scholars. The sixth is that sunset and renewal mechanisms are appropriate to a field whose success in particular domains should sometimes work itself out of a job. The seventh is that the long-term success criteria for the field should be the measurable redistribution of attention in the wider scholarly ecosystem, rather than the growth of the field itself.

The paper concludes with a synthesis of the series and a discussion of the next steps that the founding scholars of the field should consider.


1. Introduction

The preceding seven papers have specified the field’s conceptual framework, its methodological standards, its academic infrastructure, its funding strategy, its data resources, its workforce, and its engagement with research-governing institutions. The specifications have been substantial and the proposals have been many, but the series has consistently deferred a set of questions that the field’s character ultimately depends on. What is the field called, and what does the name commit it to? How does the field speak to audiences beyond its own scholars? How does the field distinguish its work from enterprises that look similar from outside but operate by different standards? How does the field examine itself with the rigor it applies to others?

The questions are deferred not because they are unimportant but because they cannot be answered until the foundation is in place. A field’s name, its public presentation, its boundaries against adjacent enterprises, and its reflexive commitments depend on what the field actually is, and the preceding papers have specified what the field is to be. The conclusion of the series can now address what the field is to become as it presents itself to the wider world.

The argument of this paper is that the reflexive commitments are not optional additions to the field’s substantive work; they are constitutive of it. A field whose central business is the rigorous identification of neglected questions cannot afford to be itself a producer of unfounded claims, of unexamined assumptions, or of the same blind spots it documents elsewhere. The reflexive commitments operate as professional discipline, as institutional design, and as cultural maintenance. They are demanding to sustain, but the field’s credibility depends on them, and the credibility is the foundation on which everything else the series has proposed rests.

The paper proceeds through the seven questions identified above, addresses the synthesis of the series as a whole, and concludes with the practical next steps that the field’s founding scholars should consider.

2. The Naming Question

The working term used throughout this series has been neglect studies, with the acknowledgment in Paper 1 that the term is provisional and that the field’s eventual name remains an open question. The question must now be addressed.

Several candidate names have been used in adjacent literatures or could be proposed for the field. Each carries implications, and the choice among them shapes both how the field is received externally and what it becomes internally.

Agnotology, as developed by Robert Proctor and Londa Schiebinger, has the advantages of an established intellectual tradition, a substantial literature, and a recognizable name in the relevant scholarly circles. The case for adopting the term and treating the proposed field as an expansion of agnotology is that the conceptual core is shared, that the methodological tools overlap substantially, and that the broader recognition of agnotology in the science studies community provides an entry point that a wholly new name would lack. The case against is that agnotology’s center of gravity has settled firmly on strategic ignorance — the manufactured doubt produced by interested actors — while the larger and arguably more consequential category of passive neglect has received much less attention. The field’s expansion of the agnotology agenda may sit uncomfortably within the existing literature, and the term may signal to external audiences a different set of commitments than the field actually maintains.

Undone-science studies, drawing on the Hess and Frickel tradition, has the advantages of a methodologically sophisticated literature, an explicit attention to civil-society challenges to research-priority decisions, and a name that captures one of the field’s central concerns. The case against is that the term has been associated primarily with environmental and public-health contexts and with cases where organized constituencies exist to identify the gap, while the field’s scope extends well beyond these. The term may also signal an activist orientation that the field’s methodological standards do not support, and the field would need to expand both the scope and the disposition that the term implies.

Attention studies has the advantage of plain English and the disadvantage of being already used for several different scholarly enterprises in cognitive science, media studies, and elsewhere. The collision of meanings would generate persistent confusion, and the name probably should be rejected on those grounds alone.

Epistemic gap analysis has the advantage of methodological transparency — it announces what the field does in terms that scholars from other disciplines can readily understand — and the disadvantage of clinical neutrality that may not serve the field’s public engagement. The name reads as a technical specialty rather than as a field with its own intellectual identity, and the field’s broader ambitions may be poorly served by it.

Neglect studies, the working term, has the advantages of plain English, of capturing what the field does in terms that non-specialists can immediately understand, and of not colliding with established uses in other contexts. The disadvantages are that the term sounds less methodologically sophisticated than the field aspires to be, that it carries connotations of complaint or grievance that the field must explicitly distance itself from, and that it does not connect the field to the established traditions on which it draws.

The recommendation is that neglect studies should be retained as the field’s working name, with the explicit understanding that the name’s plainness is a virtue rather than a limitation. The field’s methodological sophistication should be demonstrated through the work rather than signaled by the name, and the plainness of the name has the practical advantage of accessibility to the public and policy audiences whose engagement the field requires. The name’s potential connotations of grievance must be addressed through the field’s professional discipline rather than avoided through more technical naming. The connection to established traditions can be maintained through citation practice, through institutional partnerships, and through the work’s substantive engagement with the literatures on which it draws.

The recommendation is offered with the recognition that other choices are defensible and that the field’s founding scholars may settle on a different name. What matters more than the specific choice is that the choice be made deliberately, with attention to its implications, and that the choice be sustained consistently across the field’s outputs once made. A field that drifts among multiple names in its early years confuses external audiences and disadvantages itself in the consolidation that establishes a field’s identity.

3. Public-Facing Scholarship

The field’s public engagement is intrinsic to its mission rather than incidental to it. The argument has three components.

The first is that the field’s findings have public implications. To say that the research system has misallocated attention in particular ways is to say something with consequences for how public resources are spent, for what questions are addressed in policies that affect people’s lives, and for what voices are heard in the production of knowledge that shapes public understanding. The implications are not always obvious or immediate, but they are real, and the public has legitimate interests in the field’s findings.

The second is that the public is itself a constituency for some of the field’s most important work. The constituency-less-questions category in the Paper 1 taxonomy points to cases where the absent parties are members of the public whose concerns have not been adequately represented in scholarly research. The field’s engagement with these cases requires engagement with the publics whose interests are involved, both to inform the public about the patterns of neglect that affect them and to learn from the public about the questions that scholarly research has failed to address.

The third is that the public is the ultimate source of the legitimacy on which the research system depends. The funding that supports research, the institutional autonomy that universities enjoy, the standing of scholarly expertise in policy decisions: all of these depend on public support that can be withdrawn if the public concludes that the research system has failed to serve its interests. A field that examines the patterns of attention in scholarly inquiry has a specific contribution to make to the public’s understanding of the research system, and the contribution serves both the public’s interests and the research system’s long-term legitimacy.

The public-facing scholarship that the field requires must be conducted with the same methodological seriousness as the field’s scholarly work. The standards include accuracy in the representation of findings, explicit acknowledgment of the limitations and uncertainties that the underlying work carries, attention to the framing of findings in ways that the public can use, and avoidance of the sensationalism that exaggerates the field’s claims for the sake of attention.

The specific forms of public engagement the field should pursue include several. The dashboard introduced in Paper 5 provides a public-facing data resource that the public can use to explore the patterns of attention in research areas of interest. The journalism partnerships that translate the field’s findings into accessible forms can amplify the field’s reach beyond what the field’s own scholars can accomplish. The participation of the field’s scholars in broader public conversations about science and research policy provides opportunities to bring the field’s perspective to discussions that would otherwise proceed without it. The educational materials that introduce the field’s questions to students and general audiences support the broader public literacy on which the field’s longer-term standing depends.

The risks of public engagement are familiar from many scholarly fields and require explicit attention. The first risk is the simplification of findings in ways that misrepresent the underlying work. The risk is sometimes unavoidable in genuinely public-facing communication, but it must be managed by careful attention to how findings are framed, by explicit acknowledgment of the simplifications when they occur, and by the availability of fuller treatments for audiences who want to engage with the work in more depth. The second risk is the misuse of findings by actors with their own agendas. The risk cannot be eliminated, but it can be reduced by the field’s own clarity about what its findings support and do not support, and it can be managed by the field’s willingness to correct misuses when they occur. The third risk is the distortion of the field’s research agenda by the demands of public attention, with the field’s scholars finding themselves drawn toward the topics that generate public interest at the expense of less visible but equally important work. The corrective is the maintenance of the field’s professional standards independently of public attention patterns, with the understanding that not all of the field’s important work will receive public attention and that the field’s value is not measured by its visibility alone.

4. Distinguishing the Field from Adjacent Enterprises

The field must distinguish its work from adjacent enterprises that share some of its concerns but operate by different standards. The distinction is essential to the field’s credibility and to its capacity to engage productively with the broader research-policy environment.

Three adjacent enterprises deserve specific treatment.

4.1 Grievance Scholarship

Some scholarship that identifies cases of neglect operates as a vehicle for advancing the substantive interests of its authors rather than as a methodologically careful identification of patterns in the research system. The scholarship may be sincere — the authors may genuinely believe that the cases they identify are neglected — but the methodological standards are typically lower than the field requires, and the conclusions tend to align predictably with the authors’ substantive commitments rather than emerging from independent analysis.

The distinction between grievance scholarship and rigorous identification of neglect depends on the methodological standards developed in Paper 2 and on the professional norms developed across the series. The field’s outputs should be evaluated against the tiered evidence standard, with the higher tiers requiring triangulation across methods and explicit consideration of the alternative explanations for apparent neglect. The field’s professional culture should reward methodologically careful work that produces conclusions the author would not have predicted in advance, and should discount work whose conclusions track the author’s prior commitments without independent evidentiary support.

The field’s institutional structures must be designed to enforce the distinction. The journal’s editorial standards must require submissions to meet the methodological criteria appropriate to the tier claimed, with editors and reviewers trained to recognize the difference between rigorous identification of neglect and substantive advocacy in methodological clothing. The registry’s evidence-tier system must be applied consistently, with entries that do not meet the documentation requirements either declined or accepted only at the exploratory tier with explicit labeling. The professional association’s standards must require members to maintain the methodological practices that distinguish the field’s work from grievance scholarship.

The enforcement is delicate because the boundary is not always clear and because the field’s scholars will sometimes have substantive commitments that bear on the questions they study. The distinction is not that the field’s scholars must lack commitments; it is that the work must meet the methodological standards regardless of the commitments. A scholar who has substantive interest in a particular case of neglect can still produce rigorous work on that case, provided the work is conducted by methods that would be persuasive to scholars who do not share the interest and that explicitly considers the alternative explanations for the apparent neglect. The professional discipline is to meet that standard consistently, even when the substantive commitments make it tempting to relax.

4.2 Contrarianism

A second adjacent enterprise that the field must distinguish itself from is contrarianism — the disposition to oppose established positions because they are established rather than because the evidence supports the opposition. Contrarianism shares with neglect studies an interest in questions that established communities have not addressed, but the contrarian’s motivation is the rejection of established authority rather than the methodologically careful identification of patterns in attention.

The distinction matters because the field’s work can superficially resemble contrarianism. A scholar who identifies an area as neglected is implicitly questioning the priorities of the established research community in that area, and the questioning can be misread as contrarian opposition. The misreading damages the field’s credibility with the established communities whose cooperation it requires, and the field must accordingly distinguish itself from contrarianism explicitly.

The distinction depends on the methodological standards and on the field’s professional culture. The field’s work proceeds from analysis to conclusions, with the analysis conducted by methods that the relevant scholarly communities recognize as appropriate. The contrarian proceeds from a disposition to oppose established positions, with the analysis serving to justify a conclusion that the disposition predetermined. The two can produce findings that look similar at a glance, but the methodological structure that produces them is different, and the field’s outputs must make the methodological structure explicit.

The field’s engagement with established communities should also include explicit acknowledgment of what those communities have done well. A neglect-studies analysis that identifies a particular case of misallocation in a discipline is more credible when it situates the case against an accurate understanding of the discipline’s achievements and constraints than when it presents the case as evidence of the discipline’s general failure. The framing is not strategic accommodation; it is methodologically appropriate, since the patterns of attention always reflect both genuine accomplishments and the structural distortions that the field identifies, and accurate analysis must capture both.

4.3 Conspiracy Thinking

The third adjacent enterprise the field must distinguish itself from is conspiracy thinking — the tendency to attribute patterns in the research system to the deliberate coordination of interested actors who suppress particular questions for their own purposes. Conspiracy thinking shares with neglect studies an interest in the mechanisms by which attention is allocated, but the structure of explanation differs in important ways.

The field’s account of the mechanisms of neglect, developed across the preceding papers, emphasizes structural factors: funding incentives, prestige hierarchies, methodological habits, disciplinary boundaries, and historical contingencies. The mechanisms operate without anyone necessarily intending the patterns they produce, and the corrective interventions accordingly operate on the structures rather than on the supposed agents of suppression. The conspiracy account, by contrast, emphasizes intentional coordination: identified actors who deliberately suppress particular questions for purposes the conspiracy theorist can articulate.

The two accounts can sometimes apply to the same cases, and the agnotology literature has documented cases in which industrial actors have deliberately suppressed research findings that threatened their commercial interests. The field’s work should not deny that such cases exist; the literature on tobacco, on climate, and on other documented cases of strategic ignorance is solid, and the field’s scholars should engage with it on its merits. The distinction is that the field’s analytical default should be structural explanation, with intentional coordination introduced as an explanation only when the evidence specifically supports it. The default reflects both the structural realities of the research system, in which most patterns are produced by uncoordinated incentive structures rather than by deliberate suppression, and the methodological discipline that the field’s credibility requires.

The risk of conspiracy thinking is particularly acute for the field because the work attracts audiences who are predisposed toward conspiratorial interpretations. The audiences include scholars whose own work has been received poorly and who are inclined to attribute the reception to deliberate suppression rather than to methodological or substantive limitations of the work; advocacy organizations whose interests are served by framing research-policy decisions as the products of deliberate manipulation; and members of the public whose distrust of scientific institutions makes conspiratorial explanations attractive. The field’s engagement with these audiences must include the patient maintenance of the structural-explanation default and the explicit rejection of conspiratorial interpretations that the evidence does not support.

5. Internal Pluralism

The field’s hospitality to scholars whose underlying commitments differ is a methodological requirement rather than a political accommodation. The argument has three components.

The first is that the patterns of neglect cut across the political spectrum. Some neglected questions bear on concerns that are typically associated with the political left — health disparities, environmental injustice, the underrepresentation of women’s health questions in clinical research. Other neglected questions bear on concerns typically associated with the political right — the effects of family structure on child outcomes, the predictive validity of certain psychological constructs, the long-term consequences of particular policy interventions. Yet other questions cut across the political spectrum or are not naturally located on it at all — many questions in foundational science, in the humanities, and in the history of knowledge. A field that addresses only the questions associated with one political position will miss the patterns that cross the spectrum, and the partial coverage will reduce the field to a vehicle for advocacy rather than a genuine scholarly enterprise.

The second is that the field’s empirical credibility depends on demonstrating that its identifications of neglect are not driven by the political commitments of its scholars. A field whose findings consistently align with the commitments of one political position will be received as ideological rather than scholarly, and the reception will be appropriate to the pattern. The credibility requires the field to include scholars with diverse commitments, to evaluate work by methodological standards rather than by political affinity, and to recognize cases of neglect across the political spectrum on the same terms.

The third is that the methodological maturity the field requires is supported by intellectual diversity. A field whose scholars share substantive commitments tends to develop blind spots that scholars with different commitments would have noticed. The diversity is not a substitute for methodological rigor — diverse scholars can still produce poor work — but it is a condition for the rigor to operate effectively, since the methodological scrutiny depends on perspectives that can identify weaknesses that the scholars themselves do not see.

The implications for the field’s institutional structures are several. The editorial board of the flagship journal should include scholars with diverse commitments, with the diversity attended to deliberately at the founding rather than assumed to emerge naturally. The recruitment of doctoral students and early-career scholars should not select implicitly for particular commitments, and the field’s professional culture should welcome scholars across the spectrum on the same terms. The engagement with research-governing institutions should be conducted in ways that do not privilege the concerns of any particular political position. The reflexive program discussed below should specifically examine whether the field’s attention patterns show the kinds of political asymmetries that would compromise the field’s credibility.

The implications are demanding, and the field will face pressure against them. The pressure will come from scholars whose own commitments make particular cases of neglect more visible to them than others, from audiences who want the field to support their substantive positions, and from the broader political environment in which scholarly work increasingly carries political valence. Resisting the pressure is among the most important professional disciplines the field must develop, and the institutional design must explicitly support the resistance.

6. The Reflexive Program

The field requires a built-in reflexive program to examine its own attention patterns. The program operates through established procedures rather than depending on the goodwill of individual scholars, and the procedures should be specified in the field’s foundational documents rather than developed in response to subsequent controversies.

The reflexive program has several specific components.

The first is the periodic audit of the field’s own research portfolio. The audits should be conducted on a defined schedule — perhaps every five years — by scholars not directly involved in the work being audited, and the audits should examine what the field has and has not addressed during the period under review. The findings should be published in the field’s outlets and should inform the discussions of the field’s priorities going forward. The audits should specifically attend to potential blind spots: areas the field would be expected to address but has not, perspectives the field has not adequately included, and patterns in the field’s outputs that suggest implicit priorities the field’s scholars have not endorsed explicitly.

The second is the explicit attention to neglect across the political spectrum. The discussion in section 5 above identified the methodological requirement, and the reflexive program should include the procedural mechanisms that maintain the requirement in practice. The audit findings should report on the political distribution of the cases the field has addressed; the editorial decisions should be reviewed periodically to ensure that they do not show patterns of preference for particular kinds of cases; and the recruitment and retention of scholars should be examined to ensure that the field’s professional community remains diverse in the commitments its members bring.

The third is the assessment of the field’s engagement relationships and their effects on the field’s research portfolio. The engagement with research-governing institutions, discussed in Paper 7, creates pressures that can shift the field’s emphases in ways the field’s scholars would not endorse on reflection. The reflexive program should examine whether the engagement has produced such shifts, whether the engagement partners’ priorities are appropriately represented in the field’s work, and whether the structural commitments that protect the field’s analytical independence are being maintained in practice. The assessment should be conducted by scholars who are not themselves heavily involved in the engagement relationships, and the findings should be published in the field’s outlets.

The fourth is the periodic review of the field’s methodological standards and the tiered evidence system. The standards introduced in Paper 2 will require revision as the field’s experience accumulates, and the revision should be conducted through deliberate processes rather than through informal drift. The review should examine whether the standards have been applied consistently across the field’s outputs, whether the tiered system has functioned as intended, and whether the methodological developments in adjacent fields require the field’s standards to be updated. The review should be conducted by the field’s professional community through transparent procedures, and the revised standards should be documented explicitly.

The fifth is the examination of the field’s own internal patterns of attention. A field that studies which questions are addressed and which are neglected in other research areas must apply the same scrutiny to its own work. The examination should identify the substantive areas, methodological approaches, and types of cases that the field has emphasized and those it has not, and should examine whether the patterns reflect deliberate priorities or implicit ones that the field’s scholars would not endorse on reflection. The examination should be conducted with the same methodological seriousness the field applies to other fields, and the findings should inform the field’s priorities going forward.

The reflexive program is uncomfortable in practice because it requires the field’s scholars to apply scrutiny to their own work with the same rigor they apply to others. The discomfort is the point: a field whose central business is the rigorous identification of neglected questions cannot afford to be itself a producer of unfounded claims, of unexamined assumptions, or of the same blind spots it documents elsewhere. The reflexive commitments must be sustained as professional discipline, and the institutional structures must be designed to support the discipline even when sustaining it is uncomfortable.

7. Sunset and Renewal

A healthy neglect-studies enterprise should sometimes work itself out of a job in particular domains. The argument is that the field’s success in specific cases consists precisely in the redistribution of attention that the field has identified as warranted. When a previously neglected area develops its own research community, institutional infrastructure, and sustained attention, the field’s specific work on that area has succeeded, and the work itself becomes less necessary even as it leaves behind a transformed research landscape.

The principle has implications for how the field organizes its specific research programs. A center, project, or fellowship dedicated to a particular case of neglect should be conceived with explicit consideration of what the success conditions would look like and what the appropriate response to success would be. The success conditions should be specified before the work begins, the indicators that the conditions are being met should be tracked during the work, and the response to success should include the redirection of the resources to other neglected cases rather than the indefinite continuation of the specific program.

The principle is uncomfortable institutionally because institutional structures tend to perpetuate themselves once established. A center has staff whose livelihoods depend on the center’s continuation, a project has scholars whose careers are invested in the project’s ongoing work, and the natural pressures favor the institutional persistence even when the original justification has weakened. The field’s institutional design must include explicit mechanisms for resisting these pressures, with sunset clauses in specific programs, with periodic external reviews that consider whether continuation is warranted, and with cultural norms that celebrate the cases in which the field’s specific work has succeeded and is no longer needed.

The corresponding principle is renewal. The cases of neglect are not static; new cases emerge as research areas develop, as new methodologies become available, as new constituencies organize, and as the broader research system changes. The field’s institutional structures should include explicit mechanisms for identifying emerging cases and for redirecting attention toward them, with the renewal proceeding alongside the sunset of specific programs whose work has succeeded.

The sunset-and-renewal principle applies to the field as a whole as well as to its specific programs. If the field’s broader work succeeds — if the patterns of attention in the research system become more responsive to the structural distortions the field has identified, if the institutional mechanisms for identifying and addressing neglect become routine features of the research system, if the methodological and conceptual contributions the field has made become widely diffused — then the field’s specific institutional structures may become less necessary even as the broader work continues. The possibility should not be feared. A field whose mission is the redistribution of attention should welcome the success that makes its specific work less necessary, even as it continues to address the new cases that emerge as the research landscape evolves.

The recognition does not require the field to plan its own dissolution. The patterns of neglect are persistent features of scholarly inquiry, and the field’s work will remain necessary for as long as scholarly inquiry continues to allocate attention in the structurally distorted ways that the preceding papers have documented. The recognition is rather that the field’s success is measured not by its own growth and persistence but by the changes in the broader research system that the field’s work has helped to produce. The orientation toward external success rather than internal preservation is among the most important cultural commitments the field must maintain.

8. Long-Term Success Criteria

The discussion of sunset and renewal points toward the question of how the field’s long-term success should be measured. The answer is that the measure should be the redistribution of attention in the wider scholarly ecosystem, not the growth of the field itself.

The specific indicators of success include several. The first is the reduction in patterns of structural neglect that the field has documented. The patterns identified in particular cases should diminish over time if the field’s interventions have been effective, and the diminution should be measurable through the same bibliometric and analytical tools that identified the original patterns. The measurement requires the long-term data infrastructure discussed in Paper 5 and the sustained analytical work that the workforce of Paper 6 will conduct.

The second is the incorporation of the field’s methods and concepts into the routine practice of research-governing institutions. The funding agencies that adopt portfolio review as a regular practice, the learned societies that commission stocktaking reviews of their own disciplines, the universities that revise their tenure criteria to recognize the kinds of contributions the field’s scholars make, and the international organizations that incorporate attention to neglect into their standard practices all represent forms of success that go beyond the field’s own work. The success consists in the field’s contributions becoming part of how the research system works rather than remaining specific to the field’s own activities.

The third is the broader cultural shift in how the research system understands itself. The recognition that attention is allocated rather than distributed, that the allocation mechanisms produce structural distortions, and that the distortions are appropriate subjects of scholarly study and corrective intervention all represent cultural shifts that the field’s work can contribute to even when the contributions cannot be traced to specific outputs. The cultural shift is harder to measure than the specific indicators above, but it is the deepest form of success the field can achieve, and the indicators of it can be tracked through the changing terms in which the research system discusses its own priorities.

The success criteria are demanding, and they extend on timelines that exceed any individual scholar’s career. The field’s founding scholars will not see the full measure of the success they have contributed to, and the patience required to sustain work whose results extend across generations is among the cultural commitments the field must maintain. The patience is not resignation; it is the recognition that the work the field undertakes is of a scale that requires sustained effort over long periods, and that the contributions of any individual scholar or any individual cohort are valuable contributions to a larger project rather than self-contained achievements.

The implication for the field’s evaluation of its own progress is that the standard measures of scholarly success — citations, publications, grants, prestige — are partial indicators rather than ultimate measures. The standard measures matter for the practical reasons that any field’s standing depends on them, and the field must perform adequately by these measures to maintain the institutional infrastructure that supports its work. But the standard measures do not capture the field’s deepest contributions, and the field’s professional culture should keep the broader success criteria in view rather than allowing the standard measures to become ends in themselves.

9. Synthesis of the Series

The preface to this series argued that the distribution of scholarly attention bears a complicated and often weak relationship to the distribution of scholarly importance, and that the institutional and intellectual scaffolding needed to study this phenomenon systematically has not yet been built. The seven papers that followed have specified what the scaffolding would look like: the conceptual framework that defines what the field studies, the methodological standards that distinguish rigorous identification of neglect from impressionistic claims, the academic infrastructure that hosts the work, the funding strategy that sustains it, the data resources that enable it, the workforce that conducts it, and the engagement with research-governing institutions through which the work reaches the bodies that can act on it.

This final paper has addressed the commitments that hold the whole structure together: the field’s name and public identity, its distinctions from adjacent enterprises that operate by different standards, its internal pluralism, its reflexive examination of its own attention patterns, its orientation toward eventual success rather than indefinite self-perpetuation, and its broader success criteria measured by changes in the wider research system rather than by the field’s own growth.

The series has consistently emphasized the interdependencies among its elements. The methodological standards cannot be applied without the institutional infrastructure that hosts them; the institutional infrastructure cannot be sustained without the funding strategy that supports it; the funding strategy cannot be implemented without the workforce that engages with the funding partners; the engagement with funding partners cannot be conducted without the analytical independence that the reflexive commitments protect. The field cannot be built piecemeal, with elements added as resources allow and the others deferred indefinitely. The elements support each other, and the coherent building of the whole requires attention to all of them from the outset, even when their development proceeds on different timelines.

The series has also emphasized the long timelines on which the field’s work proceeds. The founding centers can be established within a few years; the journal can be launched within five; the workforce that gives the field a sustained scholarly community emerges over a decade; the broader changes in the research system that constitute the field’s deepest success extend across generations. The patience required to sustain the work over these timelines is among the cultural commitments the founding scholars must maintain, and the institutional structures must be designed to support the patience even when the temptations toward shorter-horizon thinking are persistent.

The series has been explicit about the risks the field faces. The risk of becoming a vehicle for grievance scholarship, of being captured by the institutions it engages with, of developing the same blind spots it documents elsewhere, of growing too quickly to maintain its standards or too slowly to sustain its infrastructure, of being co-opted by political actors whose purposes the field’s analytical commitments do not support — all of these have been identified, and the structural commitments that protect against them have been specified. The protections are not guarantees; they are professional disciplines that the field’s scholars must maintain through ongoing effort, and the maintenance is among the most important professional commitments the field requires.

The series has been deliberate in its argumentative structure, with each paper building on the preceding ones and the conclusions of each paper feeding into the next. The structure reflects the actual interdependencies of the field’s institutional infrastructure rather than a rhetorical convenience. The founding scholars who read the series should expect to encounter the same interdependencies in practice, and the founding work should be planned with the recognition that the elements must be developed in coordination rather than in sequence.

10. Next Steps

The series has been a design document rather than an implementation plan, and the conclusion of the series should specify the next steps that the founding scholars should consider.

The first step is the convening of a founding committee. The committee should include senior scholars from the disciplines on which the field draws — agnotology, metascience, science and technology studies, the history and philosophy of science, library and information science, priority-setting research, and the research-waste literature — together with representatives from the constituencies the field will serve: funding agencies that have expressed interest in the field’s work, foundations whose missions align with the field, and practitioners who can speak to the public’s interests in the field’s outputs. The committee’s task should be to review the series, to refine the proposals in light of the committee’s collective expertise, and to develop the specific implementation plans that the proposals require.

The second step is the identification of the institutions that will host the founding centers. The criteria for selection were discussed in Paper 3, and the committee should apply the criteria to identify the candidate institutions whose senior scholars, institutional environments, and funding arrangements make them the most plausible hosts. The selection should be deliberate rather than first-come, and the institutions selected should be expected to commit to the long-term institutional support that the founding centers will require.

The third step is the establishment of the funding partnerships that will support the founding work. The strategy outlined in Paper 4 emphasized philanthropic funding as the likely first mover, and the committee should engage with the foundations whose missions align with the field to develop the specific funding proposals that the founding work requires. The engagement should be conducted with attention to the diversification that the funding strategy emphasized, with multiple funders cultivated from the outset rather than reliance on any single funder for the early support.

The fourth step is the launch of the founding centers, with the institutional infrastructure, the funding, and the senior scholarly leadership in place. The launches should be coordinated across the centers rather than proceeding independently, with explicit attention to the complementarity among the centers and to the cross-institutional connections that will support the field’s broader community.

The fifth step is the development of the flagship journal, the registry, and the other elements of the publication infrastructure that Paper 3 specified. The development should proceed in coordination with the founding centers, with the editorial leadership drawn from the centers’ senior scholars and the operational support hosted by one of the centers.

The sixth step is the longer-term work that the preceding papers have specified: the doctoral training, the workforce development, the data infrastructure, the engagement relationships, and the reflexive program. The work proceeds on the timelines that the relevant papers identified, with the founding committee maintaining oversight of the broader strategy during the period before the field’s professional association can assume the governance functions.

The steps are demanding, and the founding scholars who undertake them are committing to long-term work whose results extend beyond their own careers. The commitment is justified, in this paper’s view, by the contributions the field can make to the broader research enterprise and to the public interests that the research enterprise serves. The justification is a matter for the founding scholars to assess for themselves, and the series has been offered as a contribution to that assessment rather than as a settled brief.

The preface to this series concluded with an invitation: that readers who find the case persuasive engage with the subsequent papers, and that readers who find it unpersuasive articulate the grounds of their disagreement. The conclusion of the series renews the invitation. The field that the series has proposed will be built only if scholars who find the case persuasive undertake the work, and the work will be more rigorous if it proceeds in conversation with scholars whose perspectives differ from the founders’. The conversation should continue, and the series should be understood as one contribution to it rather than as the last word.


Notes

[^1]: The naming question for emerging interdisciplinary fields has been examined in several contexts; the discussion in Klein (1990) of how field names shape disciplinary identities provides useful background, and the case studies in Frodeman, Klein, and Pacheco (2017) include several relevant examples.

[^2]: The literature on public engagement in science is substantial; the standards-of-practice work developed by the National Co-ordinating Centre for Public Engagement in the U.K. and parallel bodies elsewhere provides operational guidance, and the scholarly literature on the role of public engagement in research is reviewed in Stilgoe, Lock, and Wilsdon (2014).

[^3]: The distinction between rigorous identification of neglect and grievance scholarship draws on the broader literature on scholarly standards in fields with applied dimensions; Lamont (2009), cited in Paper 2, addresses adjacent questions in the context of peer review.

[^4]: The literature on contrarianism in scholarly contexts is partial but includes useful treatments in the philosophy of science; the discussion in Boudry, Blancke, and Pigliucci (2015) of the distinction between productive heterodoxy and unproductive contrarianism provides relevant analysis.

[^5]: The agnotology literature, cited extensively in earlier papers, is the primary scholarly source for the analysis of strategic ignorance; Proctor and Schiebinger (2008) and the case studies in Proctor (2011) and Oreskes and Conway (2010) provide the foundational material.

[^6]: The reflexivity literature in science studies is large and includes both methodological treatments and substantive applications; Woolgar (1988) provides a foundational statement, and the subsequent literature has developed the application of reflexive methods in many directions.

[^7]: The literature on the dissolution and renewal of research programs is partly historical and partly philosophical; Laudan (1977), cited in Paper 1, addresses the philosophical questions, and the historical literature on specific cases provides the empirical material.

[^8]: The long-term assessment of scholarly fields is discussed in the literature on the sociology of knowledge; the work of Whitley (2000) on the intellectual and social organization of the sciences provides useful conceptual resources, and the more recent literature on field formation and dissolution extends the analysis.


References

Boudry, M., Blancke, S., & Pigliucci, M. (2015). What makes weird beliefs thrive? The epidemiology of pseudoscience. Philosophical Psychology, 28(8), 1177–1198.

Frodeman, R., Klein, J. T., & Pacheco, R. C. S. (Eds.). (2017). The Oxford handbook of interdisciplinarity (2nd ed.). Oxford University Press.

Klein, J. T. (1990). Interdisciplinarity: History, theory, and practice. Wayne State University Press.

Lamont, M. (2009). How professors think: Inside the curious world of academic judgment. Harvard University Press.

Laudan, L. (1977). Progress and its problems: Toward a theory of scientific growth. University of California Press.

Oreskes, N., & Conway, E. M. (2010). Merchants of doubt: How a handful of scientists obscured the truth on issues from tobacco smoke to global warming. Bloomsbury Press.

Proctor, R. N. (2011). Golden holocaust: Origins of the cigarette catastrophe and the case for abolition. University of California Press.

Proctor, R. N., & Schiebinger, L. (Eds.). (2008). Agnotology: The making and unmaking of ignorance. Stanford University Press.

Stilgoe, J., Lock, S. J., & Wilsdon, J. (2014). Why should we promote public engagement with science? Public Understanding of Science, 23(1), 4–15.

Whitley, R. (2000). The intellectual and social organization of the sciences (2nd ed.). Oxford University Press.

Woolgar, S. (Ed.). (1988). Knowledge and reflexivity: New frontiers in the sociology of knowledge. Sage.


The series concludes here. The founding scholars who take up the work that the series has proposed will determine whether the field that has been described becomes a reality, and the answer to that question lies in their hands rather than in any further argumentative effort the series could provide.

Posted in Musings | Tagged , , , | Leave a comment

Engagement with Research-Governing Institutions: How Neglect Studies Works With the Bodies Whose Decisions It Studies


Executive Summary

This paper addresses the field’s engagement with the institutions whose decisions shape the distribution of scholarly attention: funding agencies, learned societies, journals, university administrations, government science advisory bodies, and international scientific organizations. The engagement is unavoidable because the field’s applied dimension depends on its findings reaching the bodies that can act on them, and it is fraught because those bodies are the same ones whose attention patterns the field exists to examine. The paper develops a strategy for engagement that allows the field to be useful to research-governing institutions without losing the analytical independence on which its value to those institutions depends.

The paper develops six arguments. The first is that engagement with research-governing institutions is intrinsic to the field’s mission rather than incidental to it, and that the engagement must be planned and supported with the same seriousness as the field’s scholarly work. The second is that funding agencies are the field’s primary interlocutors and that the engagement with them must address several specific functions — portfolio review, priority-setting consultation, embedded analysis — each of which has its own institutional dynamics. The third is that engagement with learned societies and journals operates through different mechanisms and addresses different aspects of the attention problem. The fourth is that engagement with university administrations is necessary for the institutional changes that affect what kinds of scholarship are professionally rewarded, and that this engagement is among the slowest of the field’s applied activities to produce visible results. The fifth is that engagement with government science advisory bodies and parliamentary committees provides the highest-leverage opportunities the field will have, but also carries the highest risks of co-optation and political entanglement. The sixth is that international scientific organizations and cross-border coordination require the field to develop capacities that the early founding years will not fully support, and that the international agenda should accordingly be paced realistically.

The paper concludes with a discussion of the independence problem — the central tension that engagement creates between usefulness to research-governing institutions and analytical credibility about them — and with concrete proposals for the institutional structures that can manage the tension.


1. Introduction

The preceding papers have specified the field’s conceptual framework, methodological standards, academic infrastructure, funding strategy, data resources, and workforce. All of this presupposes that the field’s outputs will reach audiences who can act on them. The audiences include other scholars, who can build on the field’s findings in their own work, and the broader public, which Paper 8 will address. The audiences also include the research-governing institutions whose decisions shape the distribution of scholarly attention, and the engagement with those institutions is the subject of this paper.

The engagement is intrinsic to the field’s mission for three reasons. The first is that the field’s conceptual framework — the identification of cases in which attention has been misallocated — implicitly contains a prescription, since to say that attention has been misallocated is to say that the allocation should be changed. The prescription cannot be acted on without engagement with the institutions that make allocation decisions. The second is that the field’s data depend in substantial part on the cooperation of research-governing institutions, particularly for the analysis of funding decisions, of journal-acceptance patterns, and of institutional-priority decisions. The cooperation is more likely when the institutions see the field as a productive partner rather than as an outside critic. The third is that the field’s professional development requires the recognition of its outputs by the institutions that shape scholarly careers, and the recognition comes through engagement.

The engagement is fraught for the corresponding reasons. The institutions whose decisions the field studies are the same ones whose cooperation the field requires for its data, whose funding the field needs for its work, and whose recognition the field needs for its scholars’ careers. The asymmetry creates pressures toward producing findings that the institutions can accept, toward avoiding criticisms that might damage cooperation, and toward narrowing the field’s work to topics that the institutions find comfortable. The pressures are real, they have damaged the analytical independence of adjacent fields, and the field’s engagement strategy must include explicit structural protections against them.

The argument of this paper is that the tension between engagement and independence cannot be eliminated, but it can be managed. The management depends on institutional structures that maintain the field’s analytical independence as a non-negotiable commitment, on professional norms that reward uncomfortable findings rather than punishing them, and on engagement practices that approach research-governing institutions as collaborators in a shared project rather than as patrons whose preferences must be accommodated. The paper develops the argument through the specific engagement domains and concludes with the institutional structures that the strategy requires.

2. Funding Agencies

Funding agencies are the field’s primary interlocutors among research-governing institutions because their decisions affect the distribution of attention more directly than any other set of decisions in the research system. A scholar can pursue an unfashionable question without institutional support if their resources allow it, but the work that requires substantial funding — empirical projects with real-world data, projects requiring trained research staff, projects requiring specialized infrastructure — depends on funding-agency decisions in ways that scholarly effort alone cannot overcome. The funding agencies’ priorities shape what kinds of work get done, by whom, and at what scale, and the field’s engagement with them is accordingly the highest-leverage applied activity it can pursue.

The engagement with funding agencies serves four specific functions that deserve separate treatment.

2.1 Portfolio Review

The first function is the systematic review of funding portfolios to identify patterns of attention and gaps. A funding agency’s portfolio is the cumulative result of many individual grant decisions, and the patterns that emerge in the portfolio often differ from the priorities the agency would state in its formal documents. The portfolio may concentrate on particular topics, populations, methods, or institutions in ways that nobody explicitly chose, and the concentrations may persist for years without being noticed by the agency’s leadership.

Portfolio review provides funding agencies with information that their internal review processes do not produce. The agencies’ grant-review processes evaluate individual proposals against criteria specific to each program; the portfolio-level analysis examines the cumulative pattern across programs and across years. The two perspectives are complementary, and the portfolio review can identify patterns that no individual grant decision would have produced and that the agency has reason to want to know about.

The field’s contribution to portfolio review combines bibliometric and scientometric methods (Paper 2 and Paper 5) with substantive knowledge of the research areas the portfolio covers. The output is a structured report that documents what the portfolio supports, identifies the patterns of attention that emerge, compares the patterns to relevant external indicators (disease burden, expressed public concern, theoretical centrality), and flags the candidate cases where the patterns appear difficult to justify on substantive grounds. The report does not, in its standard form, recommend specific changes to the portfolio; it provides the information that the agency’s own decision-makers can use to consider whether changes are warranted.

The standard form is important because it preserves the analytical independence the field requires. A portfolio review that ends with specific recommendations becomes an advocacy document, and the boundary between scholarship and advocacy is precisely the one the field must maintain. A portfolio review that ends with information allows the agency to reach its own conclusions, with the field’s scholars available for consultation if the agency wants further analysis but without the field becoming the agency’s policy advocate.

The arrangement under which portfolio reviews are conducted requires careful design. The agency must commit to the review’s analytical independence, meaning that the field’s scholars conduct the work according to the field’s methodological standards rather than according to the agency’s preferences. The scholars must commit to constructive engagement with the agency, meaning that the work is conducted in conversation with the agency’s staff rather than as an external audit. The output must be available to both the agency and the field’s scholarly community, with the agency receiving the report first but with publication following on an agreed timeline. The structure has been used successfully in adjacent contexts and provides a workable model.[^1]

2.2 Priority-Setting Consultation

The second function is consultation in the priority-setting processes by which funding agencies establish their research priorities. The processes vary across agencies, but they typically include some combination of advisory committees, public consultations, strategic planning exercises, and program-specific reviews. The field’s contribution to these processes draws on the priority-setting methodology developed by the James Lind Alliance and adapted by others (Papers 2 and 4), with the contribution focused on the structured identification of neglected questions that the priority-setting process can consider.

The consultation work differs from portfolio review in being prospective rather than retrospective. The portfolio review examines the cumulative results of past decisions; the priority-setting consultation provides input into future decisions. The two are complementary, and the field’s engagement with funding agencies should typically include both.

The consultation work requires the field’s scholars to participate in advisory processes whose pace and structure differ from those of conventional scholarship. The processes operate on the timelines that the agency requires, with deliverables that the agency specifies, and with constraints on confidentiality and disclosure that the agency imposes. The constraints are typically compatible with the field’s analytical standards, but the field’s scholars must be prepared to work within them, and the workforce strategy of Paper 6 must include training in the skills the engagement requires.

A specific consideration is the field’s relationship to the constituencies whose voices the priority-setting processes are intended to include. The James Lind Alliance methodology and similar approaches emphasize the inclusion of patients, clinicians, and affected communities in research-priority decisions, and the field’s contribution to priority-setting should support rather than substitute for those voices. The field’s scholars provide methodological expertise and substantive analysis that complement the lived-experience contributions of affected communities; they should not present themselves as speaking for the communities whose participation the process is designed to include.

2.3 Embedded Analysis

The third function is embedded analysis, in which a scholar trained in the field’s methods is hosted by a funding agency for an extended period — typically one to two years — to conduct analyses that the agency’s own staff is not positioned to conduct. The embedding provides the field’s scholars with access to data and processes that external researchers cannot easily obtain, and provides the agency with analytical capacity that its own staffing structure does not support.

Embedded analysis has been used in several adjacent contexts, with mixed results that depend on the design of the arrangement. The arrangements that have worked well share several features. The scholar’s institutional affiliation remains with the home university or research center rather than transferring to the agency, which preserves the scholar’s analytical independence. The agency commits to providing access to the data and processes the work requires, with the access governed by explicit agreements that protect both the analytical work and the agency’s legitimate confidentiality interests. The scholar’s outputs are published in the field’s scholarly outlets on an agreed timeline, with the agency receiving early access but not vetoing publication. The scholar’s reentry into the academic world after the embedding is supported by arrangements that preserve the scholar’s career trajectory, since embedding work is sometimes undervalued in conventional tenure evaluations.

The arrangements that have worked poorly typically failed on one or more of these features. The scholar’s affiliation transferred to the agency, with the scholar’s outputs becoming agency documents rather than scholarly publications. The agency restricted publication on terms the scholar accepted under pressure but later regretted. The scholar’s career suffered because the embedding work was not recognized appropriately by the home institution. The lessons from the unsuccessful arrangements are documented and can inform the field’s embedded-analysis program.[^2]

The field should pursue embedded-analysis arrangements with several funding agencies as a priority engagement activity. The arrangements provide the field with the data access required for substantial work, provide the agencies with analytical capacity they value, and produce the kinds of scholarly outputs that build the field’s track record. The arrangements should be initiated through formal agreements rather than individual relationships, so that they survive changes in agency leadership and changes in the scholar’s career.

2.4 Foundation Engagement

The fourth function is engagement with private foundations as distinct from public funding agencies. The distinction matters because foundations operate with different constraints, different timelines, and different decision-making structures, and the engagement strategy must accommodate the differences.

Foundations are typically more accessible than public agencies, with shorter decision cycles, more flexible engagement structures, and program officers who have substantial discretion over funding decisions within their portfolios. The accessibility makes foundations natural early partners for the field’s engagement work, and the funding strategy of Paper 4 already identified them as the likely first movers in the field’s funding pipeline. The engagement strategy should build on the funding relationships to develop the analytical engagement that the field can offer foundations on the same terms it offers public agencies.

Foundations also have specific limitations. Their resources are smaller than those of major public agencies, which limits the scale of the analytical work they can support. Their portfolios are more specialized, which limits the breadth of the analyses that are relevant to any individual foundation. Their priorities can shift more rapidly than public agencies’ priorities, which creates challenges for sustained engagement. The engagement strategy should attend to these limitations and should pursue foundation engagement with realistic expectations about what individual relationships can accomplish.

3. Learned Societies and Journals

Learned societies and journals are the second category of research-governing institutions with which the field must engage. Their decisions affect attention patterns through different mechanisms than funding-agency decisions: by determining what is published, what is presented at conferences, what is recognized through awards and honors, and what defines the working priorities of the disciplines they serve.

The engagement with learned societies serves several specific functions.

The first is the commissioning of stocktaking reviews of disciplines’ own neglected territory. The stocktaking review series introduced in Paper 3 provides a structured venue for such reviews, and the engagement with learned societies should include encouraging them to commission stocktakings of their own fields’ attention patterns. The commissioning gives the societies ownership of the reviews and ensures that the work is conducted with the substantive depth that disciplinary expertise allows. The societies’ membership becomes an audience for the reviews, with the resulting discussions taking place in the venues where disciplinary priorities are actually set.

The second is engagement with journal editorial policies. Journals shape attention patterns through their editorial decisions about what kinds of work they will publish, what methodological standards they apply, what evaluative criteria they use, and what topics they treat as within or outside their scope. The decisions accumulate over time into the patterns that constitute disciplinary literatures, and changes in editorial policy can shift the patterns in ways that individual scholarly effort cannot. The field’s engagement with journals should include specific proposals for editorial changes that would address documented patterns of neglect — special issues commissioned on neglected topics, registered reports that reduce the disadvantages faced by exploratory work, training of reviewers in recognizing the value of work on neglected questions, and editorial standards that explicitly accommodate methodological pluralism.

The third is engagement with peer-review practice. The peer-review literature (cited in earlier papers) has documented the mechanisms by which conventional peer review produces conservatism, and several adaptations have been developed to address the mechanisms. The field’s engagement with journals and conferences should include advocacy for the adaptations that are well-supported by evidence: registered reports for confirmatory work, open peer review where appropriate, structured rubrics that reduce reviewer bias toward established questions, and explicit consideration of whether submissions address neglected areas in evaluating their contribution.

The fourth is engagement with recognition structures. Learned societies typically administer awards, prizes, and honorific recognition that shape disciplinary career trajectories. The recognition structures tend to reinforce existing patterns of attention by rewarding work on established questions, and the engagement with learned societies should include specific proposals for recognition structures that reward work on neglected questions. The proposals can take the form of new awards, of explicit criteria for existing awards that recognize the value of work on neglected questions, or of nominations for existing awards of scholars whose work on neglected questions would otherwise be overlooked.

The engagement with learned societies and journals is slower than engagement with funding agencies because the relevant decisions are more distributed and the mechanisms for change are more diffuse. The engagement should be sustained over the long term rather than expected to produce rapid results, and the field should measure progress by the cumulative changes in editorial practice and disciplinary norms rather than by any individual decision.

4. University Administrations

University administrations are the third category of research-governing institutions, and their decisions affect attention patterns through the structures that determine what scholarship is professionally rewarded. The decisions include tenure and promotion criteria, faculty hiring priorities, departmental and center funding, teaching loads and assignments, and the broader institutional climate that affects what kinds of work scholars feel free to pursue.

The engagement with university administrations is among the slowest of the field’s applied activities to produce visible results, because the relevant decisions operate on long timescales and affect attention patterns through indirect mechanisms. A change in tenure criteria that explicitly recognizes interdisciplinary work shifts the career incentives for current doctoral students, who will publish their first books a decade later, who will receive tenure five years after that, and who will eventually serve on tenure committees that apply the revised criteria to subsequent generations. The timeline is generational, and the engagement strategy must be paced accordingly.

The engagement with university administrations serves several functions.

The first is advocacy for tenure and promotion criteria that recognize the field’s distinctive contributions. The criteria that work poorly for the field’s scholars were discussed in Paper 6, and the engagement with university administrations should include specific proposals for revised criteria that recognize the value of interdisciplinary work, of work in newly established outlets, of methodological innovation, and of applied engagement with research-governing institutions. The proposals are most effective when they draw on the precedents established in adjacent interdisciplinary fields, since the administrations are more receptive to proposals that have been implemented elsewhere than to proposals that require them to be pioneers.

The second is advocacy for faculty appointments in the field. The appointments at the founding centers (Paper 3) are essential foundations, but the broader workforce that the field requires depends on appointments at universities that do not host founding centers. The engagement with these universities should include specific proposals for appointments — joint appointments between relevant disciplines and metascience programs, dedicated lines in newly established programs, appointment criteria that explicitly accommodate the field’s distinctive profile — and should provide the universities with the information they need to evaluate the proposals.

The third is engagement with the structures that determine doctoral training. The doctoral programs that produce the field’s workforce operate under university structures that affect what students can be admitted, what they can be taught, and what dissertations are accepted. The engagement with university administrations should include advocacy for the structures that support the field’s training pathways — concentrations within existing programs, joint programs across departments, dedicated programs at institutions where the founding investment can be justified.

The fourth is engagement with the broader institutional climate that affects what kinds of work scholars feel free to pursue. The climate is shaped by many factors: the administrators’ rhetoric about what the university values, the funding decisions that signal institutional priorities, the appointment patterns that shape the senior faculty’s composition, and the disciplinary norms that operate within departments. The engagement with administrations should include attention to all of these factors, with the recognition that no single intervention will transform the climate but that sustained attention across multiple dimensions can shift it over time.

5. Government Science Advisory Bodies

Government science advisory bodies and parliamentary committees represent the highest-leverage engagement opportunities the field will have. The bodies advise governments on research-policy decisions, on the allocation of public research funding, on the structure of the research system, and on the broader policies that shape what kinds of scholarship are conducted in their jurisdictions. The decisions that emerge from this engagement affect attention patterns across entire national research systems, and the leverage corresponds to the breadth of effect.

The engagement also carries the highest risks. Government bodies operate in political environments that pose risks of co-optation, of political entanglement, and of the field’s work being used in ways that compromise its analytical independence. The engagement strategy must accordingly include explicit protections against the specific risks that government engagement creates.

The advisory bodies relevant to the field include those that operate at the level of national governments, those that operate at the level of regional or sub-national governments, and those that operate within particular government departments responsible for research policy. The structures vary across jurisdictions, but several engagement functions are common across them.

The first is participation in advisory processes that bear on research-policy decisions. The participation can take the form of formal membership on advisory committees, of submissions to consultations, of presentations to relevant committees, and of informal engagement with the staff who support the advisory processes. The participation should be conducted by the field’s senior scholars, since the advisory work requires both substantive depth and the institutional standing that gives the contributions weight.

The second is the production of research-policy reports commissioned by government bodies. The reports typically address specific questions on which the commissioning body has decided it wants analytical input, and they provide the field’s scholars with opportunities to apply the field’s methods to questions of direct policy relevance. The commissioning relationships should be governed by terms that protect the analytical independence of the work, with the commissioning body specifying the questions but not the answers.

The third is engagement with parliamentary or legislative committees on questions bearing on research policy. The engagement can include formal testimony, the provision of background briefings, and the development of relationships with committee staff who maintain institutional memory across the political cycles that affect elected officials. The engagement requires the field’s scholars to be prepared to work in environments where the audiences are not scholars and where the standards of communication are different from those of conventional scholarly publication.

The risks of government engagement deserve specific treatment. The first risk is political polarization: in jurisdictions where research policy has become a contested political issue, the field’s engagement can be drawn into the political contestation in ways that compromise its analytical credibility. The corrective is to maintain the field’s commitment to evenhanded analysis that does not align predictably with any political position, and to resist the pressure to use the field’s work to support political positions that the field’s scholars happen to favor. The pressure is real, particularly for scholars whose personal commitments align with one political position more than another, and the professional norms must explicitly support the resistance.

The second risk is the use of the field’s work by political actors in ways the field’s scholars did not intend. Reports commissioned for one purpose are sometimes cited in service of arguments their authors did not endorse, and the field’s scholars must be prepared for this and must develop the institutional practices that allow them to clarify the limits of their work without losing the engagement that the work is intended to support. The clarification can take the form of explicit statements about what the work supports and does not support, of follow-up communications when the work is used inappropriately, and of public statements when the misuse is sufficiently serious to require correction.

The third risk is institutional capture: the gradual alignment of the field’s work with the priorities of the government bodies it engages with, to the point that the field becomes a service provider to those bodies rather than an independent analytical voice. The corrective is the diversification of the field’s engagements, the maintenance of analytical independence as a non-negotiable commitment, and the cultural maintenance that Paper 4 identified as the deepest of the field’s institutional challenges.

6. International Scientific Organizations

The international dimension of the field’s engagement is the slowest of its applied activities to develop, because the international structures operate on longer timelines, with more diffuse decision-making, and with greater coordination requirements than the national-level engagements discussed above. The international agenda should accordingly be paced realistically, with the expectation that substantial international engagement will develop only after the field has consolidated at the national level in at least several jurisdictions.

The relevant international organizations include UNESCO and its science-related programs, the International Science Council and its disciplinary unions, the OECD’s working groups on research policy, and the various regional bodies that coordinate research policy within particular geographic areas. The engagement with these organizations serves several functions.

The first is the development of international comparative analyses that no single national engagement could produce. The field’s data infrastructure (Paper 5) supports comparative work across national research systems, and the international organizations provide both venues for presenting comparative findings and partners for the comparative work itself. The comparative analyses are particularly valuable for the field because they identify which patterns of attention are general features of scholarly inquiry and which are contingent on particular national arrangements (Paper 2).

The second is the development of international standards and norms that the field’s work can contribute to. The standards and norms include those for research integrity, for open science, for research-priority-setting, and for the broader practices that shape attention patterns across national systems. The field’s contribution should focus on the specific elements where neglect-studies expertise has distinctive value, rather than attempting to address the broader standards comprehensively.

The third is the support of neglect-studies development in jurisdictions where the field has not yet established itself. The international engagement provides the field’s scholars with opportunities to support colleagues in jurisdictions whose research-policy environments are less hospitable to the field’s work, to share the methodological and institutional resources the founding centers have developed, and to contribute to the broader internationalization of the field. The support should be offered on terms that respect the autonomy of scholars in different jurisdictions, recognizing that the patterns of attention vary across systems and that the field’s specific findings in one jurisdiction may not translate to others.

The risks of international engagement include all the risks of national-level engagement, with the addition of the specific risks created by the institutional complexity of international organizations. The organizations operate with constraints that the field’s scholars may not fully understand, with political dynamics that differ from those of national bodies, and with timelines that can be substantially longer than scholars accustomed to national engagement might expect. The engagement should be conducted with explicit awareness of these features and with realistic expectations about the pace and the products of the work.

7. The Independence Problem

The central tension that engagement creates — between usefulness to research-governing institutions and analytical credibility about them — runs through all the engagement domains discussed above. This section addresses the institutional structures that can manage the tension.

The first structural commitment is the diversification of the field’s relationships with research-governing institutions. A field whose engagement is concentrated with a single funder, a single agency, or a single set of relationships is vulnerable to the priorities of its dominant partner in ways that compromise its independence. The diversification across funders (Paper 4) and across engagement relationships supports the field’s capacity to refuse engagement on terms that would compromise its work, since the refusal does not threaten the field’s survival as it might if the relationship were the field’s only source of support.

The second commitment is the maintenance of analytical independence as a non-negotiable element of all engagement relationships. The relationships should be governed by explicit terms that protect the independence: the field’s scholars conduct work according to the field’s methodological standards, the outputs are published in the field’s scholarly outlets, and the engagement partners receive analytical input rather than predetermined conclusions. The terms should be documented in formal agreements rather than relying on informal understandings, since informal understandings tend to drift under sustained pressure in ways that documented agreements do not.

The third commitment is the cultural maintenance of professional norms that reward uncomfortable findings rather than punishing them. The norms operate through the field’s professional community: through the journal’s editorial practice, through the conference’s program decisions, through the registry’s quality standards, and through the field’s informal recognition structures. The norms must specifically reward the production of findings that engagement partners would prefer not to be published, with the recognition that such findings are the strongest evidence of the field’s analytical credibility. The norms must also protect scholars whose findings have produced friction with engagement partners, since the friction can otherwise impose career costs that discourage the kinds of work the field most needs.

The fourth commitment is the institutional separation of the field’s engagement work from its scholarly work. The separation does not mean that the same scholars cannot do both — many of the field’s most effective scholars will be engaged in both modes — but rather that the relationships and outputs of each mode should be governed by appropriate structures. The engagement work operates under the terms that engagement partners require; the scholarly work operates under the terms that the field’s professional standards establish. When the two modes generate conflicting requirements — when an engagement partner asks for findings that the scholarly standards would not support, or when scholarly findings produce friction with an engagement partner — the separation provides the field with explicit choices about how to handle the conflict, rather than blurring the modes in ways that compromise both.

The fifth commitment is the maintenance of the field’s reflexive program, which Paper 8 will develop more fully. A field that examines the patterns of attention in scholarly inquiry must be willing to examine its own attention patterns, including the patterns produced by the field’s engagement relationships. The reflexive work should include periodic audits of how the engagement relationships affect the field’s research portfolio, of whether the engagement has produced shifts in the field’s emphases that the field’s scholars would endorse on reflection, and of whether the field is becoming captured by the institutions it engages with. The audits should be conducted by the field’s professional structures rather than by the engagement partners, and the findings should be published in the field’s scholarly outlets.

The structural commitments cannot eliminate the tension between engagement and independence. The tension is intrinsic to the field’s situation and will require ongoing attention as long as the field continues to engage with research-governing institutions. The commitments can, however, manage the tension in ways that allow the field to be useful to engagement partners without losing the analytical credibility on which its usefulness depends. The management is among the most important professional disciplines the field will need to develop, and the institutional structures that support it must be designed with the recognition that the pressures against them will be persistent.

8. Conclusion

This paper has proposed an engagement strategy for neglect studies that addresses funding agencies, learned societies and journals, university administrations, government science advisory bodies, and international scientific organizations. The strategy combines specific engagement functions for each domain with structural commitments that protect the field’s analytical independence across all of them. The strategy operates on long timelines and depends on the institutional infrastructure that the preceding papers have specified.

The engagement work cannot be conducted without the workforce that Paper 6 discussed, the funding diversification that Paper 4 outlined, the data resources that Paper 5 specified, the academic infrastructure that Paper 3 proposed, the methodological standards that Paper 2 developed, and the conceptual framework that Paper 1 established. The interdependencies among the elements of the field’s institutional infrastructure are the dominant feature of the series, and the engagement paper is the most exposed to those interdependencies because it requires all the other elements to function.

The engagement work is also the most visible to external audiences and the most consequential for the field’s broader influence. The field’s eventual impact on the distribution of scholarly attention depends substantially on whether the engagement succeeds, and the engagement succeeds only if the field maintains the analytical credibility that justifies the engagement in the first place. The circle is virtuous when it works and damaging when it fails, and the structural commitments that this paper has proposed are the field’s best protection against the failure modes.

Paper 8, the final paper in the series, takes up the field’s identity, its public engagement, and the reflexive self-critique that a field of this kind requires. The engagement work that this paper has discussed will be conducted by the scholars whose identity Paper 8 will address, and the reflexive program that Paper 8 will propose will examine the engagement work among its other subjects.


Notes

[^1]: Portfolio review arrangements have been conducted with various funders over the past two decades, often through partnerships between academic researchers and the funders themselves. The most documented examples include several U.S. National Institutes of Health portfolio analyses and the analyses commissioned by the Wellcome Trust and the U.K. Medical Research Council. The arrangements vary in their specific terms but share the general structure described in section 2.1.

[^2]: The literature on embedded researchers in policy organizations is reviewed in Cherney and Head (2010) and in subsequent work. The findings on what makes embedded arrangements succeed or fail are consistent across multiple national contexts and policy domains.

[^3]: The engagement of learned societies with research-priority questions has been documented in several disciplinary cases; the work of the American Association for the Advancement of Science on cross-disciplinary research priorities and the parallel work of European disciplinary unions provides relevant examples.

[^4]: The literature on tenure and promotion criteria in interdisciplinary contexts, cited in Paper 6, develops further in the work on university administrative responses to interdisciplinary fields. Klein (2010) provides a useful treatment of the institutional dimensions, and Pfirman and Martin (2010) addresses the specific question of how interdisciplinary scholars are evaluated.

[^5]: The literature on government science advisory bodies is reviewed in Doubleday and Wilsdon (2013) and in subsequent work on the changing role of scientific advice in policy contexts. The risks of political entanglement that the literature documents are directly relevant to the engagement strategy outlined in section 5.

[^6]: The international scientific organizations have substantial documentation of their own structures and processes, available through their websites and institutional publications. The scholarly literature on the role of international organizations in research policy is partial but includes useful treatments in Crawford, Shinn, and Sörlin (1993) and in subsequent work on the internationalization of scientific governance.


References

Cherney, A., & Head, B. (2010). Evidence-based policy and practice: Key challenges for improvement. Australian Journal of Social Issues, 45(4), 509–526.

Crawford, E., Shinn, T., & Sörlin, S. (Eds.). (1993). Denationalizing science: The contexts of international scientific practice. Kluwer Academic.

Doubleday, R., & Wilsdon, J. (Eds.). (2013). Future directions for scientific advice in Whitehall. Centre for Science and Policy, University of Cambridge.

Klein, J. T. (2010). Creating interdisciplinary campus cultures: A model for strength and sustainability. Jossey-Bass.

Pfirman, S., & Martin, P. (2010). Facilitating interdisciplinary scholars. In R. Frodeman, J. T. Klein, & C. Mitcham (Eds.), The Oxford handbook of interdisciplinarity (pp. 387–403). Oxford University Press.


Posted in Musings | Tagged , , , , | Leave a comment

Workforce and Training Pipeline: Building the Scholarly Community for Neglect Studies


Executive Summary

This paper addresses the workforce that neglect studies will require to function as a mature field. The premise is that institutional infrastructure (Paper 3), funding (Paper 4), and data resources (Paper 5) are necessary conditions for the field but not sufficient ones; the work must be done by scholars whose training, career incentives, and professional networks make sustained engagement with the field possible. Building that workforce is a longer-term project than the other infrastructure work, since the training cycles measure in years rather than months and the career structures take a decade or more to mature.

The paper develops six arguments. The first is that the skill profile of a neglect-studies scholar is unusually demanding, combining substantive grounding in at least one host discipline with methodological breadth across the domains identified in Paper 2 and with the capacity to engage with research-governing institutions. The second is that the career risk profile of work on neglected questions is substantial and that the field’s workforce strategy must include explicit mechanisms for protecting early-career scholars from the professional costs that the work otherwise imposes. The third is that the field requires multiple training pathways — doctoral, master’s, continuing-education, and informal — each serving different constituencies and producing different scholarly contributions. The fourth is that mentorship structures must be designed deliberately, since the natural mentorship pathways within established disciplines do not adequately serve scholars whose work crosses disciplinary boundaries. The fifth is that the inclusion of practitioners and lived-experience contributors is intrinsic to the field’s mission rather than incidental to it, and that the workforce strategy must accordingly include structures that allow these contributors to participate as full members of the scholarly community. The sixth is that the field’s professional credentialing decisions — whether to develop formal certification, what professional association structure to build, how to define professional standards — must be made carefully and with attention to the trade-offs between consolidation and inclusiveness.

The paper concludes with a discussion of the timeline for workforce development and the specific risks the field must anticipate as the workforce matures.


1. Introduction

The institutional infrastructure outlined in the preceding papers requires people to build, sustain, and use it. The data dashboard requires scholars who can adapt bibliometric tools for neglect-mapping purposes; the registry requires editors who can evaluate evidence-tier claims; the journal requires reviewers who can assess submissions across multiple methodological domains; the abandoned-programs archive requires historians who can conduct recovery work; the funding strategy requires scholars who can engage credibly with foundation program officers and agency program staff. None of this can be done by scholars trained in conventional disciplines alone, since the field’s work routinely combines methods and substantive concerns that no single disciplinary training prepares scholars for.

The workforce problem is also the slowest of the field’s founding challenges to address. Buildings can be opened in a year; journals can be launched in two; dashboards can be developed in three. Doctoral training operates on five-to-seven-year cycles, and the scholars who emerge from those cycles need an additional decade to establish themselves as senior figures in the field. The implication is that workforce planning must begin at the field’s founding and must be sustained through the long period before its results become visible.

The argument of this paper is that the workforce strategy must address four interlocking questions. The first is what kinds of scholars the field needs and what their training should look like. The second is how the career risks of work on neglected questions can be managed, since those risks are real and the field cannot ask scholars to accept them without offering structural protections. The third is how the field’s scholarly community should be constituted, with explicit attention to who counts as a member and how the boundaries are drawn. The fourth is what professional infrastructure — associations, credentialing, standards — the field should develop and on what timeline.

The questions are interrelated, and the paper takes them up in turn while attending to the connections among them.

2. The Skill Profile

A neglect-studies scholar working at the standard the field requires must combine three kinds of capacity, each of which is demanding in its own right and the combination of which is more demanding than any one.

The first is substantive grounding in at least one host discipline. The argument is straightforward: claims that a particular question or area is neglected within a discipline depend on knowing the discipline well enough to assess what counts as established work, what the active research community considers central, and what the substantive merits of particular questions are. A scholar without serious disciplinary training cannot make such assessments credibly, and the field’s reputation depends on its scholars being credible to the disciplines whose attention patterns they study.

The grounding required is genuine rather than nominal. A neglect-studies scholar working on biomedical research portfolios must understand biomedical research well enough to engage with biomedical researchers as a colleague rather than as an outside observer. A scholar working on attention patterns in historical scholarship must know enough history to read the relevant literature with full comprehension. The standard is that the scholar’s substantive training would have allowed them to pursue a conventional career in the host discipline, with the neglect-studies work being an additional layer built on that foundation rather than a substitute for it.

The second is methodological breadth across the domains of Paper 2. The triangulation standard the field requires depends on scholars being able to read and assess findings from multiple methodological domains, and to integrate those findings into coherent conclusions. No single scholar will produce primary work in all six of the methodological domains identified in Paper 2, but every scholar should be competent to evaluate work in all of them. The competence must be deep enough to allow critical engagement rather than mere acquaintance: a scholar who cannot identify the limitations of a bibliometric analysis cannot use it appropriately, and a scholar who cannot recognize the methodological choices in an oral-history project cannot integrate its findings with other evidence.

The methodological breadth is unusual among scholars trained in established disciplines, which typically emphasize depth in a smaller range of methods. The implication is that the field’s training programs must include substantial methodological breadth as a core requirement, even though the requirement extends the time-to-completion of doctoral programs and increases the demands on students.

The third is the capacity for engagement with research-governing institutions. The field’s applied dimension (Paper 7 will develop this further) means that its scholars must be able to translate scholarly findings into terms that funders, learned societies, and policy bodies can use, and must be able to engage with those bodies in their own working modes. The capacity is partly methodological — knowing how to produce briefings, how to participate in advisory processes, how to navigate the political and institutional considerations that shape policy decisions — and partly dispositional, in the sense that it requires scholars who are willing to do the engagement work rather than treating it as secondary to publication in journals.

Not every neglect-studies scholar will engage with research-governing institutions at the same intensity, and the field has room for scholars whose work is more purely scholarly as well as for scholars whose work is more applied. But the field as a whole must include scholars in both modes, and the training programs should produce graduates who are at least equipped to engage when their work calls for it.

A specific consequence of the skill profile is that neglect-studies training is unusually long compared to training in single-discipline fields. A doctoral student combining substantive grounding in a host discipline with methodological breadth across the field’s domains and with applied capacity will typically require seven to eight years of training, compared to five to six in conventional single-discipline doctorates. The longer training has costs — to the students, to the institutions, and to the field’s growth rate — but the field cannot relax the requirement without compromising the standards on which its credibility depends.

3. Managing Career Risk

The career risks of work on neglected questions are substantial and well documented. Scholars who pursue questions outside their discipline’s center of gravity face slower publication, weaker citation accumulation, reduced grant success, and longer paths to tenure and promotion compared to scholars working on established questions. The risks are not evenly distributed: they fall more heavily on early-career scholars, on scholars at institutions without strong interdisciplinary support, and on scholars whose work crosses the political or methodological commitments of their host disciplines. The field cannot ask scholars to accept these risks without offering structural protections, and the workforce strategy must accordingly include explicit mechanisms for risk management.

Four kinds of protection deserve specific attention.

3.1 Institutional Commitments

The founding centers identified in Paper 3 should make explicit institutional commitments to the field’s early-career scholars, in the form of tenure-track positions or comparable appointments, multi-year fellowships that provide stable funding through the early-career period, and protected time for the methodological and substantive work that the standard career incentives do not adequately reward. The commitments require resources, which the funding strategy of Paper 4 must support, and they require institutional decisions that establish the field’s positions as genuinely permanent rather than as experimental appointments that can be reversed if priorities shift.

The institutional commitments should include explicit consideration of how the field’s scholars are evaluated for tenure and promotion. The standard criteria — publication in high-impact journals, citation accumulation, grant success — work poorly for scholars whose work is published in newly established outlets, whose citations accumulate more slowly because the field is small, and whose grant success is constrained by the funding mechanisms discussed in Paper 4. The evaluation criteria should be adapted to recognize the kinds of contributions the field’s scholars make, with the adaptation documented explicitly so that scholars can plan their careers around the criteria they will actually be evaluated against. The adaptation is not a special favor to the field; it is a recognition that standard criteria do not measure the contributions of scholars in emerging interdisciplinary fields accurately, and the adaptation has been made for many comparable cases.

3.2 Joint Appointments

Joint appointments between a neglect-studies center and a department in the scholar’s host discipline provide both institutional stability and methodological-substantive integration. The joint appointment allows the scholar to maintain disciplinary connections that support their substantive grounding, to publish in disciplinary outlets that support their tenure case, and to teach within disciplinary programs that maintain their teaching obligations in familiar territory. The structure has been used successfully in adjacent interdisciplinary fields and is well understood by university administrations.

The joint appointment requires careful design. The proportion of the appointment in each unit affects the scholar’s obligations and the units’ expectations, and the proportion should be set with attention to the realities of the scholar’s work rather than to administrative convenience. The tenure case must be reviewed by both units, which requires that the units’ evaluation criteria be compatible and that the scholar’s portfolio satisfies both. The teaching obligations must be distributed sensibly, with the scholar contributing to courses in both units rather than being asked to teach the full load of either. None of these design considerations is unique to neglect studies, and the established practices in adjacent fields provide reasonable models.

3.3 Cross-Institutional Mentorship Networks

Mentorship for neglect-studies scholars must come partly from outside their home institution, because the relevant senior scholars are typically scattered across institutions during the field’s early years. The founding centers should establish explicit cross-institutional mentorship networks, with senior scholars at each center serving as mentors for early-career scholars at other centers and at institutions without dedicated centers. The mentorship should include both substantive guidance on the scholar’s research program and structural guidance on navigating the career challenges specific to the field.

The mentorship networks should be funded explicitly, with travel support for in-person meetings, communication infrastructure for ongoing contact, and recognition of the mentorship work in the senior scholars’ own evaluations. The funding is modest compared to other elements of the field’s infrastructure, but the mentorship work is often unfunded and unrewarded in established disciplines, which limits how much of it can reasonably be expected from senior scholars whose other obligations are substantial.

3.4 Protected Publication Pathways

The flagship journal and companion outlets identified in Paper 3 provide publication pathways that established disciplines do not provide for neglect-studies work. The pathways protect early-career scholars from one of the most direct career costs of working on neglected questions — the difficulty of publishing in outlets that count toward tenure — but the protection works only if the field’s outlets are recognized by the scholars’ institutions and host disciplines as appropriate venues for the work.

The recognition requires deliberate effort. The flagship journal should pursue indexing in the major databases from launch (as Paper 3 specified), should accumulate citation patterns that support its standing, and should publish work that the host disciplines can recognize as serious. The founding centers should advocate within their universities for the recognition of the field’s outlets in tenure and promotion decisions, with documented arguments about the standards the outlets maintain and the scholarly community they represent. The recognition work is slow, but its absence would substantially compromise the protection that the publication pathways are intended to provide.

4. Training Pathways

Paper 3 introduced the training pathways the field requires and the curriculum framework that would govern them. This section develops the workforce implications of those pathways with greater specificity.

4.1 Doctoral Training

Doctoral training is the most consequential of the workforce pathways because doctoral graduates are the scholars whose careers will sustain the field over the long term. The doctoral programs the field establishes — whether as dedicated programs at the founding centers or as concentrations within existing programs in host disciplines — will shape the field for decades through the scholars they produce.

The argument for dedicated doctoral programs in neglect studies, as distinct from concentrations within existing programs, depends on the field’s stage of development. In the first decade, dedicated programs are probably premature: the field is too small to sustain them, the demand for graduates is too uncertain to justify the institutional commitment, and the curricular standards are not yet developed enough to support consistent training across multiple institutions. The recommendation in this period is that doctoral training should be delivered through concentrations within existing doctoral programs in host disciplines, with the concentration providing the field-specific coursework and the host program providing the substantive grounding.

In the second decade, dedicated programs become more plausible, particularly at the founding centers where the institutional commitment has been established and the demand for graduates from funding agencies, universities, and policy bodies has been demonstrated. The transition from concentrations to dedicated programs should be deliberate, with the existing concentrations continuing to operate as alternative pathways even after dedicated programs are established. The pluralism in training pathways serves the field’s broader inclusiveness and accommodates students whose institutional circumstances make concentrations more accessible than dedicated programs.

The funding of doctoral students requires specific attention. Doctoral students in conventional programs are typically funded through teaching assistantships, research assistantships on faculty grants, and institutional fellowships. The first and third of these are available to neglect-studies students through the host disciplines, but the second is constrained by the field’s funding situation (Paper 4) since the grants that would support research assistantships are themselves limited. The implication is that the field’s centers should establish dedicated doctoral fellowships as a priority, both to support students directly and to demonstrate to host institutions that the field has the resources to sustain its training commitments. Dedicated doctoral fellowships are also one of the more tractable targets for philanthropic funding, since the giving is concrete, the recipients are identifiable, and the returns on the investment are visible.

4.2 Master’s-Level Training

Master’s training serves a different function from doctoral training and accordingly should be designed differently. The constituencies for master’s training are scholars who want methodological literacy in the field without retraining as full neglect-studies scholars, practitioners in funding agencies and policy bodies who need to engage with the field’s outputs, and journalists, science communicators, and other professionals who write about research-priority questions.

The master’s curriculum should emphasize methodological breadth and applied capacity rather than substantive grounding, on the assumption that students bring their substantive expertise from prior training. The structure should accommodate part-time enrollment and distance learning, since many of the relevant students will be employed full-time and cannot relocate for residential study. The credential should be recognized in the professional contexts the students will work in, which requires the founding centers to engage with funding agencies, learned societies, and policy bodies to establish the master’s degree as appropriate preparation for the relevant roles.

A specific consideration is the relationship between the master’s program and the doctoral program. Some master’s students will subsequently want to pursue doctoral training, and the master’s curriculum should be designed to support that transition without requiring redundant coursework. The structure should also accommodate the reverse: doctoral students who decide partway through their training that their interests are better served by completing a master’s degree rather than a doctorate. The flexibility serves the students’ interests and supports the field’s broader inclusiveness.

4.3 Continuing Professional Education

Continuing education for established scholars who want to incorporate neglect-studies methods into their work is a third training stream with its own design considerations. The format should be intensive short courses, typically one to two weeks, held at the founding centers or in conjunction with the annual congress. Topics should be modular, so that participants can take individual courses without committing to a full program, and the courses should be designed to support the work of scholars whose primary identification will remain in their host disciplines rather than to convert them to full neglect-studies scholars.

The continuing-education stream serves the field’s longer-term consolidation by extending its methodological reach into adjacent disciplines and by building a network of scholars in other fields who are familiar with the field’s work. The network has practical value in providing informed reviewers for the field’s outlets, collaborators for the field’s projects, and translators of the field’s work to broader audiences. The stream also generates revenue, since participants typically pay for continuing-education courses, and the revenue can support the field’s other training activities.

The certification associated with continuing-education courses should be modest. Course completion certificates appropriate for participants’ continuing-professional-development records are reasonable; a credential that competes with formal master’s or doctoral training is not. The distinction matters because the field’s professional credibility depends on its credentials being earned through serious training rather than through short courses, and any tendency to inflate continuing-education credentials would damage the standing of the longer training pathways.

4.4 Informal Training and Self-Education

A substantial fraction of the field’s eventual workforce will not receive formal training in neglect studies at all. They will be scholars whose primary training is in other disciplines, who encounter the field through their substantive work, and who develop methodological and conceptual literacy through self-education, reading, and engagement with the field’s literature and community. The informal pathway is the dominant one in any emerging field, and neglect studies is no exception.

The field’s responsibilities to informally trained scholars include making the literature accessible (open-access publication, clear writing, documented methods), providing entry points for newcomers (introductory courses, review articles, methodological tutorials), and welcoming informally trained scholars into the professional community on terms that do not require formal credentials. The professional association the field eventually develops should explicitly accommodate informally trained members and should not adopt membership criteria that exclude them.

A specific consideration is the relationship between informally trained scholars and the field’s quality standards. The methodological standards of Paper 2 apply to the field’s work regardless of how the scholars who do the work were trained, and the field’s outlets should evaluate submissions against the standards rather than against the credentials of the authors. The structure preserves the field’s standards while remaining inclusive of scholars whose pathways into the field do not include formal training, and it depends on the field’s outlets being run by editors and reviewers whose evaluations focus on the work rather than on the authors’ credentials.

5. Mentorship and Community Formation

The professional development of scholars in any field depends substantially on mentorship and on the informal networks through which knowledge, norms, and opportunities circulate. The mentorship problem in neglect studies has specific features that the field’s workforce strategy must address.

The first feature is that the senior scholars who would naturally serve as mentors are themselves scarce in the field’s early years. A field that does not yet have many senior figures cannot offer the mentorship density that established fields provide, and the early-career scholars in the field must accept a mentorship environment that is thinner than the one their counterparts in established disciplines enjoy. The corrective is partial: deliberate effort to extend the available mentorship capacity through cross-institutional networks, through inclusion of senior scholars from adjacent fields as mentors for substantive aspects of the work, and through structures that allow early-career scholars to mentor one another in ways that established mentorship cultures do not typically support.

The second feature is that the mentorship the field requires differs from the mentorship typical of single-discipline training. A neglect-studies scholar needs mentorship on substantive questions in their host discipline, on the methodological work that the field’s training emphasizes, and on the career navigation specific to interdisciplinary work in an emerging field. No single mentor is likely to be able to provide all three, and the field’s mentorship structures should be explicit about constructing mentorship teams rather than assigning single mentors.

The third feature is that mentorship in the field must address the career risks discussed in section 3 above. Senior scholars who have navigated the relevant risks themselves are valuable mentors, but they are scarce, and the field’s mentorship structures must be able to draw on senior scholars from adjacent fields whose experience is informative even when not identical. The mentorship conversation should include explicit discussion of risk management, with the senior scholars sharing what they have learned about navigating the career challenges that the early-career scholars face.

The community formation that supports mentorship operates through the field’s conferences, workshops, journals, and informal communication channels. The structures the preceding papers have specified — the annual congress, the specialized workshops, the flagship journal and companion outlets, the registry — all serve community-formation functions in addition to their primary purposes. The workforce strategy should attend explicitly to how these structures support community formation and should design them with that function in view.

A specific consideration is the inclusion of early-career scholars in the field’s governance and editorial structures. Junior representation on the editorial board of the flagship, on the program committee of the annual congress, on the editorial committee of the registry, and on the governance bodies of the founding centers serves both the practical function of bringing fresh perspectives and the developmental function of giving early-career scholars the experience of contributing to the field’s institutional work. The inclusion should be deliberate, with explicit positions reserved for junior scholars and with the positions providing genuine influence rather than nominal participation.

6. Practitioners and Lived-Experience Contributors

The field’s mission includes attention to questions whose neglect bears on communities whose concerns have not been adequately represented in scholarly research. The constituency-less questions category in the Paper 1 taxonomy, and the peripheral inquiries category, both bear on this concern, and the priority-setting partnership tradition that the field draws on has developed explicit structures for including affected communities in research design.

The workforce strategy should accordingly include practitioners and lived-experience contributors as full members of the scholarly community rather than as informants or consultants. The distinction matters. A practitioner who is included as an informant provides information that the scholarly researchers analyze; a practitioner who is included as a full member of the community participates in the design of the research, in the interpretation of findings, and in the production of conclusions. The latter inclusion is more demanding institutionally and more rewarding intellectually, and the field’s structures should support it.

The specific structures that support full inclusion include: practitioner co-investigator roles on research projects, with the practitioners involved from the design stage rather than recruited at the data-collection stage; lived-experience contributor positions on editorial boards and governance bodies, with the positions providing genuine influence; training programs designed to support the participation of practitioners and lived-experience contributors who do not have conventional research training; and authorship practices that recognize the contributions of practitioners and lived-experience contributors to research outputs.

The structures require deliberate design and ongoing maintenance. The default patterns of academic work tend toward the exclusion of non-academic contributors, and the structures that support inclusion must be defended against the gravitational pull toward the default. The defense requires institutional commitment from the founding centers, editorial commitment from the field’s outlets, and professional commitment from the field’s individual scholars to maintain the practices in their own work.

A specific consideration is the compensation of practitioners and lived-experience contributors. Academic work has well-established compensation patterns — salaries, grants, honoraria, publication credits — that do not adequately compensate non-academic contributors for their participation. The field’s structures should include explicit provisions for compensating practitioners and lived-experience contributors at rates that reflect the value of their contributions, with the compensation provided through mechanisms that do not require the contributors to navigate the bureaucratic complexity of academic payment systems.

7. Professional Infrastructure

The professional infrastructure of the field — associations, credentialing, standards — must be developed deliberately, and the decisions about its design have long-term consequences for the field’s character. The discussion below addresses the major questions the field must answer.

7.1 Professional Association

A professional association for neglect studies provides several functions that the founding centers and the journal alone cannot provide. The association maintains the field’s membership records, organizes the annual congress, administers the credentialing structures the field eventually adopts, advocates for the field’s interests in research-policy contexts, and provides the institutional voice that speaks for the field as a whole.

The association should be established once the field has accumulated a critical mass of members, probably in the second half of its first decade. Earlier establishment is premature because the membership base is too small to support the association’s operations; later establishment is risky because the functions the association provides become harder to assemble after the field has developed without them.

The association’s structure should be governed by its members, with elected leadership, term limits, and explicit provisions for inclusion of diverse perspectives within the field. The membership criteria should be inclusive of the various pathways into the field discussed in section 4 above, with formal credentials not being a requirement for membership. The dues structure should accommodate scholars and practitioners with different income levels, with the developing-country and student rates set low enough to allow genuine participation rather than being symbolic concessions.

7.2 Credentialing

The credentialing question — whether the field should develop formal certification for its scholars and on what terms — is more difficult than the association question. The case for credentialing is that it provides quality assurance for the field’s outputs, that it supports the recognition of the field by external institutions, and that it creates clear pathways for career development. The case against is that credentialing tends to consolidate the field around the credentialing body’s preferences, that it raises barriers to entry that exclude informally trained scholars, and that it can become an end in itself rather than a means to the field’s broader purposes.

The recommendation is that formal credentialing should be deferred at least until the field’s second decade and possibly indefinitely. The field’s quality assurance can be provided through the journal’s peer review, the registry’s evidence-tier system, and the professional reputation of individual scholars within the community, without requiring formal certification. The recognition by external institutions can be supported by the documented standards the field maintains in its other infrastructure, without requiring a credential that the institutions can refer to. And the career pathways can be supported by the training programs and mentorship structures without requiring a credential at their endpoint.

If formal credentialing is eventually developed, it should be limited in scope and modest in its claims. A credential that certifies completion of specific methodological training is more defensible than a credential that claims to certify someone as a neglect-studies scholar in general, and the field should be cautious about expanding any credential it adopts beyond its initial scope.

7.3 Professional Standards

Professional standards for the field — what counts as ethical practice, what conflicts of interest must be disclosed, what evidence standards apply to different kinds of claims — should be developed explicitly and documented in a code of practice that the professional association maintains. The standards should draw on the established standards of adjacent fields where they apply, and should add field-specific provisions where the field’s distinctive features require them.

Specific provisions that the field’s standards should address include: the disclosure of funding sources for work that bears on the funders’ own decision-making (a consideration that arises directly from the funding strategy of Paper 4); the standards for representing absent constituencies in work on constituency-less questions (a consideration from Paper 2); the standards for protecting interview subjects whose accounts bear on professional reputations and institutional relationships (a consideration from Paper 5); and the standards for engagement with research-governing institutions (a consideration that Paper 7 will develop further).

The standards should be developed through a consensus process that includes the field’s diverse perspectives, should be reviewed periodically as the field’s experience accumulates, and should be enforced through professional norms rather than through formal disciplinary procedures. The enforcement question is delicate: formal disciplinary procedures require institutional infrastructure that the field will not have for many years, and informal enforcement through professional norms depends on the field’s community being cohesive enough for the norms to operate. The recommendation is to rely on informal enforcement during the field’s early years, with the possibility of more formal procedures considered if the informal mechanisms prove inadequate.

8. Timeline and Risks

The workforce development outlined above operates on a timeline considerably longer than the other infrastructure work the series has discussed. The rough timeline is as follows.

In the first three years, the founding centers should establish the doctoral concentrations within host disciplines, recruit the first cohorts of doctoral students, and begin the cross-institutional mentorship networks. The first master’s programs can launch in this period if institutional support permits, though the second half of the first decade is more realistic.

In years four through seven, the first cohort of doctoral graduates emerges, the master’s programs are operating, and the continuing-education stream is established. The professional association should be founded in this period, and the field’s community begins to recognize itself as a community rather than a collection of individual scholars.

In years eight through twelve, the early-career scholars from the first doctoral cohort move into junior faculty positions, the mentorship density begins to increase as more senior figures emerge, and the question of dedicated doctoral programs becomes pressing. The second-generation scholars trained by the first generation begin to emerge.

In years thirteen and beyond, the field reaches what counts as maturity: established doctoral programs, recognized credentials, a critical mass of senior scholars, and a professional community that operates with the conventions and capacities of established fields. The exact timeline depends on the pace at which the field grows, which depends in turn on the funding situation, the demand for the field’s outputs, and the broader research-policy environment.

The risks the workforce strategy must anticipate include several that deserve explicit treatment. The first is that the field grows too quickly relative to its capacity to maintain quality, producing graduates whose training does not meet the standards the field requires and damaging the credibility of the credentials the field offers. The corrective is to maintain selective admissions to the training programs and to resist the pressure to expand capacity beyond what can be supported with adequate mentorship and resources.

The second risk is that the field grows too slowly to sustain the institutional infrastructure that the preceding papers have specified. A flagship journal needs a steady flow of submissions and reviewers; a registry needs entries; a conference needs attendees. If the workforce does not grow to support these activities, the institutional infrastructure becomes a burden rather than a foundation. The corrective is to plan the institutional infrastructure with realistic estimates of workforce growth and to scale the infrastructure as the workforce develops.

The third risk is that the field’s workforce becomes demographically narrow, drawing scholars predominantly from particular institutions, particular regions, particular socioeconomic backgrounds, or particular substantive areas. The narrowness would compromise the field’s intellectual breadth and its credibility in addressing the equity concerns that some of its work bears on. The corrective is deliberate attention to recruitment, to fellowship targeting, and to the institutional accessibility of the training programs, with the attention sustained over the long period required for demographic patterns to change.

The fourth risk is the one that connects most directly to the field’s mission. A field that examines the patterns of attention in scholarly inquiry must be willing to examine its own attention patterns, and the workforce strategy must include the reflexive commitments that allow such self-examination. The reflexive work is uncomfortable and tends to be deferred, and the field’s professional norms must explicitly support it. Paper 8 takes up the broader question of the field’s reflexive identity, and the workforce strategy must be designed in coordination with that work.

9. Conclusion

This paper has proposed a workforce strategy for neglect studies that combines demanding skill requirements with explicit mechanisms for managing career risk, multiple training pathways with structures for mentorship and community formation, the inclusion of practitioners and lived-experience contributors as full members of the scholarly community, and the gradual development of professional infrastructure with caution about premature consolidation. The strategy operates on a longer timeline than the other elements of the field’s founding work, and its results become visible only after the field’s first decade has substantially passed.

The workforce strategy cannot be implemented without the institutional infrastructure of Paper 3, the funding of Paper 4, and the data resources of Paper 5. The strategy presupposes the methodological standards of Paper 2 and the conceptual framework of Paper 1. The interdependencies remain the dominant feature of the series, and the workforce paper is no exception.

Paper 7 takes up the field’s engagement with the research-governing institutions whose decisions the field exists to inform. The workforce that this paper has discussed is the workforce that will conduct that engagement, and the design of the engagement structures must accordingly attend to who is available to staff them.


Notes

[^1]: The literature on the career challenges of interdisciplinary scholars is reviewed in Rhoten and Parker (2004) and in the more recent treatment by Leahey, Beckman, and Stanko (2017). The findings are consistent across multiple settings: interdisciplinary work tends to have higher long-term impact but lower short-term recognition, with the career consequences falling more heavily on early-career scholars.

[^2]: The joint-appointment literature is partly empirical and partly practical; Pfirman and Martin (2010) provides one useful treatment, and the operational documents of comparable interdisciplinary fields provide additional guidance.

[^3]: The literature on doctoral training in interdisciplinary fields, introduced in Paper 3, develops further in Holley (2009, 2017) and in the subsequent work on the structure and outcomes of cross-disciplinary doctoral programs.

[^4]: The patient and public involvement literature, cited in Papers 2 and 4, provides extensive treatment of the inclusion of non-academic contributors in research; see Manafò, Petermann, Vandall-Walker, and Mason-Lai (2018) and the broader literature it reviews.

[^5]: The literature on professional associations in emerging fields is largely practical, drawing on the histories of comparable cases; the institutional documents of recently established interdisciplinary associations (the Society for the History of Recent Social Science, the Metascience Society) provide useful templates.

[^6]: The credentialing literature in adjacent fields is reviewed in Lester (2009) and in the subsequent work on professional certification in interdisciplinary contexts. The trade-offs the literature identifies are consistent with the analysis in section 7.2 above.


References

Holley, K. A. (2009). Understanding interdisciplinary challenges and opportunities in higher education. ASHE Higher Education Report, 35(2). Jossey-Bass.

Holley, K. A. (2017). Interdisciplinary curriculum and learning in higher education. In Oxford research encyclopedia of education. Oxford University Press.

Leahey, E., Beckman, C. M., & Stanko, T. L. (2017). Prominent but less productive: The impact of interdisciplinarity on scientists’ research. Administrative Science Quarterly, 62(1), 105–139.

Lester, S. (2009). Routes to qualified status: Practices and trends among UK professional bodies. Studies in Higher Education, 34(2), 223–236.

Manafò, E., Petermann, L., Vandall-Walker, V., & Mason-Lai, P. (2018). Patient and public engagement in priority setting: A systematic rapid review of the literature. PLOS ONE, 13(3), e0193579.

Pfirman, S., & Martin, P. (2010). Facilitating interdisciplinary scholars. In R. Frodeman, J. T. Klein, & C. Mitcham (Eds.), The Oxford handbook of interdisciplinarity (pp. 387–403). Oxford University Press.

Rhoten, D., & Parker, A. (2004). Risks and rewards of an interdisciplinary research path. Science, 306(5704), 2046.


Posted in Musings | Tagged , , , | Leave a comment

Data Infrastructure: Mapping the Negative Space


Executive Summary

This paper addresses the data infrastructure that neglect studies will require to function as a mature field. The premise is that a discipline whose central business is the systematic identification of underexplored questions cannot proceed on the basis of impressionistic claims alone; it requires standing data resources that allow scholars to map the distribution of attention across the research landscape, to identify candidate cases of neglect with defensible empirical grounding, and to track changes over time. The infrastructure must serve both the field’s internal research agenda and its applied engagement with research-governing institutions, and it must do so under constraints — coverage biases in existing databases, the difficulty of measuring absence rather than presence, the ethical complications of qualitative data — that the field shares with adjacent enterprises but that it must address with its own resources.

The paper develops six proposals. The first is a standing public dashboard of research distribution, drawing on existing bibliometric infrastructure but inverting the standard analytical questions to produce maps of negative space. The second is a structured registry of neglected questions, building on the proposal introduced in Paper 3 but specified here in greater detail as a data resource. The third is an archive of abandoned research programs, preserving documentation that would otherwise be lost as founding scholars retire and institutional records are discarded. The fourth is a set of common data elements — shared definitions, instruments, and codebooks — that allow studies conducted by different scholars in different settings to produce findings that aggregate meaningfully. The fifth is a federated data-access model that respects the privacy, intellectual property, and political constraints under which different data sources operate. The sixth is a qualitative archive of oral histories, interviews, and ethnographic materials that preserve the tacit knowledge of scholars whose careers have included engagement with neglected questions.

The paper concludes with a discussion of governance, sustainability, and the relationship between the field’s data infrastructure and the broader open-science movement on which much of it will depend.


1. Introduction

The methodological argument of Paper 2 was that no single method is adequate to support rigorous claims about neglect and that the field’s standards should require triangulation across methods. The institutional argument of Paper 3 was that the field requires academic infrastructure within which methodologically serious work can be conducted. This paper takes up what stands between them: the data resources on which methodologically serious work depends.

The argument can be stated simply. Bibliometric methods require databases. Expert elicitation requires panels and protocols. Historical recovery requires archives. Comparative analysis requires harmonized data across systems. Counterfactual reasoning requires structured estimates and the documentation of their assumptions. Qualitative methods require interview transcripts, field notes, and the apparatus for preserving them ethically. None of this infrastructure exists in a form designed for neglect-studies purposes, and the field’s capacity to produce credible findings depends on building it.

The argument is complicated by three features of the field’s situation. The first is that the data infrastructure required is partly continuous with existing scholarly resources — the standard bibliometric databases, the institutional archives of universities and funders, the established protocols of qualitative research — and partly distinctive, in that it must support analyses of absence rather than presence. The continuity allows the field to draw on substantial existing investment; the distinctiveness means that the field cannot simply inherit existing infrastructure and must adapt or build what is missing. The second is that data infrastructure is expensive to build and to maintain, and the field’s funding situation (Paper 4) makes choices about which resources to prioritize consequential. The third is that the data the field needs is held in many different places under many different governance arrangements, and the work of integration is at least as substantial as the work of original data collection.

The paper proceeds through six proposals, organized roughly by the maturity of the underlying infrastructure. The dashboard and the registry can be built relatively quickly on existing foundations. The abandoned-programs archive and the qualitative archive require more original work. The common data elements and the federated access model are coordination problems whose solutions depend on the field’s relationships with adjacent enterprises rather than on its own resources alone.

2. A Standing Dashboard of Research Distribution

The first proposal is a publicly accessible dashboard that visualizes the distribution of research attention across topics, populations, regions, methods, and disciplines, with the structure of the dashboard designed to make patterns of apparent neglect visible.

The technical foundation already exists. Open bibliometric databases — OpenAlex is the most ambitious, with several others operating on smaller scales — provide structured data on publications, citations, authors, and institutional affiliations at the scale required.[^1] The major commercial databases (Web of Science, Scopus, Dimensions) provide comparable data with different coverage profiles and licensing conditions. Topic-modeling and clustering tools developed in computational social science allow the data to be organized into meaningful categories.[^2] Visualization platforms developed in the broader open-data movement provide the user-facing layer.

What is missing is the integration of these resources into a single tool designed for neglect-studies questions. The standard bibliometric tools are designed to map what is being studied; the proposed dashboard would invert the standard analytical move to map what is conspicuously absent given the structure of adjacent literatures, the distribution of relevant external indicators, or historical baselines.

The dashboard’s design should include several specific features. It should allow users to specify a topic, discipline, or research area and to receive structured visualizations of how attention to that area has been distributed over time, across regions, across institutional types, and across methodological approaches. It should allow users to compare the distribution of attention to the distribution of external indicators of importance — disease burden for medical topics, environmental exposure for environmental topics, demographic significance for population-related topics — with explicit acknowledgment of the imperfections of the comparison. It should allow users to identify topics within a discipline that have unusual patterns of attention given the structure of the surrounding literature, with the unusualness flagged as a candidate for further investigation rather than as a conclusion. And it should allow users to track changes in attention patterns over time, both to identify areas where attention has been declining and to identify areas where previously neglected questions have begun to receive sustained attention.

The dashboard should not produce conclusive identifications of neglect. The tiered evidence standard of Paper 2 places dashboard findings at the exploratory level, as candidate hypotheses for further investigation rather than as substantiated claims. The dashboard should communicate this status to its users explicitly, with documentation of the limitations of the underlying data, the assumptions built into the visualizations, and the methodological caveats that apply to the patterns it displays. The communication is important: a tool that produces visually compelling representations of apparent neglect will be used by audiences who have not read the methodological caveats, and the dashboard’s credibility depends on its design making the limitations as visible as the findings.

The governance of the dashboard requires deliberate attention. The technical operation can reasonably be hosted by one of the founding centers, but the editorial decisions — which databases to include, how to structure topic classifications, how to handle the coverage biases of the underlying data — affect what users see and should be made through a process that includes diverse perspectives within the field. A standing editorial committee, with rotating membership and explicit responsibility for the dashboard’s accuracy and balance, is the appropriate structure. The committee should publish its methodological decisions, should respond to documented errors in the dashboard’s outputs, and should commission periodic external audits of the dashboard’s design.

The sustainability of the dashboard is the most difficult question. Open data resources of comparable scale have generally been funded through some combination of foundation support, institutional underwriting, and modest revenue from premium access for institutional users. The dashboard’s funding model should be settled at its launch and should include explicit provisions for what happens if any of its funding sources is withdrawn. A dashboard that ceases operation after five years because its initial grant ends would damage the field’s credibility more than no dashboard at all, and the funding planning should accordingly be conservative.

3. A Registry of Neglected Questions

The registry of neglected questions was introduced in Paper 3 as a companion publication outlet to the flagship journal. This section specifies its design as a data resource.

The registry’s central function is to provide a structured, citable, and updatable record of cases in which scholars have identified questions, populations, methods, or areas as neglected, with the documentation appropriate to the tier of evidence on which the identification rests. Each registry entry should include: the question or area identified; the discipline or disciplines to which it belongs; the category of neglect (in the Paper 1 taxonomy) to which the identification primarily applies; the methodological approach used to substantiate the identification; the evidence tier (exploratory, substantiated, rigorous) at which the identification stands; the scholars responsible for the identification; the date of submission and the dates of subsequent updates; pointers to relevant literature; and an open field for commentary, including the documentation of subsequent work that has either substantiated or revised the original identification.

The registry serves several functions that distinguish it from a journal. It supports cumulative knowledge in cases where individual contributions are too small to support full articles but where the collective contribution is substantial. It allows updating, so that a registry entry can be revised as new evidence emerges or as subsequent work changes the picture. It allows linking, so that an entry can document the relationships among related cases of neglect rather than treating each in isolation. And it produces a public-facing record that funders, learned societies, and policy bodies can consult, in a form that is more accessible to non-specialists than the journal literature alone.

The quality control problem is the same one identified in Paper 3 and bears restating here in the context of the data design. An open submission system will receive contributions that do not meet the field’s standards, and a registry that becomes a repository for unsubstantiated claims will damage the field’s credibility more comprehensively than the dashboard would, because the registry’s structured format gives entries a status that visualizations of bibliometric data do not. The proposed quality control combines three elements. First, submissions must include documentation appropriate to the evidence tier claimed, and the documentation requirements should be specified explicitly in the registry’s submission guidelines. Second, an editorial committee should review submissions before publication, with the review focused on whether the documentation supports the tier claimed rather than on the substantive merit of the identification. Third, the registry interface should display the evidence tier prominently alongside each entry, so that users can calibrate their interpretation accordingly.

A specific design question concerns the registry’s handling of contested cases. Some identifications of neglect will be contested either at the time of submission or subsequently, with different scholars reaching different conclusions about whether a particular case is genuinely neglected or appropriately deprioritized. The registry should accommodate such cases by allowing entries to include linked dissenting opinions, with the dissents documented to the same standards as the original entries. The structure communicates to users that the field’s claims are open to revision and that the registry preserves rather than suppresses methodological disagreement. The structure also creates a venue for the kind of structured argumentative engagement that produces the field’s most rigorous work over time.

The relationship between the registry and the flagship journal requires attention. The two are complementary rather than redundant: the journal publishes the methodological development, the case studies, and the field-wide analyses that contextualize particular registry entries, while the registry preserves the structured record of identifications themselves. A scholar who has identified a neglected question and produced a journal article about it should be expected to deposit a corresponding registry entry, both to make the identification accessible to subsequent scholars and to allow the entry to be updated as the case develops over time.

4. An Archive of Abandoned Research Programs

The third proposal is an archive specifically devoted to abandoned research programs — the category of neglect introduced in Paper 1 and developed methodologically in Paper 2. The case for the archive rests on the observation that the documentation of abandoned programs is unusually vulnerable to loss. When a research program is active, its documentation accumulates in journal literatures, institutional records, and the working files of active researchers. When the program is abandoned, its journal literature becomes increasingly difficult to locate, institutional records are discarded according to standard retention schedules, and the working files of researchers are lost when those researchers retire, die, or move on to other work. The window for recovering the documentation of an abandoned program closes within a generation or two of the abandonment, and once it closes the recovery becomes substantially harder.

The archive should be conceived as a federated rather than a centralized resource. Centralizing the physical collections of multiple abandoned programs at a single institution would be impractical and probably inappropriate, since the materials are often located at the institutions where the work was conducted and where local custodial expertise exists. The federated model treats the archive as a directory and integration layer that points to the holdings of multiple host institutions, that ensures consistent metadata across the holdings, and that supports cross-collection searching and analysis.

The archive’s metadata standard should include: the research program identified; the period of its active operation; the disciplinary location of the work; the reasons for abandonment, as documented in available sources; the institutions and individuals associated with the program; the holdings related to the program (publications, archival materials, working files, datasets, instruments) and the institutions where they are located; the contact information for the custodians of those holdings; and pointers to subsequent work on the program, whether by historians, by neglect-studies scholars, or by researchers attempting revival.

A specific component of the archive should be devoted to the oral histories of scholars whose careers included involvement in abandoned programs. The oral-history component is discussed in greater detail in section 7 below, but the connection to the abandoned-programs archive deserves note here. Many abandoned programs have living participants whose tacit knowledge would be lost without deliberate preservation, and the cost-benefit calculation for oral-history work strongly favors moving on the work before the participants are no longer available rather than waiting until the field’s other priorities are settled.

The archive should be developed in stages, beginning with a small number of well-documented cases that the founding centers identify as priorities. The first decade’s work should aim for perhaps twenty to forty programs documented to the standard described above, with the cases selected for their illustrative value, their historical interest, and the availability of participants for oral-history work. The selection process should be transparent, with the criteria published and the choices documented, so that subsequent scholars can both build on the early work and contribute additional cases through whatever scholarly community develops around the archive.

The relationship between the archive and the existing infrastructure for the history of science deserves explicit treatment. Several major repositories — the American Institute of Physics’s Niels Bohr Library, the Wellcome Trust’s archives, the Charles Babbage Institute, and others — already preserve materials related to scientific work, including some materials related to programs that subsequently abandoned. The proposed archive should not duplicate this work but should integrate with it, providing the metadata layer that allows existing holdings to be discovered and used for neglect-studies purposes. The integration work requires collaboration with the existing repositories and respect for their custodial responsibilities, and the archive’s design should make the collaboration straightforward rather than imposing additional burdens on partners whose own missions are different.

5. Common Data Elements

The fourth proposal addresses a coordination problem rather than a single resource. The methodological pluralism of the field (Paper 2) means that studies using different methods will produce findings whose aggregation requires shared definitions, instruments, and codebooks. Without such shared elements, the field’s outputs will be a collection of one-off studies whose findings cannot be combined to produce field-wide understanding, and the cumulative-knowledge function that distinguishes a mature field from a collection of individual scholars will be defeated.

The common data elements (CDEs) that the field requires fall into several categories.

The first is shared definitions for the categories of neglect introduced in Paper 1. The taxonomy proposed there — orphan topics, abandoned research programs, methodologically inaccessible questions, interstitial questions, peripheral inquiries, sensitive questions, and constituency-less questions — provides a starting vocabulary, but the categories require operationalization before they can be applied consistently across studies. The operationalization work should produce definitions specific enough to allow different scholars to classify cases the same way, while remaining flexible enough to accommodate the variation across cases that the categories are intended to capture. The work should be conducted through the kind of consensus-building process that Paper 1 introduced and that subsequent papers will need to specify further.

The second is shared instruments for the methodological approaches of Paper 2. Expert elicitation in particular benefits substantially from standardized protocols, both because the protocol design affects the findings in well-documented ways and because comparison across studies depends on the protocols being similar enough to allow meaningful comparison. The James Lind Alliance methodology provides a partial model,[^3] but the model is specific to health-research priority-setting and requires adaptation for the broader range of cases that neglect studies must address. Similar standardization work is needed for the documentation requirements of bibliometric mapping, for the protocols of historical recovery, and for the structure of counterfactual estimation.

The third is shared codebooks for the variables that recur across studies. Bibliometric studies routinely use measures of citation, of collaboration, of geographic distribution, and of disciplinary classification, and the comparison across studies depends on the measures being defined consistently. The existing literature on bibliometric methods provides considerable standardization, but neglect-studies applications may require extensions — for example, measures of attention to particular categories of questions, measures of the rate of change in attention over time, measures of the cross-disciplinary scope of attention — that are not yet standardized.

The development of CDEs is itself a substantial scholarly activity that requires its own resources. The work should be coordinated through one of the founding centers, with input from the field’s broader community through the structures (journal, conferences, registry) that Paper 3 established. The CDE work should be conducted transparently, with proposed elements published for community comment before adoption, and the adopted elements should be revised periodically as the field’s experience accumulates.

A specific consideration is the relationship between the field’s CDEs and those developed in adjacent fields. The CDE work in clinical research, in social science research, and in metascience has produced substantial infrastructure that the field can adapt rather than building from scratch.[^4] The adaptations require domain-specific work but the underlying methodological standards translate well, and the field’s CDE development should proceed in conversation with the adjacent efforts rather than in isolation from them.

6. Federated Access and Data Governance

The fifth proposal addresses the data-governance challenges that arise when the field’s research requires access to data held by multiple parties under multiple governance arrangements. The challenges are well documented in adjacent fields — health research, social-science survey data, education research — and the field can draw on established models rather than developing new approaches.[^5]

The relevant data types include: bibliometric data held by commercial and open providers under varying licensing terms; funding data held by agencies under varying disclosure policies; institutional data held by universities under privacy and competitive considerations; qualitative data held by individual scholars and subject to research-ethics review; and personal data — including the identities of scholars who have made career choices around particular questions — subject to the strictest protections.

The federated access model treats the data as remaining under the control of its original custodians, with access provided through standardized interfaces that allow analyses to be conducted without the data being transferred. The model is more complex to implement than centralized data deposits but has corresponding advantages: it preserves the data custodians’ control over their data, it accommodates the varying governance arrangements under which different data are held, and it allows analyses to be conducted on data that could not be released for centralization under any plausible governance arrangement.

The implementation of federated access requires technical infrastructure (standardized query interfaces, audit logs, computational environments that allow analysis without data transfer) and governance infrastructure (data-sharing agreements, access procedures, dispute-resolution mechanisms). Both have been developed in adjacent fields and the field’s implementation should draw on those models. The technical infrastructure can reasonably be hosted by one of the founding centers, with the governance infrastructure developed through agreements with the data custodians whose holdings are most important for the field’s work.

A specific governance question concerns the access of the field’s scholars to data that documents funding decisions. The funding agencies whose decision-making the field studies are also potential funders of the field’s work (Paper 4), and the access arrangements must be designed to preserve the field’s analytical independence. The arrangements that have worked in adjacent contexts include time delays between the decisions and the data release (typically five to ten years), aggregation requirements that prevent identification of individual decisions, and the involvement of the funders in the design of the access arrangements without involvement in the specific analyses that the data support. The field’s data-governance work should draw on these precedents and should be explicit about the protections that preserve analytical independence.

A separate governance question concerns the data that documents the experiences of individual scholars — interview transcripts, narrative accounts of career decisions, ethnographic field notes — that bear on the mechanisms of neglect. The data is sensitive both because it identifies individuals and because some of what it documents bears on professional reputations and institutional relationships. The governance arrangements for this category of data should follow the established standards of qualitative research ethics, with informed consent procedures that explicitly address the possibility of identification, with secure storage arrangements, and with disclosure standards that prioritize the protection of participants over the convenience of subsequent scholars. The standards are well established in adjacent fields and require adaptation rather than original development.

7. A Qualitative Archive

The sixth proposal is an archive of qualitative materials — oral histories, interview transcripts, ethnographic field notes — that document the tacit knowledge of scholars whose careers have included engagement with neglected questions. The archive’s case rests on the observation that much of the most important knowledge about how neglect operates is held by individual scholars in forms that are not preserved by ordinary scholarly publication. Scholars who have considered pursuing particular questions and decided not to, scholars who have pursued such questions and paid professional costs, scholars who have participated in the founding or the abandonment of research programs, and scholars who have served as program officers or peer reviewers whose decisions shaped the distribution of attention: all of them hold knowledge that the field’s understanding of its subject depends on, and all of them are subject to the ordinary attrition of careers and lives.

The archive should be developed in stages, with the first stage prioritizing the scholars whose careers are nearing their end and whose loss would be most consequential. The selection process should draw on multiple sources of identification: the field’s professional community, the historians of relevant disciplines, the institutional knowledge of the founding centers, and the suggestions of scholars who are themselves interviewed and who can identify others whose accounts would be valuable.

The methodology of the oral-history work should draw on the established traditions of the history of science and of qualitative research in adjacent fields.[^6] The interviews should be conducted by scholars trained in oral-history methods, should be transcribed and reviewed by the interview subjects before being archived, and should be subject to access conditions that respect the subjects’ interests in how their accounts are used. The transcripts should be deposited in repositories that can preserve them for the long term, with metadata that allows them to be discovered by subsequent scholars.

A specific consideration is the relationship between the qualitative archive and the field’s analytic work. The interview transcripts are primary sources rather than analyses, and their value to the field comes from their availability for analysis by scholars whose questions cannot be specified in advance. The archive’s design should accordingly emphasize preservation and discoverability rather than the particular analyses that motivate the initial collection. The archive should outlast the founding scholars of the field, and the materials it preserves should be available to scholars whose work the founding scholars cannot anticipate.

The qualitative archive’s relationship to research ethics deserves particular attention. The interviews will sometimes document practices and decisions that the subjects’ institutions or professional communities would prefer not to be public. The standards under which the interviews are conducted must include explicit protections for the subjects, including the option to restrict access to particular passages, to redact identifying information about third parties mentioned in the interviews, and to embargo materials for periods that the subjects specify. The standards should be developed in consultation with research-ethics committees and with the established oral-history community, and they should be documented in the archive’s published policies so that subjects can make informed decisions about participation.

8. Governance, Sustainability, and Open Science

The data infrastructure outlined above is substantial, and its governance and sustainability deserve explicit treatment.

The governance principle that runs through the proposals is that the data infrastructure should be governed by structures that include diverse perspectives within the field, that operate transparently, and that are accountable to the field’s professional community rather than to any single institution or funder. The principle requires explicit institutional design: standing committees with rotating membership, published procedures, regular reporting to the field’s community, and external review on a defined schedule. The institutional design should be settled at the founding of each data resource rather than developed in response to subsequent controversies, since governance arrangements established under pressure tend to be less stable than those established at the outset.

The sustainability of the infrastructure is the more difficult problem. Data resources have well-known patterns of decay: initial funding supports launch and early operation, but the long-term maintenance that determines whether the resource remains useful is harder to fund and often falls short. The field’s data infrastructure should be planned with sustainability in mind from the start, with explicit consideration of the operating costs after the launch funding ends, of the institutional commitments required to sustain operation, and of the contingency plans for what happens if particular funding sources are withdrawn. A data resource that becomes inaccessible or outdated after five years is sometimes worse than no resource at all, because users have come to depend on it in ways that the failure disrupts. The sustainability planning should be conservative.

The broader open-science movement provides important context for the field’s data infrastructure work. The movement has produced infrastructure (open repositories, persistent identifiers, standardized metadata, open licenses) on which the field can draw, and the movement’s standards have set the broader expectations for how scholarly data resources should operate.[^7] The field’s data infrastructure should align with open-science standards as a default, with departures from the standards justified explicitly when they are required by considerations specific to the field’s situation. The alignment serves both the field’s intrinsic commitments to the redistribution of attention — which sit poorly with restrictive access to its own outputs — and its practical interests in connecting with the broader research community.

A specific consideration is the field’s potential contribution to open-science infrastructure rather than just its consumption of that infrastructure. The methodological work on negative-space analysis, the development of common data elements for the field’s distinctive analyses, the qualitative archive’s preservation methodology: all of these have potential applications beyond the field’s own work and should be developed in ways that allow other scholars to use them. The contribution serves the field’s broader influence and provides a non-financial form of return on the open-science movement’s support.

9. Conclusion

This paper has proposed six elements of data infrastructure for neglect studies: a dashboard of research distribution, a registry of neglected questions, an archive of abandoned research programs, common data elements, federated access arrangements, and a qualitative archive. Each rests on existing scholarly resources and requires adaptation or extension for the field’s specific purposes. Each has governance and sustainability requirements that the field’s founding scholars must address explicitly. Each connects the field to adjacent enterprises whose collaboration the field will require.

The data infrastructure cannot be built without funding (Paper 4) and without the institutional homes that Paper 3 specified. It cannot be used effectively without the methodological standards of Paper 2 and the conceptual framework of Paper 1. The interdependencies are why the series has presented the elements in their current order: each paper presupposes the ones before it, and the data infrastructure proposed here is the operational expression of the commitments that the earlier papers articulated.

The papers that follow take up the workforce that will use the infrastructure (Paper 6), the research-governing institutions whose decisions the infrastructure exists to inform (Paper 7), and the field’s identity and self-critique (Paper 8). The data infrastructure paper is in some ways the most concrete of the series, and its proposals are accordingly the most easily evaluated. The field’s eventual success will be measurable in part by whether the resources proposed here exist in working form a decade after the field’s founding, and whether they are used by scholars whose work is improved by them.


Notes

[^1]: OpenAlex, launched in 2022 as a successor to Microsoft Academic Graph, has become the most widely used open bibliometric database. Its coverage, structure, and limitations are documented in Priem, Piwowar, and Orr (2022) and in the database’s own ongoing documentation. The comparison among the major bibliometric databases is reviewed in Visser, van Eck, and Waltman (2021).

[^2]: The topic-modeling literature relevant to bibliometric analysis is reviewed in Boyack and Klavans (2014), with subsequent methodological developments documented in the broader computational social science literature.

[^3]: The James Lind Alliance methodology has been adopted with variations by priority-setting partnerships in many fields, and the variations are themselves documented (Crowe et al., 2015; Cowan & Oliver, 2021). The methodology’s specific provisions for protocol standardization are part of what has allowed comparison across partnerships.

[^4]: The clinical research literature on common data elements is the most developed; the National Institutes of Health maintains the NIH CDE Repository as a coordinating resource. Sheehan et al. (2016) provides a useful overview of the principles. Adjacent work in social science research has been developed through the Data Documentation Initiative and the Inter-university Consortium for Political and Social Research.

[^5]: The federated data-access model has been developed extensively in health research, with the Observational Health Data Sciences and Informatics network providing one well-documented implementation. Voss et al. (2015) provides an overview. Similar approaches have been developed in social science research and in education research, with the European Data Infrastructure for the social sciences offering a comparable model.

[^6]: The oral-history of science tradition is documented through the American Institute of Physics’s program, the Royal Society’s archives, and several other institutional efforts. The methodological standards are reviewed in Doel and Söderqvist (2006).

[^7]: The open-science literature has grown substantially over the past two decades; Vicente-Saez and Martinez-Fuentes (2018) provides a review of the conceptual development, and the FAIR principles articulated in Wilkinson et al. (2016) have become a widely adopted standard for data resources.


References

Boyack, K. W., & Klavans, R. (2014). Creation of a highly detailed, dynamic, global model and map of science. Journal of the Association for Information Science and Technology, 65(4), 670–685.

Cowan, K., & Oliver, S. (2021). The James Lind Alliance guidebook (Version 10). James Lind Alliance.

Crowe, S., Fenton, M., Hall, M., Cowan, K., & Chalmers, I. (2015). Patients’, clinicians’ and the research communities’ priorities for treatment research: There is an important mismatch. Research Involvement and Engagement, 1, 2.

Doel, R. E., & Söderqvist, T. (Eds.). (2006). The historiography of contemporary science, technology, and medicine: Writing recent science. Routledge.

Priem, J., Piwowar, H., & Orr, R. (2022). OpenAlex: A fully-open index of scholarly works, authors, venues, institutions, and concepts. arXiv:2205.01833.

Sheehan, J., Hirschfeld, S., Foster, E., Ghitza, U., Goetz, K., Karpinski, J., Lang, L., Moser, R. P., Odenkirchen, J., Reeves, D., Rubinstein, Y., Werner, E., & Huerta, M. (2016). Improving the value of clinical research through the use of Common Data Elements. Clinical Trials, 13(6), 671–676.

Vicente-Saez, R., & Martinez-Fuentes, C. (2018). Open science now: A systematic literature review for an integrated definition. Journal of Business Research, 88, 428–436.

Visser, M., van Eck, N. J., & Waltman, L. (2021). Large-scale comparison of bibliographic data sources: Scopus, Web of Science, Dimensions, Crossref, and Microsoft Academic. Quantitative Science Studies, 2(1), 20–41.

Voss, E. A., Makadia, R., Matcho, A., Ma, Q., Knoll, C., Schuemie, M., DeFalco, F. J., Londhe, A., Zhu, V., & Ryan, P. B. (2015). Feasibility and utility of applications of the common data model to multiple, disparate observational health databases. Journal of the American Medical Informatics Association, 22(3), 553–564.

Wilkinson, M. D., Dumontier, M., Aalbersberg, I. J., Appleton, G., Axton, M., Baak, A., Blomberg, N., Boiten, J.-W., da Silva Santos, L. B., Bourne, P. E., Bouwman, J., Brookes, A. J., Clark, T., Crosas, M., Dillo, I., Dumon, O., Edmunds, S., Evelo, C. T., Finkers, R., … Mons, B. (2016). The FAIR Guiding Principles for scientific data management and stewardship. Scientific Data, 3, 160018.


Posted in Musings | Tagged , , , | Leave a comment

The Funding Ecosystem: Public, Private, and Philanthropic Pipelines for Neglect Studies


Executive Summary

This paper addresses the hardest practical problem the field faces: how a discipline whose central business is to study what institutional science neglects can secure funding from the same institutions whose attention patterns it exists to examine. The problem is not merely awkward. It is structural, and the field’s long-term viability depends on solving it in ways that neither compromise the field’s analytical independence nor leave it perpetually marginal.

The paper develops six arguments. The first is that conventional grant mechanisms tend to reproduce existing research priorities through well-understood reviewer-selection and track-record effects, which means that the standard funding pathway is poorly suited to a field whose work routinely challenges existing priorities. The second is that several alternative funding instruments — lottery allocation, golden-ticket schemes, prize-based funding, retrospective grants, and high-risk programs — have been developed in adjacent contexts and offer partial precedents for what the field needs. The third is that private philanthropy is the most likely first mover for the field, but that exclusive reliance on philanthropic funding creates vulnerabilities that the field’s founding planners should anticipate. The fourth is that public-sector funding can be secured through specific argumentative strategies that have worked for adjacent fields and that draw on the field’s potential contribution to research-policy decisions. The fifth is that institutional endowments — chairs, named centers, and dedicated fellowship programs — provide stability that no other funding source can match and should be priorities for the field’s longer-term consolidation. The sixth is that the field needs its own funded research agenda on the funding system itself, both because the topic is intellectually appropriate to the field and because the findings would inform the field’s own funding strategy.

The paper concludes with a discussion of sequencing and a frank treatment of the failure modes that the field’s funding strategy must anticipate.


1. Introduction

The preceding papers have addressed what neglect studies would study (Paper 1), how it would study it (Paper 2), and the academic infrastructure within which the work would be conducted (Paper 3). All three presupposed that the field would have resources. This paper takes up the question those presuppositions defer.

The funding problem for neglect studies has a structural feature that distinguishes it from the funding problems of most emerging fields. Most new fields can argue that they address questions the existing research system has not yet recognized as important, and the argument is usually made to funders whose own portfolios are not implicated in the critique. A new field of cellular biology in the 1950s could plausibly argue that the existing biological sciences had not yet appreciated the importance of cellular mechanisms, and the argument could be made to funders whose investments in organismal biology were not threatened by the new field’s growth. The new field added to the research system without subtracting from it.

Neglect studies is differently situated. Its central business is the systematic identification of cases in which the existing research system has misallocated attention, and the existing research system is the same system that the field must approach for funding. The asymmetry is not absolute — funders have genuine interests in improving their own decision-making, and the field’s outputs are useful to them on those grounds — but the asymmetry is real, and the field’s funding strategy must take it seriously.

The argument of this paper is not that the funding problem is unsolvable. Comparable problems have been solved for adjacent fields, and the solutions, where examined carefully, suggest pathways that neglect studies can adapt. The argument is rather that the funding problem requires deliberate strategic thinking from the outset, that the strategy must include multiple revenue streams whose vulnerabilities do not correlate, and that the strategy must preserve the analytical independence on which the field’s value to its funders depends.

2. Why Conventional Grant Mechanisms Are Poorly Suited

The mechanisms by which conventional grant programs allocate funding have been studied extensively, and the findings are consistent across multiple fields and funding agencies.[^1] Three features of standard peer-reviewed grant programs are particularly relevant to the prospects for neglect-studies funding.

The first is reviewer selection. Grant reviewers are drawn from the established researchers in a field, which means that the questions reviewers find compelling are the questions the field is already pursuing. Proposals that depart from established questions face a structural disadvantage: reviewers must understand the proposal’s framing well enough to evaluate it, and proposals framed around questions the reviewers do not recognize as important are systematically rated lower than proposals framed around established questions. The effect is well documented in studies of grant review across multiple agencies, and it operates without any individual reviewer behaving in bad faith.

The second is track record. Grant applications are evaluated in part on the applicant’s record of previous work, and the standard measures of that record — prior publications in major outlets, prior grant funding, citation counts — are themselves shaped by the same attention patterns the field is trying to study. A scholar who has built a career working on a neglected question will have a record that looks weaker by standard measures than a scholar working on an established question, even when the substantive quality of the work is comparable. The applicant’s record problem compounds the reviewer problem, with the result that scholars working on neglected questions face two reinforcing structural disadvantages in the standard grant system.

The third is project specificity. Conventional grants require applicants to specify what they will do, what they expect to find, and what methods they will use, in sufficient detail for reviewers to assess feasibility. The specifications work well for projects that build on established methods and address established questions, but they work poorly for projects that propose to develop new methods, to identify what is not yet recognized, or to recover lines of inquiry whose specifics cannot be fully specified before the recovery work has been done. Several of the methodological approaches outlined in Paper 2 — historical recovery, exploratory bibliometric mapping, expert elicitation in areas without established expert communities — fit poorly into the conventional grant template.

The implication is not that conventional grants are useless to the field. Established scholars working on substantiated cases of neglect, using mature methods, can compete for conventional funding successfully, and the field should pursue such funding actively. The implication is rather that conventional grants alone are insufficient, particularly for the field’s exploratory and methodologically innovative work, and that the funding strategy must include mechanisms designed for the kinds of projects that the conventional system is structurally poor at supporting.

3. Alternative Funding Instruments

Several alternative funding instruments have been developed in adjacent contexts and offer partial precedents for what neglect studies needs. Each is reviewed below with its strengths, limitations, and applicability to the field.

3.1 Lottery Allocation

Lottery allocation, in which grants are awarded by random selection from a pool of proposals that meet a threshold quality standard, has been piloted in several settings, including the Health Research Council of New Zealand’s explorer grants and several European national funding agencies’ experimental programs.[^2] The argument for lottery allocation is that the precision of conventional peer review is lower than its formal status suggests, that the costs of preparing applications and conducting reviews are substantial, and that random selection from a quality-screened pool produces outcomes nearly as good as conventional peer review at much lower administrative cost.

For neglect studies, lottery allocation has a specific additional appeal. The reviewer-selection and track-record effects that disadvantage proposals on neglected questions in conventional peer review are removed once a proposal has cleared the quality threshold, because the final selection among qualifying proposals is random rather than based on reviewer preferences. The field would benefit if lottery mechanisms became more widespread in research funding, and the field’s scholars should both contribute to the methodological evaluation of lottery programs and advocate for their expansion where evidence supports it.

The limitations are that lottery allocation depends on a quality-screening step whose criteria are themselves vulnerable to the same biases as conventional peer review, that the lottery component is politically controversial and slow to gain institutional acceptance, and that the field cannot rely on lottery mechanisms in the short term because the existing programs are small and the expansion of the model is uncertain.

3.2 Golden-Ticket Schemes

A golden-ticket scheme allows a small number of senior researchers — typically program officers, distinguished scientists, or members of a standing advisory committee — to fund a small number of projects per year without going through the standard review process. The Volkswagen Foundation’s experimental program along these lines has been documented, and similar mechanisms exist in several national agencies.[^3] The mechanism allows projects that conventional review would reject to receive funding when a credible senior figure judges them worth supporting.

For neglect studies, the golden-ticket mechanism is particularly well-suited to the field’s exploratory and high-risk work. A program officer who understands the field can use a golden-ticket allocation to fund a historical recovery project that conventional review would find insufficiently specified, or a methodological development project whose returns are uncertain. The mechanism trades some accountability for some flexibility, and the trade is worth making for a fraction of the funding portfolio.

The limitations are that golden-ticket schemes depend on the program officer’s judgment being good, that they create accountability concerns when projects fail, and that they are politically vulnerable to criticism as patronage. The field should advocate for golden-ticket mechanisms in research funding generally, and should encourage funders that adopt them to allocate some of the tickets to neglect-studies projects, but should not depend on the mechanism as a primary funding source.

3.3 Prize-Based Funding

Prize-based funding allocates resources retrospectively, by rewarding work that has been completed and judged successful, rather than prospectively, by funding work that has been proposed. The mechanism has been developed extensively in technology development — the X Prize family is the most visible example — and more recently in basic research through programs like the Breakthrough Prizes.[^4] Prize-based funding has the advantage of selecting on demonstrated quality rather than on the persuasiveness of an application, and the disadvantage of requiring researchers to fund the underlying work before the prize is available.

For neglect studies, prize-based funding can serve as a complement to other mechanisms rather than as a primary source. A prize for the best historical recovery of an abandoned research program, or for the best methodological contribution to bibliometric mapping of neglected areas, would incentivize work in the field’s priority areas without requiring the prize-awarding body to evaluate proposals. Prize programs are relatively straightforward to administer and can be funded by individual donors who want to support the field but who are not positioned to fund larger programs.

The limitations are familiar: prizes work best when the criteria for excellence are clear and when the prize amount is large enough to motivate substantial work. The field’s prize programs should be designed with both criteria in mind and should be understood as supplements to rather than substitutes for the main funding pathways.

3.4 Retrospective Funding for Previously Unfunded Work

A specific variant of prize-based funding deserves separate treatment. Retrospective funding programs reimburse researchers for work they have completed without prior funding, either through full grants or through smaller supplementary awards. The mechanism addresses a problem specific to scholars who have worked on neglected questions: the work has often been done on personal time, in unfunded projects, or as a side effort within larger funded programs whose primary purpose was something else.

For neglect studies, retrospective funding has two attractions. It rewards scholars who have already invested in neglected work without the institutional support that the field aims to build, which is a way of honoring the field’s intellectual debt to its precursors. And it identifies the scholars whose careers and recent work make them natural participants in the field’s consolidation, which serves the field’s community-building goals. A modest retrospective-funding program, administered by one of the field’s founding centers, would be a useful element of the funding mix.

3.5 High-Risk Programs

Several major funders have established programs specifically for high-risk research that conventional review would reject. The U.S. National Institutes of Health’s Director’s Pioneer Award, the National Science Foundation’s EAGER mechanism, the European Research Council’s various advanced grant programs, and the Defense Advanced Research Projects Agency’s program structure all represent different attempts to address the problem that conventional review is conservative.[^5] The programs vary in size, in the breadth of fields they support, and in the criteria they use to identify high-risk work.

For neglect studies, the high-risk programs are partially relevant. The field’s work is not high-risk in the same sense that a moonshot biological experiment is — most neglect-studies projects have modest budgets and predictable methods — but the field’s exploratory work shares with high-risk research the feature that its specific outputs cannot be predicted in advance. The argument for funding the field through high-risk programs has been made successfully in several adjacent metascience contexts, and the same argument should be applicable for neglect studies.

The limitations are that high-risk programs are competitive, that they have their own selection biases (often favoring established researchers whose track records make the risk seem worth taking), and that the funding amounts are typically larger than neglect-studies projects require. The mechanism is useful for the field’s larger and more ambitious projects but is not the natural home for the field’s bread-and-butter work.

4. Private Philanthropy as the Likely First Mover

The case for private philanthropy as the field’s most important early funding source rests on three considerations. The first is that foundations are structurally less constrained than public funders to align their portfolios with established research priorities. A foundation whose mission includes epistemic diversity, open science, or research reform can fund neglect studies without justifying the funding against the priorities of an established field, in a way that public funders typically cannot. The second is that foundations have shorter decision cycles than public funders, which allows them to respond to emerging fields more quickly. The third is that several foundations have already demonstrated interest in adjacent areas — metascience, open science, research reform, the philosophy of science — that make them natural candidates for engagement with the proposed field.

The foundations most plausibly aligned with the field’s mission include those that have funded the broader metascience and open-science enterprise, those whose missions emphasize the structure of scholarly inquiry, those whose missions emphasize particular substantively neglected areas (women’s health, rare diseases, environmental justice), and the family foundations of donors whose personal histories include direct encounters with neglected questions. The field’s founding strategy should include systematic engagement with foundations in each of these categories, with proposals tailored to the foundation’s particular mission.

The advantages of philanthropic funding come with corresponding vulnerabilities. Foundations are not permanent institutions; their priorities shift with changes in leadership, with the death of founding donors, and with shifts in the broader philanthropic climate. A field that depends on any single foundation’s support is vulnerable to that foundation’s reorientation, and the vulnerability is not theoretical. Several emerging fields in recent decades have been substantially damaged by the loss of foundation support that had been their primary funding base.

The implications for the field’s strategy are several. The field should pursue multiple foundation funders rather than concentrating on any one, even if one foundation is willing to be a primary partner. The field should use philanthropic funding to build infrastructure that can survive the loss of any individual funder — endowments, institutional commitments, training pipelines — rather than to support ongoing operations that would collapse without continued philanthropic support. And the field should be transparent with its philanthropic funders about its long-term ambitions for funding diversification, both because honesty is intrinsically appropriate and because foundations that understand the field’s strategy are more likely to support the diversification effort than foundations that have not been told about it.

5. Public-Sector Funding

The argument for pursuing public-sector funding alongside philanthropic funding is partly about diversification and partly about the specific advantages of public funding. Public funders provide larger and more sustained support than most foundations, they often have longer time horizons, and their funding decisions are more visible, which means that public funding for the field would signal that the field has achieved a level of recognition that purely philanthropic funding does not.

The challenge is that public funders are more constrained than private ones to align their portfolios with established research priorities, and the field’s mission is precisely to question those priorities. The strategy for securing public funding must therefore include arguments that present the field’s work in terms that public funders can accept without committing themselves to positions their political environments would find difficult.

Three argumentative strategies have worked for adjacent fields and should be deployed for neglect studies.

The first is the quality-improvement argument. Public funders have an institutional interest in improving the quality of their own decision-making, and the field’s outputs are directly relevant to that interest. A funding agency that supports research on how its own grant decisions could be improved is not endorsing any particular critique of its existing portfolio; it is investing in its own institutional learning. The argument has worked for the broader metascience enterprise, with substantial public funding flowing to research on peer review, reproducibility, and research evaluation, and the same argument should work for the parts of neglect studies that bear directly on funding-agency decision-making.

The second is the return-on-investment argument. The counterfactual reasoning proposed in Paper 2 produces estimates of the expected returns to research investment, and those estimates can be used to argue that better identification of high-value neglected areas would improve the returns to public research investment overall. The argument is partial — the estimates are uncertain, and public funders are constrained by political and institutional considerations beyond expected value — but it provides a framing in which the field’s work serves rather than challenges the funder’s mission.

The third is the equity argument. Several aspects of neglect studies, particularly the peripheral-inquiries and constituency-less-questions categories of Paper 1, bear directly on questions of equity in research portfolios. Public funders in many jurisdictions have explicit commitments to equity in research, and the field’s outputs are directly relevant to those commitments. The argument has worked for research on health disparities, for the inclusion of underrepresented populations in clinical trials, and for the support of research from underrepresented regions, and the same logic should apply to the field’s work on the structural mechanisms that produce neglect in these areas.

A practical consideration: public funding for the field is more likely to come through programs not specifically designated for it than through dedicated programs. A scholar working on neglect studies methodology may be funded through a metascience program, a program on research policy, a program on a particular substantive area in which neglect studies tools are being applied, or a general program for which the project happens to be competitive. The field’s strategy should accordingly include cultivating program officers across multiple funding lines, building the relationships and the documented track record that allow scholars to apply through whichever programs fit best, rather than waiting for dedicated neglect-studies funding to materialize.

The longer-term goal of dedicated public funding for the field should be pursued but should be understood as a destination rather than a near-term objective. The case for dedicated funding will become more compelling as the field accumulates a track record of useful outputs, and the case should be made through the channels that have worked for adjacent fields — formal reports to advisory bodies, engagement with congressional and parliamentary committees, white papers commissioned by interested agencies, and the gradual accumulation of program officers who understand the field’s work and can advocate internally for dedicated support.

6. Institutional Endowments

The most stable funding source for an academic field is an endowment whose returns support ongoing activity in perpetuity. Endowments take longer to build than other funding mechanisms, and they require donor relationships that are different in character from the foundation relationships discussed above, but they provide a foundation for the field that no other funding source can match.

The forms of endowment most relevant to the field are three.

The first is endowed chairs in neglect studies at the founding centers. An endowed chair provides a permanent faculty position in the field at a major research university, which both supports the individual scholar who holds the chair and signals institutional commitment to the field that other faculty appointments do not match. Endowed chairs typically require donor commitments in the range of two to five million dollars in current U.S. terms, and the relationship-building required to secure such commitments is substantial. The relevant donor population includes individuals whose personal histories include encounters with neglected questions, philanthropists with broader interests in the structure of scholarly inquiry, and the donor advisory committees of foundations whose missions align with the field.

The second is named research centers. A named center, supported by an endowment that funds its operating budget, provides the institutional stability that distinguishes a permanent institution from a project-funded one. Named centers in adjacent fields have typically required donor commitments in the range of ten to twenty-five million dollars, with the variation depending on the center’s size and the cost structure of the host institution. The donor population is similar to that for endowed chairs but is smaller, since fewer donors are positioned to make commitments at the scale required.

The third is dedicated fellowship programs. A named fellowship program supports residential or virtual fellowships for scholars working in the field, and a well-endowed fellowship program can support a steady stream of senior scholars whose participation builds the field’s community even when their primary affiliations are elsewhere. Fellowship endowments are smaller than chair or center endowments — typically one to three million dollars per fellowship line — and can be built incrementally as donor relationships develop.

The field’s endowment strategy should be pursued in parallel with its other funding work, on the assumption that endowment-scale donor relationships take five to ten years to develop and that early founding investments in the relationships will produce returns only in the second decade of the field’s existence. The institutional advancement offices of the founding centers should be informed about the field’s endowment ambitions from the outset, and the centers’ directors should be expected to invest substantial time in the donor cultivation that endowment building requires.

7. A Research Agenda on the Funding System Itself

The field has an additional reason to attend to funding questions beyond the practical one. The funding system is itself one of the most important mechanisms by which scholarly attention is allocated, and the systematic study of how funding decisions shape research portfolios is a core topic for the field. The relevant questions include how grant-review processes produce conservatism, how funding-agency priority-setting interacts with the priorities of the scholars who serve on review panels, how the geographic and institutional distribution of grants affects subsequent attention to questions, and how the time horizons of funding programs affect the kinds of work that can be pursued.

A research agenda on the funding system is intellectually appropriate to the field, and the findings would inform the field’s own funding strategy in ways that purely strategic thinking cannot. The agenda should be pursued through partnerships with funding agencies that are willing to make their decision-making accessible to study, through bibliometric and archival work on the historical record of funding decisions, and through comparative studies of funding systems in different national contexts. The James Lind Alliance and the broader patient-and-public-involvement literature provide precedents for this kind of work in the specific context of health research funding,[^6] and the broader metascience literature has begun to develop parallel work for other funding contexts.

A specific recommendation is that one of the founding centers should host a research program on funding systems as a core part of its work, both because the program would contribute to the field’s substantive agenda and because the program’s findings would be directly useful for the field’s own strategy. The program should produce both peer-reviewed scholarship and practical outputs directed at funders — reports, briefings, advisory engagements — that translate the scholarship into terms funders can use.

8. Sequencing and Failure Modes

The funding strategy outlined above involves many parallel activities, and the question of sequencing matters less than the question of how the activities are coordinated. The proposal is that all the funding streams discussed in this paper should be pursued from the field’s earliest years, with the recognition that different streams will produce results on different time horizons and that the field’s resource base will shift in composition over time.

In the first three to five years, the field’s funding will likely come primarily from philanthropy, with smaller contributions from conventional grants secured by individual scholars working through established disciplinary channels. The founding centers will need to demonstrate productivity during this period, both because the productivity is the foundation for everything else and because the philanthropic funders will be evaluating their investment in the field as the early period progresses.

In years five to ten, the funding mix should diversify to include substantial public funding, secured through the strategies outlined above, and the beginnings of endowment funding from donor relationships that the founding centers have been cultivating. The journal, conference, and registry should be self-sustaining by this point, on funding models established at their launch.

In years ten to twenty, the field’s funding should rest on a diversified base in which no single source provides more than perhaps thirty percent of total funding, in which endowment income provides a stable foundation that protects against short-term shocks, and in which the funding mix includes substantial contributions from sources that did not exist or did not support the field in its founding years.

The failure modes that the strategy must anticipate are several. The first is the loss of an early major philanthropic supporter before alternative funding has been secured, which would force the field into rapid contraction at a stage when contraction is most damaging. The corrective is diversification from the outset, even when diversification involves accepting smaller commitments from multiple funders rather than larger commitments from one. The second is the capture of the field by a funder whose priorities the field must accommodate in ways that compromise its analytical independence. The corrective is institutional: the founding centers’ governance must include explicit protections for editorial and research independence, and the field’s scholars must be willing to refuse funding whose conditions would compromise the field’s value. The third is the persistent marginality of the field, in which it secures enough funding to survive but not enough to consolidate, leaving its scholars in precarious positions and its institutional infrastructure underdeveloped. The corrective is patience combined with strategic discipline: the field must be willing to develop slowly rather than to compromise the methodological and institutional standards on which its long-term value depends.

The deepest failure mode is one that the field shares with several adjacent enterprises in the broader landscape of research-reform work. A field whose mission is to examine the institutions that fund it can find that its mission has been domesticated, that its outputs have been incorporated into the funders’ standard practice in ways that drain the work of its critical edge, and that the field has become a service provider to the funders rather than an independent voice. The risk is real, and the field’s institutional design should include explicit safeguards against it. The safeguards are partly procedural — independent editorial governance, diversified funding, professional standards that reward uncomfortable findings — and partly cultural, in the sense that the field’s professional community must maintain a culture in which the conscience of the field is more important than its access to resources. The cultural maintenance is the harder of the two and the more important.

9. Conclusion

This paper has argued that the funding problem for neglect studies is hard but not unsolvable, that the solution requires a diversified strategy that does not depend on any single source, and that the strategy must include both pragmatic engagement with existing funding mechanisms and the longer-term work of building dedicated funding sources that the field controls. The paper has identified philanthropic foundations as the likely first movers, public funders as essential second-stage partners, endowments as the foundation for long-term stability, and a research agenda on funding systems as both intellectually appropriate to the field and strategically valuable for it.

The funding problem cannot be solved by argument alone. It requires the patient relationship-building, the production of credible outputs, the demonstration of useful contributions, and the political and institutional work that emerging fields have always required. The argument of this series is that the work is worth doing, that the obstacles are surmountable, and that the field’s eventual contributions to the scholarly enterprise and to public policy will justify the founding investment many times over. Whether the argument is correct depends on what the founding scholars and their funders actually do over the next decade.

Paper 5 takes up the data infrastructure that the field’s research will require.


Notes

[^1]: The literature on grant peer review and its biases is reviewed in Lee, Sugimoto, Zhang, and Cronin (2013) and in subsequent work. The specific findings on conservatism in grant review are developed in Boudreau, Guinan, Lakhani, and Riedl (2016) and in Nicholson and Ioannidis (2012).

[^2]: The Health Research Council of New Zealand’s explorer grants program and subsequent lottery-based programs are documented in Liu et al. (2020). The broader argument for lottery allocation is developed in Fang and Casadevall (2016) and in Avin (2019).

[^3]: The Volkswagen Foundation’s experimentation with alternative funding models, including elements of golden-ticket allocation, is documented in the foundation’s own program reports. The broader literature on alternatives to conventional peer review in funding includes Roumbanis (2019) on lottery and golden-ticket mechanisms.

[^4]: The literature on prize-based funding is partly scholarly and partly practical; Stine (2009) provides a Congressional Research Service overview of the U.S. government’s use of prizes, and Williams (2012) addresses the comparative advantages of prizes versus grants for research support.

[^5]: The U.S. NIH Director’s Pioneer Award has been evaluated in Azoulay, Graff Zivin, and Manso (2011) and in subsequent analyses. The broader literature on high-risk funding mechanisms is reviewed in Heinze (2008).

[^6]: The James Lind Alliance methodology and its application to research-funding priorities are documented in Cowan and Oliver (2021) and in Crowe, Fenton, Hall, Cowan, and Chalmers (2015). The broader literature on patient and public involvement in research funding is reviewed in Manafò, Petermann, Vandall-Walker, and Mason-Lai (2018).


References

Avin, S. (2019). Mavericks and lotteries. Studies in History and Philosophy of Science Part A, 76, 13–23.

Azoulay, P., Graff Zivin, J. S., & Manso, G. (2011). Incentives and creativity: Evidence from the academic life sciences. RAND Journal of Economics, 42(3), 527–554.

Boudreau, K. J., Guinan, E. C., Lakhani, K. R., & Riedl, C. (2016). Looking across and looking beyond the knowledge frontier: Intellectual distance, novelty, and resource allocation in science. Management Science, 62(10), 2765–2783.

Cowan, K., & Oliver, S. (2021). The James Lind Alliance guidebook (Version 10). James Lind Alliance.

Crowe, S., Fenton, M., Hall, M., Cowan, K., & Chalmers, I. (2015). Patients’, clinicians’ and the research communities’ priorities for treatment research: There is an important mismatch. Research Involvement and Engagement, 1, 2.

Fang, F. C., & Casadevall, A. (2016). Research funding: The case for a modified lottery. mBio, 7(2), e00422–16.

Heinze, T. (2008). How to sponsor ground-breaking research: A comparison of funding schemes. Science and Public Policy, 35(5), 302–318.

Lee, C. J., Sugimoto, C. R., Zhang, G., & Cronin, B. (2013). Bias in peer review. Journal of the American Society for Information Science and Technology, 64(1), 2–17.

Liu, M., Choy, V., Clarke, P., Barnett, A., Blakely, T., & Pomeroy, L. (2020). The acceptability of using a lottery to allocate research funding: A survey of applicants. Research Integrity and Peer Review, 5, 3.

Manafò, E., Petermann, L., Vandall-Walker, V., & Mason-Lai, P. (2018). Patient and public engagement in priority setting: A systematic rapid review of the literature. PLOS ONE, 13(3), e0193579.

Nicholson, J. M., & Ioannidis, J. P. A. (2012). Conform and be funded. Nature, 492(7427), 34–36.

Roumbanis, L. (2019). Peer review or lottery? A critical analysis of two different forms of decision-making mechanisms for allocation of research grants. Science, Technology, & Human Values, 44(6), 994–1019.

Stine, D. D. (2009). Federally funded innovation inducement prizes. Congressional Research Service.

Williams, H. (2012). Innovation inducement prizes: Connecting research to policy. Journal of Policy Analysis and Management, 31(3), 752–776.


Posted in Musings | Tagged , , , | Leave a comment

Crisis of Legitimacy: The UK Labour Government After the 2026 Local Election Collapse

The severe losses suffered by the governing Labour Party in the 2026 local elections have produced the most serious internal crisis of the premiership of Keir Starmer. Although Labour still possesses a commanding parliamentary majority won in the 2024 general election, the electoral collapse at local and devolved levels has sharply raised questions about political legitimacy, governing durability, and the long-term survivability of the present leadership model.

The resulting crisis is notable because it combines several tensions that do not normally coexist simultaneously:

  • a massive Commons majority,
  • historically poor approval ratings,
  • deep ideological fragmentation,
  • rapidly deteriorating activist morale,
  • open elite rebellion,
  • and the rise of multiple anti-government alternatives simultaneously.

The consequence is a government that remains institutionally powerful but politically brittle.

Recent reporting indicates that Labour has suffered heavy losses to Reform UK, the Green Party of England and Wales, the Scottish National Party, and Plaid Cymru simultaneously, suggesting not merely dissatisfaction but fragmentation of Labour’s coalition in several directions at once. (Reuters)

I. The Nature of the Crisis

The present crisis is not merely electoral. It is fundamentally a crisis of legitimacy.

A parliamentary majority gives constitutional authority, but legitimacy depends on broader perceptions:

  • that the government represents public will,
  • that it possesses strategic competence,
  • that it can maintain coalition unity,
  • and that it retains a plausible future.

The local election losses damaged all four simultaneously.

The problem facing Labour is especially severe because the 2024 landslide victory was achieved with a historically modest vote share under the distortions of the British first-past-the-post electoral system. Labour won enormous parliamentary power without overwhelming cultural or ideological consensus. (Wikipedia)

This distinction matters greatly.

The government therefore entered office with:

  • constitutional authority,
  • but relatively shallow emotional legitimacy.

Once economic frustrations, immigration concerns, public service fatigue, and cost-of-living pressures continued beyond the initial honeymoon period, the coalition holding Labour together began fragmenting rapidly.

The local elections appear to have revealed this underlying fragility rather than created it.

II. Electoral Fragmentation and the Multi-Front Collapse

One of the most dangerous features of the current situation is that Labour is not losing support to only one rival.

Instead, the party is bleeding support in several incompatible directions:

1. Reform UK on the Right

Nigel Farage and Reform UK have made major gains in former Labour strongholds, particularly among:

  • post-industrial voters,
  • Brexit-aligned constituencies,
  • culturally conservative working-class voters,
  • and communities hostile to metropolitan elite politics. (Reuters)

This threatens Labour’s “red wall” coalition.

2. Greens on the Left

At the same time, Labour has also lost support among:

  • younger urban progressives,
  • environmental voters,
  • and left-wing activists disillusioned by Starmerite moderation.

The Green gains suggest that Labour’s attempt to suppress ideological conflict through managerial centrism may instead have intensified alienation among ideological activists. (AP News)

3. Nationalist Parties in Scotland and Wales

Further weakening Labour is the persistence of territorial fragmentation:

  • SNP resilience in Scotland,
  • and Plaid Cymru advances in Wales.

This undermines Labour’s attempt to present itself as a unifying national governing force.

III. The Internal Legitimacy Crisis

The electoral collapse has rapidly evolved into an elite legitimacy crisis inside Labour itself.

Reports indicate that dozens of MPs, ministerial aides, and even senior cabinet figures have urged Starmer either to resign immediately or establish a departure timetable. (The Times of India)

This is politically significant because Labour historically differs from the Conservative Party in organizational culture.

Conservative governments frequently tolerate open leadership warfare. Labour traditionally attempts to avoid visible internal coups because such conflicts are viewed as electorally toxic and morally delegitimizing.

Therefore, when Labour MPs publicly begin discussing succession planning, it usually indicates very deep institutional panic.

The rebellion also reveals another important issue:
Starmer’s authority appears highly procedural rather than charismatic.

His legitimacy has depended heavily upon:

  • electability,
  • managerial competence,
  • legal seriousness,
  • and contrast with Conservative instability.

Once electoral competence itself became questionable, much of the coalition sustaining his authority weakened rapidly.

IV. The Burnham Problem and the Crisis of Succession

The prominence of Andy Burnham in current discussions reveals a deeper ideological struggle within Labour.

Burnham represents:

  • a more communitarian,
  • regionally rooted,
  • economically interventionist,
  • and culturally grounded model of Labour politics.

His growing popularity among members suggests dissatisfaction with highly centralized London-centric managerial politics. (The Guardian)

The attempt by Labour’s National Executive Committee to block Burnham’s parliamentary return before the local elections now appears strategically disastrous in retrospect because it reinforced perceptions that:

  • party management was prioritizing factional control,
  • over adaptive political renewal.

This is precisely the sort of behavior that often accelerates legitimacy crises in late-stage governing parties.

V. Structural Sources of Labour’s Unpopularity

Several deeper structural issues appear to underlie Labour’s collapse.

1. The Problem of “Technocratic Anti-Politics”

The Starmer project attempted to present itself as:

  • competent,
  • managerial,
  • moderate,
  • and post-ideological.

However, such governments often struggle when public frustration becomes emotional and identity-driven rather than merely economic.

Technocratic governance can stabilize institutions temporarily while simultaneously draining emotional enthusiasm from supporters.

2. Austerity Without Narrative

Labour inherited:

  • fiscal constraints,
  • weak growth,
  • high public expectations,
  • and exhausted public services.

But unlike earlier Labour governments, it lacked:

  • a mobilizing ideological narrative,
  • transformative optimism,
  • or a compelling social vision.

The result has often appeared to voters as managerial scarcity administration.

3. Coalition Contradictions

Labour’s coalition currently includes:

  • socially progressive urban professionals,
  • public-sector workers,
  • minority communities,
  • younger graduates,
  • and economically struggling post-industrial voters.

These blocs increasingly possess conflicting priorities on:

  • immigration,
  • policing,
  • economic growth,
  • environmental policy,
  • national identity,
  • and cultural questions.

The government’s attempts to satisfy all simultaneously have increasingly satisfied none.

VI. Does the Government Still Possess Legitimacy?

Constitutionally, yes.

Politically, increasingly less so.

This distinction is crucial.

A government with a large Commons majority can continue functioning for years even while suffering:

  • low approval,
  • activist demoralization,
  • elite fragmentation,
  • and electoral collapse in local contests.

However, democratic legitimacy is relational rather than purely legal.

The danger for Labour is that the public may increasingly perceive the government as:

  • formally powerful,
  • but socially exhausted,
  • disconnected,
  • and historically temporary.

That perception itself can become self-reinforcing.

Once elites begin behaving as though a government is already entering terminal decline, institutional cohesion deteriorates rapidly.

VII. Likely Future Trajectories

Several broad trajectories are plausible.

Scenario 1: Managed Leadership Transition

This is increasingly plausible.

Under this scenario:

  • Starmer remains temporarily,
  • pressure intensifies,
  • and Labour negotiates a controlled succession.

This would likely involve:

  • avoiding a destructive public civil war,
  • preserving government continuity,
  • and presenting renewal before the next general election.

Potential successors include:

  • Andy Burnham,
  • Angela Rayner,
  • Wes Streeting,
  • or another compromise figure. (The Scottish Sun)

This trajectory resembles parliamentary systems attempting controlled elite replacement before complete collapse.

Scenario 2: Starmer Survives but Governs Weakly

This may be institutionally easiest in the short term.

Because Labour’s parliamentary majority is so large, Starmer could survive despite low popularity if:

  • cabinet elites remain divided,
  • no challenger consolidates support,
  • and fear of instability outweighs dissatisfaction.

However, this would likely produce:

  • chronic internal warfare,
  • legislative drift,
  • poor morale,
  • and continuing electoral decline.

This resembles late-period governments that remain technically operational while politically hollowed out.

Scenario 3: Open Civil War Within Labour

This is less likely but increasingly conceivable.

If:

  • cabinet resignations escalate,
  • unions intervene aggressively,
  • or competing factions attempt rapid leadership seizure,
    then Labour could enter a period resembling the factional chaos that historically damaged the party during earlier eras.

Such a scenario would benefit:

  • Reform UK,
  • Greens,
  • Liberal Democrats,
  • and nationalist parties simultaneously.

It would also reinforce public perceptions that Labour has become another unstable elite institution.

Scenario 4: Partial Political Recovery

This cannot be excluded.

Governments sometimes recover from midterm collapses if:

  • economic conditions improve,
  • opposition parties fragment,
  • leadership stabilizes,
  • or geopolitical crises reorder politics.

Labour’s large parliamentary majority gives it time.

However, recovery would likely require:

  • clearer ideological direction,
  • greater emotional resonance,
  • improved coalition management,
  • and visible policy successes.

At present, those conditions do not appear fully established.

VIII. Conclusion

The current crisis of the Labour government reflects a deeper problem common to many contemporary Western governing parties:
they can possess overwhelming institutional power while lacking durable social legitimacy.

The Starmer government appears trapped between:

  • technocratic managerialism,
  • fragmented ideological coalitions,
  • economic constraint,
  • and rapidly destabilizing voter expectations.

Its parliamentary majority remains enormous.
Its political authority no longer appears proportionally secure.

The key question is therefore not whether Labour can survive constitutionally.
It almost certainly can.

The real question is whether Labour can reconstruct:

  • emotional legitimacy,
  • coalition coherence,
  • and a credible future narrative,
    before public exhaustion hardens into durable realignment.

At present, the evidence suggests that the government remains operational but increasingly fragile — a condition that can persist for surprisingly long periods in parliamentary systems, but which often ends abruptly once elite confidence fully collapses. (The Guardian)

Posted in Musings | Tagged , , , | Leave a comment

Academic Infrastructure: Programs, Journals, Conferences, and Curricula for Neglect Studies


Executive Summary

This paper addresses the academic infrastructure required to sustain neglect studies as a field: the institutional homes within universities, the publication outlets through which findings circulate and accumulate, the conferences at which scholars meet, and the curricula through which the next generation is trained. The paper proceeds from the premise that intellectual fields do not consolidate without institutional scaffolding, and that the work of designing that scaffolding deliberately, before the field is established, allows choices to be made that would be difficult to reverse later.

The paper develops five proposals. The first is a model for hosting the field within universities that resists capture by any single discipline while providing the stability of an institutional home. The second is a flagship peer-reviewed journal with a specific editorial design suited to the field’s methodological pluralism and tiered evidence standard. The third is a set of companion publication outlets — a registry of neglected questions, a journal of negative results and abandoned programs, and a stocktaking review series — that together address publication needs the flagship cannot meet alone. The fourth is a conference and meeting structure designed to prevent the field from being colonized by any one of its parent disciplines. The fifth is a curriculum framework for doctoral and master’s training that combines methodological breadth with substantive grounding in at least one host discipline.

The paper concludes with a discussion of the sequencing of these elements and the institutions best positioned to host the first instances of each.


1. Introduction

The preface and the first two papers in this series have argued that neglect studies is intellectually warranted and methodologically tractable. Neither argument settles the practical question of where the field will live. Intellectual fields do not exist as disembodied bodies of inquiry; they exist as networks of departments, journals, conferences, training programs, and professional associations, and the choices made in establishing those structures shape what the field becomes. A field hosted within a single discipline will tend to take on that discipline’s questions and methods. A field that lacks a flagship journal will find its work scattered across outlets that index it inconsistently and to which neither newcomers nor outside observers can easily navigate. A field without doctoral training programs will depend on scholars whose primary identification lies elsewhere and whose long-term career incentives pull them away from sustained engagement.

The argument of this paper is that the institutional infrastructure for neglect studies should be designed deliberately rather than allowed to develop by accretion. Deliberate design has costs — it requires founding effort that accretion does not, and it requires choices to be made before all the relevant considerations are clear — but it has the corresponding benefit of allowing the field to avoid path dependencies that would be difficult to reverse later. The deliberate-design argument is particularly strong for a field whose distinctive feature is methodological pluralism, since a field that develops by accretion within a single discipline will not preserve the pluralism that justifies its existence.

Three design principles run through the proposals that follow. The first is cross-disciplinary integrity, meaning that the field’s institutions should be structured to prevent capture by any single parent discipline while remaining hospitable to scholars trained in many different ones. The second is methodological seriousness, meaning that the institutions should embody the tiered standard of evidence proposed in Paper 2 rather than relaxing it under the pressure of producing rapid outputs. The third is long-term sustainability, meaning that the institutions should be designed with their funding model, governance, and renewal mechanisms in view from the outset, rather than being constructed as expressions of present enthusiasm that lack durable foundations.

2. Hosting Models for Universities

The question of where neglect studies should live within universities admits several distinct answers, each with its own trade-offs. The four models considered below are not mutually exclusive, and a mature field would probably include instances of several of them. The discussion identifies the strengths and weaknesses of each and proposes which should be prioritized in the field’s founding period.

2.1 The Dedicated Center Model

A dedicated center for neglect studies — typically a small interdisciplinary unit with a director, a handful of core faculty appointments or affiliations, and a budget for fellowships, workshops, and research projects — is the most visible institutional form a new field can take. Centers of this kind exist for many emerging interdisciplinary subjects and have a well-understood operating logic.

The strengths of the center model are several. A center provides a physical and administrative home for the field, a budget line that can be defended in institutional politics, a visible point of contact for external partners, and a venue for the gathering of scholars who would otherwise be scattered across departments. A well-resourced center can also support fellowship programs that bring scholars from other institutions for sustained engagement, which is one of the most effective mechanisms for building a field’s professional community.

The weaknesses are also substantial. Centers are vulnerable to changes in institutional priorities, particularly when their founding directors retire or move. Centers without tenure-line appointments depend on faculty whose primary obligations are to their home departments, which limits the depth of engagement the center can command. Centers funded primarily by external grants are vulnerable to changes in funding climate. And centers can become professionally insular if their staff comes to identify primarily with the center rather than with the wider scholarly community.

The recommendation for neglect studies is that the field should aim for two or three founding centers in the first decade, placed in institutions where senior scholars have committed to the field’s development, where the surrounding institutional environment is hospitable to interdisciplinary work, and where the funding model includes both internal university support and external grants in a balance that does not leave the center dependent on any single source.

2.2 The School-of-Advanced-Study Model

A more ambitious version of the center model is the school of advanced study, exemplified by institutions like the Institute for Advanced Study at Princeton and several similar bodies internationally. Such institutions support scholarship through residential fellowships and do not have undergraduate or doctoral teaching responsibilities. They allow concentrated periods of work on questions that would not fit comfortably within departmental structures.

For neglect studies, the school-of-advanced-study model is attractive in principle but probably premature in practice. The model works best for fields that have already produced a substantial community of established scholars, since the fellowship pool requires a base of senior researchers from which to draw. Neglect studies does not yet have such a base, and the school-of-advanced-study model is more plausibly a destination for the field after a decade or two of development than a founding institution.

A modified version of the model — a residential fellowship program affiliated with one of the founding centers, supporting one-year stays by scholars from other institutions — is more tractable in the near term and would serve some of the same purposes.

2.3 The Distributed Network Model

The distributed network model treats the field as a virtual community whose members maintain primary affiliations in their home departments and who collaborate through periodic meetings, joint publication outlets, and online infrastructure. Several emerging fields have followed this model, particularly during their early years before institutional resources for dedicated homes became available.

The strengths of the distributed model are that it does not require substantial founding capital, that it allows the field to develop across institutions rather than being identified with any single one, and that it is robust against the loss of any individual node. The weaknesses are that distributed networks tend to lack the visibility and political weight of named institutions, that they depend on the personal commitment of individual scholars in ways that are difficult to sustain across career transitions, and that they often fail to consolidate into more permanent forms.

For neglect studies, the distributed network model is probably the right description of the field’s first five to ten years, even if the longer-term aim is for centers and dedicated programs. The early phase of any new field involves a small number of scholars working at multiple institutions without formal connections, and the question is whether the eventual transition to institutional consolidation happens deliberately or by happenstance.

2.4 The Embedded Subfield Model

The fourth model is for neglect studies to develop primarily as a subfield within an existing discipline rather than as a separate field. The most natural host disciplines are metascience and science and technology studies, both of which have institutional infrastructure that could absorb neglect-studies work without major modification.

The case for the embedded model is that it requires the least founding effort and that it places the field within established research communities with mature methods, funding pathways, and training programs. The case against it is that the embedding tends to assimilate the embedded work to the host discipline’s center of gravity, and the features that make neglect studies distinctive — its methodological pluralism, its applied policy engagement, its concern with humanities and qualitative questions as much as with scientific ones — are precisely the features that the host disciplines are least equipped to preserve.

The recommendation is that the embedded model should be one element of a multi-pronged strategy rather than the primary model. Encouraging neglect-studies work within metascience programs and science and technology studies departments is valuable, particularly in the field’s early years, but it should not substitute for the development of independent institutional homes.

2.5 Recommendation

The field should pursue a layered strategy. In the first five years, the distributed network model is the realistic description of the field, and effort should focus on building the connections among scholars at different institutions, on supporting embedded work within metascience and science and technology studies, and on identifying the two or three institutions best positioned to host founding centers. In the second five years, two or three dedicated centers should be established. In the decade following, a residential fellowship program affiliated with one of the centers can serve some of the functions of a school of advanced study without the institutional weight that the full model requires.

3. The Flagship Journal

A field consolidates around its journals more reliably than around any other single institution. The journals define what counts as the field’s work, how that work is evaluated, what methods are recognized, and what subjects are within scope. A field without a flagship journal must depend on outlets whose editorial commitments lie elsewhere, which produces persistent friction in the publication process and inconsistency in what reaches the field’s scholarly record.

The proposal is for the field to establish a flagship peer-reviewed journal with the following characteristics.

3.1 Scope

The journal’s scope should be the systematic study of scholarly neglect, broadly construed to include all seven categories of the Paper 1 taxonomy and all the methodological approaches of Paper 2. The scope should be defined inclusively in disciplinary terms — humanities, social sciences, natural sciences, and applied fields should all be within scope — and restrictively in topical terms, in the sense that the journal should publish work on neglect rather than work in whatever substantive areas the journal’s authors find neglected.

The distinction matters. A scholar who has identified an instance of neglect in their substantive field has a choice between publishing in the flagship neglect-studies journal (where the contribution is methodological and field-building) and in their substantive field’s journals (where the contribution is to the substantive literature). The flagship journal should clearly be the former. Articles in the flagship should be primarily about the patterns, mechanisms, and consequences of neglect, with substantive findings serving as cases that illustrate methodological or theoretical contributions to the field of neglect studies itself.

3.2 Editorial Governance

The editorial structure should be designed for cross-disciplinary integrity from the outset. The editor-in-chief role should rotate among scholars from different parent disciplines, with terms of three to five years and explicit succession planning. The associate editor pool should be deliberately balanced across disciplines and methodological approaches. The editorial board should be constituted with similar attention to balance and should include both senior figures and early-career scholars whose careers are being built within the field.

The governance structure should also include explicit provision for the tiered evidence standard proposed in Paper 2. The journal should publish work at all three tiers — exploratory, substantiated, and rigorous — but should label submissions accordingly and should structure peer review so that reviewers assess submissions against the standards appropriate to the tier the author claims. This structure allows the journal to serve as a venue for early-stage work without compromising the field’s professional standards, and it gives the field a vocabulary for discussing the evidentiary status of its own publications.

3.3 Peer Review

Peer review in a methodologically pluralist field requires deliberate attention to who is qualified to evaluate what. A bibliometric analysis of neglect in a particular literature should be reviewed by scholars who can assess both the bibliometric methods and the substantive claim about the literature; a historical recovery of an abandoned research program should be reviewed by historians of the relevant period and by substantive specialists; a counterfactual estimation of the value of investment in a neglected area should be reviewed by decision analysts and by relevant domain experts. The journal’s editorial office must maintain a reviewer pool with this kind of methodological and substantive breadth, and editors must be trained to construct review panels that match submissions appropriately.

The journal should also experiment with adaptations of peer review that have been developed elsewhere in metascience and adjacent fields. Registered reports, in which the methods of a planned study are reviewed before the study is conducted, are particularly well-suited to neglect-studies work because they reduce the risk of motivated identification (in the Paper 2 sense). Open peer review, in which reviewer reports and identities are made available alongside published articles, has both advantages and costs and should be considered as an option rather than a default. The journal’s editorial policies should be explicit about which adaptations are being used and why.

3.4 Access and Indexing

The journal should be open-access from the outset. The field’s commitments to redistributing scholarly attention sit poorly with a publication model that restricts access to the field’s own work, and the practical disadvantages of paywalled publication for a new field — limited readership, slower citation accumulation, restricted policy uptake — are substantial. The funding model for open-access publication is a non-trivial question, with options including author processing charges, institutional subsidies, consortial funding, and platinum open-access models supported by foundations. The choice among these is one of the most consequential the founding editorial committee will make, and the choice should be made with explicit attention to its effects on who can publish in the journal and who can read it.

Indexing in the major scholarly databases is essential for the journal’s long-term standing and should be pursued from the outset. The standards for indexing have become more stringent in recent years, and a journal that begins with attention to these standards is more likely to achieve indexed status than one that has to retrofit them later.

4. Companion Publication Outlets

The flagship journal cannot meet all the publication needs of the field, and three companion outlets are proposed.

4.1 A Registry of Neglected Questions

The first is a structured, citable registry of neglected questions, organized by discipline and category, with metadata on the evidence supporting the claim of neglect, the methodological approach used to identify it, and pointers to relevant literature. The registry would not be a journal in the conventional sense; it would be a database with persistent identifiers for each entry, allowing entries to be cited in subsequent scholarship and updated as new information becomes available.

The registry serves three functions. It provides a publication venue for findings that are too specific to support a full journal article but that are nonetheless worth contributing to the field’s cumulative knowledge. It creates a coordination mechanism for scholars who want to work on neglected questions but do not know what is already in progress or has been identified by others. And it produces a public-facing record of the field’s identifications that funding agencies, learned societies, and other research-governing bodies can consult.

The registry’s governance must address the obvious quality-control problem: any open submission system will receive contributions that do not meet the field’s standards, and a registry that becomes a repository for unsubstantiated claims will damage the field’s credibility. The proposed structure is that registry entries are submitted with the documentation appropriate to one of the three evidence tiers, that entries are reviewed by a small editorial committee before being accepted, and that the registry interface displays the tier prominently alongside each entry. The standard should be substantially lighter than full journal peer review but substantial enough to filter out impressionistic claims.

4.2 A Journal of Negative Findings and Abandoned Programs

The second companion outlet is a journal specifically for two kinds of work that the flagship will not naturally publish: cases of apparent neglect that on investigation turn out not to be neglected, and historical recoveries of abandoned research programs that on investigation turn out to have been appropriately abandoned. Both kinds of work are important for the field’s intellectual hygiene, and both are unlikely to find publication elsewhere because they produce findings that read as failures.

The journal would address the motivated-identification problem (Paper 2, section 9) by giving negative findings a venue, and the recovery-enthusiasm problem (Paper 2, section 4) by giving careful conclusions against revival a venue. The professional incentive structure that the field needs — in which careful work that produces unpopular conclusions is rewarded — depends on such an outlet existing.

The journal would also serve a methodological function by making explicit the standards by which apparent neglect is distinguished from genuine neglect and by which abandonment is evaluated. The case studies it publishes would become the field’s primary teaching material for these methodological questions.

4.3 A Stocktaking Review Series

The third companion outlet is a review series, organized around periodic stocktakings of how attention is distributed within particular disciplines and subdisciplines. The review series would be modeled on the Annual Review series in various fields, with commissioned articles by senior scholars examining the structure of attention in their areas and identifying the patterns of neglect that emerge.

The review series serves a different function from the flagship and from the registry. Where the flagship publishes work on neglect studies as a field and the registry catalogs specific instances, the stocktaking series produces field-wide assessments that can be used by funding agencies, learned societies, and university administrators as primary sources for understanding the structure of attention in particular areas. The stocktaking articles would also serve as authoritative entry points for scholars new to a particular area, and over time the accumulated series would constitute a comprehensive map of attention across the disciplinary landscape.

The series should be commissioned rather than open-submission, with the editorial committee selecting authors from established scholars whose breadth and standing make them credible producers of field-wide assessments. The commissioning process is more labor-intensive than open submission, but the quality control it provides is essential for the series to serve its function.

5. Conferences and Meetings

The conference structure of a field shapes its professional community as powerfully as its journals do. The proposal is for a two-tier meeting structure.

5.1 The Annual Congress

The field should hold an annual congress that serves as its primary meeting and as the venue at which the field’s professional community recognizes itself as a community. The congress should be modeled on the annual meetings of established interdisciplinary fields rather than on the meetings of single disciplines. The program should include plenary sessions, parallel paper sessions organized around the methodological domains of Paper 2 and the categories of Paper 1, poster sessions for early-career and exploratory work, workshops on methods, and dedicated sessions for engagement with research-governing institutions (funding agencies, learned societies, government science offices).

The congress location should rotate across regions and continents on an explicit schedule, both to support the participation of scholars from regions less well represented in the dominant scholarly networks and to prevent the field from becoming identified with any single national research system. The rotation schedule should be set by the field’s eventual professional association and should be honored even when particular years’ rotations are inconvenient for the largest national contingent of scholars.

5.2 Specialized Workshops

In addition to the annual congress, the field should support a network of specialized workshops on particular methodological domains, particular disciplines or sub-disciplines, or particular substantive cases. These workshops should be smaller (twenty to fifty participants), held more frequently (several per year across the field), and oriented toward intensive engagement with a particular question rather than toward the broad community-building of the congress.

The workshop network should be sponsored by the field’s centers and by its eventual professional association, with funding made available through small grants that workshop organizers can apply for. The structure should be deliberately decentralized, with workshop topics determined by the proposing organizers rather than centrally planned, so that the field’s specialized work can develop in directions that the central institutions have not anticipated.

6. Curricula and Training

The training of scholars is the slowest of the institutional commitments to take effect, since doctoral programs operate on multi-year cycles and the scholars they produce enter the field years after the training decisions are made. The slowness is a reason to think about curricula early rather than late.

6.1 Doctoral Training

Doctoral training in neglect studies should combine three elements. The first is methodological breadth across the domains of Paper 2: a graduate of a neglect-studies doctoral program should be competent in bibliometric methods, in expert elicitation, in historical and archival research, in comparative analysis, in counterfactual reasoning at least at the level of intelligent consumption, and in qualitative interviewing. No scholar will produce primary work in all six domains, but every scholar should be able to read and assess work in all of them, since the field’s triangulation standard requires the integration of findings from multiple methodological domains.

The second element is substantive grounding in at least one host discipline. A neglect-studies scholar who has not received serious training in the substance of a discipline will be unable to assess claims about neglect in that discipline with the depth required for rigorous work. The doctoral curriculum should accordingly include a substantial substantive component — typically equivalent to a master’s degree in the host discipline — alongside the methodological training in neglect studies proper. The combination is demanding, and doctoral programs in the field will likely require longer time-to-completion than single-discipline programs.

The third element is a thesis project that combines empirical neglect-mapping with a substantive contribution to a previously neglected area. The dissertation requirement reflects the field’s two-sided character: a neglect-studies scholar is both someone who studies the patterns of attention and someone who contributes to redirecting attention through their own work. A dissertation that identifies a neglected area without contributing to it produces a critic rather than a scholar; a dissertation that contributes to a neglected area without locating the contribution within a methodologically careful account of why it is neglected produces a substantive specialist rather than a neglect-studies scholar. The field needs both, but the doctoral program should produce the integrated form.

6.2 Master’s-Level Training

Master’s-level training is a different matter. The proposal is for one-year master’s programs aimed at three constituencies: scholars trained in conventional disciplines who want to incorporate neglect-studies methods into their work without retraining as full neglect-studies scholars; practitioners in funding agencies, learned societies, and policy bodies who need methodological literacy in the field’s outputs; and journalists, science communicators, and policy analysts who engage with research-priority questions in their professional work.

The master’s curriculum should be more methodological and less substantive than the doctoral curriculum, on the assumption that students bring their substantive expertise from prior training. The curriculum should be structured around the methodological domains of Paper 2, with case-based teaching drawing on the field’s accumulated literature. A capstone project demonstrating competence in at least one method, applied to a question of the student’s choice, should be the assessment requirement.

6.3 Continuing Professional Education

A third training stream addresses scholars whose careers are already established but who want to incorporate neglect-studies methods into their work. The format should be intensive short courses — typically one to two weeks — held in conjunction with the annual congress or at the field’s centers. Topics should include bibliometric methods for non-specialists, expert elicitation, the design of priority-setting partnerships, and the methods of historical recovery.

The continuing-education stream serves the field’s longer-term consolidation by extending its methodological reach into adjacent disciplines without requiring those disciplines’ scholars to undertake full retraining. It also generates a network of scholars in other fields who are familiar with neglect-studies methods and can serve as informed reviewers, collaborators, and translators of the field’s work to broader audiences.

6.4 Undergraduate Exposure

The case for undergraduate exposure to neglect studies is weaker than for the other training streams but worth making. A dedicated undergraduate major in the field is probably not warranted at any institution in the near term, both because the field is too small to sustain a major and because the methodological breadth required for serious work is difficult to achieve at the undergraduate level. A single undergraduate course on the structure of scholarly inquiry, drawing on neglect-studies methods and findings, is more tractable and could be taught at any institution with a single qualified faculty member.

The function of such a course is less to produce neglect-studies scholars than to introduce a wider undergraduate audience to questions about how scholarly attention is allocated. The course belongs naturally within general-education or honors curricula and would serve students entering any of the fields that the eventual neglect-studies workforce will draw from.

7. Sequencing and Founding Institutions

The institutional infrastructure outlined above is substantial, and the question of sequencing is consequential. The proposal is that the elements should be developed in roughly the following order, with the understanding that some development can happen in parallel.

The first priority is the founding of two or three centers at institutions where senior scholars are positioned to host them. The centers should be selected for their location in institutional environments hospitable to interdisciplinary work, for the presence of senior scholars committed to the field, and for the availability of internal funding that does not depend exclusively on external grants. Candidate institutions include several research universities with established metascience programs, several with science and technology studies departments, and several with policy schools that have demonstrated interest in research-policy questions. The selection process should be deliberate rather than first-come, and the founding centers should be chosen with attention to their complementarity rather than their similarity.

The second priority is the flagship journal, which can be launched once the founding centers exist to host its editorial office and to provide the scholarly base for its initial submissions. The journal should be launched with explicit commitments to the tiered evidence standard, to cross-disciplinary editorial governance, and to open-access publication. The funding model for the journal should be settled before launch.

The third priority is the annual congress, which can begin as soon as the founding centers and the journal are in place. The first congress will be small, and the program will need to draw heavily on invited contributions, but the establishment of the meeting as an annual event matters more than the size of any particular year’s program.

The fourth priority is the registry of neglected questions and the journal of negative findings, both of which can be developed in parallel with the flagship once the editorial infrastructure exists.

The fifth priority is doctoral training, which should begin with cohorts of one or two students per year at each of the founding centers, with the training delivered through existing departmental structures supplemented by neglect-studies-specific coursework. Dedicated doctoral programs in neglect studies can be considered once the field has produced enough graduates to sustain them and once the demand for such graduates from funding agencies, universities, and policy bodies has been demonstrated.

The stocktaking review series, master’s programs, continuing education, and undergraduate exposure all belong in the second decade rather than the first, on the assumption that the field’s first decade is occupied with consolidating the elements above.

8. Conclusion

The academic infrastructure proposed in this paper is ambitious but not unprecedented. Comparable infrastructure has been built for other emerging fields — bioethics, science and technology studies, metascience itself — within periods of one to two decades, and the lessons from those cases are partially transferable. The differences for neglect studies are that the field is more methodologically pluralist than most of its predecessors, that its applied dimension creates institutional complications that more purely scholarly fields do not face, and that its commitment to redistributing scholarly attention requires it to embody that commitment in its own institutional design.

The infrastructure cannot be built without funding, and the funding question is the most difficult one the field faces. Paper 4 takes it up.


Notes

[^1]: The literature on the institutional development of interdisciplinary fields is substantial; the National Academies (2005) report remains a useful overview, and the case studies in Frodeman, Klein, and Pacheco (2017) provide more recent treatments across multiple fields.

[^2]: The literature on the development of metascience as a field offers a particularly relevant comparison case; see Ioannidis et al. (2015) for an early statement of the field’s institutional ambitions and Hardwicke et al. (2020) for an assessment of progress.

[^3]: The literature on academic journal founding and editorial policy is largely practical rather than scholarly, but the work of the Committee on Publication Ethics (COPE) provides foundational standards for new journals, and the broader literature on open-access publishing is reviewed in Suber (2012).

[^4]: The Annual Review model, developed by Annual Reviews Inc., has served as a template for stocktaking review series across many fields; its history and editorial structure are documented in the publisher’s institutional materials.

[^5]: The literature on doctoral education in interdisciplinary fields is reviewed in Holley (2009) and in subsequent work on the structure and outcomes of cross-disciplinary doctoral training.


References

Committee on Publication Ethics. (2017). Core practices. https://publicationethics.org/core-practices

Frodeman, R., Klein, J. T., & Pacheco, R. C. S. (Eds.). (2017). The Oxford handbook of interdisciplinarity (2nd ed.). Oxford University Press.

Hardwicke, T. E., Serghiou, S., Janiaud, P., Danchev, V., Crüwell, S., Goodman, S. N., & Ioannidis, J. P. A. (2020). Calibrating the scientific ecosystem through meta-research. Annual Review of Statistics and Its Application, 7, 11–37.

Holley, K. A. (2009). Understanding interdisciplinary challenges and opportunities in higher education. ASHE Higher Education Report, 35(2). Jossey-Bass.

Ioannidis, J. P. A., Fanelli, D., Dunne, D. D., & Goodman, S. N. (2015). Meta-research: Evaluation and improvement of research methods and practices. PLOS Biology, 13(10), e1002264.

National Academies of Sciences, Engineering, and Medicine. (2005). Facilitating interdisciplinary research. National Academies Press.

Suber, P. (2012). Open access. MIT Press.


Posted in Graduate School, Musings | Tagged , , , , | Leave a comment

Methods: How to Study What Is Not Being Studied


Executive Summary

This paper addresses the central methodological challenge of neglect studies: how to make rigorous, defensible claims about scholarly attention that is missing rather than present. The challenge is genuine. Claims of neglect are easy to make, and the field’s credibility depends on developing standards that distinguish substantiated claims from impressionistic ones. The paper proposes that neglect studies should be methodologically pluralist by necessity, drawing on bibliometric and scientometric mapping, expert elicitation, historical and archival recovery, comparative analysis, counterfactual reasoning, and qualitative interviewing — but that the pluralism must be disciplined by shared standards rather than left as a license for any method to be acceptable.

The paper develops six methodological domains in turn, identifies the strengths and limitations of each, addresses the problem of triangulation across methods, and proposes a tiered standard of evidence — exploratory, substantiated, and rigorous — that the field can use to characterize the confidence warranted by particular claims. It concludes with a discussion of the risks specific to neglect-studies methodology, including the temptations toward circularity, motivated identification, and the substitution of researcher preferences for the preferences of absent constituencies.


1. Introduction

The previous paper proposed a working definition of scholarly neglect and a taxonomy of seven overlapping categories of it. Both the definition and the taxonomy presupposed that neglect can be identified — that it is possible to say, with some confidence, that a particular question or area is receiving substantially less attention than would be warranted, and that the deficit is attributable to mechanisms other than considered judgment. The presupposition is the methodological problem this paper addresses.

The problem has three structural features that shape what follows. First, the object of study is defined negatively, by absence rather than presence. Ordinary empirical methods are designed to study what exists; studying what does not exist requires inversions and indirections that are not standard methodological territory. Second, claims about absence are difficult to falsify in any straightforward way, because the absence of evidence is consistent with both genuine absence and with measurement failure. The field must develop ways to distinguish these. Third, the field’s claims have consequences. To assert that a question is neglected is implicitly to recommend that attention be redirected toward it, and the field’s interventions in research-policy decisions will be only as good as the methods that support them.

The argument of this paper is that no single method is adequate to the task, that the methods that are available have well-understood strengths and limitations that can be combined productively, and that the field’s professional standards should require triangulation across methods rather than reliance on any one of them. The paper does not propose a single canonical methodology; it proposes a methodological framework within which several approaches can be applied and combined, with a tiered standard of evidence that lets readers assess how seriously to take any particular claim.

A note on what this paper is not. It is not a technical handbook. The bibliometric, computational, and qualitative methods discussed below have their own substantial methodological literatures, and the field will need to engage with those literatures in depth. The present paper is a strategic statement of which methods the field needs, how they relate, and what standards should govern their use. The technical work belongs in subsequent methodological papers, in the field’s eventual handbook, and in the training curricula that Paper 6 will address.

2. Bibliometric and Scientometric Mapping

The bibliometric methods developed in library and information science over the past half-century constitute the field’s most mature technical infrastructure. The standard techniques — citation analysis, co-citation analysis, bibliographic coupling, topic modeling, co-occurrence networks, term-frequency analysis — were developed to map the structure of active research literatures, and they can be adapted to map the negative space around those structures.

The adaptation requires two inversions of the standard analytical move. The first is to ask not which topics are most central in a literature but which adjacent topics are conspicuously sparse given the structure of what surrounds them. A topic-modeling analysis of a field will identify clusters of dense activity; a neglect-studies analysis asks what lies between and beyond those clusters and whether the gaps are explicable on intellectual grounds or whether they appear arbitrary. The second inversion is to compare the actual distribution of attention to a counterfactual distribution constructed from external evidence about importance — disease burden, economic significance, expressed public concern, theoretical centrality — and to identify the points of largest divergence. Both inversions are technically feasible with existing tools, though neither has been pursued at scale as a primary research program.

The strengths of bibliometric methods for neglect studies are several. They are quantitative and replicable, which gives them credibility with audiences skeptical of more interpretive approaches. They scale to large literatures, which allows the field to identify patterns that would be invisible at the level of individual case studies. They produce findings that can be visualized and communicated to non-specialist audiences. And they rest on infrastructure that already exists and is maintained by other parties, which lowers the field’s overhead.

The limitations are equally important and must be stated explicitly, because the field’s credibility will suffer if it overclaims for its quantitative tools. The standard bibliometric databases — Web of Science, Scopus, Dimensions, OpenAlex — have well-documented coverage biases by language, region, discipline, and outlet type. Work published outside the dominant English-language journals is systematically underrepresented, which means that any analysis using these databases as a complete map of attention will misidentify peripheral inquiries (in the taxonomy’s sense) as more neglected than they are. The databases also undercount work published in books, in non-indexed journals, in gray literature, and in non-Western languages. The implication is not that bibliometric methods are unusable but that bibliometric findings about apparent neglect always require validation against other sources before being treated as established.

A second limitation is that bibliometric methods measure published output, which is a downstream proxy for attention rather than a direct measure of it. A question may have substantial attention from researchers without producing much published output — because the work is in early stages, because results have been negative, because the publication system has biases against the relevant topic, or because the researchers have chosen to disseminate findings through other channels. Counting publications will misidentify such cases as neglect. The corrective is to combine publication counts with measures of upstream attention — grant funding, conference presentations, doctoral dissertations in progress, working papers — which are partially available through other databases but require integration work that is not yet mature.

A third limitation is that bibliometric methods are good at identifying the presence of clusters but less good at characterizing the questions those clusters are not asking. A topic-modeling analysis can show that a literature consists of certain themes; it cannot directly show which themes are absent without an external standard against which to compare. The construction of that external standard — what should this literature be addressing, given the state of the world it is studying? — is not a bibliometric task. It requires the methods addressed in the next sections.

3. Expert Elicitation

Expert elicitation methods produce structured information about scholarly opinion through procedures designed to reduce the biases inherent in informal consultation. The methods include the Delphi technique, in which a panel of experts responds to iterative rounds of structured questions with feedback between rounds; the nominal group technique, in which experts generate and rank items in a structured face-to-face setting; horizon-scanning exercises, in which experts identify emerging issues that established literatures have not yet incorporated; and the priority-setting partnership methodology developed by the James Lind Alliance and adapted by others.[^1]

For neglect studies, expert elicitation serves three distinct functions. The first is the identification of candidate cases — areas that knowledgeable observers consider neglected, which can then be examined by other methods to determine whether the perception is warranted. The second is the calibration of bibliometric findings — when a bibliometric analysis identifies an apparent gap, expert elicitation can establish whether the gap is real or whether it reflects measurement limitations. The third is the documentation of mechanisms — experts can often articulate why a question is neglected in ways that bibliometric data cannot, because the mechanisms operate through career incentives, funding decisions, and professional norms that experts experience directly.

The strengths of expert elicitation are that it taps tacit knowledge unavailable in published sources, that it can address questions for which quantitative data do not yet exist, and that it produces findings expressed in the working vocabulary of the relevant research community. The methods have been validated extensively in health-research priority-setting and in environmental horizon-scanning, with track records that allow assessment of their predictive value.

The limitations are substantial and the field must take them seriously. Expert panels reflect the composition of the expert community, which is itself shaped by the same attention patterns the field is trying to study. Asking established researchers in a discipline what their discipline neglects is a useful exercise, but it is also a limited one, because the questions most invisible to a discipline are precisely those that its trained members are least likely to identify. The corrective is to recruit panels that include scholars from adjacent disciplines, practitioners who use the field’s outputs, members of affected communities, and what the priority-setting literature calls outsiders within — scholars whose institutional position gives them a particular vantage on the field’s blind spots.

A second limitation is that expert elicitation produces information about perceived neglect, which may or may not correspond to actual neglect. Perceptions are shaped by the salience of particular issues at the moment of elicitation, by recent controversies, by ongoing political debates, and by the framing of the elicitation procedure itself. The field must distinguish between expert claims that are well-substantiated by other evidence and expert claims that may reflect transient perceptions. The methodological standard should be that expert elicitation findings are treated as candidate hypotheses rather than as established conclusions, and that the hypotheses are tested against other methods before being incorporated into the field’s claims.

A third limitation is specific to constituency-less questions (in the taxonomy of Paper 1). Expert elicitation can only solicit input from those who are present to provide it, which means that questions whose affected parties are future generations, the cognitively impaired, animals, or otherwise unable to articulate concerns cannot be reached by standard expert procedures. The field will need to develop methods for representing the interests of absent parties — drawing on analogous problems in policy analysis, ethics, and law — without simply substituting the researcher’s preferences for the constituency’s. This is an open methodological problem that the field will not solve quickly.

4. Historical and Archival Recovery

The third methodological domain is historical recovery: the systematic investigation of research programs, questions, and lines of inquiry that were active at earlier periods and have since been abandoned, suppressed, or forgotten. The methods are those of intellectual history, archival research, and the history of science, applied to the specific question of identifying recoverable knowledge.

The category most directly served by historical methods is abandoned research programs (in the Paper 1 taxonomy). For each such program, the recovery work involves documenting what was known when the program was active, why it was abandoned, what subsequent developments bear on whether the abandonment was warranted, and what the costs and benefits of revival would be. The work draws on published literatures, on archival materials in institutional libraries and personal papers, on oral histories with retired scholars, and on the technical literatures of the eras in question.

The strengths of historical methods are that they produce detailed accounts that allow careful assessment of particular cases, that they can identify recoverable knowledge that would be invisible to other methods, and that they connect the field to the established traditions of the history of science and intellectual history. Several of the field’s most plausible early applied successes will likely come from historical recovery, because the work of documenting a previously active program is more tractable than the work of building a new one and yields clearer recommendations.

The limitations are characteristic of historical methods in general. The work is labor-intensive and does not scale easily, which means that historical recovery can address only a small number of cases at a time and must be selective about which cases to pursue. The work depends on archival access, which is uneven and sometimes politically constrained. The judgment about whether an abandoned program was abandoned legitimately requires substantive expertise in the program’s subject matter, which means that historical recovery in neglect studies will typically require collaboration between historians and domain specialists.

A particular methodological hazard for the field is the temptation toward what might be called recovery enthusiasm — the tendency to find that abandoned programs were abandoned wrongly, because the scholar who has invested in recovering them has incentives to argue for their merit. The corrective is procedural: serious recovery work must include explicit assessment of the case for the abandonment being correct, must consult skeptics of the program’s revival, and must reach conclusions that are defensible against the strongest available criticism rather than against straw-man versions of it. The field should reward recovery studies that conclude against revival as readily as those that conclude for it, because the former are evidence of methodological discipline and the latter are professionally easier to produce.

5. Comparative Analysis

Comparative methods examine patterns of attention across different research systems, disciplines, eras, or institutional contexts, with the aim of identifying which patterns are general features of scholarly inquiry and which are contingent on particular conditions. The relevant comparisons include cross-national (research portfolios in different countries with different funding systems and disciplinary structures), cross-disciplinary (how the same underlying question is treated in different fields), cross-temporal (how attention to a topic has varied over time), and cross-institutional (how funding agencies, journal portfolios, or university programs differ in their coverage).

For neglect studies, comparative analysis serves a specific evidentiary function: it allows the field to distinguish necessary features of scholarly attention from contingent ones. A topic that is neglected in one national research system but actively studied in another is unlikely to be neglected because of any intrinsic feature of the topic; the neglect must be attributable to features of the system, and the comparison provides leverage for identifying those features. A topic that is neglected across all systems is more likely to face structural barriers that are general to the scholarly enterprise. The comparison does not by itself establish that the neglect is warranted or unwarranted, but it constrains the space of possible explanations.

The strengths of comparative analysis are that it disciplines causal claims about the mechanisms of neglect, that it identifies natural experiments in research-system design that the field can learn from, and that it connects neglect studies to the comparative-policy literatures in adjacent fields. The methods are well-developed in political science and policy studies and require only modest adaptation for neglect-studies purposes.

The limitations are familiar to anyone who has worked with comparative data. The categories used to describe research portfolios are not standardized across systems, which means that comparisons require careful translation work. The data are often not strictly comparable in their coverage, definitions, or quality. The mechanisms identified by comparison are often correlational rather than causal, and the field must be cautious about claiming more than the comparison supports.

A specific application of comparative methods that deserves emphasis is the comparison between current research portfolios and historical ones. The history of science provides natural experiments in which different generations of scholars have addressed the same underlying questions with different priorities, methods, and frames. Comparing what was studied a century ago to what is studied now can identify both questions that have been productively retired and questions that have been dropped without adequate replacement. The historical comparison is particularly valuable because it is largely free of contemporary political stakes, which makes it useful for demonstrating the field’s methods in cases where the conclusions are less contested.

6. Counterfactual Reasoning

Counterfactual reasoning addresses the question that the other methods circle around without directly answering: what would the expected value of attention to a neglected question be if attention were redirected to it? The question is unavoidable, because the field’s interventions in research policy implicitly presuppose answers to it. A recommendation that funding be shifted toward a neglected area is a recommendation that the expected value of that shift exceeds the expected value of the alternative uses of the same resources, and the recommendation cannot be made responsibly without some attempt to estimate the magnitudes involved.

The methods available for counterfactual reasoning in neglect studies are imperfect but not negligible. Bayesian decision analysis, as developed in health-technology assessment and in the value-of-information literature, provides a framework for estimating the expected returns to research investment under uncertainty.[^2] Expert elicitation can produce probability distributions over the outcomes of hypothetical research programs, which can then be combined with cost estimates to produce expected-value calculations. Historical analogues — cases of previously neglected areas that received subsequent investment and produced documented returns — can be used to calibrate expectations about the returns to currently neglected areas. The cause-specific work in global health, on disability-adjusted life-years averted per dollar invested, provides a template for the kind of structured estimation that the field can pursue.[^3]

The strengths of counterfactual reasoning are that it forces explicit articulation of the magnitudes that the field’s policy recommendations presuppose and that it produces estimates that can be compared across cases. The estimates are subject to substantial uncertainty, but they are better than implicit assumptions about expected value that go unexamined.

The limitations are also substantial. Counterfactual estimates depend on assumptions that are themselves often poorly grounded, and the estimates can be highly sensitive to choices that are made early in the analysis. The methods work better for cases where outcomes can be measured in standard units — lives, dollars, time — than for cases where the relevant outcomes are intellectual, cultural, or otherwise difficult to quantify. Many of the most important neglected questions in the humanities and in foundational areas of the sciences fall into the latter category, and the field must develop appropriate methods for these cases without overreaching into quantification where quantification is not honest.

The field’s standard for counterfactual reasoning should be that estimates are produced transparently, with explicit statement of the assumptions on which they rest, and that they are accompanied by sensitivity analyses that show how the estimates change under plausible variations in those assumptions. Estimates that are not robust under sensitivity analysis should be reported as such, and the field should resist the temptation to convert highly uncertain estimates into single numbers that imply more confidence than the underlying analysis supports.

7. Qualitative and Ethnographic Methods

The methods discussed so far address the patterns and magnitudes of neglect; qualitative and ethnographic methods address its mechanisms and lived experience. Interviews with scholars about questions they have considered and not pursued, ethnographic study of how research priorities are set in funding agencies and laboratories, narrative reconstruction of how research programs end, and discourse analysis of how disciplines describe their own legitimate questions all produce findings that quantitative methods cannot reach.[^4]

For neglect studies, qualitative methods are particularly important for the sensitive-questions category (in Paper 1’s taxonomy). The mechanisms by which scholars decline to pursue politically or commercially sensitive questions operate through professional networks, informal communications, and tacit understandings that do not appear in published sources or in formal funding records. The only way to document these mechanisms with any depth is through careful interviewing with researchers who have either pursued such questions and paid the costs or considered pursuing them and declined.

The strengths of qualitative methods are that they capture mechanisms invisible to other approaches, that they produce findings expressed in the participants’ own categories and vocabulary, and that they generate hypotheses that other methods can then test at larger scale. The interviews-with-scholars genre in particular has been productive in the history-of-science literature and can be adapted to neglect-studies purposes with limited modification.

The limitations include all the familiar concerns about qualitative work: limited generalizability, dependence on the interpretive skills of the researcher, vulnerability to selection effects in who agrees to be interviewed, and difficulty in establishing the field-wide patterns to which individual interview material speaks. The corrective is the same as for the other methods: triangulation. Interview findings should be treated as hypotheses about mechanisms that other methods can examine at larger scale, rather than as conclusions in themselves.

A specific methodological problem deserves explicit treatment. Interviews about why scholars do not pursue particular questions are vulnerable to several kinds of distortion. Scholars may have post-hoc rationalizations for choices that were originally made for less articulable reasons. Scholars may overstate or understate the role of professional costs depending on their current institutional position. Scholars may be reluctant to acknowledge that they have declined to pursue questions for prudential reasons. The methodological standard should require that interview findings be triangulated against documentary evidence — funding records, publication patterns, departmental decisions — wherever possible, and that the limitations of the interview method be acknowledged explicitly in any findings that rest substantially on it.

8. Triangulation and the Tiered Standard of Evidence

The argument of the preceding sections is that no single method is adequate to support rigorous claims about neglect and that the field’s standards should require triangulation across methods. The argument now needs to be made more specific: what does triangulation mean in practice, and what standard of evidence should the field require for claims of different kinds?

The proposal is for a tiered standard with three levels.

The first tier is exploratory. A claim at this level is supported by one method — typically bibliometric mapping or expert elicitation — and is offered as a candidate hypothesis for further investigation. Exploratory claims should be clearly labeled as such, should not form the basis for policy recommendations, and should be understood as identifying cases that warrant additional methodological work rather than as establishing that the cases are genuinely neglected.

The second tier is substantiated. A claim at this level is supported by at least two independent methods that produce consistent findings — for example, a bibliometric analysis showing apparent neglect combined with expert elicitation confirming the perception, or historical recovery documenting an abandoned program combined with substantive assessment that the abandonment was unwarranted. Substantiated claims can support cautious policy recommendations, with explicit acknowledgment of the limitations of the methods used.

The third tier is rigorous. A claim at this level is supported by multiple methods spanning different methodological domains — quantitative mapping, expert elicitation, historical or comparative analysis, and where appropriate counterfactual estimation — that produce findings consistent with one another. Rigorous claims can support substantive policy recommendations and can be cited in subsequent work without further methodological caveats, though the underlying methods and their limitations should remain documented.

The tiered standard is intended to do two things. The first is to give the field a vocabulary for distinguishing among claims of different evidentiary status, which is necessary if the field’s outputs are to be usable by readers who are not themselves methodological specialists. The second is to create professional incentives for methodologically careful work, by giving the field’s most consequential standing to claims that have undergone the most scrutiny. The tiered standard should be implemented in the field’s eventual flagship journal, in its handbook, and in the training curricula that Paper 6 will address.

9. Risks Specific to Neglect-Studies Methodology

Three methodological risks are specific enough to the field that they deserve explicit treatment.

The first is circularity. The field’s claims about which questions are neglected rest in part on assessments of which questions are important, and assessments of importance are themselves shaped by the same attention patterns the field is trying to study. A topic that has been neglected for a generation will not be widely recognized as important, and a methodologically naive analysis may conclude that it is appropriately neglected because no one is arguing that it is important. The corrective is to ground importance judgments in evidence that is partially independent of current scholarly attention — disease burden, expressed public concern, theoretical centrality in cognate fields that have not neglected the question, historical evidence that earlier generations considered the question important. None of these is fully independent of attention patterns, but the combination of several partially-independent grounds is more robust than reliance on any one.

The second is motivated identification. Scholars who study neglect have professional incentives to find it, because identifying neglected questions is the field’s central output. The incentive structure creates a risk parallel to the file-drawer problem in experimental research: cases of apparent neglect that turn out on examination to be appropriate deprioritization may be less likely to be reported than cases that confirm the neglect hypothesis. The corrective is procedural: the field’s professional standards should require that scholars report cases they have investigated and concluded not to be neglected, and the field’s flagship outlets should publish such cases on terms comparable to those for positive findings. This is a difficult standard to maintain in practice, because negative findings are inherently less interesting to readers, but the field’s long-term credibility depends on it.

The third risk is specific to constituency-less questions. The field’s interest in such questions requires it to make judgments on behalf of parties who are not present to make judgments for themselves, and the line between representing absent constituencies and substituting the researcher’s preferences for theirs is genuinely difficult to draw. The corrective is partial and procedural: scholars working on constituency-less cases should be explicit about which parties they take themselves to be representing, should articulate the grounds on which they take the representation to be legitimate, should consult adjacent constituencies and proxies wherever possible, and should subject their conclusions to scrutiny from scholars whose underlying commitments differ. The procedure does not eliminate the difficulty, but it makes the difficulty visible, which is a precondition for handling it responsibly.

10. Conclusion

This paper has proposed that neglect studies should be methodologically pluralist by necessity, drawing on bibliometric mapping, expert elicitation, historical recovery, comparative analysis, counterfactual reasoning, and qualitative methods. It has argued that the pluralism must be disciplined by triangulation across methods and by a tiered standard of evidence that distinguishes exploratory, substantiated, and rigorous claims. It has identified three risks specific to the field’s methodology — circularity, motivated identification, and the representation of absent constituencies — and proposed procedural correctives for each.

What remains undone after this paper is the technical work of operationalizing each method in detail, of developing standard procedures for triangulation, and of validating the tiered standard against actual cases. That work belongs in subsequent methodological papers, in the field’s handbook, and in the methodological training that any serious doctoral program in neglect studies would need to provide.

The methodological agenda outlined here is demanding, and the field will face pressure to relax it. The pressure will come from scholars who have invested in particular cases and want to advance them without the methodological scaffolding the standards require, from policy audiences who want clear recommendations on faster timelines than careful triangulation allows, and from the field’s own institutional pressures to produce visible outputs. Resisting that pressure is the central professional discipline that neglect studies will need to maintain. The field’s claim on serious attention rests on its methods being more rigorous than the impressionistic gap-claiming that characterizes much existing literature on research priorities, and the moment that distinction collapses, the field’s reason for existing collapses with it.

Paper 3 takes up the academic infrastructure — programs, journals, conferences, curricula — within which methodologically serious neglect studies could be sustained.


Notes

[^1]: The Delphi method has a substantial methodological literature dating to the original RAND Corporation work in the 1950s and 1960s; Linstone and Turoff (2002) is the standard reference. The James Lind Alliance methodology is documented in Cowan and Oliver (2021). Horizon-scanning methods are reviewed in Sutherland and Woodroof (2009) for ecology and conservation, with parallel applications in other fields.

[^2]: The value-of-information literature in health technology assessment has produced extensive methodology for estimating the expected returns to research investment under uncertainty; see Claxton et al. (2002) for a foundational treatment and Steuten et al. (2013) for a more recent review.

[^3]: The disability-adjusted life-year framework, developed in the Global Burden of Disease project, provides a template for the kind of structured comparison across health conditions that neglect studies will need to develop for its own purposes; see Murray et al. (2012) for the underlying methodology.

[^4]: The ethnographic study of scientific practice has a substantial tradition in science and technology studies; Latour and Woolgar (1986) and Knorr-Cetina (1999) are the foundational monographs, with subsequent work in many directions. The specific application to research-priority-setting in funding agencies is less developed; Lamont (2009) on peer review in the social sciences is among the most relevant adjacent studies.


References

Claxton, K., Sculpher, M., & Drummond, M. (2002). A rational framework for decision making by the National Institute for Clinical Excellence. The Lancet, 360(9334), 711–715.

Cowan, K., & Oliver, S. (2021). The James Lind Alliance guidebook (Version 10). James Lind Alliance.

Knorr-Cetina, K. (1999). Epistemic cultures: How the sciences make knowledge. Harvard University Press.

Lamont, M. (2009). How professors think: Inside the curious world of academic judgment. Harvard University Press.

Latour, B., & Woolgar, S. (1986). Laboratory life: The construction of scientific facts (2nd ed.). Princeton University Press.

Linstone, H. A., & Turoff, M. (Eds.). (2002). The Delphi method: Techniques and applications. Addison-Wesley. (Original work published 1975)

Murray, C. J. L., Ezzati, M., Flaxman, A. D., Lim, S., Lozano, R., Michaud, C., Naghavi, M., Salomon, J. A., Shibuya, K., Vos, T., Wikler, D., & Lopez, A. D. (2012). GBD 2010: Design, definitions, and metrics. The Lancet, 380(9859), 2063–2066.

Steuten, L., van de Wetering, G., Groothuis-Oudshoorn, K., & Retèl, V. (2013). A systematic and critical review of the evolving methods and applications of value of information in academia and practice. PharmacoEconomics, 31(1), 25–48.

Sutherland, W. J., & Woodroof, H. J. (2009). The need for environmental horizon scanning. Trends in Ecology & Evolution, 24(10), 523–527.


Posted in Graduate School, Musings | Tagged , , | Leave a comment

Defining the Field: Scope, Taxonomy, and Antecedents of Neglect Studies


Executive Summary

This paper develops the conceptual foundation for neglect studies as a distinct field of inquiry. It addresses three tasks. First, it establishes the scope of the field by specifying what counts as an instance of scholarly neglect and what does not, distinguishing genuine neglect from appropriate deprioritization. Second, it proposes a working taxonomy of seven categories of neglect — orphan topics, abandoned research programs, methodologically inaccessible questions, interstitial questions, peripheral inquiries, sensitive questions, and constituency-less questions — with the understanding that these categories overlap and that real cases often belong to several at once. Third, it traces the field’s intellectual antecedents in greater depth than the preface allowed, situating neglect studies in relation to agnotology, the sociology of undone science, metascience, priority-setting research, the research-waste literature, the history and philosophy of science, library and information science, and several smaller bodies of work that have addressed pieces of the same problem under different names.

The paper concludes with a discussion of boundary problems and an outline of the questions that the methodological paper (Paper 2) will need to answer if the field is to develop rigorous standards for its own claims.


1. Introduction

The preface to this series argued that the distribution of scholarly attention bears a complicated and often weak relationship to the distribution of scholarly importance, and that the institutional and intellectual scaffolding needed to study this phenomenon systematically has not yet been built. The argument was deliberately general. This paper undertakes the more difficult work of specifying what the field would actually study and how it would distinguish itself from adjacent enterprises.

The difficulty is genuine. A field whose subject matter is what other fields overlook faces three structural challenges that more conventionally defined disciplines do not. The first is that its object of study is defined negatively — by absence rather than presence — which complicates ordinary empirical methods. The second is that its claims are easy to make and difficult to substantiate, since asserting that something is neglected is rhetorically cheap and verifying the claim is methodologically expensive. The third is that the field’s boundaries are inherently porous: any topic could be argued to be neglected from some perspective, and without principled criteria the field risks becoming a venue for any scholar whose preferred questions are not receiving the attention they would like. The taxonomy and the antecedent discussion in this paper are intended to address the first and third of these challenges. The second is the work of Paper 2.

A note on terminology. The field’s eventual name remains an open question, and Paper 8 in this series returns to it. Neglect studies is used throughout the present series as a working term, with the understanding that alternatives — agnotology in an expanded sense, attention studies, epistemic gap analysis, undone-science studies — all carry their own implications and constituencies. The working term has the virtue of plain English and the cost of seeming to promise less methodological sophistication than the field aspires to. The trade-off is accepted for the duration of this series.

2. What Counts as Neglect

A working definition: scholarly neglect is the condition of a question, topic, population, method, region, or line of inquiry that receives substantially less sustained scholarly attention than would be warranted by its importance, tractability, or expected value if pursued, where the deficit in attention is attributable to mechanisms other than considered judgment about the relative merits of available research directions.

Three elements of this definition do significant work and deserve unpacking.

The first is substantially less. Neglect studies is not concerned with marginal differences in attention across topics; the distribution of research effort will always be uneven, and the field’s claim is not that the distribution should be uniform. The claim is that some deficits in attention are large enough, and the topics important enough, that the gap merits study and, where appropriate, intervention. What counts as substantial is a methodological problem rather than a definitional one, and Paper 2 takes it up.

The second is importance, tractability, or expected value. These are three separate grounds for thinking that a question merits attention, and they can come apart. A question may be important without being tractable, in which case its neglect may be appropriate until enabling tools arrive. A question may be tractable without being important, in which case its neglect is unproblematic. A question may have high expected value — meaning that the product of its importance, its tractability, and the probability of useful findings is high — without being either spectacularly important or trivially tractable. The field’s interest is in questions that score reasonably well on at least one of these dimensions and that nonetheless receive little attention.

The third is attributable to mechanisms other than considered judgment. This is the most contested part of the definition. The field is not interested in cases where research communities have deliberately and reflectively concluded that a question is not worth pursuing; those cases are simply the ordinary work of disciplinary prioritization. It is interested in cases where the deficit in attention is produced by mechanisms — funding incentives, prestige hierarchies, methodological habits, political sensitivities, disciplinary boundaries, historical contingency — that operate without anyone having considered the question on its merits. The distinction is difficult to draw in practice, since the boundary between considered judgment and structural neglect is rarely clean. But the distinction does real work, because it focuses the field on cases where intervention is plausibly justified rather than on cases where intervention would be presumptuous.

The definition explicitly excludes several phenomena that might seem related. It excludes mere unfashionability, which is a feature of all intellectual communities and not by itself a problem. It excludes the ordinary lag between a question being identified and a research community forming around it. It excludes the appropriate concentration of effort that follows from genuine theoretical progress, where research clusters around productive paradigms because they are productive. And it excludes the misallocation of effort within active research programs, which is the territory of the research-waste literature rather than of neglect studies proper.

3. A Working Taxonomy

The taxonomy below proposes seven categories of neglect. The categories are not mutually exclusive, and the most important cases for the field tend to belong to several at once. The point of the taxonomy is not to assign each case to a single bin but to clarify the different mechanisms by which attention fails to reach a question, since different mechanisms call for different institutional responses.

3.1 Orphan Topics

An orphan topic is a question or area of inquiry that has no sustained research community — no graduate programs producing specialists, no journals devoted to it, no conferences organized around it, no senior scholars who identify it as their primary research interest. Orphan topics are not necessarily unstudied; they may receive occasional attention from scholars whose primary identification lies elsewhere. But they lack the institutional infrastructure that allows knowledge to accumulate cumulatively rather than episodically.

The orphan-topic category includes both topics that have never had a community and topics that have lost the one they had. The latter shades into the second category, abandoned research programs, and the two are sometimes difficult to separate. The distinction is roughly that orphan topics are characterized by the absence of a community, while abandoned programs are characterized by the departure of one.

Examples in the literature include the historical study of certain pre-modern technologies, the comparative grammar of language families with few living speakers, several questions in soil microbiology before its revival in the past two decades, and large portions of the history of women’s intellectual contributions before the development of feminist scholarship made the question legible.

3.2 Abandoned Research Programs

An abandoned research program is one that was active at an earlier period and was discontinued for reasons unrelated to its intellectual merits. The discontinuation may be traceable to a major funder’s shift in priorities, to the death or retirement of a founding figure, to a political climate that made the work professionally costly, to the rise of a competing paradigm that crowded the program out, or to simple bad luck in the form of a few negative results that became unduly authoritative.

The category is intellectually important because abandoned programs often contain accumulated knowledge — published papers, archived data, trained personnel — that can be recovered at substantially lower cost than building a research program from scratch. The history of psychedelic research after the regulatory clampdowns of the 1970s is a well-documented case: the program’s revival in the past two decades has been able to draw on a pre-existing literature whose findings, methods, and questions had been preserved even when active research was suspended. Similar cases exist in fields as varied as fermentation chemistry, classical breeding genetics, and several areas of clinical nutrition.

The recovery of abandoned programs is one of the most tractable applied projects available to neglect studies, because the work of identifying the program, evaluating its merits, and recommending revival can be done with conventional historical and bibliometric methods.

3.3 Methodologically Inaccessible Questions

Some questions cannot be productively studied without enabling tools that do not yet exist or have not yet been applied. These questions are not neglected in the ordinary sense — researchers may be perfectly aware of them and may be waiting for the methods to mature — but they constitute a distinct category because the conditions for their study are external to the question itself.

The category is interesting for neglect studies because methodological inaccessibility is itself often a product of attention patterns. Tools are developed where there is demand for them, and demand is shaped by which questions a research community considers important. A question that has been treated as unimportant for a generation will not generate demand for the tools needed to study it, and the absence of tools will then be cited as the reason the question remains unstudied. The cycle is self-sustaining and breakable only by deliberate intervention, often from outside the field in which the question sits.

Examples include large portions of the microbiome literature before sequencing costs dropped, the study of rare cognitive phenomena before reliable measurement instruments were developed, and several areas of historical climate research before the development of ice-core methods.

3.4 Interstitial Questions

Interstitial questions fall between established disciplines, in the spaces where no department has institutional responsibility and no journal has editorial scope. The interdisciplinarity literature has documented this problem extensively but has tended to treat it as a feature of certain individual scholars’ careers rather than as a systematic distortion of the research landscape.[^1]

The interstitial category is large and growing, in part because the problems that most exercise public policy — climate, public health, technology governance, mental health, demographic change — are characteristically multi-disciplinary, while the institutional apparatus of the academy remains organized around disciplines that were formalized a century ago. The mismatch is not absolute, since interdisciplinary centers and joint appointments exist, but it is substantial enough that many genuinely important questions sit in the seams between fields that each regard them as belonging primarily to the other.

The category includes questions in the philosophy of medicine that fall between philosophy departments and medical schools, questions in the political economy of science that fall between political science and science studies, and questions in the history of technology that fall between history departments and engineering schools.

3.5 Peripheral Inquiries

Peripheral inquiries are questions whose neglect is associated with the geographic, linguistic, or institutional location of the scholars best positioned to pursue them. A question pursued primarily by scholars in regions outside the dominant publication networks, or in languages other than the dominant scholarly languages, will receive systematically less attention than an equally important question pursued from a central location, even when the work itself is of comparable quality.

The category overlaps with broader concerns about epistemic inequality in the global knowledge system, which have been developed by scholars working under headings such as decolonial epistemology, global knowledge production, and Southern theory.[^2] Neglect studies has a more limited interest in these issues than those broader literatures: its concern is specifically with the patterns by which attention fails to reach particular questions, rather than with the wider normative arguments about whose knowledge counts. But the patterns overlap substantially, and neglect studies will need to draw on the broader literatures while maintaining its own focus.

Examples include the slow incorporation of indigenous ecological knowledge into mainstream ecology, the limited circulation of social-science scholarship from Latin America and Africa in the dominant English-language journals, and the asymmetry between the volume of work on northern-hemisphere ecosystems and the volume on southern-hemisphere ones.

3.6 Sensitive Questions

Sensitive questions are those whose pursuit imposes professional, political, or commercial costs on researchers. The costs may be direct — loss of funding, denial of tenure, harassment — or indirect — informal exclusion from networks, difficulty publishing, reputational damage. The mechanisms are well documented in the suppression-of-dissent literature[^3] and in the related literature on forbidden knowledge.[^4]

The category requires particular methodological care, because claims that a question is sensitive can be made for tactical reasons as well as for descriptive ones, and the field’s credibility depends on distinguishing genuine cases from rhetorical ones. A serious instance of sensitive neglect has several markers: documented cases of professional cost to researchers who pursued the question, evidence that the question is empirically tractable, evidence that the question is important on grounds that would be recognized by parties with different prior commitments, and evidence that the suppression mechanism operates across institutions rather than reflecting the judgment of a single funder or department.

Examples that have been studied in the literature include certain questions in the epidemiology of industrial exposures, certain questions in the social-science study of intelligence and behavior, and certain questions about the long-term effects of widely used pharmaceuticals. The field will need to handle such cases with particular discipline, because the political stakes are high and the temptation to use the field as a vehicle for advocacy in particular directions will be persistent.

3.7 Constituency-Less Questions

Constituency-less questions are those whose neglect is associated with the absence of any organized stakeholder community to advocate for their study. The priority-setting partnership literature has demonstrated that organized constituencies — patient groups, professional associations, advocacy organizations — can substantially shift research portfolios when they articulate research priorities clearly.[^5] The converse is that questions whose stakeholders are absent, diffuse, future, or non-human are systematically underserved.

The category includes questions whose affected parties are not yet born (most questions about long-term environmental change, demographic projection, and intergenerational policy), questions whose affected parties cannot articulate their concerns (questions about cognitive impairment, very young children, and several categories of animal welfare), questions whose affected parties are too dispersed to organize (many questions about everyday consumer products and low-grade environmental exposures), and questions whose affected parties exist but have not formed advocacy structures (many questions about rare conditions and small populations).

This category is particularly important for neglect studies because the priority-setting partnership model, which has been one of the most effective tools for redirecting research attention, by its construction cannot reach constituency-less questions. The field will need to develop methods for representing the interests of absent constituencies in priority discussions, while remaining honest about the difficulty of doing so without simply substituting the researcher’s preferences for the constituency’s.

4. Intellectual Antecedents

The preface introduced five literatures that constitute the most direct intellectual antecedents of neglect studies. This section develops the discussion of each and adds several smaller literatures that the preface did not have space to address. The aim is not a comprehensive review — that work belongs in a separate handbook — but a map of the conceptual resources the field can draw on and the gaps that remain when those resources have been assembled.

4.1 Agnotology

Agnotology, as named and developed by Robert Proctor and Londa Schiebinger in the 2008 collection that effectively founded the field,[^6] takes ignorance as a positive object of study rather than as the mere absence of knowledge. The field has produced powerful case studies, particularly Proctor’s own work on the tobacco industry’s manufacture of doubt about the health effects of smoking[^7] and Naomi Oreskes and Erik Conway’s parallel work on climate science.[^8] The field has also developed a useful conceptual vocabulary, distinguishing among ignorance as native state, ignorance as lost realm, and ignorance as strategic ploy — the third being the category that has received the most attention.

For neglect studies, agnotology is the most directly relevant antecedent, and the case for treating the new field as an expansion of agnotology rather than as a separate enterprise is serious. The case against is that agnotology’s center of gravity has settled firmly on strategic ignorance — the manufactured doubt produced by interested actors — while the larger and arguably more consequential category of passive neglect has received much less attention within the field. A neglect-studies enterprise that took agnotology’s core methods and applied them to the passive category would be a natural extension; whether the extension is best pursued under the agnotology banner or under a new name is a question of strategy more than of substance.

4.2 The Sociology of Undone Science

The undone-science literature, developed by David Hess, Scott Frickel, and their collaborators,[^9] approaches the same problem from a different direction. Where agnotology asks how ignorance is produced, the undone-science literature asks how civil-society actors identify research that institutional science declines to undertake. The empirical work has concentrated on environmental health, energy, and food systems, with notable studies of community concerns about industrial pollution that mainstream toxicology had not investigated.

For neglect studies, the contribution of the undone-science literature is methodological as much as substantive. The literature has developed careful procedures for documenting how research agendas are set, how civil-society actors challenge them, and how the resulting contestation reshapes the research landscape. Those procedures are directly applicable to neglect studies, with the qualification that the undone-science literature has confined itself to cases in which an organized constituency exists. The constituency-less category in the taxonomy above identifies the territory where the undone-science approach cannot reach without methodological extension.

4.3 Metascience

Metascience has emerged over the past two decades as a quantitative study of the research enterprise itself, with substantial institutional infrastructure including the Center for Open Science, the Meta-Research Innovation Center at Stanford, and a growing number of dedicated journals.[^10] The field’s central concerns have been research quality, reproducibility, and the demographic and institutional patterns of scientific careers.

For neglect studies, metascience is the closest existing methodological home and the most plausible institutional partner. Metascience already employs the bibliometric, scientometric, and computational methods that neglect studies will need, and several metascience research groups have begun work on research-coverage questions that overlap directly with the proposed field’s agenda. The argument for treating neglect studies as a subfield of metascience is therefore stronger than the argument for treating it as a subfield of agnotology. The argument against is that metascience’s institutional identity has formed around quality-and-reproducibility questions, and the coverage agenda has so far been peripheral within it. Whether that peripheral position is a stable foundation for the proposed field, or whether the coverage agenda needs its own institutional vehicle, is a strategic question that subsequent papers in this series will need to address.

4.4 Priority-Setting Research

The priority-setting research literature, exemplified by the James Lind Alliance methodology[^11] and the broader patient-and-public-involvement movement in health research,[^12] has developed structured procedures for eliciting research questions from affected communities and comparing them to existing research portfolios. The findings have been consistent across dozens of applications: substantial fractions of the questions that matter to patients, carers, and clinicians are not being addressed by ongoing research, and the magnitude of the mismatch is generally larger than researchers anticipate before the priority-setting exercise is conducted.

For neglect studies, the priority-setting literature offers a well-validated methodology that the field can adopt directly for one important category of cases — those in which an articulate constituency exists. The literature has been less developed for cases without organized constituencies, for foundational research questions, and for humanities scholarship, all of which the proposed field will need to address. Extensions of the priority-setting methodology to these cases are an open methodological problem and a candidate for early field-building work.

4.5 The Research-Waste Literature

The research-waste literature, associated with the REWARD initiative in The Lancet[^13] and with the broader work of Iain Chalmers, Paul Glasziou, and their collaborators, has documented that a substantial fraction of biomedical research effort is misallocated relative to the questions that matter to patients and clinicians. The estimates have been controversial in their specifics — the often-cited figure of eighty-five percent waste has been challenged — but the general finding is robust: research portfolios are not optimally allocated, and the gap between optimal and actual allocation is large enough to matter.

For neglect studies, the research-waste literature is a sibling enterprise rather than an antecedent in the strict sense. The two share a premise (the distribution of research effort is improvable) and differ in their focus (waste within active programs versus absence of programs at all). The relationship between them is roughly that the research-waste literature studies the misallocation of attention within the set of questions being asked, while neglect studies studies the misallocation of attention across the set of questions that could be asked. Both are needed, and a mature research-policy enterprise would treat them as complementary rather than competing.

4.6 History and Philosophy of Science

The history and philosophy of science have a long tradition of attention to questions that bear on neglect studies, even when the term has not been used. The historical literature on “lost sciences” — alchemy, phrenology, mesmerism, Lysenkoism — has implicitly addressed the question of how research programs end, sometimes legitimately and sometimes for reasons that look different in retrospect. The philosophical literature on theory choice, particularly in the post-Kuhn tradition, has addressed the question of how research communities allocate effort across alternative paradigms.[^14] The sociology of scientific knowledge has examined how methodological commitments shape what counts as a legitimate question.[^15]

For neglect studies, these literatures provide essential context and a stock of case studies, but they have not coalesced into a unified field with shared methods. The history of “lost sciences” has been particularly underdeveloped as a systematic enterprise, perhaps because the cases that historians most enjoy are those that turn out to have been correctly abandoned, while the cases of greatest interest to neglect studies are those that turn out to have been abandoned prematurely.

4.7 Library and Information Science

Library and information science has developed substantial bibliometric and scientometric infrastructure that is directly applicable to neglect studies. The discipline’s tools for mapping the structure of scholarly literatures — citation analysis, topic modeling, co-occurrence networks, coverage analysis — are the technical foundation on which large-scale neglect-mapping must rest.[^16]

For neglect studies, the relevant point is that the technical infrastructure already exists and is mature. What has been missing is a research agenda that uses it to ask coverage questions systematically. The mapping of negative space requires inverting the usual citation-analysis question — rather than asking which topics are most central, asking which topics are conspicuously absent given the structure of adjacent fields — and this inversion is a methodological extension rather than a wholly new technique.

4.8 Smaller Literatures

Several smaller literatures address pieces of the field’s territory and deserve mention. The literature on negative results and publication bias[^17] addresses the question of which findings within active research programs fail to enter the published record, which overlaps with neglect studies at the case level. The literature on the demographics of scientific careers[^18] addresses the question of which questions are pursued because of who is in a position to pursue them. The literature on funding-effects-on-research[^19] addresses the question of how grant structures shape research portfolios. The literature on academic freedom and self-censorship[^20] addresses the conditions under which researchers decline to pursue questions they would otherwise be interested in.

Each of these literatures contributes a piece. None of them, alone or together, constitutes the field that this series proposes to build.

5. Boundary Problems

Three boundary problems deserve explicit treatment, because the field’s coherence depends on handling them well.

The first is the boundary between neglect studies and ordinary disciplinary self-criticism. Every discipline has internal voices arguing that some of its questions are under-attended, and the work of those voices is healthy and necessary. Neglect studies is not in competition with disciplinary self-criticism; it is a meta-level enterprise that studies the patterns of attention across disciplines and the mechanisms that produce them. The relationship between the two is analogous to the relationship between economics and management studies: economics studies markets and firms in general, while management studies addresses the particular problems of running a particular firm. Both are legitimate, and neither replaces the other.

The second is the boundary between neglect studies and advocacy for particular neglected topics. Scholars who study a particular neglected topic and argue for more attention to it are doing important work, but they are not necessarily doing neglect studies. The distinction is roughly that the topic-specific advocate makes the case for their topic, while the neglect-studies scholar makes the case for a method of identifying which topics merit such cases. The two roles can be combined in a single scholar, but they should not be confused, and the field’s credibility will suffer if it is seen as a venue for any scholar to advance their preferred topic under a methodological banner.

The third is the boundary between neglect studies and political critique of the academy. Claims about what the academy neglects are sometimes made as part of broader political arguments about the academy’s commitments, biases, or institutional location. Those broader arguments are legitimate subjects of debate, but they are not the same as neglect studies, and the field will damage itself if it allows itself to be conscripted into them. The discipline required is to focus on empirically tractable questions about attention patterns and their mechanisms, while leaving the larger political questions to the venues in which they are appropriately conducted. The field will need to be hospitable to scholars whose underlying political commitments differ, because the patterns of neglect cut across the political spectrum and the field’s empirical credibility depends on demonstrating this in practice.

6. Conclusion

This paper has proposed a working definition of scholarly neglect, a taxonomy of seven overlapping categories, and a map of the intellectual antecedents on which the field can draw. The definition emphasizes that neglect studies is concerned with deficits in attention that are produced by mechanisms other than considered judgment, and that are large enough and the topics important enough to merit study. The taxonomy distinguishes orphan topics, abandoned research programs, methodologically inaccessible questions, interstitial questions, peripheral inquiries, sensitive questions, and constituency-less questions, with the understanding that real cases belong to several categories at once. The antecedent discussion has located the field in relation to agnotology, the sociology of undone science, metascience, priority-setting research, the research-waste literature, the history and philosophy of science, library and information science, and several smaller literatures that address pieces of the same problem.

What remains undone after this paper, and what Paper 2 will need to take up, is the methodological work that distinguishes rigorous identification of neglect from impressionistic claim-making. The categories above provide a vocabulary; the methods that would allow a scholar to defensibly assert that a particular case belongs to one of them are the next step. The credibility of the field as a whole depends on those methods being developed seriously, applied carefully, and held to standards that would survive scrutiny from scholars who are skeptical of the enterprise. The skepticism is itself a healthy condition for the field to develop under, since a field whose business is the rigorous identification of neglected questions cannot afford to be rigorously identified as a producer of unfounded claims.


Notes

[^1]: The interdisciplinarity literature has been growing for several decades and has its own internal debates about whether interstitial work is best supported through dedicated interdisciplinary institutions or through joint appointments within existing disciplinary structures. Jacobs and Frickel (2009) provide a critical assessment of the field’s claims; the National Academies (2005) report on facilitating interdisciplinary research is the most influential institutional document.

[^2]: The relevant literatures here include the global knowledge production scholarship developed by Raewyn Connell (2007), the decolonial epistemology literature associated with Boaventura de Sousa Santos (2014), and the science-studies work on geographical patterns in research, exemplified by the bibliometric studies summarized in Mongeon and Paul-Hus (2016) on database coverage biases.

[^3]: The suppression-of-dissent literature has been developed most extensively by Brian Martin and colleagues (Martin, 1999, 2014), with case studies across multiple disciplines.

[^4]: The forbidden-knowledge concept was developed by Joanna Kempner and colleagues (Kempner et al., 2011) and has been applied to questions in several fields, including stem-cell research, behavioral genetics, and certain areas of social science.

[^5]: The James Lind Alliance has published outcome studies of its priority-setting partnerships demonstrating substantial mismatches between patient-clinician priorities and existing research portfolios (Crowe et al., 2015).

[^6]: Proctor and Schiebinger (2008) is the founding text. Proctor’s own introductory chapter, “Agnotology: A Missing Term to Describe the Cultural Production of Ignorance (and Its Study),” is the most cited single statement of the field’s program.

[^7]: Proctor (2011) is the most developed treatment.

[^8]: Oreskes and Conway (2010) is the standard reference.

[^9]: Hess (2007) is the foundational monograph; Frickel et al. (2010) is the most cited article-length treatment.

[^10]: Ioannidis (2018) provides an overview of metascience as a field. The Center for Open Science and the Meta-Research Innovation Center at Stanford are the most visible institutional homes.

[^11]: Cowan and Oliver (2021) is the official methodology guidebook; the Alliance’s website maintains a list of completed partnerships with their identified research priorities.

[^12]: The broader patient-and-public-involvement literature is large; INVOLVE (the U.K. NIHR initiative) and the Patient-Centered Outcomes Research Institute in the U.S. are the most institutionally consolidated examples.

[^13]: The REWARD series in The Lancet began with Chalmers and Glasziou (2009) and developed through the multi-paper 2014 series initiated by Chalmers et al. (2014).

[^14]: Kuhn (1962/2012) remains the most influential single statement; the post-Kuhn literature on theory choice is large and includes Lakatos (1970), Laudan (1977), and many subsequent contributions.

[^15]: Bloor (1976) and the Edinburgh school’s broader output are the classic statements; subsequent work in science and technology studies has developed the program in many directions.

[^16]: The bibliometric and scientometric literature is vast. Mongeon and Paul-Hus (2016) on database coverage is particularly relevant to neglect studies because it documents the biases built into the standard data sources on which large-scale mapping must rely.

[^17]: The publication-bias literature begins with Rosenthal (1979) and has produced a substantial subsequent body of work, most recently focused on registered reports and pre-registration as corrective mechanisms.

[^18]: The demographics-of-science literature has documented patterns by gender, race, national origin, and institutional affiliation; Stephan (2012) provides an overview from the economics-of-science perspective.

[^19]: Azoulay and colleagues’ work on the effects of different funding structures on research productivity (Azoulay et al., 2011) is among the most cited; the broader literature is reviewed in Stephan (2012).

[^20]: The academic-freedom literature has both U.S. and international branches; recent contributions include Whittington (2018) and the various reports of organizations such as the American Association of University Professors.


References

Azoulay, P., Graff Zivin, J. S., & Manso, G. (2011). Incentives and creativity: Evidence from the academic life sciences. RAND Journal of Economics, 42(3), 527–554.

Bloor, D. (1976). Knowledge and social imagery. Routledge & Kegan Paul.

Chalmers, I., Bracken, M. B., Djulbegovic, B., Garattini, S., Grant, J., Gülmezoglu, A. M., Howells, D. W., Ioannidis, J. P. A., & Oliver, S. (2014). How to increase value and reduce waste when research priorities are set. The Lancet, 383(9912), 156–165.

Chalmers, I., & Glasziou, P. (2009). Avoidable waste in the production and reporting of research evidence. The Lancet, 374(9683), 86–89.

Connell, R. (2007). Southern theory: The global dynamics of knowledge in social science. Polity.

Cowan, K., & Oliver, S. (2021). The James Lind Alliance guidebook (Version 10). James Lind Alliance.

Crowe, S., Fenton, M., Hall, M., Cowan, K., & Chalmers, I. (2015). Patients’, clinicians’ and the research communities’ priorities for treatment research: There is an important mismatch. Research Involvement and Engagement, 1, 2.

de Sousa Santos, B. (2014). Epistemologies of the South: Justice against epistemicide. Paradigm Publishers.

Frickel, S., Gibbon, S., Howard, J., Kempner, J., Ottinger, G., & Hess, D. J. (2010). Undone science: Charting social movement and civil society challenges to research agenda setting. Science, Technology, & Human Values, 35(4), 444–473.

Hess, D. J. (2007). Alternative pathways in science and industry: Activism, innovation, and the environment in an era of globalization. MIT Press.

Ioannidis, J. P. A. (2018). Meta-research: Why research on research matters. PLOS Biology, 16(3), e2005468.

Jacobs, J. A., & Frickel, S. (2009). Interdisciplinarity: A critical assessment. Annual Review of Sociology, 35, 43–65.

Kempner, J., Merz, J. F., & Bosk, C. L. (2011). Forbidden knowledge: Public controversy and the production of nonknowledge. Sociological Forum, 26(3), 475–500.

Kuhn, T. S. (2012). The structure of scientific revolutions (4th ed.). University of Chicago Press. (Original work published 1962)

Lakatos, I. (1970). Falsification and the methodology of scientific research programmes. In I. Lakatos & A. Musgrave (Eds.), Criticism and the growth of knowledge (pp. 91–196). Cambridge University Press.

Laudan, L. (1977). Progress and its problems: Toward a theory of scientific growth. University of California Press.

Martin, B. (1999). Suppression of dissent in science. Research in Social Problems and Public Policy, 7, 105–135.

Martin, B. (2014). The controversy manual. Irene Publishing.

Mongeon, P., & Paul-Hus, A. (2016). The journal coverage of Web of Science and Scopus: A comparative analysis. Scientometrics, 106(1), 213–228.

National Academies of Sciences, Engineering, and Medicine. (2005). Facilitating interdisciplinary research. National Academies Press.

Oreskes, N., & Conway, E. M. (2010). Merchants of doubt: How a handful of scientists obscured the truth on issues from tobacco smoke to global warming. Bloomsbury Press.

Proctor, R. N. (2011). Golden holocaust: Origins of the cigarette catastrophe and the case for abolition. University of California Press.

Proctor, R. N., & Schiebinger, L. (Eds.). (2008). Agnotology: The making and unmaking of ignorance. Stanford University Press.

Rosenthal, R. (1979). The file drawer problem and tolerance for null results. Psychological Bulletin, 86(3), 638–641.

Stephan, P. E. (2012). How economics shapes science. Harvard University Press.

Whittington, K. E. (2018). Speak freely: Why universities must defend free speech. Princeton University Press.


Posted in Graduate School, Musings | Tagged , , | Leave a comment

The Scriptural Indictment of Contemporary Elites: A Biblicist Examination of Asymmetric Burden, False Compassion, and the Pattern of Those Who Say and Do Not

Abstract

This paper applies the testimony of Scripture to the conduct of contemporary political, institutional, and cultural elites, treating the elite pattern of demanding deference while exempting themselves from imposed burdens, of professing care for the governed while displaying contempt for them, and of claiming competence while delivering serial failure, as a recognizable spiritual condition with a recognizable biblical diagnosis. The paper draws on the prophetic literature, the wisdom literature, the Gospels, and the apostolic writings to develop the indictment in scriptural rather than merely sociological terms. It examines the specific judgments Scripture pronounces on rulers, teachers, shepherds, and judges who behave in the manner now observable, and considers the remedy Scripture prescribes for those under such conduct as well as for those who engage in it.

1. Introduction: The Scriptural Framework for Judging Authority

Scripture is not silent on the conduct of those who govern, teach, judge, and lead. It addresses the matter from Genesis to Revelation, in passages of considerable specificity, and it does so with a consistency across the canon that permits a coherent indictment to be developed from the texts themselves. The framework Scripture provides is not the framework of contemporary political theory, which evaluates rulers principally by their efficiency, their popularity, or their conformity to procedural norms. It is rather the framework of covenant accountability, in which those granted authority over others are held to a standard intensified rather than relaxed by their station, and in which the failure to meet that standard is treated as a spiritual condition with spiritual consequences, not merely as a political failure with political consequences.

Three principles undergird the scriptural approach to elite conduct, and they will recur throughout this examination. The first is that authority is delegated rather than inherent, given by God to particular persons for particular purposes, and accountable to the One who delegated it. Daniel makes this explicit when he tells Nebuchadnezzar that the Most High rules in the kingdom of men and gives it to whomever He will, and Paul makes it explicit when he says that the powers that be are ordained of God. The implication is that no human authority is autonomous; all are stewards rather than owners, and stewards face accounting.

The second principle is that the measure of authority is the welfare of those over whom it is exercised, not the welfare of those exercising it. Ezekiel 34 develops this at length in its denunciation of the shepherds of Israel who fed themselves rather than the flock, and the principle is implicit throughout the law and the prophets. Authority is given for the protection and provision of the governed; authority exercised for the benefit of the governing is by that fact a corruption of its purpose.

The third principle is that the standard of judgment applied to those in authority is stricter than that applied to ordinary people, not looser. James states this directly when he warns that not many should become teachers, knowing that they will receive the stricter judgment. Christ states it when He declares that to whom much is given, of him shall much be required. The intuitive elite supposition, that station permits relaxation of the rules, is precisely inverted in the biblical framework, where station intensifies them.

With these principles established, the indictment of contemporary elites can be developed by reference to the specific patterns Scripture identifies and condemns.

2. The Pattern of Heavy Burdens: Matthew 23 and Its Application

The most direct scriptural treatment of the asymmetric burden pattern is found in Matthew 23, where Christ pronounces a series of woes upon the scribes and Pharisees. The opening characterization, in verses 2 through 4, identifies precisely the pattern under examination. The scribes and Pharisees sit in Moses’ seat, which is to say they occupy positions of legitimate teaching authority. Christ does not deny their authority; He instructs the people to do what they say. But He immediately distinguishes what they say from what they do, warning the people not to do after their works, for they say and do not. He then specifies the pattern in language that admits of no ambiguity: they bind heavy burdens and grievous to be borne, and lay them on men’s shoulders; but they themselves will not move them with one of their fingers.

The pattern Christ identifies is not generalized hypocrisy but a specific institutional behavior, in which those occupying seats of authority devise demands they impose on the governed while contriving exemptions for themselves. This is the precise pattern now observable in contemporary elite conduct, and the scriptural judgment on it is unambiguous. Christ does not call for the heavy burdens to be moderated; He calls for the discrepancy between the imposers and the imposed to be ended. The teachers retain their seat in Moses’ chair; what they forfeit is the standing to be imitated, and what they incur is the woe pronounced upon them in the verses that follow.

Several features of the Matthew 23 indictment merit particular attention because they map directly onto contemporary conditions. The scribes and Pharisees love the uppermost rooms at feasts and the chief seats in the synagogues, and they love greetings in the markets and to be called of men rabbi. The contemporary elite preoccupation with status, with the visible markers of professional achievement, with the deference signaled by professional titles, and with the segregated spaces in which elites encounter only one another, is recognizably the same pattern. Christ continues by denouncing their proselytizing zeal, which produces converts who become twofold more the children of hell than themselves. The contemporary expansion of credentialing systems, which reproduces the elite pattern in successive generations while intensifying its pathologies, is recognizable in this denunciation.

Christ further denounces the pattern of straining at a gnat while swallowing a camel, of meticulous compliance with peripheral requirements while neglecting the weightier matters of judgment, mercy, and faith. This is precisely the pattern of contemporary elite moralism, which mounts elaborate campaigns about microaggressions, pronouns, and other peripheral concerns while presiding over wars, deindustrializations, and institutional failures that produce mass suffering of the kind the prophets denounced as the substantive injustice from which God’s judgment proceeds. Christ’s denunciation of those who make clean the outside of the cup and platter while the inside is full of extortion and excess applies with peculiar force to a class whose public posture is one of caring while its actual conduct is one of self-enrichment at the expense of the governed.

The woes culminate in the comparison with whited sepulchres, which indeed appear beautiful outward but are within full of dead men’s bones and of all uncleanness. The contemporary elite’s curated public image, polished by communications professionals, transmitted through cooperative media, and protected by the assumption of professional respectability, is identifiable in this image, and Scripture’s judgment on it is that the polished exterior aggravates rather than mitigates the offense, because it conceals the corruption rather than confessing it.

3. The Shepherds Who Feed Themselves: Ezekiel 34 and Its Application

Where Matthew 23 addresses teachers, Ezekiel 34 addresses rulers, and the indictment is correspondingly comprehensive. The prophet is instructed to prophesy against the shepherds of Israel and to say to them that the Lord God is against them. The substance of the indictment is given in the opening verses: woe to the shepherds of Israel that do feed themselves, for the shepherds should feed the flocks. The specific failures are then enumerated. The shepherds eat the fat and clothe themselves with the wool; they kill them that are fed; but they feed not the flock. The diseased they have not strengthened, neither have they healed that which was sick, neither have they bound up that which was broken, neither have they brought again that which was driven away, neither have they sought that which was lost; but with force and with cruelty have they ruled them.

The pattern Ezekiel identifies is the systematic inversion of the purpose for which authority is given. The flock exists to be fed, protected, healed, and gathered; the shepherds exist to perform these services. When the shepherds reverse the relationship, treating the flock as the resource from which they extract sustenance, status, and benefit while declining to perform the services for which their position was constituted, they incur the judgment that the prophet then pronounces. The Lord declares Himself against the shepherds, requires the flock at their hand, causes them to cease from feeding the flock, and delivers His flock from their mouth that they may not be meat for them.

The application to contemporary elites does not require extensive elaboration. A governing class that extracts wealth, status, and security from the populations it nominally serves, while presiding over the decline of those populations’ communities, the decay of their institutions, and the deterioration of their conditions of life, fits the Ezekiel pattern with precision. The diseased of contemporary society have not been strengthened; the broken have not been bound up; the lost have not been sought; and the ruling has been with force and with cruelty, even when the cruelty is administered through bureaucratic procedure rather than through visible violence. The judgment Ezekiel pronounces is the same that any biblicist reading of contemporary conditions must pronounce, because the conditions are recognizably the same.

Ezekiel proceeds to describe the gathering of the scattered flock by the Lord Himself, who will seek out His sheep and deliver them from all places where they have been scattered in the cloudy and dark day. The implication for the failed shepherds is that their function will be removed from them; the implication for the flock is that deliverance is not contingent on the conversion of the shepherds, who in the prophecy do not repent but are simply set aside. This is a point of some importance, because it indicates that the scriptural framework does not require elites to be redeemed in order for the flock to be delivered; redemption is offered to those who repent, but deliverance proceeds whether they do or not, and the principal hope of the governed lies not in the conversion of those who have failed them but in the action of the One who appointed them.

4. The Prophetic Indictment of Unjust Rulers: Isaiah, Jeremiah, Amos, Micah

The prophetic literature beyond Ezekiel contains an extensive indictment of the rulers, judges, and priests of Israel and Judah whose conduct prefigures and parallels that of contemporary elites. The indictments are sufficiently consistent across the prophets that they may be treated together, with attention to the specific patterns each prophet addresses.

Isaiah’s opening chapters indict the rulers of Sodom and the people of Gomorrah, by which he means the rulers and people of Jerusalem whose conduct merits the comparison. The princes are rebellious, companions of thieves; every one loves gifts and follows after rewards; they judge not the fatherless, neither does the cause of the widow come to them. The indictment is of a ruling class whose decisions are for sale, whose attention is captured by those who can pay for it, and whose neglect of the powerless is systemic rather than incidental. Isaiah continues with the famous indictment of those who decree unrighteous decrees and write grievousness which they have prescribed, to turn aside the needy from judgment and to take away the right from the poor of the people. The use of legal forms to accomplish unjust ends, the construction of regulatory and procedural apparatus that systematically advantages the powerful at the expense of the weak, is identified by the prophet as a particular and aggravated form of elite corruption, because it adds the abuse of legitimacy to the underlying injustice.

Jeremiah addresses the prophets and priests who deal falsely, who have healed the hurt of the daughter of His people slightly, saying peace, peace, when there is no peace. The pattern of false reassurance, in which those in positions of religious or intellectual authority issue confident pronouncements that conditions are well or improving when they are in fact deteriorating, is identified by Jeremiah as a particular offense, because the false comfort retards the response that the actual conditions require. Contemporary elites who insist that their populations are thriving when their populations are visibly declining, who pronounce confident verdicts on questions where the underlying evidence is uncertain or contested, who substitute the polished communication of comforting messages for the harder labor of telling the governed what is actually happening, are recognizable in Jeremiah’s denunciation. He continues with the indictment that they were not at all ashamed, neither could they blush. The capacity for shame, which presupposes the recognition that one has done something one should not have done, is precisely what is absent in contemporary elite conduct, and its absence is identified by the prophet as a particular mark of advanced corruption.

Amos addresses the comfortable elites of Samaria with particular severity. The chapter that begins with woe to them that are at ease in Zion and trust in the mountain of Samaria identifies a class that lies upon beds of ivory, stretches themselves upon their couches, eats the lambs out of the flock and the calves out of the midst of the stall, sings idle songs to the sound of the viol, drinks wine in bowls, and anoints themselves with the chief ointments, but they are not grieved for the affliction of Joseph. The indictment is of luxurious self-indulgence accompanied by indifference to the suffering of the people. The conjunction is the precise pattern of contemporary elite life, in which substantial personal consumption coexists with the moralized rhetoric of concern, and the resolution Amos pronounces is that those who lie on beds of ivory will go captive with the first that go captive. The luxury does not exempt the elite from the judgment that falls on the society; it identifies them as among the first to be caught up in it.

Micah develops the indictment in particularly direct terms with respect to the heads of the house of Jacob and princes of the house of Israel, who abhor judgment and pervert all equity. They build up Zion with blood and Jerusalem with iniquity. The heads thereof judge for reward, and the priests thereof teach for hire, and the prophets thereof divine for money; yet will they lean upon the Lord and say, Is not the Lord among us? None evil can come upon us. The indictment is of a comprehensive system in which every form of authority has been corrupted by payment, and yet the corrupt continue to claim divine protection on the basis of their formal religious affiliation. The contemporary parallel, in which institutions claim moral authority while operating on principles indistinguishable from those of the interests that fund them, is recognizable in Micah’s denunciation. The verdict the prophet pronounces is that Zion shall for their sake be plowed as a field, and Jerusalem shall become heaps, and the mountain of the house as the high places of the forest. The institutions in which the corrupt elites took refuge will be destroyed, and the formal religious claims will not protect the system from the judgment its conduct has earned.

5. The Wisdom Literature on Rulers and the Conduct of Authority

The wisdom literature supplements the prophetic indictment with sustained reflection on the principles by which rulers should be evaluated and the consequences of their failure. Proverbs in particular contains an extensive treatment of the matter, scattered through its chapters but consistent in its emphasis. The throne is established by righteousness, not by power or efficiency, and a ruler who removes mercy from the foundation of his rule has removed the principal support that holds it up. The king by judgment establishes the land; but he that receives gifts overthrows it. Where the indictment of the prophets is rendered in oracular form, the wisdom of Proverbs is rendered in epigrammatic form, and the cumulative effect is to specify with considerable precision the conditions under which authority is legitimate and the conditions under which its illegitimacy guarantees the eventual collapse of the system that sustained it.

Several Proverbs passages have particular contemporary application. The verse that observes that when the righteous are in authority, the people rejoice; but when the wicked bear rule, the people mourn, identifies a phenomenon that is empirically verifiable in any society and that explains the contemporary political mood across the developed world. The widespread popular discontent in many countries is not, on this analysis, the product of irrational populism or external manipulation; it is the natural response of populations being ruled by those whose conduct merits the condemnation Proverbs supplies. The verse that observes that as a roaring lion and a ranging bear, so is a wicked ruler over the poor people, identifies the predatory rather than protective relationship that the elite-popular relationship has become in many contemporary cases. The verse that observes that the prince that wants understanding is also a great oppressor, but he that hates covetousness shall prolong his days, identifies the linkage between incompetence and oppression that the contemporary elite class repeatedly demonstrates: rulers who cannot perform the substantive functions of rule turn to oppression as the substitute for the performance they cannot achieve.

Ecclesiastes contributes a particular passage on the corruption of judicial and administrative apparatus that bears directly on contemporary conditions. If thou see the oppression of the poor, and violent perverting of judgment and justice in a province, marvel not at the matter; for he that is higher than the highest regards; and there be higher than they. The passage is sometimes read as an expression of resignation, but it is more precisely an observation that the hierarchy of human authorities provides no remedy when corruption has captured the system at multiple levels, because each level is observed by the one above it, and the highest authorities are themselves participants in the system whose conduct merits the denunciation. The contemporary problem of regulatory capture, in which each layer of oversight is itself captured by those it is supposed to oversee, is given precise expression in this passage, and the remedy Scripture points to is not the reform of the captured system but the recourse to the One who is higher than the highest of them.

6. The Specific Indictment of False Compassion: Self-Perception of the Elite Class

A particular feature of contemporary elite conduct that merits separate scriptural treatment is the elite class’s perception of itself as compassionate and caring, even as its actual conduct produces the suffering of those it claims to care for. This pattern is treated in Scripture under several different headings, and the cumulative judgment is severe.

The first relevant passage is Proverbs’ observation that the tender mercies of the wicked are cruel. The verse is sometimes treated as paradoxical, but it is in fact precise: the apparent mercies extended by those whose underlying disposition is corrupt are themselves instruments of cruelty, because they substitute for the genuine mercy the situation requires, mislead the recipient about the disposition of the giver, and protect the corrupt system from the recognition that would otherwise force its reform. Contemporary elite philanthropy, which redistributes a small fraction of the wealth extracted by elite arrangements while leaving those arrangements intact, fits this pattern. Contemporary elite moralism, which speaks tenderly of distant and abstract victims while presiding over the concrete and proximate victimization of the governed, fits it as well. The tenderness expressed is not the contradiction of the cruelty; it is the form the cruelty takes when its perpetrators retain the self-conception of compassionate persons.

The second relevant passage is Christ’s address to the church at Laodicea, which says, I am rich, and increased with goods, and have need of nothing, and knows not that thou art wretched, and miserable, and poor, and blind, and naked. The self-perception of the Laodicean church is that it is in excellent condition; the actual condition disclosed by Christ is one of comprehensive failure that the Laodiceans themselves cannot perceive. The discrepancy between self-perception and actual condition is the diagnostic feature of the Laodicean state, and it is precisely the diagnostic feature of contemporary elite consciousness. The members of the elite class do not generally perceive themselves as cruel, incompetent, or self-serving; they perceive themselves as caring, competent, and devoted to the public good, and the persistence of this self-perception in the face of overwhelming contrary evidence is itself a feature requiring scriptural diagnosis. Christ’s counsel to Laodicea is that they buy of Him gold tried in the fire, that they may be rich, and white raiment, that they may be clothed, and anoint their eyes with eyesalve, that they may see. The remedy is not the renunciation of the self-perception in favor of accurate self-knowledge by their own effort, which they are constitutionally incapable of, but the receipt from Christ of the resources that would permit such accurate self-knowledge to be acquired.

The third relevant passage is the Lord’s instruction through Isaiah that the fast He has chosen is not the ostentatious religious observance the people are performing but the loosing of the bands of wickedness, the undoing of heavy burdens, the letting of the oppressed go free, and the breaking of every yoke. The substance of the religious observance the elites of Isaiah’s day are performing is then exposed: they fast for strife and debate, and to smite with the fist of wickedness. The performance of religious or moral activity does not, in itself, constitute the substance of righteousness; if the underlying conduct contradicts what the religious activity is supposed to express, the religious activity becomes itself an additional offense rather than a mitigation of the conduct. Contemporary elite moral activity, which expresses concern through professional and institutional channels while the underlying conduct produces the conditions of suffering the concern claims to address, falls under the Isaiah indictment. The elites in question are fasting for strife and debate; their public expressions of concern are not the contradiction of their underlying conduct but its accompaniment, and the scriptural judgment on the conjunction is severe.

7. The Pattern of Demanded Deference: Pride, Self-Exaltation, and Their Consequences

A further feature of contemporary elite conduct requiring scriptural treatment is the demand for deference, which is to say the insistence that the elite be granted authority, respect, and benefit of the doubt by those over whom they are placed, even when their conduct has not earned and does not justify such treatment. Scripture treats this pattern under the heading of pride, and the treatment is unambiguous.

Proverbs declares that pride goes before destruction, and an haughty spirit before a fall. The verse is sometimes treated as a moralistic observation, but it is more precisely a description of a causal sequence: pride, by closing the prideful off from the information they require to correct their course, ensures that the destruction that would otherwise be avoidable becomes inevitable. The contemporary elite class’s resistance to recognizing the conditions that have produced popular dissatisfaction, its attribution of that dissatisfaction to mass irrationality or external manipulation rather than to its own conduct, and its determination to continue the conduct that has produced the dissatisfaction while demanding renewed deference, fits the Proverbs pattern. The destruction Proverbs predicts is the destruction of those who cannot be told what they have done, and the contemporary elite arrangement has constructed elaborate institutional defenses against being told.

Isaiah’s treatment of the king of Babylon, sometimes read also as addressing the spiritual reality behind the human king, captures the inner logic of demanded deference with precision. The aspiration is to ascend into heaven, to exalt the throne above the stars of God, to sit upon the mount of the congregation, to ascend above the heights of the clouds, to be like the most High. The pattern is one of self-exaltation that aspires to displace the actual authority by which the would-be exalter was constituted. The contemporary elite pretension to authority over questions of value, meaning, and moral judgment that Scripture reserves to God, exercised through institutions that claim to speak with authority on these matters by virtue of their professional standing, is recognizable in Isaiah’s denunciation. The judgment is that the would-be exalter is brought down to hell, to the sides of the pit, and is observed by those who see him with the question, Is this the man that made the earth to tremble, that did shake kingdoms? The contemporary inflated self-conception of expert and professional elites is set up for precisely the deflation Isaiah describes, and the eventual recognition of the gap between the pretension and the actual standing of those exercising it.

Christ addresses the same pattern directly when He observes that the kings of the Gentiles exercise lordship over them, and they that exercise authority upon them are called benefactors. The Gentile pattern of authority, in which those exercising it both lord it over their subjects and arrange for themselves to be called benefactors regardless of whether they confer benefit, is identified by Christ as precisely the pattern His disciples are not to follow. The contrast He develops is that the greatest among them is to be as the younger, and he that is chief, as he that does serve. The substance of authority in the kingdom Christ establishes is service rather than lordship, and the marker of that service is that it actually serves rather than that it claims to serve while extracting the deference and benefit that lordship would extract. The contemporary elite pattern, which is precisely the Gentile pattern Christ identified, does not become exempt from His denunciation by virtue of operating in formally democratic or representative systems; the substance is the same as the substance Christ rejected, and the rejection extends to it.

8. The Severity of the Judgment Pronounced

The cumulative scriptural indictment of the pattern of conduct under examination is severe, and the severity merits direct statement rather than the softening that contemporary discourse would prefer. Scripture does not treat the conduct of elites who say and do not, who feed themselves rather than the flock, who heal the hurt slightly while pronouncing peace where there is no peace, who lie on beds of ivory while indifferent to the affliction of the people, who demand deference for authority they have not earned, and who perceive themselves as caring while their conduct produces suffering, as an unfortunate political condition requiring sympathetic management. It treats it as a recognizable spiritual condition under judgment, and the judgment pronounced is comprehensive.

The judgments specified across the texts include: the withdrawal of the flock from the shepherds and the cessation of their feeding function, as in Ezekiel 34; the destruction of the institutions in which the corrupt elites took refuge, as in Micah 3; the captivity of the comfortable as among the first to go into captivity, as in Amos 6; the bringing down of the proud to the sides of the pit, as in Isaiah 14; the woe pronounced upon those who say and do not, who shut up the kingdom of heaven against men and neither enter themselves nor allow those who would, who compass sea and land to make one proselyte and make him twofold more the child of hell than themselves, as in Matthew 23; and the stricter judgment that James warns falls on teachers and that Christ specifies for those to whom much has been given. The severity is consistent across the canon, and any contemporary attempt to apply the framework Scripture provides must apply the severity that framework requires, rather than substituting a moderated version that would be more acceptable to those it indicts.

It must also be said that the scriptural judgment is not exhausted by the temporal consequences the prophets describe. The judgment specified in the New Testament is eschatological as well as historical, and the woes pronounced by Christ on the scribes and Pharisees include the explicit warning that they shall receive the greater damnation. The contemporary inclination to treat elite failure as merely a question of political correction within history is inadequate to the scriptural framework, which treats it as a question with consequences extending beyond history into the judgment that follows it. The elite class that has failed in the manner Scripture describes is not merely facing the political consequences of its conduct within history, which may or may not arrive in any individual case; it is facing the eschatological consequences that no political arrangement can defer, and on that point the testimony of Scripture is unified and severe.

9. The Remedy Scripture Prescribes

Scripture does not pronounce judgment without also indicating the remedy by which judgment may be averted, and the framework would be incomplete without attention to it. The remedy is specified in different terms in different texts, but the substance is consistent: it is repentance, by which is meant a real and observable change of conduct, accepted at personal cost, accompanied by restitution where restitution is possible, and sustained over time.

The pattern is established in Old Testament texts that address the conduct of rulers and elites directly. The Lord’s instruction through Isaiah, that the fast He has chosen is the loosing of the bands of wickedness and the undoing of heavy burdens, specifies what repentant elite conduct would actually look like: the surrender of the apparatus by which the powerful are advantaged over the weak, the removal of the heavy burdens the elites have laid on others, the practical liberation of those who have been oppressed by elite arrangements. The instruction through Jeremiah, that the king of Judah should execute judgment and righteousness, deliver the spoiled out of the hand of the oppressor, and do no wrong, do no violence to the stranger, the fatherless, nor the widow, specifies the substance of what righteous rule would require. The remedy is not the moderation of unrighteous conduct but its replacement with conduct of the opposite kind.

In the New Testament, the pattern is developed further. John the Baptist, when asked by various groups what they should do, gave answers specific to the conduct of each group. To the tax collectors he said, exact no more than that which is appointed you. To the soldiers he said, do violence to no man, neither accuse any falsely, and be content with your wages. To the multitudes he said, he that has two coats, let him impart to him that has none, and he that has meat, let him do likewise. The remedy specified is not generalized but specific to the conduct that needed changing in each case. Applied to contemporary elites, this would mean specific corrections to the specific patterns of conduct that have produced the credibility failure: the abandonment of self-exemption, the surrender of regulatory capture, the acceptance of personal consequences for institutional failure, the substitution of competence for credentialing, the alignment of expressed concern with demonstrated behavior, and the restoration of mediating institutions through which elites and the governed could be exposed to one another.

Christ’s instruction to Zacchaeus, or rather Zacchaeus’ own declaration of what his repentance would mean, is also instructive: behold, Lord, the half of my goods I give to the poor; and if I have taken any thing from any man by false accusation, I restore him fourfold. The substance of the repentance includes restitution at a multiple of what was wrongly taken, not merely the cessation of the wrongful taking. The contemporary elite class that has accumulated wealth, status, and power through arrangements that have damaged the populations under its rule would, under the Zacchaeus pattern, owe restitution at a multiple of what those arrangements yielded, not merely an end to the arrangements going forward. This is a severe requirement, and it is unlikely to be undertaken voluntarily, but it is the requirement Scripture establishes, and any lesser response falls short of what the framework would describe as actual repentance.

The remedy, finally, is available to particular individuals more readily than to collective elite classes. Scripture’s pattern is that repentance is undertaken by persons, who then either find others willing to undertake it with them or who, more often, find themselves separated from the unrepentant class to which they previously belonged. The contemporary application is that individual members of elite institutions may undertake the remedy Scripture prescribes, at personal cost to themselves, even when the institutions as a whole do not. Such individuals will not generally restore the credibility of the institutions to which they previously belonged; they will more likely find themselves expelled from those institutions, as has been the historical pattern when persons of conscience have departed from the conduct of the elite classes around them. But the remedy is available to them as persons, and the eschatological judgment Scripture describes attaches to persons in the end, not to institutions, so the individual remedy is the substantial one in any case.

10. The Position of Those Under Elite Conduct

A final matter requires scriptural treatment, which is the position of those who are themselves under the conduct of failed elites. Scripture addresses this position as well, and the instruction it provides differs in important respects from what contemporary political discourse would suggest.

The first instruction is that the governed are not to extend deference to elite conduct that does not deserve it, but they are also not to extend their judgment of elite conduct into rebellion against the structures of authority as such. The distinction is important. Daniel’s response to Nebuchadnezzar, who was a ruler of considerable violence and idolatry, was both to give him honor as a king delegated by God and to refuse the specific commands that contradicted obedience to God. Daniel did not rebel against Nebuchadnezzar’s authority as a structure; he refused particular exercises of it that crossed the line into the demand for actions God forbade. The Hebrew children in the fiery furnace did the same, as did Daniel in the lions’ den, and as did the apostles when commanded by the Sanhedrin to cease preaching in the name of Christ, replying that they ought to obey God rather than men. The pattern is consistent: refusal of unlawful commands, accompanied by acceptance of the consequences of refusal, while continuing to honor the structure of authority as a structure even when its particular occupants are unworthy of it.

The second instruction is that those under failed elite conduct are not to suppose that their own righteousness is established by their dissatisfaction with the elites who have failed them. The contemporary inclination to identify with the populist rejection of corrupt elites carries with it the temptation to suppose that the rejection is itself a sufficient virtue. Scripture does not allow this supposition. The populations that suffered under the corrupt elites the prophets denounced were themselves often complicit in the conditions of corruption, and the prophets typically denounced both the rulers and the people in the same chapters. The contemporary application is that those dissatisfied with the conduct of elites must examine their own conduct as well, applying the same scriptural standard to themselves that they apply to those above them, and not supposing that the failures of elites license relaxation of the standards that would otherwise apply to ordinary persons.

The third instruction is that the substantial hope of those under failed elite conduct is not the conversion of those elites, which is unlikely, nor the political displacement of them, which is uncertain in its results, but the action of the One whose authority all human authority derives from and who reserves to Himself the final correction of the conditions that human authority has produced. This is the consistent testimony of the prophetic literature, which combines unflinching denunciation of present elite conduct with the assurance that God Himself will eventually intervene to correct what the human apparatus has failed to correct. The position of those under failed elite conduct is therefore one of patient endurance combined with practical faithfulness, refusing to extend deference where it has not been earned, refusing the unlawful commands that may be imposed, and waiting for the deliverance that Scripture promises will eventually arrive.

11. Conclusion

The pattern of conduct exhibited by contemporary political, institutional, and cultural elites is not a novel phenomenon requiring novel evaluation. It is a recognizable pattern that Scripture identifies, addresses, and judges in considerable detail across both Testaments. The pattern of those who say and do not, of shepherds who feed themselves rather than the flock, of those who heal the hurt slightly and pronounce peace where there is no peace, of those who lie on beds of ivory while indifferent to the affliction of the people, of those who demand deference while their conduct does not warrant it, and of those who perceive themselves as caring while their conduct produces suffering, is the pattern Scripture denounces with consistency and severity from Moses to the Apocalypse. The contemporary elite class that exhibits this pattern is under the judgment Scripture pronounces on it, and no amount of self-justification, institutional protection, or cooperative media coverage will avert that judgment in the end.

The remedy is available, but it is severe, requiring real and observable change of conduct, accepted at personal cost, accompanied by restitution, and sustained over time. The remedy is more likely to be undertaken by particular persons than by elite classes as a whole, and those persons are likely to find themselves separated from the classes they previously belonged to. The position of those under failed elite conduct is one of refused deference, refused unlawful command, patient endurance, and faithful waiting for the deliverance Scripture promises. The judgment Scripture pronounces on the unrepentant elites extends beyond history into the judgment that follows it, and on that point Scripture’s testimony is unified, severe, and not subject to softening by any contemporary discourse that would prefer to evaluate the matter on lesser terms.

The biblicist conclusion is that the present condition of elite-popular relations in the developed world is, in scriptural terms, a condition of judgment already in progress. The withdrawal of deference by ordinary people is not principally a political phenomenon to be managed but a recognition, partial and imperfect, of the conduct Scripture identifies as deserving the withdrawal. The conditions under which that deference might be restored are the conditions of genuine repentance by the elite class, which on the evidence of present conduct is not in prospect. The eventual resolution will therefore be by other means than elite repentance, whether through political displacement within history or through the eschatological correction that Scripture promises, and the present task of the biblicist observer is to identify the conduct as Scripture identifies it, to refuse the deference Scripture would not extend to it, and to wait in patient faithfulness for the deliverance that Scripture promises will arrive in its time.

Posted in Bible, Christianity, Church of God, Musings | Tagged , , , | Leave a comment