Lightning Talks

MAIN AUDITORIUM

08:45 Monitoring AI-Modified Content at Scale: A Case Study on the Impact of ChatGPT on AI Conference Peer Reviews #221

Weixin Liang (Stanford University)

08:55 Scientists Have an Inherent Prioritized Queue in Selecting Collaborations #104

Miura Chiaki (The University of Tokyo)

ABSTRACT. The temporal dynamics of co-authorship are of significant interest in understanding researchers' topic migration and its relation to impactful research. While longitudinal analyses of persistent collaboration have been conducted, there is ongoing debate about the existence and nature of consistent macroscopic patterns among groups of researchers. We focus on the time intervals of scientists' recurring collaboration, as it reflects the dynamism of researchers’ interests, assuming that individual dyads consistently engage with the same topic. We argue that empirical data suggest a fat-tailed interval distribution in collaboration, which can be explained by the priority selection model.

09:05 Assessing Bias and Idiosyncrasies in Elite Scientific Peer Review #148

Daniel Larremore (University of Colorado Boulder)

ABSTRACT. Peer review at elite journals disproportionately influences the scientific record, society, and the careers and composition of the scientific workforce. As a social process, peer review is susceptible to bias and idiosyncrasy, raising critical questions about fairness and equity, especially at elite venues. Yet, we lack an integrated understanding of such non-meritocratic influences on peer review across fields or at elite venues, because its confidential data are largely inaccessible, limiting reproducibility and theory building. In the uncommon event that access can be secured, or an experiment carried out, the data typically cannot be shared, precluding replication or effective synthesis of published findings, and rendering impossible analyses which would shed light on how editorial processes shape outcome inequalities, or how they vary across disciplines or journal prestige.

09:15 Increased Specialization and Reduced Innovation in Interdisciplinary Teams #51

Yiling Lin (University of Pittsburgh) and Lingfei Wu (University of Pittsburgh)

ABSTRACT. As science grows more complex, the idea of assembling specialized researchers to pursue groundbreaking discoveries has gained momentum—similar to gathering a blacksmith, a mason, and a carpenter to mirror Leonardo da Vinci’s genius. The promise of joining complementary specialists fuels the proliferation of teams in a multitude of scientific domains, especially interdisciplinary ones. However, as the prevalence and size of teams have grown, science has not produced a surge of innovative work as we would expect. Recent research shows that adding more experts to a team does not always boost innovation. This raises a fundamental question: Does pooling the expertise of specialized scientists truly lead to scientific breakthroughs? To investigate, we analyze millions of scientific articles across the full spectrum of science to examine whether and how team members’ expertise impacts innovation. Our findings suggest that even as scientists increasingly specialize in their research fields, interdisciplinary teams of generalists consistently outperform those comprising specialists in making groundbreaking discoveries. In response to the increasing burden of knowledge, scientists often identify team members from complementary specialty areas and divide tasks accordingly to extend their reach. Our results will hopefully prompt science policymakers to revisit the utility of this approach. To meet grand challenges and spur innovative work, it may be more fruitful to foster the “intra-personal interdisciplinarity” of individual scientists and the joining of such broad-thinking generalists into teams.

09:25 An empirical investigation into the production and reception of “mesearch” #57

Molly King (Santa Clara University)

ABSTRACT. Scholars have questioned the ability of social scientists to separate the self from the subject. Nowhere is this more evident than in the practice of “mesearch,” when researchers study a dimension of the social order on which they are marginalized. To better understand the influence of mesearch, we draw on original survey data from 2,850 sociologists linked with their publications in the Web of Science to ask two questions: What is the role of traditionally marginalized groups in creating knowledge about sociodemographic minority groups in sociology? How is mesearch rewarded or penalized within sociology? To study mesearch, we compare the text of paper abstracts with the self-identified demographics of a paper’s authors across not only gender and race, but also sexuality, disability, and family background, which are typically unavailable in bibliometric analyses.

09:35 The increasing fragmentation of global science limits the diffusion of ideas #37

Jianjian Gao (School of Data Science, University of Virginia)

ABSTRACT. The global scientific landscape emerges from a complex interplay of collaboration and competition, where nations vie for dominance while simultaneously fostering the diffusion of knowledge on a global scale. This raises crucial questions: What underlying patterns govern international scientific recognition and influence? How does this structure impact knowledge dissemination? Traditional models view the global scientific ecosystem through a core-periphery lens, with Western nations dominating knowledge production. Here, we investigate the dynamics of international scientific recognition through the lens of national preferences, introducing a novel signed measure to characterize national citation preferences and enabling a network analysis of international scientific recognition. We find that scientific recognition is related to cultural and political factors, as well as economic strength and scientific quality. Our analysis challenges the conventional core-periphery narrative, uncovering instead several communities of international knowledge production that are rapidly fragmenting the scientific recognition ecosystem. Moreover, we provide compelling evidence that this network significantly constrains the diffusion of ideas across international borders. The resulting network framework for global scientific recognition sheds light on the barriers and opportunities for collaboration, innovation, and the equitable recognition of scientific advancements, with significant consequences for policymakers seeking to foster inclusive and impactful international scientific endeavours.