<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:"var\(--font-family-primary\)";
panose-1:0 0 0 0 0 0 0 0 0 0;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
h1
{mso-style-priority:9;
mso-style-link:"Heading 1 Char";
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:24.0pt;
font-family:"Calibri",sans-serif;
font-weight:bold;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri",sans-serif;
color:windowtext;}
span.Heading1Char
{mso-style-name:"Heading 1 Char";
mso-style-priority:9;
mso-style-link:"Heading 1";
font-family:"Calibri",sans-serif;
font-weight:bold;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="#0563C1" vlink="#954F72">
<div class="WordSection1">
<p class="MsoNormal">Interesting paper and use of ChatGPT…<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><a href="https://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Felifesciences.org%2Freviewed-preprints%2F90230%3Futm_source%3Dcontent_alert%26utm_medium%3Demail%26utm_content%3Dfulltext%26utm_campaign%3D4-October-23-elife-alert&data=05%7C01%7Cwomeninmedicine%40list.pitt.edu%7Cf53bf141b55d4cd3dce908dbc4fa50a5%7C9ef9f489e0a04eeb87cc3a526112fd0d%7C1%7C0%7C638320351605111331%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=7Cs3ZpCyzWvwYoUv04M2ywIrmxiSZosliFQie%2FpLlSA%3D&reserved=0" originalsrc="https://elifesciences.org/reviewed-preprints/90230?utm_source=content_alert&utm_medium=email&utm_content=fulltext&utm_campaign=4-October-23-elife-alert" shash="s3+wSNQol+tWeos2uRJGiP1lBIZrXwS80YOuMKQwRR4AUyUey33l1F1bNmNuCccoPkqDohBc/hit/gUr4yvp1Plbc9b+IL+sW6+YxUS/D4aT4MHY/vkccw4rXFawdyLoYlwKBEtGdlh1TYFuvqTpJUoF/iMhggkl9Bbrbp4jUXU=">https://elifesciences.org/reviewed-preprints/90230?utm_source=content_alert&utm_medium=email&utm_content=fulltext&utm_campaign=4-October-23-elife-alert</a><o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;background:white">
<b><span style="font-size:24.0pt;font-family:"var(--font-family-primary)",serif;color:#212121">Abstract<o:p></o:p></span></b></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;background:white">
<span style="font-size:12.0pt;font-family:"Times New Roman",serif;color:#212121">The peer review process is a critical step in ensuring the quality of scientific research. However, its subjectivity has raised concerns. To investigate this issue, I examined
over 500 publicly available peer review reports from 200 published neuroscience papers in 2022-2023. OpenAI’s generative artificial intelligence <i>ChatGPT</i> was used to analyze language use in these reports. It demonstrated superior performance compared
to traditional lexicon- and rule-based language models. As expected, most reviews for these published papers were seen as favorable by <i>ChatGPT</i> (89.8% of reviews), and language use was mostly polite (99.8% of reviews). However, this analysis also demonstrated
high levels of variability in how each reviewer scored the same paper, indicating the presence of subjectivity in the peer review process. The results further revealed that female first authors received less polite reviews than their male peers, indicating
a gender bias in reviewing. In addition, published papers with a female senior author received more favorable reviews than papers with a male senior author, for which I discuss potential causes. Together, this study highlights the potential of generative artificial
intelligence in performing natural language processing of specialized scientific texts. As a proof of concept, I show that <i>ChatGPT</i> can identify areas of concern in scientific peer review, underscoring the importance of transparent peer review in studying
equitability in scientific publishing.<o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><span style="font-size:7.5pt;color:black">_____________________________________________________________________</span><span style="font-size:12.0pt;font-family:"Times New Roman",serif;color:black"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;color:black">Ora A. Weisz, PhD | Professor of Medicine, Cell Biology, and Clinical and Translational Science</span><span style="font-size:12.0pt;font-family:"Times New Roman",serif;color:black"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;color:black">Vice Chair of Faculty Development, Department of Medicine</span><span style="font-size:12.0pt;font-family:"Times New Roman",serif;color:black"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;color:black">Associate Dean for Faculty Development, University of Pittsburgh School of Medicine</span><span style="font-size:12.0pt;font-family:"Times New Roman",serif;color:black"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;color:black">Assistant Vice Chancellor for Faculty Excellence, University of Pittsburgh Health Sciences</span><span style="font-size:12.0pt;font-family:"Times New Roman",serif;color:black"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;color:black">Renal-Electrolyte Division | 978.1 Scaife Hall | 3550 Terrace St. | Pittsburgh PA 15261<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;color:black"><a href="https://www.weiszlab.pitt.edu/"><span style="color:blue">https://www.weiszlab.pitt.edu</span></a><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;color:black">Tel: 412-383-8891 | Email:
<a href="mailto:weisz@pitt.edu"><span style="color:blue">weisz@pitt.edu</span></a></span><o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</body>
</html>