Up close and personal | Nature Human Behaviour

Up close and personal | Nature Human Behaviour

Play all audios:

Loading...

We spend a lot of time on the manuscripts we publish, from pre-review evaluation and finding reviewers to post-review decisions and revision evaluations. However, we reserve the closest


level of scrutiny for manuscripts that have successfully passed the peer review process and are in preparation for acceptance. Credit: Daniel Kulinski/Moment/Getty Before accepting a


manuscript, we perform dozens of checks. Several of these checks are intended to ensure the accuracy and transparency of the manuscript, as well as its accessibility for a broad audience.


Here, we highlight some of the key checks we perform that authors need to address before their manuscript can be accepted for publication (Box 1). Although we may have raised some of these


issues earlier in the consideration process (for example, before sending a manuscript out to review or when inviting a revision), this is our final opportunity to make sure everything is in


order. This means that we spend considerable time evaluating the final draft of manuscripts we are accepting in principle, and this process usually involves one or more rounds of detailed


editorial checks. BOX 1 ABRIDGED EDITORIAL CHECKLIST FOR _NATURE HUMAN BEHAVIOUR_ These are some of the checks that the _Nature Human Behaviour_ editors perform before accepting a manuscript


for publication (additional checks apply to clinical trials, systematic reviews and meta-analyses). These checks assess whether the: TITLE * is unclear * overgeneralizes or overstates the


key finding * makes an unwarranted novelty or priority claim * makes an unwarranted causal claim * interprets absence of evidence as evidence of absence * omits the population studied (where


relevant) * uses non-inclusive language ABSTRACT * is poorly structured or presented * makes unwarranted novelty or priority claims * makes unwarranted causal claims * includes qualitative


characterizations of the work (‘most comprehensive’, ‘highly rigorous’, and so on) * omits the population studied (where relevant) * omits sample sizes (where relevant) * omits effects sizes


and confidence intervals (where relevant) * overstates the results * includes positive discussion of numerical differences that were not supported by the statistical tests * interprets


absence of evidence as evidence of absence * overstates the implications of the work * uses non-inclusive language MAIN TEXT: GENERAL * reframes or changes research questions, hypotheses


and/or predictions from previous versions of the manuscript or from preregistration (for confirmatory research) * recycles text from other work without acknowledgement * makes unwarranted


novelty or priority claims * makes unwarranted causal claims * includes qualitative characterizations of the work (‘most comprehensive’, ‘highly rigorous’ and so on) * includes mention of


named individuals * includes claims that may be considered libellous * includes mention of commercial products, services or organizations that may be perceived as advertising * uses


non-inclusive language MAIN TEXT: RESULTS * include results statements that are not accompanied by reported statistics * fail to report frequentist inferential statistics in full (statistic


(degrees of freedom) = value; _P_ = value; effect size statistic = value; and confidence intervals = values) * report inexact _P_ values * infer differences between studies or conditions on


the basis of comparison of statistical significance levels without using formal statistical tests of the difference itself * declare statistical significance at an alpha level higher than


0.05 without preregistration and robust justification * describe the results of statistical tests with _P_ values in the range 0.05–0.15 as ‘marginally significant’ rather than as not


statistically significant * interpret ‘marginally significant’ results as providing support for the hypotheses tested * inappropriately report null effects * include a main result that is


null, without the authors having carried out appropriate statistical tests (for example, Bayes factors or equivalence tests) to be able to interpret the null effect * have a main result that


is null, without the authors having provided evidence that the study is sufficiently powered to detect the smallest theoretically or practically meaningful effect size * lack correction for


multiple comparisons * are missing specification of whether tests were one- or two-tailed * report one-tailed tests without the research having been preregistered * omit mention of whether


the data met the assumptions of the statistical tests used * fail to report Bayesian analyses in full * include actual analyses that differ from those preregistered * include ‘data not


shown’ in the text MAIN TEXT: DISCUSSION * includes interpretations of the evidence that do not match the results * lacks discussion of limitations * overstates the significance or


implications of the work METHODS: HUMAN PARTICIPANTS RESEARCH * have no mention of ethics review or waiver * mention ethics review but not the committee name * mention ethics approval but


not the protocol number * are missing information on informed consent * are missing information on participant compensation * are missing key demographic information on participants (sex or


gender, number or age) METHODS: ANIMAL RESEARCH * are missing a statement that confirms that research complies with all relevant ethical regulations * have no mention of ethics review *


mention ethics review but not the committee name * mention ethics approval but not the protocol number * are missing a statement that confirms that the ARRIVE guidelines were used to report


the research METHODS: PREREGISTRATION * mention preregistration but have a private or inactive link to preregistration * are missing the date of preregistration * include undisclosed


deviations from the preregistration METHODS: ALL RESEARCH REPORTING PRIMARY (EXPERIMENTAL) DATA * have no statement to indicate how sample sizes were chosen * have no statement on


randomization * have no statement on blinding * have no statement on participant or data point exclusion METHODS: SECONDARY DATA * include data that are not publicly available, without


permission from the dataset owner or owners being sought * include data that are not publicly available, without consent for use in academic research being sought from those who contributed


data * have an application for data access that does not match the purpose for which the data are used in the manuscript * merge datasets (public or otherwise) from multiple sources for the


same group of individuals and present an identifiability risk * include data that are publicly available, but that are sensitive and raise concerns about informed consent DATA AVAILABILITY *


statement is missing * states that data are unavailable * states that data are available upon request, but with no explanation as to why they are not made publicly available * statement


includes wording that data are available ‘upon reasonable request’ * includes a link to deposited data that is private or not active CODE AVAILABILITY * statement is required, but is missing


* states that code is unavailable * states that code is available upon request, but with no explanation as to why it is not made publicly available * statement includes wording that code is


available ‘upon reasonable request’ * includes a link to deposited code that is private or not active FIGURES AND TABLES * include graph axes that are used inappropriately to exaggerate


effects * use a data visualization format that does not show data distribution * use asterisks to indicate statistical significance * use red–green overlay images (which are unsuitable for


those who are colour blind) * do not fully report statistics (for tables) ACKNOWLEDGEMENTS * are missing funder information * are missing a declaration of the role of funders in the research


and its publication * acknowledge individuals whose contribution appears to merit authorship AUTHOR CONTRIBUTIONS * statement is missing COMPETING INTERESTS * statement is missing *


statement is not transparent enough * declares financial competing interests only * statement omits obvious competing interests (for example, commercial affiliation) TITLES AND ABSTRACTS We


pay close attention to titles and abstracts. Frequently, these are the only parts of a published article that readers will access, and it is essential to get them right. Titles are


occasionally too general, overstate the results, make novelty claims or unwarranted causal claims, or omit the population or populations studied (where relevant). We frequently suggest


different titles that more closely reflect the scope and evidence of a paper. Abstracts are a mini version of the paper and can be challenging to write given length constraints (150 words


for most manuscript types). We may recommend modifications to the abstract or suggest a different abstract to ensure that it summarizes past research and the current work accurately,


provides all key information (including sample sizes, effect sizes and confidence intervals, where relevant), and does not overstate the significance or implications of the work1. NOVELTY


CLAIMS AND EXAGGERATED LANGUAGE In most disciplines, novelty or priority is impossible to ascertain. As a policy, we ask authors not to make novelty or priority claims in their manuscripts


(except in genetics and archaeology) and to avoid qualitative characterizations of their own work2. Before accepting manuscripts for publication, we read them closely to make sure they are


free of novelty claims or exaggerated claims of significance, scale or quality. A piece of research is more credible if readers are allowed to form their own opinion of the value of the


work. CAUSAL CLAIMS For quantitative studies, one of the most common issues we encounter is the interpretation of associations as causal evidence3. Descriptive or predictive work is


important and valuable, but it should be presented as such. We ask authors to ensure that the language they use is appropriate for the type of evidence they report and to remove or revise


wording that implies directionality when no causal evidence is presented. INCLUSIVE LANGUAGE Several of the manuscripts we publish report research on human population groups based on social


characteristics such as gender, race or ethnicity, religion or socioeconomic status. Inclusive language is important in these manuscripts to avoid stigmatizing the studied groups or


perpetuating societal prejudice. We rely on the American Psychological Association’s inclusive language guidelines and guide to bias-free language, as well as internal resources, to


recommend changes to language that may be unintentionally harmful for the groups studied. STATISTICS Statistical reporting is the area in which we encounter the greatest number of issues. In


a recent editorial, we explained our requirements for statistical reporting4. We perform thorough checks on statistics to ensure compliance with our requirements. APPROPRIATE INTERPRETATION


OF THE RESULTS Occasionally, the interpretation of a study’s findings is not aligned with the statistical evidence. For example, the results of a Bayes factor test with a value close to 1


may be interpreted as providing support for the hypothesis, but would be more appropriately interpreted as largely inconclusive. In other cases, a numerical difference between two conditions


may be interpreted as theoretically or practically meaningful even though the null-hypothesis significance test did not yield statistically significant results. Or a very small but


statistically significant effect size is interpreted as important without any consideration of effect size. We read the results and discussion sections of our manuscripts carefully to make


sure that all claims and interpretations are directly supported by the statistical analyses that the authors performed. LIMITATIONS All studies have limitations. Being transparent about


limitations and discussing them appropriately (without minimizing their potential impact) does not detract from the value of the work. On the contrary, it enhancesits credibility. We require


the inclusion of a discussion of limitations all our manuscripts. We may also make suggestions on limitations that are necessary to discuss or how limitations are presented. In cases in


which there is a risk of misinterpretation of the work, we suggest that key limitations are also mentioned in the abstract. PREREGISTRATION We prioritize preregistered research for peer


review and ultimate publication5. However, for preregistration to be meaningful, it needs to be followed6. For manuscripts that report preregistered research, we read the preregistration


carefully and compare it to what is reported in the manuscript. We pay close attention to the hypotheses and outcome measures in the preregistration and whether they match those reported in


the manuscript. We scrutinize the analysis plan and check whether it was followed in the manuscript. In cases of deviation from the preregistration, we ask authors to report hypotheses and


outcome measures as they were preregistered. If the authors deviated from their analysis plan, we require that authors declare the deviations and report the preregistered analyses alongside


the ones reported in the manuscript, except if those analyses proved to be unfeasible or wrong. FIGURES Figures are a key part of empirical research manuscripts: they tell the ‘story’ of a


manuscript visually and enable a closer examination of the empirical claims in the work. Although we comment on several aspects of the figures (and their legends), there are some frequent


requests that we make. We discourage the use of bar charts for continuous variables. Instead, we recommend visual representation formats that show data distribution clearly: for example, dot


plots, box-and-whisker plots or violin plots. If the authors prefer to use bar charts, we ask that they overlay the corresponding data points (as dot plots) whenever possible and always for


_n_ ≤ 10. For figures that present graphs, we ask that graph axes start at 0 and are not altered in scale to exaggerate effects (a discontinuity symbol can be used if necessary, but it


should be prominent to avoid misinterpretation of effect size). Finally, we do not allow ‘data not shown’. We ask authors to either show the data or remove any mention of them. ETHICS If a


manuscript reports the results of research with human participants or nonhuman animals, we ask that the Methods section starts with a statement that confirms that the research complies with


all relevant ethical regulations and naming the board and institution that approved the study protocol (including protocol number). For research with human participants, we also ask that


authors confirm that informed consent was obtained from all participants. Information on participant compensation should also be included. Manuscripts reporting research with non-human


animals should additionally confirm that the ARRIVE (Animal Research: Reporting of In Vivo Research) guidelines were used to report the research. A lot of the work that we publish involves


the use of secondary, administrative, proprietary or digital data (such as from social media platforms). In most jurisdictions, this work is exempt from ethics review but poses some of the


same ethical challenges as research with primary data7. In these cases, we typically have already obtained ethics or legal advice from an appropriate expert in earlier stages of processing a


manuscript. However, before acceptance, we make sure that the datasets used comply with considerations of informed consent, privacy and minimization of harm. If the data were obtained on


application, we ask for confirmation that the use to which the data were put complies with the content of the application. DATA AND CODE AVAILABILITY The availability of code is essential


for verification and reproduction of the evidence and claims in the manuscript. For this reason, we do not publish papers for which the underlying data cannot be made available or cannot be


obtained by a third party under any circumstances. We encourage the public deposition of datasets if there are no ethical or legal constraints. When the data are only available ‘upon


request’, we ask that authors explain in their data availability statement why this is so. We also do not allow the inclusion of the word ‘reasonable’ (‘upon reasonable request’) in such


statements. What is considered ‘reasonable’ is subjective and the statement could be used to deny legitimate requests for data sharing. Specific restrictions (for example, the requirement


for ethics approval or a data sharing agreement) should be described. For manuscripts for which code is a central part of the work, we also require that authors provide a code availability


statement. The same requirements for access and availability to code apply as for data availability. COMPETING INTERESTS AND ROLE OF THE FUNDERS A competing interest is not disqualifying for


primary research. However, it is crucial that all competing interests — both financial and nonfinancial — be transparently reported in sufficient detail. We also ask authors to declare what


role, if any, the funders had in the conduct of their study, the content of the manuscript or the decision to publish. Funder involvement in the work should be declared as a competing


interest. CLINICAL TRIALS AND SYSTEMATIC REVIEWS For clinical trials, systematic reviews and meta-analyses, we perform several additional checks. We mandate prospective registration in a


clinical trial registry for all clinical trials. We also ask that authors of clinical trials include a CONSORT (Consolidated Standard of Reporting Trials) checklist with their manuscripts.


We require a suitable PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) checklist, or equivalent, for systematic reviews and meta-analyses. In these cases, we check


compliance and completeness of reporting against the requisite checklist. For editors, the pre-acceptance process is quite involved and time-consuming. The process is equally demanding for


authors, who may need to make several revisions to their manuscripts before they can be accepted. However, the process invariably improves the rigour, transparency and accessibility of the


work that we publish. REFERENCES * _Nat. Hum. Behav_. 7, 465 (2023). * _Nat. Hum. Behav_. 5, 175 (2021). * _Nat. Hum. Behav_. 5, 1261 (2021). * _Nat. Hum. Behav_. 7, 293–294 (2023). * _Nat.


Hum. Behav_. 3, 1127–1128 (2019). * _Nat. Hum. Behav_. 4, 1 (2020). * _Nat. Hum. Behav._ 6, 1321–1323 (2022) Download references RIGHTS AND PERMISSIONS Reprints and permissions ABOUT THIS


ARTICLE CITE THIS ARTICLE Up close and personal. _Nat Hum Behav_ 7, 1601–1604 (2023). https://doi.org/10.1038/s41562-023-01753-z Download citation * Published: 20 October 2023 * Issue Date:


October 2023 * DOI: https://doi.org/10.1038/s41562-023-01753-z SHARE THIS ARTICLE Anyone you share the following link with will be able to read this content: Get shareable link Sorry, a


shareable link is not currently available for this article. Copy to clipboard Provided by the Springer Nature SharedIt content-sharing initiative