2  Scientific knowledge and non-scientific knowledge

Learning Outcomes

• Students can describe differences between scientific knowledge and non-scientific knowledge
• Students can list quality criteria for scientific methods

2.1 Introduction

How can scientific knowledge be differentiated from non-scientific knowledge, such as for example, everyday knowledge, that we acquire and apply day by day? Especially in times of “fake news”, the “post-truth area” and a “knowledge crisis” (Hopf et al. 2019), this question is more crucial than ever. Because, depending on the discipline, in which they have been trained, different scientists might answer this question slightly differently. In our understanding, we follow the definitions of Bhattacherjee et al. (2019) in their introduction to social science research:

• Science is a structured and systematic body of knowledge of different areas, developed through “the scientific method”, with the primary goal of producing scientific knowledge. (p. 5-6)
• Scientific knowledge represents a generalised body of theories and laws to explain particular phenomena or behaviours, that have been collected using the scientific method. Laws are observed patterns or behaviours, while theories offer structured explanations for those laws.The goal of scientific research is to discover these laws and propose theories, building scientific knowledge, though this knowledge may be limited or even inaccurate in some cases. Scientific knowledge does not offer a single truth but rather a spectrum of multiple truths, as the theories and laws are based on the explanations of the individual scientist and the context, which over time can evolve as well. Scientific knowledge is derived from a process of logic (theory) and evidence (observations). (p. 6-7)
• Scientific method refers to a standardised body of techniques to produce scientific knowledge, such as guidelines for valid observations or the interpretation and generalisation of results. This allows researchers to individually and independently test existing theories and findings, allowing for open discussion, revision, or improvement. (p. 9)

Thus, it can be said, that scientific knowledge is the product of a research process, in which scientific methods are applied.

Table 2.1: Distinctions between scientific and everyday knowledge.

	Everyday knowledge	Scientific knowledge
Formation	Through experience	Based on scientific methods, i.e., verifiability / falsifiability of studies, transparent result
Objectivity	Direct link between knowledge and person (subjectively influenced)	Separation of knowledge and person (intersubjectivity)
Dissemination / Communication	Everyday language, routines, publications in newspapers etc.	Scientific language, Publication as textbooks, articles in peer-reviewed academic journals

2.2 Quality criteria of scientific methods

The question of how scientific knowledge was generated (i.e., which methods were used) is therefore crucial to the differentiation of scientific knowledge from non-scientific knowledge. Different quality criteria have been established both between different disciplines and within schools of thought within disciplines, which are used to evaluate the scientific methods used. In other words, here too, different disciplines have divergent understandings of what is considered a “good” scientific method, and thus the knowledge produced is also considered valid. Here are some examples (this is not an exhaustive list):

• Natural Sciences: Empirical Evidence, Falsifiability (Popper, 2002), Reproducibility (Mayo, 1996), Objectivity (Chalmers, 1999).
• Quantitative Social Sciences: Replicablity, Precision, Falsifiability, Parsimony (Bhattacherjee, et al., 2019), Transparency and Reproduciability (Hardwicke et al., 2020).
• Qualitative Social Sciences: Credibility, Transferability, Dependability and Comfortability (Yadav, 2022).
• Humanities: Interpretative Depth (Ricoeu, 1981), Coherence (Gadamer, 2004), Historical Contextualization (Skinner, 2002), Ciritcal Engagement (Eagleton, 2008).
• Philosophy: Consistency, Coherence, and Correspondence (Reichling, 1996), Argumentative Rigor (Russell, 1912).
• Law: Legal Precedent (Dworkin, 1977), Argumentation & Reasoning (Fuller, 1969), Doctrinal Accuracy (Posner, 203), Normative Clarity (Habermas, 1996)

2.3 Quality criteria of trandisciplinary research

Sustainability sciences often follow transdisciplinary research designs. Belcher et al. (2016) describe transdisciplinary research as crossing disciplinary and institutional boundaries, and as being context specific, and problem oriented. Moreover, it combines and blends methodologies from different theoretical paradigms, includes a diversity of both academic and societal actors, and is conducted with a range of research goals, organizational forms, and outputs. It is widely acknowledged that complex and wicked social problems, as those who are the research topics of sustainability sciences, as well as the claim to contribute to reals world solutions, are best approaches by such comprehensive and holistic approaches such as provided by transdisciplinary research designs. However, as boundaries between disciplines are crossed, and as research engages more with stakeholders in complex systems, traditional academic definitions and criteria of research quality are no longer sufficient—there is a need for a parallel evolution of principles and criteria to define and evaluate research quality in a transdisciplinary research context. This is, why Belcher et al. (2016) propose, based on a comprehensive literature review, the following four quality criteria for transdisciplinary research (cf. Table 3 in Belcher et al. 2016):

• Relevance: The importance, significance, and usefulness of the research problem, objectives, processes, and findings to the problem context
• Credibility: The research findings are robust and the sources of knowledge are dependable. This includes clear demonstration of the adequacy of the data and the methods used to procure the data including clearly presented and logical interpretation of findings
• Legitimacy: The research process is perceived as fair and ethical. This encompasses the ethical and fair representation of all involved and the appropriate and genuine inclusion and consideration of diverse participants, values, interests, and perspectives
• Effectiveness: The research generates knowledge and stimulates actions that address the problem and contribute to solutions and innovation

The quality of transdisciplinary knowledge production therefore does not follow any rigid quality criteria of disciplinary research paradigms. Rather, various methodological approaches are combined, depending on the best fit with the desired research objectives and questions, with regard to the inclusion of all participants, and with regard to implementation and solution-orientation. The selected research approaches are implemented in such a way as to maximise credibility. Following Belcher et al. (2016), credible high-quality research is authoritative, transparent, defensible, believable, and rigorous. For this, traditional disciplinary criteria can be applied to transdisciplinary research. However, additional and modified criteria are needed to address the integration of epistemologies and methodologies and the development of novel methods through collaboration, the broad preparation and competencies required to carry out the research, and the need for reflection and adaptation when operating in complex systems.

For scientists who engage in or evaluate transdisciplinary research, this means that they should be open to and tolerant of different scientific methods and corresponding comprehensive set of quality criteria.

Moreover, Walter and Kremer (2023, 340) argue that within transdisciplinary learning contexts, the different cultures of knowledge provide the potential for a more holistic reflection, and therefore more comprehensive understanding. Persons who intend to collaborate in a transdisciplinary research project or educational task should reflect on and communicate their sources of knowledge, its reliability, and limitations. Conscious discussion may enhance mutual understanding for different approaches, documentation, and methodologies in scientific knowledge acquisition and therefore may prevent possible misconceptions. In addition, this reflection may help to identify common points of contact and complementary additions to the various disciplinary levels of knowledge, thereby enhancing mutual learning.

2.4 Assessing the quality of scientific publications

However, the methodological openness and diversity of transdisciplinary research does not mean that “everything” is possible and permitted. Rather, the transparent disclosure of sources and decisions made, the quality of the underlying data and the comprehensibility of interpretations are central to gaining confidence in the quality of the knowledge gained. In view of the possibilities created by intelligent systems (e.g., AI) in the production of knowledge, many researchers are also tempted to resort to questionable methods in the production of knowledge (see examples in Lüscher 2019). So, how can you recognise whether a scientific publication (especially if it does not originate from your own discipline) is of high quality?
We suggest the following questions that can be asked of a publication in order to assess its quality:

What is the quality of the content?

• The aformentioned quality criteria can be applied here

Who is/are the author(s)?

• Is/are the author(s) writing about a topic on which they are also conducting research (or are they commenting on topics that do not correspond to their primary research)?
• Does the author(s) have a reputation in this field?
• Might there be any conflicts of interest?

Who is the publisher?

• Does the publisher specialise in scientific publications in the relevant subject area?
• What is the reputation of the publisher (see list of predatory publishers)?
• Might there be any conflicts of interest?

Who is the target audience?

• Was the publication written for a scientific audience (or is it, for example, a textbook for students or a specialist article for a non-scientific audience)?

How was the publication received in the scientific community?

• Has the publication been cited by others (cf. citation indices)?
• Are there any reviews?

Please note that there is no simple yes-no answer regarding the quality of publications. Rather, this is determined gradually on the basis of multi-dimensional considerations.

Belcher, Brian M., Katherine E. Rasmussen, Matthew R. Kemshaw, and Deborah A. Zornes. 2016. “Defining and Assessing Research Quality in a Transdisciplinary Context.” Research Evaluation 25 (1): 1–17. https://doi.org/10.1093/reseval/rvv025.

Bhattacherjee, Anol, Mark Toleman, Samara Rowling, Anita Frederiks, and Nikki Andersen. 2019. “Social Science Research: Principles, Methods and Practices.” Edited by Samara Rowling. https://doi.org/10.26192/Q7W89.

Hopf, Henning, Alain Krief, Goverdhan Mehta, and Stephen A. Matlin. 2019. “Fake Science and the Knowledge Crisis: Ignorance Can Be Fatal.” Royal Society Open Science 6 (5): 190161. https://doi.org/10.1098/rsos.190161.

Lüscher, Thomas F. 2019. “Honesty and Truth in Academic Research and Writing.” In A Guide to the Scientific Career, 139–54. John Wiley & Sons, Ltd. https://doi.org/10.1002/9781118907283.ch17.

Walter, Hildrun, and Kerstin Kremer. 2023. “Scientific Knowledge.” In Handbook Transdisciplinary Learning, edited by Thorsten Philipp and Tobias Schmohl, 1st ed., 6:339–48. Bielefeld, Germany: transcript Verlag. https://doi.org/10.14361/9783839463475-035.