At JASP, we conduct thorough internal tests to ensure the highest quality of our software. In order to confirm that the results from JASP are reliable and accurate, we use a series of robust testing procedures, including automated unit tests, manual verification, and comparisons with recognized benchmarks. Our top priority is to deliver results you can trust.
Unit Tests
All JASP modules are safeguarded by automated unit tests, which play a crucial role in maintaining the integrity of the software. These tests ensure that any modifications to the source code do not affect previously validated results, providing confidence that updates and improvements preserve the accuracy and reliability of the analyses.
Manual Verification
In addition to automatic tests, we also manually conduct a variety of tests on the release candidates and the final installers. This constitutes, for example, refreshing a library of jasp files and validating that the results do not change.
Comparison to Other Software
A key benchmark for validating the results from JASP results is the comparison to the results from other widely-used statistical software. A dedicated verification project compares the results from JASP to those obtained from other software and from manual calculations. The findings are available at https://jasp-stats.github.io/jasp-verification-project/. Additionally, the textbooks “Discovering Statistics Using JASP” (2025) and “Learning Statistics with JASP: A Tutorial for Psychology Students and Other Beginners” have demonstrated that JASP produces results consistent with SPSS and R in their worked examples.
Community Feedback
JASP is used at universities, hospitals, and companies worldwide. Whenever something is unclear, users can post an issue on the JASP Forum or the JASP GitHub page, and this way the JASP software is subject to a continual audit from a large community of users inside and outside of academia.
Open Source
JASP is an open-source software built on the statistical programming language R, which is the lingua franca in the field of statistics. Users have access to the underlying R code at different levels. For instance, the R code executed within JASP is open to inspection, including the underlying formulas and R packages used for computations. This transparency enables any user to verify the JASP results. The source code is publicly available at https://github.com/jasp-stats.