The present scale for measuring study satisfaction is based on The Satisfaction With Life Scale by Diener et al. (1985) and was adapted to the domain of studying in higher education. In two studies, the unidimensional German five-item scale showed good internal consistencies and good model fit. Strict measurement invariance was established for gender, study program, type of higher education institution, and across time. Evidence for the validity of the interpretation of test scores was gathered with satisfactory results. Overall, the scale can be recommended as a valid, reliable, and time-efficient instrument. Furthermore, we validated a three-item and a single-item measure to assess study satisfaction in surveys with severe time constraints. Both short measures have acceptable psychometric properties.
Instruction
No specific instructions are required, but we recommend using the following wording: “To what extent do the following statements apply to your studies?” (“Wie sehr treffen die folgenden Aussagen auf Ihr Studium zu?“).
Items
Table 1
Items of the Scale to Assess Study Satisfaction
No. |
Validated German version |
Unvalidated English version |
1 |
In den meisten Bereichen entspricht mein Studium meinen Idealvorstellungen. |
In most ways my studies are close to my ideal. |
2 |
Meine Studienbedingungen sind ausgezeichnet. |
The conditions of my studies are excellent. |
3 |
Ich bin mit meinem Studium zufrieden. |
I am satisfied with my studies. |
4 |
Bisher habe ich die wesentlichen Dinge erreicht, die ich mir für mein Studium wünsche. |
So far, I have gotten the important things I want in my studies. |
5 |
Wenn ich mein Studium noch einmal beginnen könnte, würde ich kaum etwas ändern. |
If I could start my studies over, I would change almost nothing. |
Note. The unvalidated English version of the Scale is based on the exact wording of the Satisfaction with Life Scale (Diener et al., 1985) with the exception of the words life and live changed to studies and start.
Response specifications
All five items were rated on a seven-point Likert-scale with the response options 1 – completely disagree (trifft überhaupt nicht zu), 2 – disagree (trifft nicht zu), 3 – rather disagree (trifft eher nicht zu), 4 – do not agree nor disagree (teils/ teils), 5 – rather agree (trifft eher zu), 6 – agree (trifft zu), 7 - completely agree (trifft vollkommen zu).
Scoring
All items are positively polarized and are not differentiated into subscales. High values indicate high study satisfaction and low values indicate low study satisfaction. A simple total score for study satisfaction is formed based on all five items. For situations with severe time constraints, study satisfaction can also be measured based on the three-item scale (items 1, 2, and 3) or with a single item (item 3).
Application field
The scale was mainly developed for the assessment of study satisfaction in higher education research. For instance, the scale can be used to identify predictors and consequences of study satisfaction or to investigate the temporal development of study satisfaction over the course of studies. The target group are higher education students of all study programs and all types of higher education institutions (e.g., universities, universities of applied sciences, distance learning universities). The intended survey mode for the scale is online computer-assisted self-administered interviewing, but the scale can also be used with paper-and-pencil self-administered interviewing. Based on the processing time in Study 1, we can confirm that the scale can be answered by most students (88.81 %) in under a minute.
Item generation and selection
We aimed to ensure that the constructed measure was embedded in a psychological theory. More precisely, we considered study satisfaction as a domain-specific aspect of subjective well-being in terms of Diener et al. (1985). In general, there is no clear rationale in how researchers may approach the development of domain-specific measures of the cognitive component of subjective well-being. Yet there is strong consensus on the measurement of overarching subjective well-being. For this purpose, the Satisfaction With Life Scale by Diener et al. (1985) has been validated in several cultures and translated in many languages including German (Schuhmacher, 2003). For the present scale, we adapted the items of the German translation to the higher education context. This procedure was carried out in two steps. First, all six authors separately adapted the five items to reflect study satisfaction instead of life satisfaction. Subsequently, the items were selected for the scale that all authors considered to be closest to the original wording and most comprehensible.
Guided by the validated three-item life satisfaction scale (Kjell & Diener, 2021), we selected the first three items to form a short scale measuring study satisfaction. Furthermore, we chose item three for a single-item measure as it yields the most direct wording to represent overall study satisfaction from our point of view. The five-item scale, three-item scale, and single-item measure were then tested in two samples of students.
Samples
Study 1. Data collection was part of a cross-sectional study in January and February 2024 with the main purpose of examining self-reported cheating of higher education students in the academic context. Higher education students were recruited via social media, posters, and mailing lists. They received either credit points for their studies (only students of psychology or human exercises) or could win one out of five book vouchers for 25€ each. Participants who stated that they had not answered the survey honestly (n = 9) or did not select the instructed response option for two items that were included in the survey to test participants’ attention (n = 4) were excluded. A total of N = 420 (73.10 % female, 23.81 % male, 1.43 % diverse) participants were included in our analyses. They were on average M = 23.31 (SD = 3.89) years old, studied in their M = 4.94 (SD = 2.63) semester, and studied various majors at German universities (e.g., 35 % psychology, 12 % teaching, 7 % law, 4 % computer sciences).
Study 2. Data collection was conducted with online surveys from January to April 2024. The main purpose of the project was to assess study motivation and learning behavior in the 14 days prior to each participants’ individual first exam of the winter semester 2023/2024. We assessed study satisfaction in the preliminary survey before students’ first exam of the semester and in the post survey at the start of the following semester. Participants from all higher education institutions in Germany were recruited via social media, mailing lists, posters, and announcements in various lectures. For their participation, students received either credit points for their studies (only students of psychology or human exercises) or could win one out of 15 monetary rewards each worth 100 euros. Overall, N = 471 students (81.10 % female, 17.62 % male, 0.06 % diverse) were included in the analyses. They studied at 31 German universities, were M = 26.11 years old (SD = 8.69), studied in their M = 3.49 semester (SD = 2.68), and studied different majors with a large proportion of psychology students (83.01 %).
Item analyses
All analyses were conducted using the statistic software R (R Core Team, 2024) with packages lavaan (version 0.6.17; Rosseel, 2012) and semTools (version 0.5.6; Jorgensen et al., 2022). We analyzed the unidimensional structure of the five-item scale with confirmatory factor analyses with robust maximum likelihood estimation. Standardized path coefficients of both studies are displayed in Figure 1. Following recommendations of Hu and Bentler (1998), in Study 1 most fit indices showed overall good fit (CFI = .969, SRMR = .038, c²(5) = 28.467, p < .001, N1 = 420). Only the Root Mean Square Error of Approximation (RMSEA = .093) was higher than the recommended cut-off value. In Study 2, again, most fit indices showed overall good fit at T1 (CFI = .972, SRMR = .035, c²(5) = 32.047, p < .001, N2 = 471), but the RMSEA with a value of .103 exceeded the recommended cut-off value. However, the RMSEA often falsely indicates a poor fit in models with small degrees of freedom and small samples (Kenny et al., 2015). Therefore, we report the RMSEA for completeness but in line with recommendations by Kenny et al. (2015) do not dismiss the one-factor model for study satisfaction. In addition, we analyzed the one-factor structure of the three-item scale with confirmatory factor analyses in both studies (Figure 2).
Figure 1
One Factor Confirmatory Factor Analysis for Study 1 (left) and Study 2 (right) for the Five-Item Scale
Note. Standardized path coefficients, N1 = 420, N2 = 471.
Figure 2
One Factor Confirmatory Factor Analysis for Study 1 (left) and Study 2 (right) for the Three-Item Scale
Note. Standardized path coefficients, N1 = 420, N2 = 471.
Item parameters
Table 2
Means, Standard Deviations, Skewness, Kurtosis, and Selectivity of the Manifest Items in Study 1 / Study 2
|
M |
SD |
Skewness |
Kurtosis |
Selectivity 5-item scale |
Selectivity 3-item scale |
Item 1 |
4.21 / 4.30 |
1.44 / 1.48 |
-0.31 / -0.27 |
-0.62 / -0.61 |
.71 / .71 |
.71 / .70 |
Item 2 |
4.23 / 4.29 |
1.40 / 1.48 |
-0.26 / - 0.29 |
-0.39 / -0.45 |
.58 / .61 |
.55 / .55 |
Item 3 |
4.94 / 5.06 |
1.33 / 1.37 |
-0.68 / -0.53 |
0.15 / -0.09 |
.69 / .74 |
.68 / .73 |
Item 4 |
4.91 / 4.44 |
1.35 / 1.56 |
-0.61 / - 0.32 |
0.04 / -0.59 |
.55 / .63 |
|
Item 5 |
3.95 / 4.21 |
1.71 / 1.80 |
-0.08 / -0.16 |
-1.11 / -1.06 |
.63 / .61 |
|
Note. Scale ranging from 1 (completely disagree) to 7 (completely agree), N1 = 420, N2 = 471, M = mean, SD = standard deviation, selectivity = corrected part-whole-correlation.
Objectivity
The survey is meant to be used as an online or paper-based survey and was validated online in CASI mode. Standardized instructions and items are presented so that the survey can be conducted objectively.
Reliability
Internal consistency of the five-item and three-item scale was determined using McDonald's Omega-h and Cronbach’s Alpha. In both studies the coefficients for the five-item scale showed good internal consistency (α1 = .83, ω1 = .82, α2 = .85, ω2 = .83). For the three-item scale, internal consistency was also good in both studies (α1 = .80, ω1 = .81, α2 = .81, ω2 = .82). For Study 2 we could estimate a retest-reliability of r = .71 (p < .001) based on data of N = 301 students who participated in both measurement points.
Validity
Using data from Study 1 and the first measurement point of Study 2, we analyzed the correlations of our five-item scale, three-item scale, and single item with the three subscales of study satisfaction by Schiefele and Jacob-Ebbinghaus (2006) to examine associations with existing measures for study satisfaction as an indicator for validity. Each of our measures showed a strong positive correlation with the subscales of study satisfaction. Correlations were highest with the subscale satisfaction with study content.
In addition, we used data from Study 2 to examine how our three measures correlated with academic self-concept (Dickhäuser et al., 2002), intrinsic value (Schnettler et al., 2020), motivational costs (Schnettler et al., 2020), the behavioral as well as the emotional component of academic procrastination (Bobe et al., 2022), and dropout intentions (Bäulke et al., 2021). The correlations found for motivational constructs were likewise strong and, as expected, positive for the academic self-concept and intrinsic value but negative for motivational costs. The relation of study satisfaction with learning behavior in the form of academic procrastination was negative and smaller than the correlations of study satisfaction with motivational constructs. The correlation with the academic success domain of dropout intention was negative and moderately high. These results show that our scale for measuring study satisfaction relates to study-relevant variables as we expected based on theory and previous empirical findings, indicating validity.
Table 3
Correlations of the Five-Item Scale, Three-Item Scale, and Single Item to Assess Study Satisfaction With Further Study-Relevant Variables
|
Study 1 |
Study 2 |
|||||
|
Five-item scale |
Three-item scale |
Single item |
Five-item scale |
Three-item scale |
Single item |
|
Satisfaction with study content |
.74 |
.78 |
.80 |
.68 |
.70 |
.73 |
|
Satisfaction with study conditions |
.48 |
.54 |
.40 |
.48 |
.53 |
.42 |
|
Satisfaction with coping with study-related stress |
.49 |
.47 |
.42 |
.47 |
.49 |
.47 |
|
Academic self-concept |
|
|
|
.42 |
.38 |
.40 |
|
Intrinsic value |
|
|
|
.59 |
.61 |
.66 |
|
Motivational costs |
|
|
|
-.50 |
-.53 |
-.53 |
|
Behavioral component of procrastination |
|
|
|
-.24 |
-.22 |
-.23 |
|
Emotional component of procrastination |
|
|
|
-.16 |
-.15 |
-.13 |
|
Student dropout intention |
|
|
|
-.46 |
-.46 |
-.50 |
|
Note. N1 = 420, N2 = 471, three-item scale contains items one, two, and three, single item is item three, all correlations were significant with p < .01.
Descriptive statistics (scaling)
The five-item and three-item scales to assess study satisfaction showed comparable descriptive statistics in Study 1 and Study 2 (see Table 4). This finding is similar to the comparison of the five-item and three-item Satisfaction with Life Scale (Kjell & Diener, 2021).
Table 4
Means, Standard Deviations, Skewness, and Kurtosis of the Five-Item Scale and Three-Item Scale in Study 1 / Study 2
|
M |
SD |
Skewness |
Kurtosis |
5-item scale |
4.45 / 4.46 |
1.12 / 1.21 |
-0.25 / -0.09 |
-0.54 / -0.45 |
3-item scale |
4.46 / 4.55 |
1.18 / 1.23 |
-0.39 / -0.23 |
-0.52 / -0.40 |
Note. Scale ranging from 1 (completely disagree) to 7 (completely agree), N1 = 420, N2 = 471, M = mean, SD = standard deviation.
Further quality criteria
This scale enables a very time- and cost-efficient assessment of study satisfaction. In Study 1 mean processing time of the survey page to assess study satisfaction including instruction, the five items of interest, and two control items was 41.71 seconds (SD = 30.83 seconds) and 88.81 % of participants completed this survey page in under 60 seconds.
We examined measurement invariance for gender (female and male) in Study 1 and Study 2, for study program (psychology and others) in Study 1 and Study 2, for the type of higher education institution (distance learning university and traditional face-to-face learning university) in Study 2, and over time in Study 2. For this purpose, we compared fit indices of progressively restricted multigroup CFAs by using cut-off values suggested by Chen (2007; metric: ΔCFI ≤ −.010, ΔRMSEA ≥ .015, ΔSRMR ≥ .030; scalar: ΔCFI ≤ −.010, ΔRMSEA ≥ .015, ΔSRMR ≥ .010; strict: ΔCFI ≤ −.010, ΔRMSEA ≥ .015, ΔSRMR ≥ .010). The five-item scale showed strict invariance for gender (Table 5), study program in Study 2 (Table 6), type of higher education institution (Table 7), and over time (Table 8).
Table 5
Measurement Invariance for the Five-Item Scale to Assess Study Satisfaction for Gender in Study 1 and Study 2
Study |
Model |
c² (df) |
CFI |
ΔCFI |
SRMR |
ΔSRMR |
RMSEA |
ΔRMSEA |
1 |
Configural |
36.510 (10) |
.965 |
|
.036 |
|
.114 |
|
|
Metric |
40.758 (14) |
.965 |
.000 |
.050 |
.014 |
.096 |
-.018 |
|
Scalar |
43.893 (18) |
.966 |
.001 |
.052 |
.002 |
.083 |
-.013 |
|
Strict |
51.880 (23) |
.963 |
-.003 |
.049 |
-.003 |
.077 |
-.006 |
2 |
Configural |
53.702 (10) |
.956 |
|
.037 |
|
.137 |
|
|
Metric |
61.183 (14) |
.953 |
-.003 |
.054 |
.017 |
.120 |
-.017 |
|
Scalar |
72.325 (20) |
.946 |
-.007 |
.058 |
.004 |
.114 |
-.006 |
|
Strict |
82.156 (23) |
.941 |
-.005 |
.058 |
.000 |
.105 |
-.009 |
Note. N1 = 407, female group n = 307, male group n = 100, N2 = 465, female group n = 382, male group n = 83, all c² are significant with p < .001.
Table 6
Measurement Invariance for the Five-Item Scale to Assess Study Satisfaction for Study Program in Study 1 and Study 2
Study |
Model |
c² (df) |
CFI |
ΔCFI |
SRMR |
ΔSRMR |
RMSEA |
ΔRMSEA |
1 |
Configural |
30.795 (10) |
.972 |
|
.033 |
|
.100 |
|
|
Metric |
43.645 (14) |
.961 |
-.011 |
.055 |
.022 |
.100 |
.000 |
|
Scalar |
47.225 (18) |
.961 |
.000 |
.056 |
.001 |
.088 |
-.012 |
|
Strict |
51.695 (23) |
.962 |
.001 |
.057 |
.001 |
.077 |
-.011 |
2 |
Configural |
43.102 (10) |
.966 |
|
.033 |
|
.119 |
|
|
Metric |
46.890 (14) |
.967 |
.001 |
.044 |
.011 |
.100 |
-.019 |
|
Scalar |
52.901 (18) |
.965 |
-.002 |
.047 |
.003 |
.091 |
-.009 |
|
Strict |
58.003 (23) |
.965 |
.000 |
.048 |
.001 |
.080 |
-.011 |
Note. N1 = 420, psychology group n = 142, other study programs-group n = 278, N2 = 471, psychology group n = 391, other study programs-group n = 80, all c² are significant with p < .001.
Table 7
Measurement Invariance for the Five-Item Scale to Assess Study Satisfaction for Students From Distance Learning Universities and Face-to-Face Universities in Study 2
Model |
c² (df) |
CFI |
ΔCFI |
SRMR |
ΔSRMR |
RMSEA |
ΔRMSEA |
Configural |
32.168 (10) |
.978 |
|
.029 |
|
.097 |
|
Metric |
41.404 (14) |
.972 |
-.006 |
.048 |
.019 |
.091 |
-.006 |
Scalar |
57.832 (18) |
.960 |
-.012 |
.056 |
.008 |
.097 |
.006 |
Strict |
63.911 (23) |
.958 |
-.002 |
.056 |
.000 |
.087 |
-.010 |
Note. N = 471, students from distance learning universities n = 195, students from traditional universities n = 276, all c² are significant with p < .001.
Table 8
Measurement Invariance for the Five-Item Scale to Assess Study Satisfaction for Students Over Time in Study 2
Model |
c² (df) |
CFI |
ΔCFI |
SRMR |
ΔSRMR |
RMSEA |
ΔRMSEA |
Configural |
41.355 (10) |
.976 |
|
.030 |
|
.102 |
|
Metric |
42.646 (14) |
.978 |
.002 |
.033 |
.003 |
.082 |
-.010 |
Scalar |
57.589 (18) |
.970 |
-.008 |
.041 |
.008 |
.085 |
.003 |
Strict |
70.808 (23) |
.964 |
-.006 |
.046 |
.005 |
.083 |
-.002 |
Note. N = 301, all c² are significant with p < .001.
Acknowledgement
We would like to thank all participants who spent their time completing the surveys and thus supported our research projects. Carola Grunschel, thank you very much for your continuous support at all levels for the realization of both studies. Many thanks to Jeannine Kecker and Moira Andrä for the implementation of Study 1, and to Lucas Wloch for the realization of Study 2.