Testing invariance between web and paper students satisfaction surveys. A case study

Autor: Martha Giraldo O'Meara, Mónica Martínez-Gómez, Juan A. Marin-Garcia
Jazyk: angličtina
Rok vydání: 2017
Předmět:
Organizational Behavior and Human Resource Management
Strategy and Management
Teaching method
ESTADISTICA E INVESTIGACION OPERATIVA
lcsh:A
Sample (statistics)
Surveys
010501 environmental sciences
Enquestes
01 natural sciences
Education
Measurement equivalence
Measurement equivalence
Students’ satisfaction and motivation
Job Diagnostic Survey
Multigroup confirmatory analysis
Higher education
Active methodologies

Management of Technology and Innovation
Accounting
0502 economics and business
Ensenyament i aprenentatge::Ensenyament universitari [Àrees temàtiques de la UPC]
Symmetry (Mathematics)
Mathematics education
Econometrics
Active methodologies
Measurement invariance
Higher education
Students satisfaction and motivation
Job Diagnostic Survey
Business and International Management
Students’ satisfaction and motivation
Reliability (statistics)
0105 earth and related environmental sciences
Factor analysis
Data collection
05 social sciences
Matemàtiques i estadística [Àrees temàtiques de la UPC]
Educational surveys
Variance (accounting)
Confirmatory factor analysis
Enquestes educatives
Simetria (Matemàtica)
ORGANIZACION DE EMPRESAS
Multigroup confirmatory analysis
lcsh:General Works
Psychology
050203 business & management
Zdroj: Intangible Capital; 2017: Vol.: 13 Núm.: 5
Intangible Capital, Vol 13, Iss 5, Pp 879-902 (2017)
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
instname
UPCommons. Portal del coneixement obert de la UPC
Universitat Politècnica de Catalunya (UPC)
ISSN: 2014-3214
DOI: 10.3926/ic.1049
Popis: [EN] Purpose: This paper studied the measurement invariance (MI) across web-based and paper-based surveys to evidence if both techniques of data collection can be regarded as equivalent. Design/methodology: We develop a multigroup confirmatory factor analysis (MGCFA) with Maximum Likelihood Estimation to asses measurement invariance of the Job Diagnostic Survey (JDS) adapted to teaching, with data collected from paper and web surveys. Sample from paper surveys was constituted by 294 student of a Spanish public university in the academic years 2007-08, 2008-09 and 2009-10. Internet surveys were administered through an open source survey application called Lime Survey. We received 241 completed questionnaires. Findings: Results show that metric invariance, covariance invariance, variance of latent factors invariance and measurement errors invariance can be established between two groups. We can conclude that both methods of collecting data can be considered equivalent. Research limitations/implications: This study was done with a particular sample and strict focus questionnaire and we might not generalize the findings. It should be extended in the future to include other universities and graduate students. Originality/value: Results showed that the factor structures remained invariant across the internet-based and paper-based groups, that is to say, both methods of collecting data can be considered equivalent, with the same factor structure, factor loadings, measurement errors of factors and the same reliability. These findings are useful for researchers since they add a new sample in which web and paper questionnaires are equivalent and for teachers to desire to change the teaching methodology at university, encourage students' participation and teamwork through active methodologies.
This paper has been written with financial support from the Project "Validacion de las Competencias Transversales de Innovacion mediante un enfoque formativo". (GV/2016/004) de la Conselleria d'Educacio, Investigacio, Cultura i Esport (Generalitat Valenciana).
Databáze: OpenAIRE