Saturday, February 29, 2020

Reliability and Validity Analysis

Previous scholars have shown that Partial Least Squares (PLS) is a robust technique that has been frequently used in the literature. In PLS, to analyse a model, we need to follow the two-step procedure which are the measurement model and structural model (Hair et al. 1998).

1. Measurement Model
In this step, we measure convergent validity and discriminant validity

What are the purpose of measuring convergent validity? The reason for analysing convergent validity is to measure the close relations exist among the items of the same construct. We need to measure composite reliability (CR) and average variance extracted (AVE).



In PLS, the factor loading should be greater than 0.7 (Hair, 2013). We need to remove items loading with less than 0.7 to increase CR or AVE in the first order of the component of independent variables (IVs).

Fornell and Larcker (1981) stated that the CR values should be more than 0.7 and AVE should be greater than 0.5 in order for the result to be accepted. Convergent validity is established if all the values of CR are greater than 0.7 and all the values AVE in a study are greater than 0.5. To know more about how to calculate CR and AVE, you can click HERE (Scopus-indexed journal).



Discriminant validity explains the degree of irrelevance between constructs. To measure discriminant validity, there are two steps which are confirmatory factor analysis and AVE analysis. All items should have high loading on their corresponding constructs. Then, we calculate the square root of the AVE that exceed the inter-correlation of the construct in the proposed model. In order to support discriminant validity, each construct's AVE square root should be greater than its correlations with other constructs. 

To see more about the explanation in analysing convergent and discriminant validity you can either click HERE or HERE





2. Structural Model
Structural equation modelling tested the hypothesised paths of the structural model. All coefficient estimates were significant (p<0.05) in accordance with the hypothesised directions. In testing the proposed hypotheses, the standardised path coefficient is expected to be at least 0.2 and preferably greater than 0.3 (Chin and Newsted, 1999).

The reliability of the coefficients in the study is obtained through a bootstrapping procedure (500 resamples). All t values need to be higher than the theoretical t value of 2.57 for a 5% probability of error. Meanwhile, the p values of 0.000 indicate that all path relationship are significant at a 5% probability of error.




Predictive accuracy of a model can be measured by analysing the coefficient of determination. A rule thumb on the acceptable coefficient of determination is 0.75, 0.50 and 0.25, explaining substantial, moderate or weak level of predictive accuracy, respectively (Hair et al., 2014).

For further explanation on how to calculate the structural equation model analysis and how to explain the predictive accuracy of the model, you can click HERE (Scopus-indexed journal).


Love,
Dr SAA
2