Level of detail in UML models and its impact on model comprehension: a replication study

Abstract

This replication study examines the impact of level of detail (LoD) in unified modeling language (UML) on model comprehension, replicating a controlled experiment, which involved 53 MSc students at Eindhoven University of Technology. Using the same UML model and experimental design, we conducted the study with 23 MSc Computer Science students at Bina Nusantara University, Indonesia. Consistent with the original findings, higher LoD was found to enhance comprehension correctness. However, the effect on comprehension efficiency was weaker and not statistically significant, likely due to the smaller sample size and contextual differences in subjects’ backgrounds. Furthermore, we found a potential disconnect between perception and actual comprehension performance in the subjects receiving UML model with low LoD. Specifically, while they viewed the model favourably, their actual understanding may have been impaired by the limited information and therefore the perceived clarity and ease of comprehension are not reflective of the true comprehension. Overall, this study reinforces the importance of LoD in UML modeling and highlights the need for further replication, particularly in contexts involving professional software engineers.