<img height="1" width="1" style="display:none" src="https://www.facebook.com/tr?id=1907245749562386&amp;ev=PageView&amp;noscript=1">

The Leonardo Blog

How to Assess Your Process Models

All Posts

How to Assess Your Process Models

How do you know when you've come across a good process model? Do you use your gut feel or do you actually quantitatively assess how good a process model is. Interestingly enough, there's very little out there that describes how to assess whether a model is good or not.

Assessing process models is actually a very important part of the governance of process models and you want to govern your process models so that you're consistently creating valuable and useful models. One of the steps to assess process models involves being able to quantitatively assess how good they are. This will be especially useful when you've got tens, hundreds, possibly even thousands of process models awaiting your approval.

The model quality framework assesses model quality from a quantitative perspective. To break it down further, we talk about quantitative assessment in three categories.

  1. Semantic quality -Semantic quality refers to the accuracy and completeness of your process models.
  2. Syntactic quality -Syntactic quality is the performance of all your process models to your modeling standards.
  3. Pragmatic quality -Pragmatic quality is the usefulness and fitful purpose of your process model.

In each of these three categories, you'd have to look at variables or criteria that would help you assess quantitatively how good that process model is, so for each one of these categories, you could assign a set of scores. Semantic, syntactic, and pragmatic each have a total score.

For semantic, we can assess the total number of objects that are associated with an activity for completeness. That completeness can be easily calculated and you can assign a score.For the purposes of this article, let's say semantic quality score is 40 points.

For syntactic quality, you would be looking at conformance to your standards, so any breaches in the process model to your standards, you would deduct score again. For syntactic quality, let's assign 40 points to it.

Finally, pragmatic quality. You might want to use pragmatic quality with somebody else, somebody who's actually consuming that process model. Their feedback will give you an assessment, quantitatively, as to how good that process model is from a pragmatic perspective. For this examples, let's do 20 points.


In total, you've got 40 points for semantic, 40 points for syntactic, and 20 points for pragmatic, a total of 100 points. Out of this 100 points, you need to assign a minimum threshold. Let's say 80 points.

When you do your assessment against semantic, syntactic, and pragmatic quality, you now can assign a score.

How_to_identify_good_process_models_Model_Quality_Framework.00_03_20_24.Still003.jpg  How_to_identify_good_process_models_Model_Quality_Framework.00_03_26_23.Still004.jpg

Any score below 80 points, you have to send that process model back for review and back for correction. Anything above 80 points is now ready for consumption.

Now there's a way to quantitatively measure how good process models are using the model quality framework. You do this across three categories: semantic, syntactic, and pragmatic; and you assign values against each one of those areas.

Any model that passes your minimum threshold is good to go. Anything that doesn't, send it right back for review.

Watch Process Modeling Excellence Video Seminar - 45 minutes!

Related Posts

Leonardo wins 2020 Red Hat ANZ Professional Services Partner of the Year

Red Hat announced Leonardo as their 'ANZ Professional Services Partner of the Year'. This is the third year in a row Leonardo has been recognised at these regional awards, and we're extremely honoured again for this acknowledgement. Well done to Team Leonardo for your superb work delivering great outcomes for clients - and to Red Hat Asia Pacific for their amazing partner growth and results over the past year.

Leonardo Invests in Apromore to advance AI-Driven, Open-Source Process Mining Technology

MELBOURNE, AUSTRALIA – 7 July 2020 – Leonardo today announced its investment in Apromore - a leading developer of open-source, AI-driven process mining technology. The investment forms part of a Series A round of funding totalling $A6.8 million, led by German business process management specialist GBTEC, and also included The University of Melbourne, which helped to incubate Apromore prior to spin off.

Leonardo wins 2019 Red Hat Hackathon - Customer Experience with OpenSource

      We're thrilled to share with you that Leonardo has won 2019 Red Hat Hackathon 'ReBoot Customer Experience with Open Source'. Early on Friday morning ( 5am AEDT 13th December 2019),  Leonardo awarded first place from a field that included 320 participants from across the globe.  The Hackathon's brief was to reinvent customer experience using Open Source. Providing an outstanding customer experience that customers actually love is especially challenging in more traditional industries like banking, insurance, telecommunication, public sector/government, healthcare, manufacturing, or transportation. These markets offer great opportunities for change and disruption as has been shown by many examples such as Uber disrupting transportation, Twilio disrupting telcos and Stripe or Transferwise disrupting banking.  We want you to be the next disrupter who creates a customer experience that users actually love.  An Open Source solution - ACE  Airline Customer Experience Our project is an application using a Red Hat Process Automation Manager process-as-microservice developed for "ACE Airlines", our fictional client (see video above for the demo). It communicates personalised, event-driven (gate change, delay, etc.) messages to passengers in the language of their choice, using their preferred communications type (SMS, push notification, email).