Skip to content

Commit

Permalink
Public release of 1.3.5 with new metrics and experimental results
Browse files Browse the repository at this point in the history
  • Loading branch information
@adamburkegh
adamburkegh committed Apr 14, 2023
1 parent 246e1b3 commit 6f513a3
Show file tree
Hide file tree
Showing 476 changed files with 4,382,185 additions and 2,730 deletions.
7 changes: 5 additions & 2 deletions README.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -6,13 +6,16 @@ This also includes a genetic algorithm for mining stochastic process models, cal

The paper describing this experiment is "Burke, A., Leemans, SJJ, Wynn, M.T, van der Aalst, W.M.D, and ter Hofstede, A.H.M. - Stochastic Process Model-Log Quality Dimensions: An Experimental Study, ICPM 2022".

Further experiments with additional measures and analysis were performed in 2022-2023.

# Development Setup and Installation

## Gradle and Java

Checkout [`prom-helpers`](https://github.com/adamburkegh/prom-helpers)
Checkout [`prom-helpers`](https://github.com/adamburkegh/prom-helpers) and [`prob-process-tree`](https://github.com/adamburkegh/prob-process-tree)

In `prom-helpers`, `./gradlew test ./gradlew publishToMavenLocal`
In `prob-process-tree`, `./gradlew test ; ./gradlew publishToMavenLocal`
In `prom-helpers`, `./gradlew test ; ./gradlew publishToMavenLocal`

In `spd_dim`, `./gradlew test`

Expand Down
31 changes: 28 additions & 3 deletions build.gradle
View file
Original file line number Diff line number Diff line change
Expand Up @@ -116,9 +116,34 @@ jar {


group = 'qut.pm'
version = '1.2.6'
description = 'spmdim'
sourceCompatibility = '1.8'
version = '1.3.5'
description = 'sqdimensions'
sourceCompatibility = '11'
targetCompatibility = '11'


task(copyTask, dependsOn: 'classes', type: JavaExec) {
main 'qut.pm.setm.results.CopyTask'
classpath sourceSets.main.runtimeClasspath
}

task(copyTaskByMeasure, dependsOn: 'classes', type: JavaExec) {
main 'qut.pm.setm.results.CopyTaskByMeasure'
classpath sourceSets.main.runtimeClasspath
}


task(addNote, dependsOn: 'classes', type: JavaExec) {
main 'qut.pm.setm.results.AddNote'
classpath sourceSets.main.runtimeClasspath
}


task(pnmlToDot, dependsOn: 'classes', type: JavaExec) {
main 'qut.pm.prom.helpers.PetriNetConverter'
classpath sourceSets.main.runtimeClasspath
args '-v -i PNML'
}


applicationDistribution.from('config') {
Expand Down
2 changes: 1 addition & 1 deletion build.sh
View file
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
set -e

./gradlew test distZip
./gradlew test distZip --offline


1 change: 1 addition & 0 deletions results/cycle1/README.md
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
Results from preparatory laboratory work and analysis, before the first conference paper.
1 change: 1 addition & 0 deletions results/cycle2/README.md
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
Experiment 1 results.
1 change: 1 addition & 0 deletions results/cycle3/README.md
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
Experiment 2 results.
108 changes: 108 additions & 0 deletions results/cycle3/eval3.psv
View file

Large diffs are not rendered by default.

272 changes: 272 additions & 0 deletions results/cycle3/eval3/mrun_BPIC2013_closed_predef-aplh-fodina_20230222-122942.xml
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,272 @@
<runStats artifactCreator="predef-aplh-fodina" machineName="cl5n018" runnerVersion="1.3.0.2023-02-21">
<inputLogFileName>BPIC2013_closed.xes</inputLogFileName>
<inputModelFileName>osmodel_aplh-fodina_BPIC2013_closed.pnml</inputModelFileName>
<runExportFileName>var/mrun_BPIC2013_closed_predef-aplh-fodina_20230222-122942.xml</runExportFileName>
<runDateTime>2023-02-22 12:29:42.147 AEST</runDateTime>
<nestedRunStats class="java.util.LinkedList"/>
<taskRunStats class="java.util.LinkedList">
<taskStats taskName="spmlogparser" runState="RUNNING">
<duration>0</duration>
<start>1677032982147</start>
<errorMessage></errorMessage>
<note></note>
<measureStats measure="LOG_EVENT_COUNT">
<number class="java.lang.Integer">6660</number>
</measureStats>
<measureStats measure="LOG_TRACE_COUNT">
<number class="java.lang.Integer">1487</number>
</measureStats>
</taskStats>
<taskStats taskName="calculate Activity Ratio Gower&apos;s similarity" runState="SUCCESS">
<duration>3</duration>
<start>1677032982252</start>
<errorMessage></errorMessage>
<note></note>
<measureStats measure="EVENT_RATIO_GOWER">
<number class="java.lang.Double">0.0</number>
</measureStats>
</taskStats>
<taskStats taskName="calculate Trace Ratio (2) Gower&apos;s similarity" runState="SUCCESS">
<duration>1</duration>
<start>1677032982255</start>
<errorMessage></errorMessage>
<note></note>
<measureStats measure="TRACE_RATIO_GOWER_2">
<number class="java.lang.Double">0.0</number>
</measureStats>
</taskStats>
<taskStats taskName="calculate Trace Ratio (3) Gower&apos;s similarity" runState="SUCCESS">
<duration>1</duration>
<start>1677032982256</start>
<errorMessage></errorMessage>
<note></note>
<measureStats measure="TRACE_RATIO_GOWER_3">
<number class="java.lang.Double">0.0</number>
</measureStats>
</taskStats>
<taskStats taskName="calculate Trace Ratio (4) Gower&apos;s similarity" runState="SUCCESS">
<duration>1</duration>
<start>1677032982257</start>
<errorMessage></errorMessage>
<note></note>
<measureStats measure="TRACE_RATIO_GOWER_4">
<number class="java.lang.Double">0.0</number>
</measureStats>
</taskStats>
<taskStats taskName="calculate Earth movers&apos; distance by trace" runState="SUCCESS">
<duration>1</duration>
<start>1677032982258</start>
<errorMessage></errorMessage>
<note></note>
<measureStats measure="EARTH_MOVERS_TRACEWISE">
<number class="java.lang.Double">0.0</number>
</measureStats>
</taskStats>
<taskStats taskName="calculate Trace Entropy Precision" runState="SUCCESS">
<duration>1</duration>
<start>1677032982259</start>
<errorMessage></errorMessage>
<note></note>
<measureStats measure="ENTROPY_PRECISION_TRACEWISE">
<number class="java.lang.Double">0.0</number>
</measureStats>
</taskStats>
<taskStats taskName="calculate Trace Entropy Fitness" runState="SUCCESS">
<duration>0</duration>
<start>1677032982260</start>
<errorMessage></errorMessage>
<note></note>
<measureStats measure="ENTROPY_FITNESS_TRACEWISE">
<number class="java.lang.Double">0.0</number>
</measureStats>
</taskStats>
<taskStats taskName="calculate Trace Entropy Projection Fitness" runState="SUCCESS">
<duration>0</duration>
<start>1677032982260</start>
<errorMessage></errorMessage>
<note></note>
<measureStats measure="ENTROPY_FITNESS_TRACEPROJECT">
<number class="java.lang.Double">-0.0</number>
</measureStats>
</taskStats>
<taskStats taskName="calculate Trace Entropy Projection Precision" runState="SUCCESS">
<duration>0</duration>
<start>1677032982260</start>
<errorMessage></errorMessage>
<note></note>
<measureStats measure="ENTROPY_PRECISION_TRACEPROJECT">
<number class="java.lang.Double">0.0</number>
</measureStats>
</taskStats>
<taskStats taskName="calculate Trace Overlap Ratio" runState="SUCCESS">
<duration>1</duration>
<start>1677032982260</start>
<errorMessage></errorMessage>
<note></note>
<measureStats measure="TRACE_OVERLAP_RATIO">
<number class="java.lang.Double">0.0</number>
</measureStats>
</taskStats>
<taskStats taskName="calculate Generalization by trace floor (5)" runState="SUCCESS">
<duration>0</duration>
<start>1677032982261</start>
<errorMessage></errorMessage>
<note></note>
<measureStats measure="TRACE_GENERALIZATION_FLOOR_5">
<number class="java.lang.Double">0.0</number>
</measureStats>
</taskStats>
<taskStats taskName="calculate Generalization by trace uniqueness diff" runState="SUCCESS">
<duration>1</duration>
<start>1677032982261</start>
<errorMessage></errorMessage>
<note></note>
<measureStats measure="TRACE_GENERALIZATION_DIFF_UNIQ">
<number class="java.lang.Double">0.0</number>
</measureStats>
</taskStats>
<taskStats taskName="calculate Entity count" runState="SUCCESS">
<duration>0</duration>
<start>1677032982262</start>
<errorMessage></errorMessage>
<note></note>
<measureStats measure="MODEL_ENTITY_COUNT">
<number class="java.lang.Double">12.0</number>
</measureStats>
</taskStats>
<taskStats taskName="calculate Edge count" runState="SUCCESS">
<duration>0</duration>
<start>1677032982262</start>
<errorMessage></errorMessage>
<note></note>
<measureStats measure="MODEL_EDGE_COUNT">
<number class="java.lang.Double">14.0</number>
</measureStats>
</taskStats>
<taskStats taskName="calculate Alpha Precision Unrestricted alpha-sig 0.0" runState="SUCCESS">
<duration>1</duration>
<start>1677032982262</start>
<errorMessage></errorMessage>
<note></note>
<measureStats measure="ALPHA_PRECISION_UNRESTRICTED_ZERO">
<number class="java.lang.Double">0.0</number>
</measureStats>
</taskStats>
<taskStats taskName="calculate Alpha Precision Unrestricted alpha-sig 0.01" runState="SUCCESS">
<duration>1</duration>
<start>1677032982263</start>
<errorMessage></errorMessage>
<note></note>
<measureStats measure="ALPHA_PRECISION_UNRESTRICTED_1_PCT">
<number class="java.lang.Double">0.0</number>
</measureStats>
</taskStats>
<taskStats taskName="calculate Alpha Precision Restricted alpha-sig 0.01" runState="SUCCESS">
<duration>2</duration>
<start>1677032982264</start>
<errorMessage></errorMessage>
<note></note>
<measureStats measure="ALPHA_PRECISION_RESTRICTED_1_PCT">
<number class="java.lang.Double">0.0</number>
</measureStats>
</taskStats>
<taskStats taskName="calculate Simplicity by edge count" runState="SUCCESS">
<duration>0</duration>
<start>1677032982266</start>
<errorMessage></errorMessage>
<note></note>
<measureStats measure="STRUCTURAL_SIMPLICITY_EDGE_COUNT">
<number class="java.lang.Double">0.9234972677595629</number>
</measureStats>
</taskStats>
<taskStats taskName="calculate Simplicity by entity count" runState="SUCCESS">
<duration>0</duration>
<start>1677032982266</start>
<errorMessage></errorMessage>
<note></note>
<measureStats measure="STRUCTURAL_SIMPLICITY_ENTITY_COUNT">
<number class="java.lang.Double">0.9344262295081968</number>
</measureStats>
</taskStats>
<taskStats taskName="calculate Simplicity by stochastic structural uniqueness" runState="SUCCESS">
<duration>0</duration>
<start>1677032982266</start>
<errorMessage></errorMessage>
<note></note>
<measureStats measure="STRUCTURAL_SIMPLICITY_STOCHASTIC">
<number class="java.lang.Double">0.819672131147541</number>
</measureStats>
</taskStats>
<taskStats taskName="calculate Stochastic Structural Uniqueness" runState="SUCCESS">
<duration>0</duration>
<start>1677032982266</start>
<errorMessage></errorMessage>
<note></note>
<measureStats measure="MODEL_STRUCTURAL_STOCHASTIC_COMPLEXITY">
<number class="java.lang.Double">33.0</number>
</measureStats>
</taskStats>
<taskStats taskName="calculate Entropic Relevance Uniform" runState="SUCCESS">
<duration>1</duration>
<start>1677032982266</start>
<errorMessage></errorMessage>
<note></note>
<measureStats measure="ENTROPIC_RELEVANCE_UNIFORM">
<number class="java.lang.Double">12.721417746501238</number>
</measureStats>
</taskStats>
<taskStats taskName="calculate Entropic Relevance Zero Order" runState="SUCCESS">
<duration>1</duration>
<start>1677032982267</start>
<errorMessage></errorMessage>
<note></note>
<measureStats measure="ENTROPIC_RELEVANCE_ZERO_ORDER">
<number class="java.lang.Double">9.679959403805617</number>
</measureStats>
</taskStats>
<taskStats taskName="calculate Entropic Relevance Restricted Zero Order" runState="SUCCESS">
<duration>2</duration>
<start>1677032982268</start>
<errorMessage></errorMessage>
<note></note>
<measureStats measure="ENTROPIC_RELEVANCE_RESTRICTED_ZO">
<number class="java.lang.Double">9.679959403805617</number>
</measureStats>
</taskStats>
<taskStats taskName="calculate Earth Movers Similarity Tuned" runState="SUCCESS">
<duration>15</duration>
<start>1598827903224</start>
<errorMessage></errorMessage>
<note>Copied from C:\Users\burkeat\bpm\bpm-dimensions-lab\results\cycle2\eval2\mrun_BPIC2013_closed_predef-aplh-fodina_20220605-012204.xml on Mon Feb 27 09:49:48 AEST 2023</note>
<measureStats measure="EARTH_MOVERS_LIGHT_COVERAGE">
<number class="java.lang.Double">-7.741618901491165E-9</number>
</measureStats>
</taskStats>
<taskStats taskName="calculate Entropy Precision and Recall" runState="SUCCESS">
<duration>16</duration>
<start>1598827903208</start>
<errorMessage></errorMessage>
<note>Copied from C:\Users\burkeat\bpm\bpm-dimensions-lab\results\cycle2\eval2\mrun_BPIC2013_closed_predef-aplh-fodina_20220605-012204.xml on Mon Feb 27 09:49:53 AEST 2023</note>
<measureStats measure="ENTROPY_RECALL">
<number class="java.lang.Double">-0.0</number>
</measureStats>
<measureStats measure="ENTROPY_PRECISION">
<number class="java.lang.Double">-0.0</number>
</measureStats>
</taskStats>
<taskStats taskName="calculate Entropy Precision and Recall" runState="SUCCESS">
<duration>16</duration>
<start>1598827903208</start>
<errorMessage></errorMessage>
<note>Copied from C:\Users\burkeat\bpm\bpm-dimensions-lab\results\cycle2\eval2\mrun_BPIC2013_closed_predef-aplh-fodina_20220605-012204.xml on Mon Feb 27 09:49:57 AEST 2023</note>
<measureStats measure="ENTROPY_RECALL">
<number class="java.lang.Double">-0.0</number>
</measureStats>
<measureStats measure="ENTROPY_PRECISION">
<number class="java.lang.Double">-0.0</number>
</measureStats>
</taskStats>
</taskRunStats>
<errorMessage></errorMessage>
<runState>RUNNING</runState>
</runStats>
Loading

0 comments on commit 6f513a3

Please sign in to comment.