Bot test: Global variable comparison by PLukas2018 · Pull Request #17 · PLukas2018/diffkemp

PLukas2018 · 2026-06-17T05:23:38Z

No description provided.

PLukas2018 · 2026-06-17T05:26:15Z

\evaluate

diffkemp-dev-bot · 2026-06-17T09:40:44Z

EqBench

description	TN	FP	TP	FN	compare runtime
default optimization	56	91	123	2	322s $$\color{red}+5$$
-O2 optimization	97	50	121	4	327s $$\color{red}+1$$

Details

Details for default optimization

Details for -O2 optimization

diffkemp-dev-bot · 2026-06-17T09:40:48Z

RHEL functions

versions	equal	not equal	unknown	errors	total differences	compare runtime

Details

diffkemp-dev-bot · 2026-06-17T09:41:01Z

RHEL sysctl

versions	equal	not equal	total differences	compare runtime
8.0-8.1	278	117	50	1588s
8.1-8.2	334	60	91	973s $$\color{red}+2$$
8.2-8.3	339	53	99	1405s $$\color{green}-4$$
8.3-8.4	324	68	86	907s $$\color{green}-2$$
8.4-8.5	342	65	67	1133s $$\color{green}-1$$

Details

Details for 8.0-8.1

Details for 8.1-8.2

Details for 8.2-8.3

Details for 8.3-8.4

Details for 8.4-8.5

PLukas2018 · 2026-06-22T05:19:44Z

\evaluate --rebuild

This fixes the issue of ninja crashing when building using nix flakes, when z3 is installed on the system, by prioritizing FindZ3 script before falling back to Z3Config.

diffkemp-dev-bot · 2026-06-22T08:52:30Z

EqBench

description	TN	FP	TP	FN	compare runtime
default optimization	56	91	123	2	322s $$\color{green}-189$$
-O2 optimization	97	50	121	4	327s $$\color{green}-194$$

Details

Details for default optimization

Details for -O2 optimization

diffkemp-dev-bot · 2026-06-22T08:52:34Z

RHEL functions

versions	equal	not equal	unknown	errors	total differences	compare runtime

Details

diffkemp-dev-bot · 2026-06-22T08:52:47Z

RHEL sysctl

versions	equal	not equal	total differences	compare runtime
8.0-8.1	278	117	50	1588s $$\color{green}-473$$
8.1-8.2	334	60	91	973s $$\color{green}-243$$
8.2-8.3	339	53	99	1405s $$\color{green}-640$$
8.3-8.4	324	68	86	907s $$\color{green}-303$$
8.4-8.5	342	65	67	1133s $$\color{green}-505$$

Details

Details for 8.0-8.1

Details for 8.1-8.2

Details for 8.2-8.3

Details for 8.3-8.4

Details for 8.4-8.5

PLukas2018 · 2026-06-23T04:54:45Z

\evaluate --rebuild

diffkemp-dev-bot · 2026-06-23T08:27:28Z

EqBench

description	TN	FP	TP	FN	compare runtime
default optimization	56	91	123	2	322s $$\color{green}-190$$
-O2 optimization	97	50	121	4	327s $$\color{green}-194$$

Details

Details for default optimization

Details for -O2 optimization

diffkemp-dev-bot · 2026-06-23T08:27:32Z

RHEL functions

versions	equal	not equal	unknown	errors	total differences	compare runtime

Details

diffkemp-dev-bot · 2026-06-23T08:27:46Z

RHEL sysctl

versions	equal	not equal	total differences	compare runtime
8.0-8.1	278	117	50	1588s $$\color{green}-463$$
8.1-8.2	334	60	91	973s $$\color{green}-289$$
8.2-8.3	339	53	99	1405s $$\color{green}-643$$
8.3-8.4	324	68	86	907s $$\color{green}-313$$
8.4-8.5	342	65	67	1133s $$\color{green}-510$$

Details

Details for 8.0-8.1

Details for 8.1-8.2

Details for 8.2-8.3

Details for 8.3-8.4

Details for 8.4-8.5

PLukas2018 · 2026-06-28T19:38:17Z

\evaluate --rebuild

PLukas2018 · 2026-06-28T21:26:16Z

\evaluate --rebuild

diffkemp-dev-bot · 2026-06-29T01:01:09Z

EqBench

description	TN	FP	TP	FN	compare runtime
default optimization	56	91	123	2	322s $$\color{green}-188$$
-O2 optimization	97	50	121	4	327s $$\color{green}-192$$

Details

Details for default optimization

Details for -O2 optimization

diffkemp-dev-bot · 2026-06-29T01:01:21Z

RHEL functions

versions	equal	not equal	unknown	total differences	compare runtime
8.0-8.1	359	87	75	100	941s $$\color{red}+175$$
8.1-8.2	330	163	80	147	1325s $$\color{green}-38$$
8.2-8.3	413	185	89	185	2326s $$\color{red}+414$$
8.3-8.4	442	159	90	180	2090s $$\color{green}-3$$
8.4-8.5	439	171	90	158	1800s $$\color{red}+400$$

Details

Details for 8.0-8.1

Details for 8.1-8.2

Details for 8.2-8.3

Details for 8.3-8.4

Details for 8.4-8.5

diffkemp-dev-bot · 2026-06-29T01:01:36Z

RHEL sysctl

versions	equal	not equal	total differences	compare runtime
8.0-8.1	278 $$\color{red}-4$$	117 $$\color{red}+3$$	50	1588s $$\color{green}-462$$
8.1-8.2	334 $$\color{red}-6$$	60 $$\color{red}+5$$	91	973s $$\color{green}-8$$
8.2-8.3	339 $$\color{red}-1$$	53	99	1405s $$\color{green}-628$$
8.3-8.4	324 $$\color{red}-4$$	68 $$\color{red}+3$$	86 $$\color{green}-1$$	907s $$\color{green}-113$$
8.4-8.5	342 $$\color{red}-4$$	65 $$\color{red}+3$$	67 $$\color{green}-10$$	1133s $$\color{green}-501$$

Details

Details for 8.0-8.1

Details for 8.1-8.2

Compared symbols newly evaluated as non-equal

check_hung_task

Details for 8.2-8.3

Details for 8.3-8.4

Compared symbols previously evaluated as non-equal

domain_dirty_limits

Eliminated differing symbols

domain_dirty_limits [, ] (in dirty_bytes_handler, dirty_ratio_handler, domain_dirty_limits) Error: Missing definitions for the differing function!

Details for 8.4-8.5

Eliminated differing symbols

check_preempt_wakeup [, ] (in load_balance) Error: Missing definitions for the differing function!
detach_tasks [, ] (in load_balance) Error: Missing definitions for the differing function!
enqueue_task_fair [, ] (in load_balance) Error: Missing definitions for the differing function!
hrtick_update [, ] (in load_balance) Error: Missing definitions for the differing function!
pick_next_entity [, ] (in load_balance) Error: Missing definitions for the differing function!
pick_next_task_fair [, ] (in load_balance) Error: Missing definitions for the differing function!
reweight_entity [, ] (in load_balance) Error: Missing definitions for the differing function!
task_hot [, ] (in load_balance) Error: Missing definitions for the differing function!
throttle_cfs_rq [, ] (in load_balance) Error: Missing definitions for the differing function!
update_stats_wait_end [, ] (in load_balance) Error: Missing definitions for the differing function!

If a global variable is present in the symbol list during function comparison, a group of all functions using this global variable is created, similarly how sysctl comparison is treated. In this case, the overall Result (root of the Result tree) can contain both functions and function groups. Group_kind field was also added to Result so it is possible to distinguish between different kinds of groups, e.g. sysctl and glob_var.

The result viewer was changed to handle different shapes of the result comparison tree. The viewer displays differences in the same way as before the change, that is it only shows the differences found in functions, not how these functions are aggregated in groups.

A few tests were added to test whether the result viewer can handle different shapes of the result comparison tree.

diffkemp-dev-bot Bot added the Success: EqBench stable EqBench experiment: same results were gained as on the master branch. label Jun 17, 2026

diffkemp-dev-bot Bot added the Success: RHEL functions stable RHEL KABI functions: same results were gained as on the master branch. label Jun 17, 2026

diffkemp-dev-bot Bot added the Success: RHEL sysctl stable RHEL KABI sysctl: same results were gained as on the master branch. label Jun 17, 2026

PLukas2018 mentioned this pull request Jun 22, 2026

Add comparison of global variables diffkemp/diffkemp#432

Merged

Fix system z3 being prioritized over local

5a66ea5

This fixes the issue of ninja crashing when building using nix flakes, when z3 is installed on the system, by prioritizing FindZ3 script before falling back to Z3Config.

diffkemp-dev-bot Bot removed the Success: EqBench stable EqBench experiment: same results were gained as on the master branch. label Jun 22, 2026

diffkemp-dev-bot Bot added Success: EqBench stable EqBench experiment: same results were gained as on the master branch. and removed Success: RHEL functions stable RHEL KABI functions: same results were gained as on the master branch. labels Jun 22, 2026

diffkemp-dev-bot Bot added Success: RHEL functions stable RHEL KABI functions: same results were gained as on the master branch. and removed Success: RHEL sysctl stable RHEL KABI sysctl: same results were gained as on the master branch. labels Jun 22, 2026

diffkemp-dev-bot Bot added the Success: RHEL sysctl stable RHEL KABI sysctl: same results were gained as on the master branch. label Jun 22, 2026

davidkre525 force-pushed the global-variable-comparison branch from 9761afe to 3bec8a2 Compare June 22, 2026 15:45

diffkemp-dev-bot Bot added the Success: EqBench stable EqBench experiment: same results were gained as on the master branch. label Jun 23, 2026

diffkemp-dev-bot Bot added the Success: RHEL functions stable RHEL KABI functions: same results were gained as on the master branch. label Jun 23, 2026

diffkemp-dev-bot Bot added the Success: RHEL sysctl stable RHEL KABI sysctl: same results were gained as on the master branch. label Jun 23, 2026

davidkre525 force-pushed the global-variable-comparison branch from 3bec8a2 to 245ab69 Compare June 26, 2026 13:46

diffkemp-dev-bot Bot added the Success: EqBench stable EqBench experiment: same results were gained as on the master branch. label Jun 29, 2026

diffkemp-dev-bot Bot added the Success: RHEL functions stable RHEL KABI functions: same results were gained as on the master branch. label Jun 29, 2026

diffkemp-dev-bot Bot added the Failure: RHEL sysctl more NEQ/UNK/ERR RHEL KABI sysctl: more non-equal/unknown/error functions were gained than on the master branch. label Jun 29, 2026

davidkre525 added 3 commits June 29, 2026 09:36

Add tests for the result viewer

a5aa151

A few tests were added to test whether the result viewer can handle different shapes of the result comparison tree.

davidkre525 force-pushed the global-variable-comparison branch from 245ab69 to a5aa151 Compare June 29, 2026 10:10

Conversation

PLukas2018 commented Jun 17, 2026

Uh oh!

PLukas2018 commented Jun 17, 2026

Uh oh!

diffkemp-dev-bot Bot commented Jun 17, 2026

EqBench

Details for default optimization

Details for -O2 optimization

Uh oh!

diffkemp-dev-bot Bot commented Jun 17, 2026

RHEL functions

Uh oh!

diffkemp-dev-bot Bot commented Jun 17, 2026

RHEL sysctl

Details for 8.0-8.1

Details for 8.1-8.2

Details for 8.2-8.3

Details for 8.3-8.4

Details for 8.4-8.5

Uh oh!

PLukas2018 commented Jun 22, 2026

Uh oh!

diffkemp-dev-bot Bot commented Jun 22, 2026

EqBench

Details for default optimization

Details for -O2 optimization

Uh oh!

diffkemp-dev-bot Bot commented Jun 22, 2026

RHEL functions

Uh oh!

diffkemp-dev-bot Bot commented Jun 22, 2026

RHEL sysctl

Details for 8.0-8.1

Details for 8.1-8.2

Details for 8.2-8.3

Details for 8.3-8.4

Details for 8.4-8.5

Uh oh!

PLukas2018 commented Jun 23, 2026

Uh oh!

diffkemp-dev-bot Bot commented Jun 23, 2026

EqBench

Details for default optimization

Details for -O2 optimization

Uh oh!

diffkemp-dev-bot Bot commented Jun 23, 2026

RHEL functions

Uh oh!

diffkemp-dev-bot Bot commented Jun 23, 2026

RHEL sysctl

Details for 8.0-8.1

Details for 8.1-8.2

Details for 8.2-8.3

Details for 8.3-8.4

Details for 8.4-8.5

Uh oh!

PLukas2018 commented Jun 28, 2026

Uh oh!

PLukas2018 commented Jun 28, 2026

Uh oh!

diffkemp-dev-bot Bot commented Jun 29, 2026

EqBench

Details for default optimization

Details for -O2 optimization

Uh oh!

diffkemp-dev-bot Bot commented Jun 29, 2026

RHEL functions

Details for 8.0-8.1

Details for 8.1-8.2

Details for 8.2-8.3

Details for 8.3-8.4

Details for 8.4-8.5

Uh oh!

diffkemp-dev-bot Bot commented Jun 29, 2026

RHEL sysctl

Details for 8.0-8.1

Details for 8.1-8.2

Compared symbols newly evaluated as non-equal

Details for 8.2-8.3