Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Experiment/v2.0.0/no cuts or random access #684

Closed
wants to merge 2 commits into from

Conversation

SSoelvsten
Copy link
Owner

!! DO NOT MERGE !!

Another preliminary experiment for the paper on Multi-variable Quantification.

This comment was marked as off-topic.

Copy link

github-actions bot commented Jul 1, 2024

🔴 Regression Test (12-Queens)

'ssoelvsten/adiar/experiment/v2.0.0/no_cuts_or_random_access' is a change in performance of -46.19% (stdev: 0.30%).

... origin/main ssoelvsten/adiar/experiment/v2.0.0/no_cuts_or_random_access
Mean 11380.33 16637.00
Standard Deviation 13.50 50.12

Number of samples: 3

Copy link

github-actions bot commented Jul 1, 2024

🔴 Regression Test (Picotrav 'adder')

'ssoelvsten/adiar/experiment/v2.0.0/no_cuts_or_random_access' is a change in performance of -1147.93% (stdev: 0.31%).

... origin/main ssoelvsten/adiar/experiment/v2.0.0/no_cuts_or_random_access
Mean 9488.00 118403.33
Standard Deviation 29.46 305.68

Number of samples: 3

Copy link

github-actions bot commented Jul 1, 2024

🔴 Regression Test (QBF 'breakthrough_dual/3x6_10_bwnib')

'ssoelvsten/adiar/experiment/v2.0.0/no_cuts_or_random_access' is a change in performance of -309.56% (stdev: 0.74%).

... origin/main ssoelvsten/adiar/experiment/v2.0.0/no_cuts_or_random_access
Mean 5177.67 21205.67
Standard Deviation 38.37 86.63

Number of samples: 3

Copy link

github-actions bot commented Jul 1, 2024

🔴 Regression Test (QBF 'connect4/6x6_11_connect4_bwnib')

'ssoelvsten/adiar/experiment/v2.0.0/no_cuts_or_random_access' is a change in performance of -171.59% (stdev: 0.46%).

... origin/main ssoelvsten/adiar/experiment/v2.0.0/no_cuts_or_random_access
Mean 12044.00 32710.67
Standard Deviation 55.97 30.89

Number of samples: 3

Copy link

github-actions bot commented Jul 1, 2024

🔴 Regression Test (QBF 'breakthrough/3x4_19_bwnib')

'ssoelvsten/adiar/experiment/v2.0.0/no_cuts_or_random_access' is a change in performance of -129.41% (stdev: 0.93%).

... origin/main ssoelvsten/adiar/experiment/v2.0.0/no_cuts_or_random_access
Mean 22201.67 50933.33
Standard Deviation 81.71 473.21

Number of samples: 3

Copy link

github-actions bot commented Jul 1, 2024

🔴 Regression Test (QBF 'domineering/5x5_13_bwnib')

'ssoelvsten/adiar/experiment/v2.0.0/no_cuts_or_random_access' is a change in performance of -96.20% (stdev: 0.17%).

... origin/main ssoelvsten/adiar/experiment/v2.0.0/no_cuts_or_random_access
Mean 15271.00 29962.33
Standard Deviation 26.46 25.11

Number of samples: 3

Copy link

github-actions bot commented Jul 1, 2024

🔴 Regression Test (QBF 'ep_dual/8x8_6_e-8-1_p-2-3_bwnib')

'ssoelvsten/adiar/experiment/v2.0.0/no_cuts_or_random_access' is a change in performance of -397.70% (stdev: 1.18%).

... origin/main ssoelvsten/adiar/experiment/v2.0.0/no_cuts_or_random_access
Mean 5130.67 25535.33
Standard Deviation 60.47 89.32

Number of samples: 3

Copy link

github-actions bot commented Jul 1, 2024

🔴 Regression Test (QBF 'ep/8x8_7_e-8-1_p-3-4_bwnib')

'ssoelvsten/adiar/experiment/v2.0.0/no_cuts_or_random_access' is a change in performance of -150.28% (stdev: 2.46%).

... origin/main ssoelvsten/adiar/experiment/v2.0.0/no_cuts_or_random_access
Mean 29884.33 74794.67
Standard Deviation 532.85 1838.51

Number of samples: 3

Copy link

github-actions bot commented Jul 1, 2024

🔴 Regression Test (QBF 'httt/4x4_9_tippy_bwnib')

'ssoelvsten/adiar/experiment/v2.0.0/no_cuts_or_random_access' is a change in performance of -120.83% (stdev: 0.49%).

... origin/main ssoelvsten/adiar/experiment/v2.0.0/no_cuts_or_random_access
Mean 9381.67 20717.33
Standard Deviation 15.28 101.25

Number of samples: 3

Copy link

github-actions bot commented Jul 1, 2024

🔴 Regression Test (QBF 'hex/hein_08_5x5-11_bwnib')

'ssoelvsten/adiar/experiment/v2.0.0/no_cuts_or_random_access' is a change in performance of -111.24% (stdev: 2.15%).

... origin/main ssoelvsten/adiar/experiment/v2.0.0/no_cuts_or_random_access
Mean 16844.00 35580.67
Standard Deviation 109.03 765.00

Number of samples: 3

Copy link

github-actions bot commented Jul 1, 2024

🔴 Regression Test (14-Queens)

'ssoelvsten/adiar/experiment/v2.0.0/no_cuts_or_random_access' is a change in performance of -36.51% (stdev: 0.60%).

... origin/main ssoelvsten/adiar/experiment/v2.0.0/no_cuts_or_random_access
Mean 265625.67 362612.33
Standard Deviation 1593.10 2071.70

Number of samples: 3

Copy link

github-actions bot commented Jul 1, 2024

🔴 Regression Test (Picotrav 'arbiter')

'ssoelvsten/adiar/experiment/v2.0.0/no_cuts_or_random_access' is a change in performance of -930.40% (stdev: 0.47%).

... origin/main ssoelvsten/adiar/experiment/v2.0.0/no_cuts_or_random_access
Mean 64103.00 660517.00
Standard Deviation 248.50 3128.40

Number of samples: 3

@SSoelvsten SSoelvsten force-pushed the main branch 2 times, most recently from b167b6c to adf22ef Compare July 1, 2024 14:40
Copy link

github-actions bot commented Jul 1, 2024

🔴 Regression Test (Picotrav 'mem_ctrl')

'ssoelvsten/adiar/experiment/v2.0.0/no_cuts_or_random_access' is a change in performance of -905.77% (stdev: 0.90%).

... origin/main ssoelvsten/adiar/experiment/v2.0.0/no_cuts_or_random_access
Mean 115773.00 1164415.67
Standard Deviation 421.84 10477.60

Number of samples: 3

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant