Skip to content

Decision tree-based policy synthesis for f-MDPs #65

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
laDok8 wants to merge 82 commits into
base: master
from
Draft

Decision tree-based policy synthesis for f-MDPs #65

Changes from all commits
Commits
Show all changes
82 commits
Select commit Hold shift + click to select a range
8e7b7c1
First version of DtControl integration (still waiting for fix in DtCo…
TheGreatfpmK Jan 9, 2025
d786696
Merge remote-tracking branch 'upstream/master' into dt-update
TheGreatfpmK Jan 9, 2025
fa34135
Subtree synthesis bug fixes
TheGreatfpmK Jan 26, 2025
d4d189b
Merge remote-tracking branch 'upstream/master' into dt-update
TheGreatfpmK Jan 26, 2025
3213064
Forgot to add one conflict resolution
TheGreatfpmK Jan 26, 2025
d5cec96
Fixed bug with epsilon threshold not being respected
TheGreatfpmK Jan 27, 2025
67c452a
code optimizations; normalized epsilon synthesis; some fixes
TheGreatfpmK Feb 3, 2025
52aeb63
added breaking on first found subtree
TheGreatfpmK Feb 3, 2025
0d3160a
Merge remote-tracking branch 'upstream/master' into dt-update
TheGreatfpmK Feb 3, 2025
d69da55
forgot to resolve one conflict
TheGreatfpmK Feb 3, 2025
1c8735d
more optimizations
TheGreatfpmK Feb 3, 2025
0a14ec3
added recomputation of scheduler
TheGreatfpmK Feb 4, 2025
0b5e596
Merge remote-tracking branch 'upstream/init-optimized' into dt-update
TheGreatfpmK Feb 4, 2025
fdbfcdd
added stuff for experiments
TheGreatfpmK Feb 4, 2025
a41698c
changed the prioritization of choosing trees
TheGreatfpmK Feb 4, 2025
a69ed99
added options for different dtcontrol settings
TheGreatfpmK Feb 4, 2025
4082e59
testing something
TheGreatfpmK Feb 5, 2025
481ece0
removing value based heuristic
TheGreatfpmK Feb 5, 2025
bff581c
adding all the different trees produced by different dtcontrol settings
TheGreatfpmK Feb 5, 2025
e2523cc
added option to choose dtcontrol initial tree
TheGreatfpmK Feb 5, 2025
c13a096
Fixed error when subtree has 0 relevant states
TheGreatfpmK Feb 6, 2025
f24f1ac
added option for using number of states as a heuristic for node queue
TheGreatfpmK Feb 6, 2025
b50c8de
added tictactoe model
TheGreatfpmK Feb 7, 2025
537e50b
added all trees for tictactoe
TheGreatfpmK Feb 7, 2025
4a19001
updated schedulers
TheGreatfpmK Mar 20, 2025
c35dec7
sanity checks for family split
randriu Feb 7, 2025
7e00544
remove redundant checks in ColoringSmt::selectCompatibleChoices
randriu Feb 8, 2025
8087a63
fix policy tree double-check
randriu Feb 11, 2025
0636832
possible fix for issue with with build on M1
TheGreatfpmK Feb 18, 2025
e8a0cb0
test setup and one initial test
TheGreatfpmK Feb 18, 2025
57d7465
added exact test for add dont care action
TheGreatfpmK Feb 19, 2025
5e7098e
added way to load paynt models for tests; added one example test for …
TheGreatfpmK Feb 20, 2025
dd4e680
Fixed the memory strategy for SAYNT to correspond to CAV algorithm as…
TheGreatfpmK Feb 23, 2025
f8f7788
fix different argument types for std::max
randriu Feb 27, 2025
7939995
added function that creates SAYNT FSC
TheGreatfpmK Mar 6, 2025
0f09c34
enable DTmap calls for ATVApaynt
laDok8 Dec 23, 2024
6de165d
reduce state space for dtMap
laDok8 Dec 26, 2024
7b1025a
rebase fixes for DT irrelevant states
laDok8 Jan 19, 2025
2d2240f
fix default value for irrelevant states
laDok8 Jan 19, 2025
02c2ce3
work on combining policy and decision trees
laDok8 Feb 8, 2025
c7acca8
fix policy tree invalid merging
laDok8 Feb 14, 2025
fcc3b35
add test model
laDok8 Feb 21, 2025
60bcb89
update atva models with self loop
laDok8 Mar 6, 2025
7e4fc23
update for combining policy with decision trees and policy minimization
laDok8 Mar 6, 2025
d80d759
revert redundant changes
laDok8 Mar 8, 2025
ef2a39e
41&21
laDok8 Mar 9, 2025
cb71a01
postprocess granularity update
laDok8 Mar 11, 2025
1829aff
refactor
laDok8 Mar 15, 2025
c46d444
improve policy culling for F-MDP
laDok8 Mar 15, 2025
9cc9384
rebase fixes dtNest
laDok8 Mar 19, 2025
da3b4f4
WIP: local dtControl
laDok8 Mar 19, 2025
8675d1e
WIP: ldok previous work works
laDok8 Mar 19, 2025
f7931a8
WIP: dtMap invocation from ATVA24 works
laDok8 Mar 19, 2025
7990752
WIP: adapt policy tree for dtNest
laDok8 Mar 28, 2025
47ccd17
demo3 works
laDok8 Mar 28, 2025
bae1f9f
obstacles-demo works, weird MDP values
laDok8 Mar 29, 2025
64b30a9
multiple policies work, weird MDP values
laDok8 Mar 29, 2025
ef7a4a7
fix memory leak & cleanup
laDok8 Apr 5, 2025
f6e10d1
add stay action for remaining models
laDok8 Apr 5, 2025
8c7fe0f
dtNest calling completed
laDok8 Apr 5, 2025
5220e80
dtNest fixes & model updates
laDok8 Apr 6, 2025
98e1a88
refactor
laDok8 Apr 8, 2025
5c018aa
bugfix
laDok8 Apr 9, 2025
ebf6c92
refactor
laDok8 Apr 21, 2025
5a25b63
update stay action
laDok8 Apr 22, 2025
2985821
programatic noop action
laDok8 Apr 23, 2025
35cf627
refactor action name
laDok8 Apr 23, 2025
1739d34
improve gitignore
laDok8 Apr 23, 2025
c5cb6b3
multiple end states support
laDok8 Apr 23, 2025
c442890
refactor to policy_tree
laDok8 Apr 23, 2025
36b706c
further methods refactoring
laDok8 Apr 23, 2025
e6d32a3
noop cleanup
laDok8 Apr 23, 2025
7be60c0
WIP: remove later
laDok8 Apr 24, 2025
9ea0151
fix dtNest
laDok8 Apr 24, 2025
f67107c
better demo
laDok8 Apr 24, 2025
fe8001b
improve UX
laDok8 May 6, 2025
5790920
refactor
laDok8 May 7, 2025
a870221
per policy dtNest
laDok8 May 7, 2025
7c77c6e
update install guide
laDok8 May 7, 2025
d486432
add Candidate Map tree
laDok8 May 7, 2025
ac3b587
dtcontrol change final
laDok8 May 8, 2025
a95d018
correct CMT
laDok8 May 8, 2025

Sorry, this diff is taking too long to generate.

It may be too large to display on GitHub.