Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add MountainCar-V0 to DynSys #28

Open
wants to merge 3 commits into
base: master
Choose a base branch
from

Conversation

michael-lauria
Copy link

@michael-lauria michael-lauria commented Aug 9, 2021

I'm looking into backwards reachability in MountainCar-V0 and was hoping to use this package. Here is my effort so far, but I'm not able to get the reachable set to grow to include the usual starting point at (-0.4, 0). (see video attached)

reach_fail_mountain_car.mp4

If someone has some time to help me out:

  1. Is there something obvious that I am doing wrong?
  2. Is my choice of optimal control the problem? (assumed it works from https://github.com/openai/gym/wiki/Leaderboard#mountaincar-v0, but could verify somehow?)
  3. Any other suggestions at all! Thank you!

EDIT: Here is a video with a denser grid. I am trying to investigate the narrow passage in state space, so this is almost expected, but I'm hoping to see it make it to the other side.

1841_grid.mp4

EDIT 2: I think I managed to fix the optimal control. The latest video is below. I used a grid of 181 x 181 and run for 600 time steps (60 "seconds") . The reachable set still does not approach the initial conditions.

181_grid_new.mp4

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants