Code

start from beginning of day#137

Code

Open

xinpw8 wants to merge 114 commits intoPufferAI:devPufferAI/PufferLib:devfrom xinpw8:j_enduro_prxinpw8/PufferLib:j_enduro_prCopy head branch name to clipboard

+2,889-2,678

Commits

Commits on Oct 31, 2024

• first commit

  XanderKehoe

  committed
  08718c5

  Copy full SHA for 08718c5

Commits on Nov 2, 2024

• successfully training env

  XanderKehoe

  committed
  520473c

  Copy full SHA for 520473c

Commits on Nov 5, 2024

• moving towards c implementation of env

  XanderKehoe

  committed
  df12494

  Copy full SHA for df12494

Commits on Nov 6, 2024

• updated main script to handle more run_modes and other refactors

  XanderKehoe

  committed
  a69c7ea

  Copy full SHA for a69c7ea

• fixed minor bugs with saving models

  XanderKehoe

  committed
  5a80774

  Copy full SHA for 5a80774

Commits on Nov 7, 2024

• Merge branch 'dev' of https://github.com/pufferai/pufferlib into trash_pickup

  XanderKehoe

  committed
  c5c7f32

  Copy full SHA for c5c7f32

• Added documentation, but video mode still doesn't work...

  XanderKehoe

  committed
  4037e7a

  Copy full SHA for 4037e7a

• added video rendering support and other minor fixes

  XanderKehoe

  committed
  1d722e9

  Copy full SHA for 1d722e9

Commits on Nov 10, 2024

• updated env to have optional continuous reward signal for distance to objective for each agent

  XanderKehoe

  committed
  a4c4150

  Copy full SHA for a4c4150

• updated from CNN to just linear layer with one-hot encoding

  XanderKehoe

  committed
  3606465

  Copy full SHA for 3606465

Commits on Nov 14, 2024

• pre grid replacement obs update

  XanderKehoe

  committed
  29cfa06

  Copy full SHA for 29cfa06

Commits on Nov 16, 2024

• clean up

  XanderKehoe

  committed
  1ba058c

  Copy full SHA for 1ba058c

• removed .pt files

  XanderKehoe

  committed
  ff682b9

  Copy full SHA for ff682b9

• updated README.md with new gif

  XanderKehoe

  committed
  7bc4f80

  Copy full SHA for 7bc4f80

• clean up

  XanderKehoe

  committed
  595bb3c

  Copy full SHA for 595bb3c

Commits on Nov 18, 2024

• added validation checks when initializing environment and re-added grid as an optional observation space

  XanderKehoe

  committed
  726c169

  Copy full SHA for 726c169

• Merge branch 'dev' of https://github.com/pufferai/pufferlib into trash_pickup

  XanderKehoe

  committed
  f6c686a

  Copy full SHA for f6c686a

Commits on Nov 19, 2024

• Addressed feedback from Joseph

  XanderKehoe

  committed
  96f3459

  Copy full SHA for 96f3459

• fixed some bugs

  XanderKehoe

  committed
  e61c313

  Copy full SHA for e61c313

• fixed performance bugs with how num_agents was set

  XanderKehoe

  committed
  71ade21

  Copy full SHA for 71ade21

• added new .ini file changes

  XanderKehoe

  committed
  82d4228

  Copy full SHA for 82d4228

• Merge branch 'dev' of https://github.com/pufferai/pufferlib into trash_pickup

  XanderKehoe

  committed
  c01158d

  Copy full SHA for c01158d

• undo rware changes

  XanderKehoe

  committed
  1dbc318

  Copy full SHA for 1dbc318

• removed .gif from readme

  XanderKehoe

  committed
  e983821

  Copy full SHA for e983821

• cleaned up .c & .h files

  XanderKehoe

  committed
  bfe8d1d

  Copy full SHA for bfe8d1d

Commits on Nov 20, 2024

• Fixed bugs in env

  XanderKehoe

  committed
  8469004

  Copy full SHA for 8469004

• removed old comment

  XanderKehoe

  committed
  3a4571b

  Copy full SHA for 3a4571b

Commits on Nov 22, 2024

• added user stats tracking and observation space buffer

  XanderKehoe

  committed
  67883e0

  Copy full SHA for 67883e0

• adding custom network for env

  XanderKehoe

  committed
  16d2821

  Copy full SHA for 16d2821

• added new custom network

  XanderKehoe

  committed
  96dd3d2

  Copy full SHA for 96dd3d2

• simplified env for testing purposes

  XanderKehoe

  committed
  55fc290

  Copy full SHA for 55fc290

Commits on Nov 23, 2024

• minor changes

  XanderKehoe

  committed
  03e5784

  Copy full SHA for 03e5784

Commits on Nov 24, 2024

• made all agents get a reward when trash is picked up or deposited instead of just one agent, promoting collaborating rather than competition

  XanderKehoe

  committed
  4864568

  Copy full SHA for 4864568

Commits on Nov 26, 2024

• addressed feedback but now segfaulting...

  XanderKehoe

  committed
  caf8f43

  Copy full SHA for caf8f43

• fixed some more issues, but weird bugs with the agents spirit inhabiting the body of the trash bin and controlling it, leaving its own body behind...

  XanderKehoe

  committed
  a414bc5

  Copy full SHA for a414bc5

• fixed ghost bug

  XanderKehoe

  committed
  63733b3

  Copy full SHA for 63733b3

• fixed more issues

  XanderKehoe

  committed
  437f70e

  Copy full SHA for 437f70e

• pulled in latest dev branch and resolved merge conflict

  XanderKehoe

  committed
  ffbd13c

  Copy full SHA for ffbd13c

• Updated model code, but getting 'Broken pipe' error now

  XanderKehoe

  committed
  437d9c6

  Copy full SHA for 437d9c6

Commits on Nov 27, 2024

• Merge branch 'dev' of https://github.com/pufferai/pufferlib into trash_pickup

  XanderKehoe

  committed
  2e749a1

  Copy full SHA for 2e749a1

Commits on Nov 30, 2024

• clean up

  XanderKehoe

  committed
  3981186

  Copy full SHA for 3981186

• removed unused macro definition

  XanderKehoe

  committed
  2c4ef0f

  Copy full SHA for 2c4ef0f

• fixed allocation of obs space

  XanderKehoe

  committed
  8619993

  Copy full SHA for 8619993

Commits on Dec 6, 2024

• start from beginning of day

  

  xinpw8

  committed
  2b0d2fc

  Copy full SHA for 2b0d2fc

Commits on Dec 7, 2024

• Pedantic compiler

  

  Joseph Suarez

  committed
  d13c4cf

  Copy full SHA for d13c4cf

Commits on Dec 8, 2024

• Version

  

  Joseph Suarez

  committed
  c9a4e0e

  Copy full SHA for c9a4e0e

• Start day randomizer

  

  Joseph Suarez

  committed
  958dbac

  Copy full SHA for 958dbac

• remove old pokemon stuff

  

  Joseph Suarez

  committed
  a544f5a

  Copy full SHA for a544f5a

• Update readme

  

  Joseph Suarez

  committed
  f3ab711

  Copy full SHA for f3ab711

• Trailer

  

  Joseph Suarez

  committed
  f2485ad

  Copy full SHA for f2485ad

Commits on Dec 9, 2024

• release

  

  Joseph Suarez

  committed
  ccef676

  Copy full SHA for ccef676

• Fix sneaky github

  

  Joseph Suarez

  committed
  0147384

  Copy full SHA for 0147384

• bump version

  

  Joseph Suarez

  committed
  af5d828

  Copy full SHA for af5d828

Commits on Dec 12, 2024

• Update pong.py

  thedch

  authored
  aa29f27

  Copy full SHA for aa29f27

Commits on Dec 21, 2024

• Merge pull request PufferAI#138 from thedch/patch-1

  Show description for 1885902
  jsuarez5341

  authored
  1885902

  Copy full SHA for 1885902

• Initial dev on vec infra refactor

  

  Joseph Suarez

  committed
  d6935bb

  Copy full SHA for d6935bb

• Makes PufferLib compatible with Python3.12. Probably doesn't break anything important

  

  Joseph Suarez

  committed
  d06946e

  Copy full SHA for d06946e

• Merge branch '2.0' of https://github.com/pufferai/pufferlib into 2.0

  

  Joseph Suarez

  committed
  5a0a22e

  Copy full SHA for 5a0a22e

• Fix bug

  

  Joseph Suarez

  committed
  952e935

  Copy full SHA for 952e935

• addressed some feedback, pulling in 2.0-dev

  XanderKehoe

  committed
  6039a11

  Copy full SHA for 6039a11

• Merge branch '2.0-dev' of https://github.com/pufferai/pufferlib into trash_pickup

  XanderKehoe

  committed
  f2778b4

  Copy full SHA for f2778b4

• Revert numpy

  

  Joseph Suarez

  committed
  a5a054b

  Copy full SHA for a5a054b

• Serial single-agent working, multiagent in progress

  

  Joseph Suarez

  committed
  91f04e4

  Copy full SHA for 91f04e4

• Fix multiagent serial with new buffers

  

  Joseph Suarez

  committed
  a61a0a2

  Copy full SHA for a61a0a2

• Initial fixes for multiprocessing

  

  Joseph Suarez

  committed
  719bb9b

  Copy full SHA for 719bb9b

Commits on Dec 22, 2024

• addressed some feedback, but getting segfault when trying to train...

  XanderKehoe

  committed
  b69a670

  Copy full SHA for b69a670

• Serial support for Native PufferEnvs. Up to 1M sps train in pure python for light envs. Required a bunch of emulation refactors

  

  Joseph Suarez

  committed
  e78202b

  Copy full SHA for e78202b

• Merge pull request PufferAI#140 from PufferAI/2.0-dev

  Show description for 48ac6c2
  jsuarez5341

  authored
  48ac6c2

  Copy full SHA for 48ac6c2

Commits on Dec 23, 2024

• Reimplemented 2D Local Crop Obs Space

  XanderKehoe

  committed
  28e6dd4

  Copy full SHA for 28e6dd4

• Merge pull request PufferAI#126 from XanderKehoe/trash_pickup

  Show description for b035dcc
  jsuarez5341

  authored
  b035dcc

  Copy full SHA for b035dcc

• Trash pickup fixes. Policy learns now

  

  Joseph Suarez

  committed
  7b2ba16

  Copy full SHA for 7b2ba16

• reskin

  

  Joseph Suarez

  committed
  eae70c7

  Copy full SHA for eae70c7

• Trash pickup

  

  Joseph Suarez

  committed
  efac335

  Copy full SHA for efac335

• Merge pull request PufferAI#141 from PufferAI/2.0-dev

  Show description for 0193b26
  jsuarez5341

  authored
  0193b26

  Copy full SHA for 0193b26

Commits on Dec 24, 2024

• add a barebones github action and status badge

  thatguy11325

  committed
  e5168f9

  Copy full SHA for e5168f9

• Integrate Daniel's Mac build fixes

  

  Joseph Suarez

  committed
  f9a5688

  Copy full SHA for f9a5688

• Merge pull request PufferAI#144 from PufferAI/2.0-dev

  Show description for debb0ef
  jsuarez5341

  authored
  debb0ef

  Copy full SHA for debb0ef

• add macos

  thatguy11325

  committed
  7fa25a8

  Copy full SHA for 7fa25a8

• Merge pull request PufferAI#143 from thatguy11325/github-action

  Show description for 4918ccb
  jsuarez5341

  authored
  4918ccb

  Copy full SHA for 4918ccb

• Update install.yml

  jsuarez5341

  authored
  4e793cf

  Copy full SHA for 4e793cf

Commits on Dec 27, 2024

• Small enduro refactor

  

  Joseph Suarez

  committed
  8c4c0f0

  Copy full SHA for 8c4c0f0

• Merge pull request PufferAI#145 from PufferAI/2.0-dev

  Show description for e185fed
  jsuarez5341

  authored
  e185fed

  Copy full SHA for e185fed

• Fix trash pickup obs: 1m sps train

  

  Joseph Suarez

  committed
  eb77c95

  Copy full SHA for eb77c95

• Merge pull request PufferAI#146 from PufferAI/2.0-dev

  Show description for c543e3d
  jsuarez5341

  authored
  c543e3d

  Copy full SHA for c543e3d

Commits on Jan 1, 2025

• Merge remote-tracking branch 'pufferai/2.0' into j_enduro_pr

  

  xinpw8

  committed
  4e3db19

  Copy full SHA for 4e3db19

• removed fn prototypes, removed verbose infos logging in cython, some other stuff

  

  xinpw8

  committed
  6b5135c

  Copy full SHA for 6b5135c

Commits on Jan 2, 2025

• cleaned up some things

  

  xinpw8

  committed
  986b3fa

  Copy full SHA for 986b3fa

Commits on Jan 3, 2025

• some cleanup

  

  xinpw8

  committed
  4933556

  Copy full SHA for 4933556

• 1744 lines enduro.h. removed client struct; replaced with gamestate. removed redundant logic.

  

  xinpw8

  committed
  734acd8

  Copy full SHA for 734acd8

Commits on Jan 4, 2025

• significant line reduction and refactor

  

  xinpw8

  committed
  82257fc

  Copy full SHA for 82257fc

Commits on Jan 5, 2025

• refactor; logging is broken a little maybe. still trains and beats 9 days on eval

  

  xinpw8

  committed
  bae3af2

  Copy full SHA for bae3af2

Commits on Jan 6, 2025

• final changes, removed some gamestate struc vars that weren't used. still need to figure out why logging isn't smooth and also fix speed score increment

  

  xinpw8

  committed
  1bf5702

  Copy full SHA for 1bf5702

Commits on Jan 7, 2025

• logging is mostly fixed. still intermittent initially, but much better than previous.

  

  xinpw8

  committed
  821018f

  Copy full SHA for 821018f

Commits on Jan 11, 2025

• cleaned up a few things

  

  xinpw8

  committed
  fc3dee3

  Copy full SHA for fc3dee3

Commits on Jan 12, 2025

• refactor to remove extraneous code and consolidate init() and reset() fns.

  

  xinpw8

  committed
  791bfe5

  Copy full SHA for 791bfe5

• final edit, finishing touches. Python perf test: SPS: 2,045,564.3756013566 on mediocre hardware. C perf test: SPS: 333299.687500. added README. formatted w/ clang-tidy Google for succinctness and r…

  Show description for fcba83c
  

  xinpw8

  committed
  fcba83c

  Copy full SHA for fcba83c

Commits on Jan 15, 2025

• Very dumb change. Prefix c functions with c_ to prevent Conda's garbage compiler from breaking

  

  Joseph Suarez

  committed
  c1dc549

  Copy full SHA for c1dc549

• Link path fixes for package build

  

  Joseph Suarez

  committed
  25ccb93

  Copy full SHA for 25ccb93

• Switch to static linking to avoid much pain and suffering

  

  Joseph Suarez

  committed
  dcff243

  Copy full SHA for dcff243

• Remove arg for mac

  

  Joseph Suarez

  committed
  ec53ba0

  Copy full SHA for ec53ba0

• Add conda to ci

  

  Joseph Suarez

  committed
  770e994

  Copy full SHA for 770e994

• Add conda to ci

  jsuarez5341

  authored
  e881766

  Copy full SHA for e881766

• Fix conda ci

  jsuarez5341

  authored
  f63ed9b

  Copy full SHA for f63ed9b

• Fix miniconda version

  jsuarez5341

  authored
  e18bc65

  Copy full SHA for e18bc65

• Merge workflow

  

  Joseph Suarez

  committed
  40827e0

  Copy full SHA for 40827e0

Commits on Jan 17, 2025

• 4 space

  

  xinpw8

  committed
  8bee0f7

  Copy full SHA for 8bee0f7

• formatting fixed

  

  xinpw8

  committed
  d2916b5

  Copy full SHA for d2916b5

• further refactors: put logs with logs, removed unused variables from gamestate, renamed gamestate to client, c_* welcome back, 4 space tabs, fixed annoying formatting width, spritesheet flatmap spl…

  Show description for e310000
  

  xinpw8

  committed
  e310000

  Copy full SHA for e310000

• minor fixes. TODO: init() reset() swap

  

  xinpw8

  committed
  9ffddf4

  Copy full SHA for 9ffddf4

Commits on Jan 18, 2025

• merge down 2.0

  

  xinpw8

  committed
  e0ef6bc

  Copy full SHA for e0ef6bc

• TODO: cars_to_pass isn't being returned in the logging, and i am unsure as to why.

  

  xinpw8

  committed
  8d721af

  Copy full SHA for 8d721af

Commits on Jan 19, 2025

• enduro is complete.

  

  xinpw8

  committed
  4605438

  Copy full SHA for 4605438

Commits on Jan 20, 2025

• refactor 2. SPS: 332174.312500 c profile, SPS: 2,130,944.0023679365 python profile. random start times for training, start from begininng for eval.

  

  xinpw8

  committed
  b430721

  Copy full SHA for b430721

• removed an extra call to init in enduro.c

  

  xinpw8

  committed
  1e2244f

  Copy full SHA for 1e2244f