GitHub - Pdbz199/Koopman-RL-Old: Data-driven Koopman control theory applied to reinforcement learning!

1 Branch 0 Tags

Name	Name	Last commit message	Last commit date
Latest commit Pdbz199 Starting from optimal value function weights doesn't work Aug 23, 2023 d3146d2 · Aug 23, 2023 History 525 Commits
final	final	Starting from optimal value function weights doesn't work	Aug 23, 2023
koopman_tensor	koopman_tensor	Movie	Dec 12, 2022
misc	misc	Work on AC	Apr 27, 2023
optimal_agent	optimal_agent	Trying to generalize, but LQR isn't working	Aug 15, 2022
random_agent	random_agent	Trying to generalize, but LQR isn't working	Aug 15, 2022
.gitignore	.gitignore	New SAC Implementation Working	May 25, 2023
Control Algorithms 10.28.2021.ipynb	Control Algorithms 10.28.2021.ipynb	New notebook with algorithm updates	Nov 4, 2021
Control Algorithms 11.04.2021.ipynb	Control Algorithms 11.04.2021.ipynb	Stuff	Nov 7, 2021
DoubleWell_GenerateData.py	DoubleWell_GenerateData.py	Added Stefan's DoubleWell gen data script and started work on 1D DW c…	Nov 17, 2021
Koopman RL 3-26.ipynb	Koopman RL 3-26.ipynb	Minor changes	May 15, 2021
Koopman RL 3-26.py	Koopman RL 3-26.py	Nearly complete notebook!	Mar 28, 2021
Koopman RL 4-15.ipynb	Koopman RL 4-15.ipynb	Includes nice package for fitting a model!	Apr 17, 2021
Koopman RL 4-15.py	Koopman RL 4-15.py	Minor changes	May 15, 2021
Koopman RL 5-5.ipynb	Koopman RL 5-5.ipynb	Faster integration +notebooks!	May 6, 2021
Koopman RL 5-5.py	Koopman RL 5-5.py	Faster integration +notebooks!	May 6, 2021
Koopman RL 6-10.ipynb	Koopman RL 6-10.ipynb	oops	Apr 30, 2022
Q_table.npy	Q_table.npy	Initial commit	Mar 13, 2021
RL.py	RL.py	Multiple Koopman approach implemented	May 15, 2021
__init__.py	__init__.py	LQR policy iteration is finicky	Aug 15, 2022
algorithms.py	algorithms.py	Attempts at checking validity of value iteration	May 4, 2021
algorithmsv2.py	algorithmsv2.py	Removed loop over X in pi_us	Jan 16, 2022
algorithmsv2_parallel.py	algorithmsv2_parallel.py	Cartpole works (using NN)	Apr 27, 2022
animation.gif	animation.gif	Cartpole work	Mar 5, 2022
auxiliaries.py	auxiliaries.py	Working with periodic kernel	Jul 16, 2021
base.py	base.py	Includes nice package for fitting a model!	Apr 17, 2021
bellman-weights.npy	bellman-weights.npy	Updates	Jan 29, 2022
brownian.py	brownian.py	Implementing generator operator	Mar 21, 2021
cartpole-actor-critic.py	cartpole-actor-critic.py	Actor critic code	Oct 16, 2022
cartpole_discrete_koopman_actor_critic.py	cartpole_discrete_koopman_actor_critic.py	Work on actor critic and generalizing code; lqr still not working	Oct 17, 2022
cartpole_reward.py	cartpole_reward.py	Fixed w_hat computation, but Q is still way off	May 5, 2022
conda-requirements.txt	conda-requirements.txt	Work on AC	Apr 27, 2023
conda-requirements.yml	conda-requirements.yml	Changes	Jul 10, 2023
domain.py	domain.py	Progress on double well control	Sep 21, 2021
edmd-rff-kernel.py	edmd-rff-kernel.py	Includes action path testing	May 15, 2021
estimate-drift-and-variance.py	estimate-drift-and-variance.py	Some small updates	Jul 23, 2021
estimate_L.py	estimate_L.py	Tests on DW Discrete ABE--it converges!	Dec 16, 2021
faster_integration.py	faster_integration.py	New control algorithm implemented	Sep 23, 2021
gedmd.py	gedmd.py	Implemented CartPole reward function	Apr 5, 2021
gedmdTest.py	gedmdTest.py	Progress on double well control	Sep 21, 2021
general_model.py	general_model.py	Attempts at checking validity of value iteration	May 4, 2021
generator.py	generator.py	Includes nice package for fitting a model!	Apr 17, 2021
gradient.py	gradient.py	Attempt at predicting brownian mechanics	May 6, 2021
hjb-koopman-control.py	hjb-koopman-control.py	Working with periodic kernel	Jul 16, 2021
iterative-lqr.py	iterative-lqr.py	Some small updates	Jul 23, 2021
kernel-koopman.py	kernel-koopman.py	Working with periodic kernel	Jul 16, 2021
kernels.py	kernels.py	Added kernels	May 11, 2021
klus_algos.py	klus_algos.py	Updates but not much	Sep 18, 2021
koopman-control.py	koopman-control.py	Working with periodic kernel	Jul 16, 2021
koopman-taxi.py	koopman-taxi.py	Some testing	Aug 12, 2021
koopman-tensor-cartpole.py	koopman-tensor-cartpole.py	Big updates	Aug 5, 2021
koopman.py	koopman.py	Implemented new a matrix solution	Mar 26, 2021
lambda-labs-requirements.txt	lambda-labs-requirements.txt	Lambda labs requirements	Oct 31, 2022
lqr-cartpole-swing-up.py	lqr-cartpole-swing-up.py	Cartpole work	Mar 5, 2022
multi-koopman.py	multi-koopman.py	Working with periodic kernel	Jul 16, 2021
observables.py	observables.py	Work on SAC and SAKC	Jun 1, 2023
observables.py.BAK	observables.py.BAK	SAC Working on Fluid Flow, Koopman versions not working yet	Mar 2, 2023
pip-requirements.txt	pip-requirements.txt	Work on AC	Apr 27, 2023
predict_brownian.py	predict_brownian.py	Why doesn't brownian work...	May 9, 2021
random-taxi-agent.py	random-taxi-agent.py	Koopman tensor work!	Aug 6, 2021
randomRL.py	randomRL.py	Some changes	May 16, 2021
rrr.py	rrr.py	Updates, work on new progress notebook	Apr 15, 2021
scrap.py	scrap.py	Implemented order five monomials manually	Apr 27, 2021
simple_env.py	simple_env.py	Attempts at checking validity of value iteration	May 4, 2021
sindy.py	sindy.py	Includes nice package for fitting a model!	Apr 17, 2021
state-action-inputs.npy	state-action-inputs.npy	Re-collected data	Mar 14, 2021
state-action-outputs.npy	state-action-outputs.npy	Re-collected data	Mar 14, 2021
system_identification.py	system_identification.py	Added sample usage file	Apr 8, 2021
systems.py	systems.py	Added ornstein-uhlenback system and more	May 9, 2021
tensor-approach.py	tensor-approach.py	Some modifications and prediction error testing	May 16, 2021
test_model.py	test_model.py	Attempts at checking validity of value iteration	May 4, 2021
test_mppi.py	test_mppi.py	File with PyTorch MPPI outline	May 7, 2021
test_observables.py	test_observables.py	Fixed TensorFlow observables	Nov 10, 2021
tf_algorithmsv2.py	tf_algorithmsv2.py	Vectorization has started	Nov 10, 2021
tf_observables.py	tf_observables.py	Some updates	Nov 10, 2021
tools.py	tools.py	Why doesn't brownian work...	May 9, 2021
utilities.py	utilities.py	Updates	Apr 4, 2022
williams-paper.py	williams-paper.py	Final attempt from Williams paper	Mar 18, 2021