Repositories list

• POMDPs.jl

  Public
  MDPs and POMDPs in Julia - An interface for defining, solving, and simulating fully and partially observable Markov decision processes on discrete and continuous spaces.

  pythonreinforcement-learningartificial-intelligence+ 6pomdpsreinforcement-learning-algorithmscontrol-systemsmarkov-decision-processesmdpsjulia

  Julia

  •

  Other

  •105•678•21•2•Updated Dec 15, 2024Dec 15, 2024

• QuickPOMDPs.jl

  Public
  Concise and friendly interfaces for defining MDP and POMDP models for use with POMDPs.jl solvers

  pythonjuliamarkov-decision-processes+ 2mdpspomdps

  Julia

  •

  Other

  •7•29•9•1•Updated Nov 19, 2024Nov 19, 2024

• CompressedBeliefMDPs.jl

  Public
  Compressed belief-state MDPs in Julia for reinforcement learning and sequential decision making. Part of the POMDPs.jl community.

  compressionreinforcement-learningjulia+ 5artificial-intelligencepomdpsdimensionality-reductionmarkov-decision-processesmdps

  Julia

  •

  MIT License

  •0•5•1•0•Updated Nov 18, 2024Nov 18, 2024

• ParticleFilters.jl

  Public
  Simple particle filter implementation in Julia - works with POMDPs.jl models or others.

  Julia

  •

  Other

  •16•46•10•3•Updated Nov 14, 2024Nov 14, 2024

• POMDPExamples.jl

  Public archive
  Examples and Tutorials for POMDPs.jl

  Jupyter Notebook

  •

  MIT License

  •26•29•1•0•Updated Sep 12, 2024Sep 12, 2024

• POMDPGallery.jl

  Public archive
  A gallery of POMDPs.jl problems

  machine-learningreinforcement-learningpomdps

  Julia

  •

  Other

  •10•48•1•0•Updated Sep 12, 2024Sep 12, 2024

• TagPOMDPProblem.jl

  Public
  Tag POMDP problem using POMDPS.jl

  Julia

  •

  MIT License

  •1•2•2•0•Updated Aug 12, 2024Aug 12, 2024

• NativeSARSOP.jl

  Public
  Julia

  •

  MIT License

  •6•6•7•5•Updated Jul 29, 2024Jul 29, 2024

• ARDESPOT.jl

  Public
  Implementation of the AR-DESPOT POMDP algorithm

  Julia

  •

  Other

  •8•12•8•1•Updated Jul 8, 2024Jul 8, 2024

• POMDPFiles.jl

  Public
  Julia

  •

  Other

  •6•6•3•1•Updated Jul 1, 2024Jul 1, 2024

• MCTS.jl

  Public
  Monte Carlo Tree Search for Markov decision processes using the POMDPs.jl framework

  Julia

  •

  Other

  •34•77•8•4•Updated Jun 19, 2024Jun 19, 2024

• LaserTag.jl

  Public
  Jupyter Notebook

  •

  Other

  •8•4•3•2•Updated Jun 14, 2024Jun 14, 2024

• AEMS.jl

  Public
  Anytime error minimization search for POMDPs, implemented in Julia.

  Julia

  •

  Other

  •3•6•1•0•Updated Jun 14, 2024Jun 14, 2024

• GlobalApproximationValueIteration.jl

  Public
  Julia

  •

  MIT License

  •6•6•1•0•Updated Jun 14, 2024Jun 14, 2024

• TabularTDLearning.jl

  Public
  Julia implementations of temporal difference Reinforcement Learning algorithms like Q-Learning and SARSA

  reinforcement-learningq-learningsarsa

  Julia

  •

  Other

  •6•10•1•0•Updated Jun 14, 2024Jun 14, 2024

• MCVI.jl

  Public
  Julia

  •

  Other

  •3•5•3•0•Updated Jun 14, 2024Jun 14, 2024

• DeepQLearning.jl

  Public
  Implementation of the Deep Q-learning algorithm to solve MDPs

  machine-learningreinforcement-learningdeep-reinforcement-learning+ 1pomdps

  Julia

  •

  Other

  •13•73•8•0•Updated Jun 14, 2024Jun 14, 2024

• FiniteHorizonValueIteration.jl

  Public
  Julia

  •

  MIT License

  •2•2•0•0•Updated Jun 14, 2024Jun 14, 2024

• FIB.jl

  Public
  Fast informed bound solver for POMDPs.

  Julia

  •

  Other

  •3•2•3•0•Updated Jun 14, 2024Jun 14, 2024

• POMDPSolve.jl

  Public
  A Julia wrapper for pomdp-solve that interfaces with the POMDPs.jl framework

  Julia

  •

  Other

  •4•10•3•0•Updated Jun 14, 2024Jun 14, 2024

• AdaOPS.jl

  Public
  An implementation of the AdaOPS (Adaptive Online Packing-based Search), which is an online POMDP Solver used to solve problems defined with the POMDPs.jl generative interface.

  Julia

  •

  Other

  •3•13•1•0•Updated Jun 14, 2024Jun 14, 2024

• IncrementalPruning.jl

  Public
  Incremental pruning solver for partially observable Markov decision processes

  Julia

  •

  MIT License

  •3•5•1•0•Updated Jun 14, 2024Jun 14, 2024

• PointBasedValueIteration.jl

  Public
  Point-based value iteration solver for POMDPs

  Julia

  •

  MIT License

  •4•6•1•0•Updated Jun 14, 2024Jun 14, 2024

• LocalApproximationValueIteration.jl

  Public
  Julia

  •

  Other

  •6•10•2•0•Updated Jun 14, 2024Jun 14, 2024

• FactoredValueMCTS.jl

  Public
  Scalable MCTS for team scenarios

  mctsmultiagent-systemsmultiagent-planning

  Julia

  •

  MIT License

  •3•15•1•0•Updated Jun 14, 2024Jun 14, 2024

• POMCPOW.jl

  Public
  Online solver based on Monte Carlo tree search for POMDPs with continuous state, action, and observation spaces.

  pomdps

  Julia

  •

  Other

  •17•54•4•0•Updated Jun 14, 2024Jun 14, 2024

• FiniteHorizonPOMDPs.jl

  Public
  POMDPs.jl-compatible interface for defining MDPs and POMDPs with finite horizons

  Julia

  •

  MIT License

  •4•6•3•0•Updated Jun 14, 2024Jun 14, 2024

• BeliefGridValueIteration.jl

  Public
  Offline POMDP solver computing an upper bound of the value function in a discretized belief space.

  Julia

  •

  Other

  •2•3•0•0•Updated Jun 14, 2024Jun 14, 2024

• MultiAgentPOMDPs.jl

  Public
  Julia

  •

  MIT License

  •1•4•2•0•Updated Jun 14, 2024Jun 14, 2024

• MultiUAVDelivery.jl

  Public
  Julia

  •

  MIT License

  •2•3•1•0•Updated Jun 14, 2024Jun 14, 2024