MDPs and POMDPs in Julia - An interface for defining, solving, and simulating fully and partially observable Markov decision processes on discrete and continuous spaces.

Monte Carlo Tree Search for Markov decision processes using the POMDPs.jl framework

Implementation of the Deep Q-learning algorithm to solve MDPs

Online solver based on Monte Carlo tree search for POMDPs with continuous state, action, and observation spaces.

A gallery of POMDPs.jl problems

Simple particle filter implementation in Julia - works with POMDPs.jl models or others.

The PO-UCT algorithm (aka POMCP) implemented in Julia

Problem models for testing POMDPs.jl

Concise and friendly interfaces for defining MDP and POMDP models for use with POMDPs.jl solvers

Value iteration solver for MDPs

QMDP Solvers for POMDPs

Scalable MCTS for team scenarios

Julia package that wraps the SARSOP software for solving POMDPs/MDPs

Implementation of the AR-DESPOT POMDP algorithm

An implementation of the AdaOPS (Adaptive Online Packing-based Search), which is an online POMDP Solver used to solve problems defined with the POMDPs.jl generative interface.

Support tools for solving POMDPs

Julia implementations of temporal difference Reinforcement Learning algorithms like Q-Learning and SARSA

A Julia wrapper for pomdp-solve that interfaces with the POMDPs.jl framework

-

-

Useful extensions of the POMDPs.jl interface

Simulators for POMDPs.jl

Anytime error minimization search for POMDPs, implemented in Julia.

Implementation of a drone surveillance problem with POMDPs.jl

-

Point-based value iteration solver for POMDPs

-

-

Implement the rock sample problem using POMDPs.jl

Incremental pruning solver for partially observable Markov decision processes

Compressed belief-state MDPs in Julia compatible with POMDPs.jl

-

POMDPs.jl-compatible interface for defining MDPs and POMDPs with finite horizons

-

Tools to help develop POMDP Models

-

Package for generating and parsing .pomdpx files for SARSOP

-

-

Offline POMDP solver computing an upper bound of the value function in a discretized belief space.