MDPs and POMDPs in Julia - An interface for defining, solving, and simulating fully and partially observable Markov decision processes on discrete and continuous spaces.

Monte Carlo Tree Search for Markov decision processes using the POMDPs.jl framework

Implementation of the Deep Q-learning algorithm to solve MDPs

A gallery of POMDPs.jl problems

Online solver based on Monte Carlo tree search for POMDPs with continuous state, action, and observation spaces.

Simple particle filter implementation in Julia - works with POMDPs.jl models or others.

Interface for deep reinforcement learning

Concise and friendly interfaces for defining MDP and POMDP models for use with POMDPs.jl solvers

Problem models for testing POMDPs.jl

The PO-UCT algorithm (aka POMCP) implemented in Julia

Value iteration solver for MDPs

Support tools for solving POMDPs

QMDP Solvers for POMDPs

Julia package that wraps the SARSOP software for solving POMDPs/MDPs

[UNMAINTAINED - USE ARDESPOT.jl] Package implementing DESPOT POMDP solver for POMDPs.jl

A Julia wrapper for pomdp-solve that interfaces with the POMDPs.jl framework

-

Useful extensions of the POMDPs.jl interface

Scalable MCTS for team scenarios

-

Anytime error minimization search for POMDPs, implemented in Julia.

POMDPs.jl-compatible interface for defining MDPs and POMDPs with finite horizons

Implementation of the AR-DESPOT POMDP algorithm

Julia implementations of temporal difference Reinforcement Learning algorithms like Q-Learning and SARSA

-

-

Package for generating and parsing .pomdpx files for SARSOP

-

Point-based value iteration solver for POMDPs

-

Tools to help develop POMDP Models

Simulators for POMDPs.jl

-

Implement the rock sample problem using POMDPs.jl

Offline POMDP solver computing an upper bound of the value function in a discretized belief space.

-

-

-

Fast informed bound solver for POMDPs.

-