Useful extensions of the POMDPs.jl interface

-

Simulators for POMDPs.jl

-

-

Support tools for solving POMDPs

Tools to help develop POMDP Models

Problem models for testing POMDPs.jl

QMDP Solvers for POMDPs

Implementation of a drone surveillance problem with POMDPs.jl

Utilities for generating gifs of POMDPs

Value iteration solver for MDPs

Implement the rock sample problem using POMDPs.jl

Package for generating and parsing .pomdpx files for SARSOP

-

-

-

Offline POMDP solver computing an upper bound of the value function in a discretized belief space.

POMDPs.jl-compatible interface for defining MDPs and POMDPs with finite horizons

Online solver based on Monte Carlo tree search for POMDPs with continuous state, action, and observation spaces.

Scalable MCTS for team scenarios

-

Point-based value iteration solver for POMDPs

A Julia wrapper for pomdp-solve that interfaces with the POMDPs.jl framework

Fast informed bound solver for POMDPs.

-

Implementation of the Deep Q-learning algorithm to solve MDPs

-

Julia implementations of temporal difference Reinforcement Learning algorithms like Q-Learning and SARSA

-

Anytime error minimization search for POMDPs, implemented in Julia.

-

The PO-UCT algorithm (aka POMCP) implemented in Julia

Implementation of the AR-DESPOT POMDP algorithm

-

Concise and friendly interfaces for defining MDP and POMDP models for use with POMDPs.jl solvers

Tag POMDP problem using POMDPS.jl

Julia package that wraps the SARSOP software for solving POMDPs/MDPs

Simple particle filter implementation in Julia - works with POMDPs.jl models or others.

Compressed belief-state MDPs in Julia compatible with POMDPs.jl