Monte Carlo Tree Search for Markov decision processes using the POMDPs.jl framework

Implementation of the Deep Q-learning algorithm to solve MDPs

Online solver based on Monte Carlo tree search for POMDPs with continuous state, action, and observation spaces.

Simple particle filter implementation in Julia - works with POMDPs.jl models or others.

Julia library for deep reinforcement learning

The PO-UCT algorithm (aka POMCP) implemented in Julia

Problem models for testing POMDPs.jl

Concise and friendly interfaces for defining MDP and POMDP models for use with POMDPs.jl solvers

Value iteration solver for MDPs

QMDP Solvers for POMDPs

Scalable MCTS for team scenarios

Perform Model Checking and POMDP Planning from LTL specifications using POMDPs.jl

Julia package that wraps the SARSOP software for solving POMDPs/MDPs

Adaptive stress testing of black-box systems within POMDPs.jl

Implementation of the AR-DESPOT POMDP algorithm

An implementation of the AdaOPS (Adaptive Online Packing-based Search), which is an online POMDP Solver used to solve problems defined with the POMDPs.jl generative interface.

-

A Julia wrapper for pomdp-solve that interfaces with the POMDPs.jl framework

Julia implementations of temporal difference Reinforcement Learning algorithms like Q-Learning and SARSA

-

Useful extensions of the POMDPs.jl interface

Simulators for POMDPs.jl

An implementation of the cross entropy method that works well for time series

A decision-making framework for the cost-efficient design of experiments, balancing the value of acquired experimental evidence and incurred costs.

-

Point-based value iteration solver for POMDPs

Anytime error minimization search for POMDPs, implemented in Julia.

Implementation of a drone surveillance problem with POMDPs.jl

-

-

Incremental pruning solver for partially observable Markov decision processes

-

POMDPs.jl-compatible interface for defining MDPs and POMDPs with finite horizons

Compressed belief-state MDPs in Julia compatible with POMDPs.jl

-

Implement the rock sample problem using POMDPs.jl

Package for generating and parsing .pomdpx files for SARSOP

-

Offline POMDP solver computing an upper bound of the value function in a discretized belief space.

-