PointBasedValueIteration.jl

Point-based value iteration solver for POMDPs
Author JuliaPOMDP
Popularity
2 Stars
Updated Last
1 Year Ago
Started In
June 2020

Point-based value iteration

Build status Coverage Status codecov

Point-based value iteration solver (Pineau et al., 2003, Shani et al., 2012) for the POMDPs.jl framework.

Installation

This package is available from Julia's General package registry.

using Pkg
Pkg.add("PointBasedValueIteration")

Usage

using PointBasedValueIteration
using POMDPModels
pomdp = TigerPOMDP() # initialize POMDP

solver = PBVI() # set the solver

policy = solve(solver, pomdp) # solve the POMDP

The function solve returns an AlphaVectorPolicy as defined in POMDPPolicies.

References

  • Pineau, J., Gordon, G., & Thrun, S. (2003, August). Point-based value iteration: An anytime algorithm for POMDPs. In IJCAI (Vol. 3, pp. 1025-1032).
  • Shani, G., Pineau, J. & Kaplow, R. A survey of point-based POMDP solvers. Auton Agent Multi-Agent Syst 27, 1–51 (2013). https://doi.org/10.1007/s10458-012-9200-2

Used By Packages

No packages found.