Projected Gradient Optimization

using Pkg; Pkg.add("Progradio")

$$ \begin{aligned} \min_x \hspace{0.5em} f(x) \end{aligned} $$

where $x \in \mathbb{R}^n$, and $f: \mathbb{R}^n \rightarrow \mathbb{R}$ is smooth. Given an initial guess x_0::Vector and an in-place gradient function g!, the problem is defined as:

up = UProblem(x_0, f, g!);

$$ \begin{aligned} \min_x \hspace{0.5em} &f(x)\\ \text{s.t.} \hspace{0.5em} &\ell \leq x \leq u, \end{aligned} $$

where $\ell, u \in \mathbb{R}^n$. Given ℓ::Vector and u::Vector, the problem is defined as:

bcp = BCProblem(x_0, ℓ, u, f, g!);

$$ \begin{aligned} \min_x \hspace{0.5em} &f(x)\\ \text{s.t.} \hspace{0.5em} &\sum_{j \in \mathcal{S}} x_j = 1, \quad x_j \geq 0 &\forall j \in \mathcal{S},\\ &\ell_j \leq x_j \leq u_j &\forall j \notin \mathcal{S}, \end{aligned} $$

where $\mathcal{S}$ is the set of indices of $x$ in the unit simplex. Given S::BitSet, the problem is defined as:

sbcp = SBCProblem(x_0, S, ℓ, u, f, g!);

Recommended usage with solve()

# Problem
bcp = BCProblem(x_0, ℓ, u, f, g!);

# Solve
solve(bcp, SteepestDescent(), Armijo())

Advanced usage with Iterator

# Iterator
iterator = Iterator(bcp, SteepestDescent(), Armijo());

# Iterate
collect(iterator)