A very small package providing the constructor
BatchIterator(X; batchsize=…, limit=…) and the function
centered_batch_iterator(X; kwargs…), which allow iteration over blocks of columns of
X, for any object
X supporting 2d indexing and for which the function
size is defined.
choose_batchsize helps finding a good batch size while controlling memory usage.
The package was originally designed to iterate over samples of an out-of-core dataset.