JSON stream processing with YAJL in Julia
Author christopher-dG
4 Stars
Updated Last
1 Year Ago
Started In
February 2019

YAJL.jl Build Status

A Julia wrapper around the YAJL JSON library.

Use Case

YAJL.jl is pretty niche since there are already very good JSON libraries in pure Julia such as these. However, YAJL makes it possible to write highly custom JSON processors that never need to hold the entirety of the data in memory.


It's quite easy to write your own custom JSON context. You get to choose your data representation, and you only need to implement what you'll use.

Suppose that we had a massive list of numbers that we wanted to count. Code for this task would look like this:

using YAJL

mutable struct Counter <: YAJL.Context
    Counter() = new(0)

YAJL.collect(ctx::Counter) = ctx.n
@yajl number(ctx::Counter, ::Ptr{UInt8}, ::Int) = ctx.n += 1

n = open(io -> YAJL.run(io, Counter()), "big_list.json")

Counting this list uses a constant amount of memory, regardless of the list length.

There are more basic examples in runtests.jl. For a more complete example, see minifier.jl.

Required Packages

Used By Packages

No packages found.