using ExpandNestedData
using JSON3
using DataFrames
message = JSON3.read("""
{
"a" : [
{"b" : 1, "c" : 2},
{"b" : 2},
{"b" : [3, 4], "c" : 1},
{"b" : []}
],
"d" : 4
}
"""
)
expand(message) |> DataFrameUse ColumnDefinitions to tightly control what gets added to the table and how it gets added.
column_defs = [
ColumnDefinition([:d]; column_name = :ColumnD),
ColumnDefinition([:a, :b]; flatten_arrays=true),
ColumnDefinition([:e, :f]; column_name = :MissingColumn, default_value="Missing branch")
]
expand(message, column_defs) |> DataFrame- Return a custom Table that allows nested and flattened access to columns
- Support for AbstractTree.jl input (This would enable composability with Gumbo.jl and others)
- Use custom Table as input for compressing tabular data to nested data
- Widen arrays so column names match XPath expressions
- Parse Xpath to ColumnDefinitions
- Dispatch on user-defined
get_keysandget_valuesfunctions to traverse arbitrary custom types