Time Series Compression with LZ4 using DeltaCodec

Jun 11, 2015 at 10:21 PM
I just wanted to let users know that LZ4 is one of several compression libraries that has been adapted for use in DeltaCodec.

This allows a developer to directly encode and decode lists or arrays of any intrinsic data type.
For example,
var codec = LZ4DeltaCodec.Instance;
var bytes = codec.Encode(IList<T> list);
var listOut = codec.Decode<T>(bytes);
Custom codecs or codec methods can be added to handle arbitrarily complex data structures.

Differencing the time series improves the ratio significantly, and speed can be enhanced by encoding multiple blocks concurrently.
For example,
var bytes = codec.Encode(list, numBlocks: 4, level: CompressionLevel.Fastest);
I Hope others will find this useful.