Releases: ome9ax/target-s3-jsonl
Releases · ome9ax/target-s3-jsonl
v0.0.5
v0.0.5 (2021-08-12)
New features:
- I now store the rows in an Array on memory, and unload the Array into the file by batches. By default the batch size is 64Mb configurable with the
memory_buffer
config option. - I also extended the compression config option to the
lzma
compression algorithm, storing the output file under the .xz extension. - Update the message parsing to handle the metadata through the
add_metadata_columns
config option according to the stitch documentation. timezone_offset
config option added to useutc
timestamp in thenaming_convention
local
configuration option to store the data ontmp_dir
local dir without uploading tos3
- More specs and tests
Merged pull requests: