Skip to content

Releases: ome9ax/target-s3-jsonl

v0.0.5

12 Aug 10:49
443fb05
Compare
Choose a tag to compare

v0.0.5 (2021-08-12)

New features:

  • I now store the rows in an Array on memory, and unload the Array into the file by batches. By default the batch size is 64Mb configurable with the memory_buffer config option.
  • I also extended the compression config option to the lzma compression algorithm, storing the output file under the .xz extension.
  • Update the message parsing to handle the metadata through the add_metadata_columns config option according to the stitch documentation.
  • timezone_offset config option added to use utc timestamp in the naming_convention
  • local configuration option to store the data on tmp_dir local dir without uploading to s3
  • More specs and tests

Merged pull requests:

v0.0.4

09 Aug 11:05
8af8ed4
Compare
Choose a tag to compare

Singer Target target-s3-jsonl initial release is now live!