Skip to content

Commit

Permalink
update readme
Browse files Browse the repository at this point in the history
  • Loading branch information
Ken Payne committed Sep 19, 2023
1 parent ac5f713 commit bc1309d
Showing 1 changed file with 3 additions and 1 deletion.
4 changes: 3 additions & 1 deletion README.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -2,10 +2,12 @@

A library for interacting with a Singerlake; a store of files in Singer JSONL format.

**Note:** This software is in active development. Here be dragons 🐉. Use with caution.

## Overview

For expended details of the Singerlake Spec, checkout [this blog post](https://kenpayne.co.uk/blog/2023-01-17.html).

Broadly the Singerlake Spec describes a way to write raw Singer messages into object stores (such as S3) in a structured way.
In addition to offering cheap long-term storage of captured data, it also unlocks several interesting patterns.
The overall aim would be to roll `python-singerlake` into a `tap-singerlake` and `target-singerlake` for use in data pipelines.
The overall aim is to roll `python-singerlake` into a `tap-singerlake` and `target-singerlake` for use in data pipelines.

0 comments on commit bc1309d

Please sign in to comment.