Skip to content

Releases: streamingfast/substreams-sink-sql

v4.3.0

29 Nov 19:23
Compare
Choose a tag to compare
  • Added a check for non-existent columns in Clickhouse
  • Added support for Nullable types in Clickhouse.
  • Bump substreams to v0.11.1
  • Bump substreams-sink to v0.5.0

v4.2.2

07 Nov 20:21
Compare
Choose a tag to compare
  • Fix major bug when receiving empty MapOutput

v4.2.1

13 Sep 21:09
Compare
Choose a tag to compare

DO NOT USE THIS VERSION USE ANYTHING >= v.4.2.2

  • Bump substreams to v1.10.3 to support new manifest data like protobuf:excludePaths

v4.2.0

28 Jun 20:51
Compare
Choose a tag to compare
  • Added the --cursor-table and --history-table flags to allow running to sinks on the same database (be careful that you have no collision in table names)
  • bumped substreams to v1.8.2, add some default network endpoints

v4.0.3

30 Apr 18:48
Compare
Choose a tag to compare
  • Fix another case where 'infinite-retry' would not work and the program would stop on an error.
  • Enable multiple Substreams authentication methods (API key, JWT), using flags --api-key-envvar and --api-token-envvar.
  • Deprecates the use of SF_API_TOKEN environment variable, now use default SUBSTREAMS_API_TOKEN or set your own using --api-token-envvar.

v4.0.2

19 Mar 16:42
Compare
Choose a tag to compare
  • Fixed spurious error reporting when the sinker is terminating or has been canceled.

  • Updated substreams dependency to latest version v1.3.7.

v4.0.1

01 Feb 19:10
Compare
Choose a tag to compare
  • Fixed the timestamp parsing in Clickhouse dialect.
  • Fixed the schema in the tutorial for clickhouse.
  • Add --network flag to override the default value in the manifest or spkg

v4.0.0

12 Dec 16:30
Compare
Choose a tag to compare

Highlights

  • This release brings support for managing reorgs in Postgres database, enabled by default when --undo-buffer-size to 0.

Breaking changes

  • A change in your SQL schema may be required to keep existing substreams:SQL integrations working:
    • The presence of a primary key (single key or composite) is now MANDATORY on every table.
    • The sf.substreams.sink.database.v1.TableChange message, generated inside substreams, must now exactly match its primary key with the one in the SQL schema.
    • You will need to re-run setup on your existing PostgreSQL databases to add the substreams_history table. You can use the new --system-tables-only flag to perform only that.
  • Since reorgs management is not yet supported on Clickhouse, users will have to set --undo-buffer-size to a non-zero value (12 was the previous default)

Fixes

  • Bump version of schema dependency to fix errors with newer Clickhouse versions now using system.tables table instead of information_schema.tables view.
  • Support more networks with default mappings (ex: solana, soon: optimism, soon: bitcoin)
  • Add command "create-user " to help creating more SQL users, read-only or otherwise
  • Add 'enabled' field under "DBTConfig"
  • Removed PgwebFrontend and WireProtocolAccess fields from the SinkConfig message: they will now be deployed when on a development environment, so they are not mentionned here anymore.

v4.0.0-rc.3

29 Nov 21:40
Compare
Choose a tag to compare
v4.0.0-rc.3 Pre-release
Pre-release
  • Fix a critical bug breaking the reorg management when more than one row needs to be reverted.

v4.0.0-rc.2

28 Nov 15:23
Compare
Choose a tag to compare
v4.0.0-rc.2 Pre-release
Pre-release
  • Support more networks with default mappings (ex: solana, soon: optimism, soon: bitcoin)
  • Add command "create-user " to help creating more SQL users, read-only or otherwise
  • add 'enabled' field under "DBTConfig"
  • Removed PgwebFrontend and WireProtocolAccess fields from the SinkConfig message: they will now be deployed when on a development environment, so they are not mentionned here anymore.