v4.0.0

Highlights

• This release brings support for managing reorgs in Postgres database, enabled by default when --undo-buffer-size to 0.

Breaking changes

• A change in your SQL schema may be required to keep existing substreams:SQL integrations working:
  • The presence of a primary key (single key or composite) is now MANDATORY on every table.
  • The sf.substreams.sink.database.v1.TableChange message, generated inside substreams, must now exactly match its primary key with the one in the SQL schema.
  • You will need to re-run setup on your existing PostgreSQL databases to add the substreams_history table. You can use the new --system-tables-only flag to perform only that.
• Since reorgs management is not yet supported on Clickhouse, users will have to set --undo-buffer-size to a non-zero value (12 was the previous default)

Fixes

• Bump version of schema dependency to fix errors with newer Clickhouse versions now using system.tables table instead of information_schema.tables view.
• Support more networks with default mappings (ex: solana, soon: optimism, soon: bitcoin)
• Add command "create-user " to help creating more SQL users, read-only or otherwise
• Add 'enabled' field under "DBTConfig"
• Removed PgwebFrontend and WireProtocolAccess fields from the SinkConfig message: they will now be deployed when on a development environment, so they are not mentionned here anymore.