v0.1.6
New Features
- Support Wildcard expression in Select clause
- Expression parsing support nested aggregations
- Implement Continue Ingestion and Stream creation in Snowflake
- Implement direct insert to cache pipeline
- Support Multi-way JOIN
- Improved DAG structure with
daggy
- Atomatically trim record history in
RecordWriter
- Only persist checkpoint states of relevant sources.
- Add sql_date support to snowflake integration
- adding commit SHA for ECR image tag for release
- Change app config to support source name in api endpoints
Bug fixes
- Mapping of sqlite data type to dozer data type
CONCAT()
to support multiple arguments- Unify typed service
query
andon_event
record representation - Implement record versioning in
RecordWriter
andRecordReader
- Fix minor snowflake connector issues
- Continue REPL execution after unknown command
- Forbid duplicated cte names
- Insert after delete problem in aggregation
- Use context to solve alias properly
- Fix snowflake connector
- Unable to clean untagged images
- Fix source with empty columns list validation
serde_str
is needed to bincode deserializeDecimal
- Don't commit when no source produces new op
- Fix stream exist check for tables
- Architecture diagram
- Fix snowflake stream consumption
- Ethereum end to end test
ApiEndpoint
is not serializing all fields- Integration tests required
dozer-tests
image when using local runner - Clear PK from Projection output
Full Changelog: v0.1.5...v0.1.6