Glue Schema Registry schema replication converter#352

Open

srakshit wants to merge 49 commits intoawslabs:masterfrom srakshit:gsr-schema-replication-converter

+3,988-19

Commits on Aug 17, 2023

Created MM2 Converter and Added Unit Tests
Jessie Chen
committed
Modified Converter Based on First CR Feedback
Jessie Chen
committed

Commits on Aug 18, 2023

Modified Converter Based on First CR Feedback
Jessie Chen
committed
Added TODOs
Jessie Chen
committed

Commits on Sep 11, 2023

Merge pull request awslabs#283 from JC-CJ2222/new_cross-region-replication-mm2-converter
YangSan0622
authored

Commits on Jun 13, 2024

Created MM2 Converter and Added Unit Tests

Jessie Chen
authored and
Subham Rakshit
committed
Modified Converter Based on First CR Feedback

Jessie Chen
authored and
Subham Rakshit
committed
Modified Converter Based on First CR Feedback

Jessie Chen
authored and
Subham Rakshit
committed
Added TODOs

Jessie Chen
authored and
Subham Rakshit
committed
Change version in pom
Subham Rakshit
committed
Added 2nd kafka and ZK in docker compose service file
Subham Rakshit
committed
Added mm2 connector files for standalone run
Subham Rakshit
committed

Commits on Jun 14, 2024

Added code for scenario where message doesn't have schema in it.
Subham Rakshit
committed
Merge remote-tracking branch 'upstream/schema-replication-converter' into gsr-schema-replication-converter
Subham Rakshit
committed
Merge code
Subham Rakshit
committed
Updated mm2 configs
Subham Rakshit
committed
Unit test to show when data doesn't have schema, it still gets replicated as-is
Subham Rakshit
committed

Commits on Jun 15, 2024

Fixed some issues in the compose file and added mm2
Subham Rakshit
committed
Dockerfile and mm2 config for mm2 container
Subham Rakshit
committed

Commits on Jun 18, 2024

Added integration tests for schema replication
Subham Rakshit
committed
Added integration tests for schema replication
Subham Rakshit
committed
loading aws credentials from host to docker
Subham Rakshit
committed
Configuring default aws profile
Subham Rakshit
committed

Commits on Jul 3, 2024

Renamed class to AWSGlueCrossRegionSchemaReplicationConverter
Subham Rakshit
committed
Increased the sleep time
Subham Rakshit
committed

Commits on Jul 8, 2024

Source schema compatibility mode is persisted in target schema
Subham Rakshit
committed

Commits on Jul 9, 2024

Commits on Jul 11, 2024

Issue Fix: Order of schema versions in the source are honoured in the target
Subham Rakshit
committed
Added tests for GlueSchemaRegistryConfiguration and AWSGlueCrossRegionSchemaReplicationConverter
Subham Rakshit
committed
Added tests for SchemaByDefinitionFetcher changes
Subham Rakshit
committed

Commits on Jul 12, 2024

Added tests for AWSSchemaRegistryClient changes
Subham Rakshit
committed
Added an integration test with the schema replication converter and fixed issue with how default configs are set with TARGET specific configs in AWSGlueCrossRegionSchemaReplicationConverter and Glu…
Subham Rakshit
committed
Deleted wget-log as its unnecessary
Subham Rakshit
committed

Commits on Aug 20, 2024

Code Cleanup: Moved the logic of createSchemaAndRegisterAllSchemaVersions to schema replication converter.
Subham Rakshit
committed

Commits on Aug 21, 2024

Code cleanup and added cache for schema replication converter for initial MM2 schema sync
Subham Rakshit
committed
Code Cleanup: Moved schema replication related GSR configurations to schema replciation converter module
Subham Rakshit
committed
Code Cleanup: Moved schema replication related GSR configurations to schema replciation converter module
Subham Rakshit
committed
Code Cleanup: Moved schema replication related constants to the converter module
Subham Rakshit
committed

Commits on Sep 6, 2024

Code refactorings to improve performance of schema replication
Subham Rakshit
committed

Commits on Dec 16, 2024

Added unit test for schema replication and removed schema-replication related code from core modules
Subham Rakshit
committed
Removed redundant code
Subham Rakshit
committed

Commits on Dec 17, 2024

Code Refactorings to cleanup AWSSchemaRegistryClient
Subham Rakshit
committed
mockito library updated
Subham Rakshit
committed
Fixed checkstyle issues
Subham Rakshit
committed