Feature / Initial support for structured object datasets (STRUCT type) #509

martin-traverse · 2025-02-03T22:58:43Z

No description provided.

…early

…sses

… in a later change

martin-traverse added 20 commits February 3, 2025 17:50

Relax infer_format for STRUCT data storage in dev mode translator

4b4ad2d

Improve support for generic types in the config parser

338ab78

Handle Python 3.9 missing UnionType in types module

4ba6251

Bump versions to address build issues

b52d97f

Start to generalize DataItem / DataView framework

7e25ad3

Define experimental API for STRUCT data

ce2a0ac

Static API for define_struct (requires StructProcessor)

ebb7098

Use new DataItem helpers in context tests

387946e

Extend engine load / save functions to handle the struct data type

caff1d5

Fix in the storage layer for recording file size if stream is closed …

e02562f

…early

Validator support for type arguments

23c6330

Minimal example using STRUCT data types

f1d3df2

Allow config parser to read Pydantic models as well as native datacla…

d1449b8

…sses

First implementation of STRUCT processing logic (partial)

0ebb266

Allow validation to pass for non-table model sockets

f418f0d

Add metadata types for structured object data

5ee04c8

Implement context methods for get / put struct

d8429c6

Remove test for pure python structs (must be dataclass or pydantic)

4e4b320

Fix handling of union types for Python 3.9

fd924af

Fix handling of NoneType for Python 3.9

81cb834

martin-traverse changed the title ~~Feature/runtime struct~~ Feature / Initial support for structured object datasets (STRUCT type) Feb 3, 2025

martin-traverse added 8 commits February 3, 2025 23:07

Fix handling of NoneType for Python 3.9

6129037

Fix missing import in config parser if Pydantic not installed

e7a1bbe

Support for enum fields in STRUCTS

471e562

For Pydantic types, build models using the Pydantic constructor

0001f02

Include a date field in the example model

6296d7b

Use a separate parser for STRUCT data (config parser to be moved over…

7fb952a

… in a later change

Include structured objects in example models run in CI

c3dfe8a

Fix handling of generic vs Pydantic types in Python 3.9 and 3.10

6f729b3

martin-traverse merged commit 881e438 into finos:main Feb 4, 2025
41 checks passed

martin-traverse deleted the feature/runtime_struct branch February 4, 2025 10:59

Provide feedback