v0.3.13

cdf

Fixed

• When using the commands cdf deploy/clean, the Toolkit no longer warns about unrelated resources
  that are not part of the deployment.
• When using `cdf deploy/clean/build, the Toolkit no longer warns about duplicated RAW databases.
• Changes to Streamlit app code were not deployed. This is now fixed.

templates

Changed

• The modules cdf_idm_extension and cdf_idm_extension_full are renamed to cdf_process_industry_extension and
  cdf_process_industry_extension_full respectively.
• The Source System data pipelines now requires cdf_process_industry_extension and writes to the extension model
  instead of the Core model.
• The modules in Source System, Contextualization, and Industrial Tool packages now use shared resources
  in cdf_common.

Details

What's Changed

• [CDF-23334] 😋 CDF common by @doctrino in #1221
• [CDF-23326, CDF-23363, CDF-22835] 🦕 Source systems to extended model by @doctrino in #1226
• [CDF-23335] 🦎User group by @doctrino in #1227
• [CDF-23339] 🐙QuickStart demo by @doctrino in #1228
• [CDF-23379] Streamlit bug by @ronpal in #1233
• [CDF-23377] 😬QuickStart AuthVerify by @doctrino in #1232
• Prepare 0.3.13 by @doctrino in #1234

Full Changelog: v0.3.12...v0.3.13

v0.3.12

cdf

Added

• [Alpha feature] Support for specifying list of variables under modules in config.[env].yaml file.
  This allows you to reuse the same module with different variables.
• [Alpha feature] GraphQL now supports the preserveDml parameter.

templates

Added

• Added new modules cdf_entity_matching in the contextualization package. This contains a pipeline for
  doing entity matching based on the Cognite Core model.

Fixed

• Bug in extension models in the models package. The through field was not correctly set. In addition,
  simplified the CogniteCore and CogniteProcessIndustries minimum extension models further. Finally, all
  containers were duplicated. This has been fixed.
• Bug in cdf_sap_assets causing the asset transformation to fail to a READ access error.

Details

What's Changed

• [CDF-22706] 🥷 Repeat modules by @doctrino in #1216
• [CDF-23212] 🤡 Entity matching by @doctrino in #1183
• [CDF-23338] Notification create/update bug by @ronpal in #1220
• [CDF-23327] 🤠 Preserve DML by @doctrino in #1219
• [CDF-23311] 😬Through bug by @doctrino in #1217
• [CDF-23312] 🧑‍🔧 Workaround asset asset by @doctrino in #1218
• Prepare 0.3.12 by @doctrino in #1222

Full Changelog: v0.3.11...v0.3.12

v0.3.11

cdf

Fixed

• In cdf build when loading config.[env].yaml the Toolkit now correctly prefers variables deeper, more
  specific, in the hierarchy over more general variables.
• If assets are specified as .csv or .parquet in the module, they are now deployed, also if there are no
  other classic resources.
• [Alpha feature] cdf build will no longer copy content YAML files to the build directory.
• [Alpha feature] cdf deploy will no longer deploy GraphQL resources if they are not changed.

Improved

• The cdf auth verify no longer gives UserWarning is the user has unknown capabilities.

templates

No changes to templates.

Details

What's Changed

• One more badge by @doctrino in #1200
• [CDF-22717] Avoid always rededploy by @doctrino in #1204
• [CDF-23025] 😑Skip non resource yaml on required kind by @doctrino in #1208
• [CDF-22422] 😷 Tests without feature flags by @doctrino in #1210
• [CDF-23279] 🥴 Variable priority order by @doctrino in #1211
• [CDF-23165] 😳Regression fix by @doctrino in #1212
• [CDF-23191, CDF-23207] 😢 Lonely csv by @doctrino in #1209
• [CDF-23264] 🙊 Auth verify Warning by @doctrino in #1213
• Prepare 0.3.11 by @doctrino in #1214

Full Changelog: v0.3.10...v0.3.11

v0.3.10

cdf

Fixed

• cdf auth verify no longer asks to update missing capabilities if there are no missing capabilities.
• run function local now works with functions that are importing adjacent modules.
• Environment variables were not replaced in Functions. This is now fixed.

Improved

• run function local give a more informative error message if the function code cannot be imported.

• run function local now automatically loads environment variables from .env file. This is useful if you want to
  run the run_check.py script manually, for example, in debug mode with your IDE.

  templates

  No changes

v0.3.9

cdf

Added

• [alpha-feature] --force-update flag to cdf deploy to force update of all resources even if they are not changed.

templates

No changes

Details

• [CDF-23258] 🤫 Force update by @doctrino in #1191
• Prepare 0.3.9 by @doctrino in #1192

Full Changelog: v0.3.8...v0.3.9

v0.3.8

cdf

Fixed

• Running cdf run function local no longer defaults to IDP_CLIENT_SECRET as the environment variable
  for the client secret. Instead, it will use the name specified in the function schedule configuration.
• cdf auth verify now asks the user to verify before updating the capabilities of the service principal.

templates

Added

• The sourcesystem modules now has example data.

Fixed

• Ensure uniqueness of joins in the transformations of the cdf_connection_sql module.

Changed

• Extension of CogniteCore and CogniteProcessIndustries now includes containers.

Details

What's Changed

• [CDF-23132, CDF-23133] 🕵Better error messages on ill defined dependencies by @doctrino in #1172
• [CDF-23166] ADO pipelines to use containers containers by @ronpal in #1174
• [CDF-23175] 🚊 Verify question before updating by @doctrino in #1176
• [CDF-23100] ➡ Run workflow Part 1 by @doctrino in #1173
• [CDF-23100] ➡ Run workflow Part 2 by @doctrino in #1177
• [CDF-23097] 👻 Example data by @doctrino in #1179
• [CDF-23189] 🕵 Verify quickstart package by @doctrino in #1180
• [CDF-23210] 🤕 Filtering on space by @doctrino in #1186
• [CDF-23209] 🤵 Linting contextualization functions by @doctrino in #1182
• [CDF-23223] 🐋 Extension containers by @doctrino in #1187
• [CDF-22845] 🥺 Support streamlit by @doctrino in #1181
• Prepare 0.3.8 by @doctrino in #1188

Full Changelog: v0.3.7...v0.3.8

v0.3.7

cdf

Fixed

• Deploying RAW Tables/Databases no longer raises a ToolkitRequiredValueError.
• Deploying Asset given as .csv/.parquet is now supported again.
• Running cdf deploy no longer complains about !keyvault syntax in ExtractionPipelineConfig resources.

Templates

No changes

Details

• Bootcamp updates by @petreeb in #1160
• [CDF-21838] S🪓 plit utils.py into a submodule by @doctrino in #1167
• [CDF-23093] 🥬Load Table Formats by @doctrino in #1152
• [CDF-23154] Distinguish between DataBase and Table by @doctrino in #1168
• [CDF-22997] 🛡️ limit env replacement to loaders with auth/credentials by @ronpal in #1155
• [CDF-23157] No more complains by @doctrino in #1169
• Prepare 0.3.7 by @doctrino in #1170

Full Changelog: v0.3.6...v0.3.7

v0.3.6

cdf

Fixed

• When running cdf modules add, the Toolkit removed trailing slash in the module path causing a
  build error. This is now fixed.
• When running cdf build, the Toolkit now stops if an error is encountered.
• Asset resources without metadata are no longer always redeployed when running cdf deploy,
  only if the local is different than the CDF configuration.
• Asset centric LocationFilters are no longer always redeployed when running cdf deploy,
  only if the local is different than the CDF configuration.
• When deleting a Function the file is also removed if it exists.
• The parentExternalId in LocationFilter is now correctly replaced by parentId when running cdf deploy.

templates

Added

• The modules init wizard provides an option for an empty, custom module scaffolding.

Fixed

• Removed unused variables from default InRobot configuration.
• Added missing transformation asset to asset in cdf_sap_asset module.

Details

• docs; poste fix by @doctrino in #1132
• 🐛Fix P&ID Annotation by @doctrino in #1134
• residue variables by @ronpal in #1133
• [CDF-23033] 🦈DML valid Extension Models by @doctrino in #1137
• [CDF-22975] 🧑‍✈️ Warning on deploying to prod by @doctrino in #1138
• Typo in connection transformation by @doctrino in #1139
• [CDF-22808] Custom module creation by @ronpal in #1144
• [CDF-23045] Preserving trailing slash on 'modules/' by @ronpal in #1145
• [CDF-22891] cdf_connection_sql by @doctrino in #1143
• Revert full extionsion by @doctrino in #1146
• [CDF-23032] 🛑 Build stop on error by @doctrino in #1148
• [CDF-22957] 🐘 Remove redundant warning in CICD by @doctrino in #1153
• [CDF-23039] 🏃‍♂️ Finish Quickstart by @doctrino in #1147
• [CDF-23073] 🪱 Fix LocationFilter by @doctrino in #1156
• [CDF-22720] Support parent external id in location filter by @doctrino in #1162
• [CDF-23090, CDF-23107] 🦍Create RAW Database before Table by @doctrino in #1158
• [CDF-23012] Delete file ID when function is deleted. by @doctrino in #1157
• Move location filter examples by @doctrino in #1163
• Prepare 0.3.6 by @doctrino in #1164

Full Changelog: v0.3.5...v0.3.6

v0.3.5

cdf

No changes

Templates

• Added new module cdf_sharepoint to the sourcesystem package.
• Added new package industrial_tool for data exploration and analytics with modules
  • cdf_search for setting up location filters
• Added new package contextualization with modules
  • cdf_p_and_id_parser
  • cdf_timeseries_equipment_sql

Details

• small fix to avoid mixup between environments by @ronpal in #1110
• [CDF-22886] File datasource module by @ronpal in #1105
• Fix source system modules by @doctrino in #1111
• [CDF-22892] 📍Module search location by @ronpal in #1112
• [CDF-22809] 🔓Dev auth write all by @doctrino in #1122
• Fix all groups by @doctrino in #1123
• Remove userProfilesAcl by @doctrino in #1125
• [CDF-22890] 😈Diagram Parser Module by @doctrino in #1113
• [CDF-22888] connect CogniteAssets and CogniteTimeSeries by @ronpal in #1114
• [CDF-23000] 🧑‍🔧Cleanup naming by @doctrino in #1127
• [CDF-22841] 🧐 Require Kind by @doctrino in #1126
• build: fix changelog by @doctrino in #1129
• Prepare 0.3.5 by @doctrino in #1130

Full Changelog: v0.3.4...v0.3.5

v0.3.4

cdf

Fixed

• Building a WorkflowTrigger will no longer complain that authentication is an unused variable.
• In resource Group, the following lookups are now done when running cdf deploy/clean:
  • securityCategoriesAcl idscope Security Names are now replaced by IDs.
  • locationFiltersAcl idscope external LocationFilter Ids are now replaced by IDs.
  • timeSeriesAcl idscope external TimeSeries IDs are now replaced by internal IDs.
  • assetRootIdScope external Asset IDs are now replaced by internal IDs.
• The resource ResourceScopedGroup is now correctly deployed after RAW Tables and Databases,
  LocationFilters, and SecurityCategories when running cdf deploy.

Templates

Added

• Added new package sourcesystem with modules
  • sap_asset
  • sap_events
  • pi
• Added new modules for extension of CogniteProcessIndustries model.
  Full and minimum extension templates in quickstart and example packages.

Details

• [CDF-22879] Lower bound cognite-sdk >=7.63.5 by @doctrino in #1097
• 💀Skeleton for SourceSystem package by @doctrino in #1098
• [CDF-22884] 👨‍🔧SAP Module Template by @doctrino in #1099
• [CDF-22934] 🧑‍🏭IDM Model extension by @doctrino in #1102
• [CDF-22933] 🦏 SAP round2 events by @doctrino in #1103
• [CDF-22885] 🥧 AVEVA PI source module by @ronpal in #1101
• [CDF-22938] 🦡 Pretty badges by @doctrino in #1106
• [CDF-22936] 🐧 Lookup Security Cagetgories in Groups by @doctrino in #1104
• Removing invalid volumes mount in the default github workflow by @ddonukis in #1107
• Prepare 0.3.4 by @doctrino in #1108

Full Changelog: v0.3.3...v0.3.4