[CDF-27105] 🫨 Data products alpha support by ronpal · Pull Request #2510 · cognitedata/toolkit

ronpal · 2026-02-13T08:49:37Z

Description

Data Products alpha feature based on service contract https://github.com/cognitedata/service-contracts/blob/a386f0c1592ce3f8d6b93bb6cf83d0c6443eaf6f/versions/v1/dataproducts.preproc.yml

The Data Product service is available in a limited number of Projects at the moment.

Bump

Patch
Skip

Changelog

Added

Support for data products [alpha]

…ta-products

gemini-code-assist · 2026-02-13T08:49:41Z

Using Gemini Code Assist

The full guide for Gemini Code Assist can be found on our documentation page, here are some quick tips.

Invoking Gemini

You can request assistance from Gemini at any point by creating a comment using either /gemini <command> or @gemini-code-assist <command>. Below is a summary of the supported commands on the current page.

Feature	Command	Description

Customization

To customize Gemini Code Assist for GitHub experience, repository maintainers can create a configuration file and/or provide a custom code review style guide (such as PEP-8 for Python) by creating and adding files to a .gemini/ folder in the base of the repository. Detailed instructions can be found here.

Limitations & Feedback

Gemini Code Assist may make mistakes. Please leave feedback on any instances where its feedback is incorrect or counter productive. You can react with 👍 and 👎 on @gemini-code-assist comments. If you're interested in giving your feedback about your experience with Gemini Code Assist for Github and other Google products, sign up here.

github-actions · 2026-02-13T08:55:02Z

☂️ Python Coverage

current status: ✅

Overall Coverage

Lines	Covered	Coverage	Threshold	Status
34387	29523	86%	80%	🟢

New Files

File	Coverage	Status
cognite_toolkit/_cdf_tk/client/api/data_products.py	91%	🟢
cognite_toolkit/_cdf_tk/client/resource_classes/data_product.py	100%	🟢
cognite_toolkit/_cdf_tk/cruds/_resource_cruds/data_product.py	91%	🟢
cognite_toolkit/_cdf_tk/resource_classes/data_product.py	92%	🟢
TOTAL	93%	🟢

Modified Files

File	Coverage	Status
cognite_toolkit/_cdf_tk/client/_toolkit_client.py	100%	🟢
cognite_toolkit/_cdf_tk/client/testing.py	100%	🟢
cognite_toolkit/_cdf_tk/commands/_migrate/creators.py	85%	🟢
cognite_toolkit/_cdf_tk/cruds/init.py	79%	🟢
cognite_toolkit/_cdf_tk/cruds/_resource_cruds/init.py	100%	🟢
cognite_toolkit/_cdf_tk/feature_flags.py	100%	🟢
cognite_toolkit/_cdf_tk/resource_classes/init.py	100%	🟢
cognite_toolkit/_cdf_tk/utils/text.py	90%	🟢
TOTAL	94%	🟢

updated for commit: 07d6722 by action🐍

codecov · 2026-02-13T08:55:29Z

Codecov Report

❌ Patch coverage is 90.96386% with 15 lines in your changes missing coverage. Please review.
✅ Project coverage is 85.85%. Comparing base (81b84de) to head (07d6722).
⚠️ Report is 1 commits behind head on main.

Files with missing lines	Patch %	Lines
...lkit/_cdf_tk/cruds/_resource_cruds/data_product.py	90.90%	6 Missing ⚠️
cognite_toolkit/_cdf_tk/utils/text.py	66.66%	4 Missing ⚠️
...ognite_toolkit/_cdf_tk/client/api/data_products.py	91.17%	3 Missing ⚠️
cognite_toolkit/_cdf_tk/cruds/__init__.py	80.00%	1 Missing ⚠️
...e_toolkit/_cdf_tk/resource_classes/data_product.py	91.66%	1 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #2510      +/-   ##
==========================================
+ Coverage   85.83%   85.85%   +0.02%     
==========================================
  Files         410      414       +4     
  Lines       34222    34387     +165     
==========================================
+ Hits        29373    29523     +150     
- Misses       4849     4864      +15

Files with missing lines	Coverage Δ
cognite_toolkit/_cdf_tk/client/_toolkit_client.py	`100.00% <100.00%> (ø)`
...it/_cdf_tk/client/resource_classes/data_product.py	`100.00% <100.00%> (ø)`
cognite_toolkit/_cdf_tk/client/testing.py	`100.00% <100.00%> (ø)`
...nite_toolkit/_cdf_tk/commands/_migrate/creators.py	`84.84% <100.00%> (+0.07%)`	⬆️
..._toolkit/_cdf_tk/cruds/_resource_cruds/__init__.py	`100.00% <100.00%> (ø)`
cognite_toolkit/_cdf_tk/feature_flags.py	`100.00% <100.00%> (ø)`
...gnite_toolkit/_cdf_tk/resource_classes/__init__.py	`100.00% <100.00%> (ø)`
cognite_toolkit/_cdf_tk/cruds/__init__.py	`79.31% <80.00%> (+0.06%)`	⬆️
...e_toolkit/_cdf_tk/resource_classes/data_product.py	`91.66% <91.66%> (ø)`
...ognite_toolkit/_cdf_tk/client/api/data_products.py	`91.17% <91.17%> (ø)`
... and 2 more

🚀 New features to boost your workflow:

❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

…into data-products

doctrino

Good stuff. I have commented where I found issues.

In addition, you have to ensure that data products are exempt from smoke tests as all API classes that subclass CDFResourceAPI will automatically be picked up. Thus if this is merged smoke tests will fail.

tests/data/complete_org_alpha_flags/modules/my_example_module/data_products/my.DataProduct.yaml

cognite_toolkit/_cdf_tk/resource_classes/data_product.py

cognite_toolkit/_cdf_tk/client/resource_classes/data_product.py

cognite_toolkit/_cdf_tk/cruds/_resource_cruds/data_product.py

tests/test_unit/test_cdf_tk/test_client/test_cdf_apis.py

tests/test_unit/test_cdf_tk/test_cruds/test_data_product.py

…ta-products

Co-authored-by: Anders Albert <60234212+doctrino@users.noreply.github.com>

…ta-products

Co-authored-by: Anders Albert <60234212+doctrino@users.noreply.github.com>

…into data-products

…a flag Suppress 404 errors from the data products API when the alpha flag is enabled but the endpoint is not yet available on the test server. Co-authored-by: Cursor <cursoragent@cursor.com>

…ta-products

tests/test_integration/test_commands/test_deploy.py

doctrino

You are missing extending https://github.com/cognitedata/toolkit/blob/main/tests/test_unit/approval_client/config.py#L1314
such that the local deployment of complete org checks for data product

- Extract shared DataProduct base class for request/response models - Rename items -> external_ids on retrieve and delete API methods - Fix list default from None to 10 - Simplify integration test: always exclude DataProductCRUD since alpha flag is off in cdf.toml

…ta-products

The fallback was lost during a merge from main. Without it, deserializing built data product resources fails when DataProductCRUD is excluded from CRUDS_BY_FOLDER_NAME.

Register DataProductsAPI in the approval client config so the complete_org build/deploy unit tests exercise data product CRUD.

The approval client now includes data products, so the build/deploy snapshot needs the expected DataProductResponse output.

doctrino · 2026-02-17T07:05:01Z

tests/test_integration/test_commands/test_deploy.py

+            os.environ,
+            {"EVENTHUB_CLIENT_ID": client_id, "EVENTHUB_CLIENT_SECRET": client_secret},
+        ),
+        patch.dict(


This is a good solution.

ronpal added 3 commits February 12, 2026 15:30

First pass on CRUD and API

4d0706d

Merge branch 'main' of https://github.com/cognitedata/toolkit into da…

7f94947

…ta-products

alpha flag and tests

a1876d2

ronpal requested review from a team as code owners February 13, 2026 08:49

Merge branch 'main' into data-products

0ae9685

ronpal marked this pull request as draft February 13, 2026 09:37

ronpal added 5 commits February 13, 2026 12:48

alpha flag in toml

1c60ae7

restructured on correct spec

11ae454

Merge branch 'data-products' of https://github.com/cognitedata/toolkit …

d251c24

…into data-products

Tuning

5cc0fb1

Merge branch 'main' into data-products

4b0d13d

ronpal marked this pull request as ready for review February 13, 2026 13:54

ronpal added 4 commits February 13, 2026 15:10

Updating tests

8d525a7

Merge branch 'data-products' of https://github.com/cognitedata/toolkit …

0632327

…into data-products

Skipping ACL due to SDK bug

9260512

Skipping DP tests due to lack of API support

fc4710b

doctrino reviewed Feb 16, 2026

View reviewed changes

ronpal and others added 9 commits February 16, 2026 08:46

Skipping DP tests due to lack of API support

e52b45c

Merge branch 'main' of https://github.com/cognitedata/toolkit into da…

c7c9f8c

…ta-products

Update cognite_toolkit/_cdf_tk/client/resource_classes/data_product.py

83581cd

Co-authored-by: Anders Albert <60234212+doctrino@users.noreply.github.com>

Update cognite_toolkit/_cdf_tk/client/resource_classes/data_product.py

a369cbb

Co-authored-by: Anders Albert <60234212+doctrino@users.noreply.github.com>

Merge branch 'main' of https://github.com/cognitedata/toolkit into da…

eaf5d18

…ta-products

Better alignment

925f72f

Update cognite_toolkit/_cdf_tk/client/resource_classes/data_product.py

e059622

Co-authored-by: Anders Albert <60234212+doctrino@users.noreply.github.com>

Update cognite_toolkit/_cdf_tk/cruds/_resource_cruds/data_product.py

4aa85be

Co-authored-by: Anders Albert <60234212+doctrino@users.noreply.github.com>

Update cognite_toolkit/_cdf_tk/cruds/_resource_cruds/data_product.py

551e449

Co-authored-by: Anders Albert <60234212+doctrino@users.noreply.github.com>

ronpal and others added 6 commits February 16, 2026 12:05

Merge branch 'data-products' of https://github.com/cognitedata/toolkit …

c661b17

…into data-products

switching to externalid

5d75dca

test cleanup

34e5771

More test fixixng

bf11117

Conditionally include data products in integration test based on alph…

aab7f83

…a flag Suppress 404 errors from the data products API when the alpha flag is enabled but the endpoint is not yet available on the test server. Co-authored-by: Cursor <cursoragent@cursor.com>

Merge branch 'main' of https://github.com/cognitedata/toolkit into da…

e4aeb38

…ta-products

doctrino reviewed Feb 16, 2026

View reviewed changes

tests/test_integration/test_commands/test_deploy.py Outdated Show resolved Hide resolved

doctrino reviewed Feb 16, 2026

View reviewed changes

ronpal added 5 commits February 16, 2026 15:48

Merge branch 'main' of https://github.com/cognitedata/toolkit into da…

28e7496

…ta-products

Restore get_crud fallback to alpha-inclusive CRUD registry

e646d3b

The fallback was lost during a merge from main. Without it, deserializing built data product resources fails when DataProductCRUD is excluded from CRUDS_BY_FOLDER_NAME.

Add data products to approval client for unit test coverage

4148971

Register DataProductsAPI in the approval client config so the complete_org build/deploy unit tests exercise data product CRUD.

Update complete_org_alpha_flags snapshot with DataProductResponse

9f39d22

The approval client now includes data products, so the build/deploy snapshot needs the expected DataProductResponse output.

doctrino reviewed Feb 17, 2026

View reviewed changes

doctrino previously approved these changes Feb 17, 2026

View reviewed changes

ronpal enabled auto-merge (squash) February 17, 2026 07:06

ronpal added 2 commits February 17, 2026 08:06

Merge branch 'main' into data-products

2b0664a

Adding as_id()

07d6722

ronpal dismissed doctrino’s stale review via 07d6722 February 17, 2026 07:16

doctrino self-requested a review February 17, 2026 07:24

doctrino approved these changes Feb 17, 2026

View reviewed changes

ronpal merged commit 5ab8f8c into main Feb 17, 2026
15 checks passed

ronpal deleted the data-products branch February 17, 2026 07:24

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[CDF-27105] 🫨 Data products alpha support #2510

[CDF-27105] 🫨 Data products alpha support #2510
ronpal merged 35 commits intomainfrom
data-products

ronpal commented Feb 13, 2026 •

edited

Loading

Uh oh!

gemini-code-assist bot commented Feb 13, 2026

Uh oh!

github-actions bot commented Feb 13, 2026 •

edited

Loading

Uh oh!

codecov bot commented Feb 13, 2026 •

edited

Loading

Uh oh!

doctrino left a comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

doctrino left a comment

Uh oh!

doctrino Feb 17, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Conversation

ronpal commented Feb 13, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Description

Bump

Changelog

Added

Uh oh!

gemini-code-assist bot commented Feb 13, 2026

Uh oh!

github-actions bot commented Feb 13, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

☂️ Python Coverage

Overall Coverage

New Files

Modified Files

Uh oh!

codecov bot commented Feb 13, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Codecov Report

Uh oh!

doctrino left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

doctrino left a comment

Choose a reason for hiding this comment

Uh oh!

doctrino Feb 17, 2026

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

ronpal commented Feb 13, 2026 •

edited

Loading

github-actions bot commented Feb 13, 2026 •

edited

Loading

codecov bot commented Feb 13, 2026 •

edited

Loading