[KW-search] Confluence: Standardize parents and internal ID

[philipperolet]

Goal is to ensure for Confluence that:

• Parent ids used in the parents[] array in core data_source_nodes and internal ids from connectors should now match node_id in core data_sources_nodes (= document_id for docs, table_id for tables, folder_id for folders);
• the convention that parents[0] = node_id should be enforced.

The connector should be thoroughly inspected. If there is a convention mismatch, fix it; explained in details in #9069

As noted here : https://github.com/dust-tt/dust/pull/9261/files#r1879852550 , we should add parent_id parameter in upserts as part of this card once parents are standardized.

[aubin-tchoi]

Taking this one @philipperolet

[tdraier]

As noted here : https://github.com/dust-tt/dust/pull/9261/files#r1879852550 , we should add parent_id parameter in upserts as part of this card once parents are standardized.

[aubin-tchoi]

done!
related PRs (sorry I forgot to mention this issue):

• [KWSearch] Double Confluence parent IDs #9274
• [parent_migrator] add parentId for Confluence #9308
• [connectors] update Confluence to use new internalIDs in content nodes and upsertions #9337
• Set parentId in Confluence #9363
• • every one working on the migration scripts