Where is the dedup dev?

I need to build an app that works on some messing dedup - no unique identifiers - and would like to pay attention and contribute to the upcoming duplicate detection but Im not finding the issues or discussions. Any one point me in the right direction?

We have one particular dedup problem that I think we are going to end up doing a round of probabilistic entity resolution, followed by matching to known authoritative sources, 3rd party profile enrichment on the misses, and finally a deterministic entity resolution with the unique identifiers.

I am hopping the UX around your built-in duplicate detection (which I am assuming requires existing unique identifiers) can be extended to with a workflow and external services or something along those lines.

@chandimaj and @vicky can you guys provide some more insight into how exactly this will work and look like?

I’m a bit out of the loop on this one so I’ll need some backup :eyes:

Hey @tom

We have very first initial implementation of de-dup for compose records and It’s available in latest release(2022.9.0).

Here is quick glance at current DeDup implementation.

This is not final version, more updates/changes will follow in upcoming releases.

Thanks for sharing that, it does look pretty slick. Is there a workflow I could “hook” into so I could present the same UX but with more complicated matching behind the scene?

As of now there is no workflow for deDup yet, but feel free to create and share it here if you like, It will be helpful for the community :grin: