bibinprathap /veritasreason:deduplicate
Remove duplicates from the knowledge graph. Usage: /veritasreason:deduplicate <strategy> [args]
$ARGUMENTS = deduplication strategy + optional entity or threshold.
entities [--threshold <score>] [--field <name>]
Detect duplicate entities and group them by similarity.
from veritasreason.deduplication import DuplicateDetector
finder = DuplicateDetector()
candidates = finder.detect_duplicates(entities, threshold=threshold)
groups = finder.detect_duplicate_groups(entities, threshold=threshold)
Output: duplicate candidate list, duplicate groups, and representative merge recommendations.
relations [--similarity <score>]
Detect duplicate relationships and normalize edge representations.
from veritasreason.deduplication import DuplicateDetector
finder = DuplicateDetector()
relations = finder.detect_duplicates(relation_list, threshold=similarity)
Result: duplicate relation candidates, normalized relationship groups, and cleanup summary.