Full Entity deduper + Inserter !
Now system is capable of taking conversation and turning it into entities that are linked by relations and preserve history of changes!
From technical point of view
What actually changed in past 3.5h was that I fully implemented entity deduper and inserter. Now entities land in database which also means that previously implemented db deduper can use those as references to do its job.
Slowly but steadily
Now system is starting to come to a point where in next 20h it might become actually usable. Only things left now are:
- Recaller - System for querying this knowledge graph
-
Periodical Merger - Extension of
deduperthat will periodically run to merge potentially wrong flagged entities for example:Rust (PROGRAMMING_LANGUAGE)ANDRust (TECHNOLOGY), These two refer to the same entity but couldn’t have been merged by direct deduper because this is anIndirect relationship
Comments 0
No comments yet. Be the first!
Sign in to join the conversation.