DEVOURED
Tytan: Interactive Neurosymbolic Construction of Analytic Semantic Schemas from Relational Data
Tytan automates the construction of complex analytic schemas by combining LLM-based inference with deterministic database checks.
What: Tytan builds semantic schemas from relational data by validating entity proposals and joins, achieving 100% coverage on reference domains and 100% execution success on 3,758 retrieval tests.
Why it matters: Automating the creation of the semantic layer removes a significant bottleneck for data teams and reduces dependency on manual database documentation.
Deep dive
- Methodology: Uses symbolic analysis to verify keys and joins, paired with an LLM to assign semantic roles and names to columns.
- Interactivity: The system uses a human-in-the-loop approach, asking targeted natural-language questions only when the underlying data reveals ambiguities.
- Evaluation: Tested across eight distinct database domains, successfully capturing all key features and relationships required for reporting.
- Performance: Successfully generated instructions for 1,678 self-generated data retrieval claims, all of which executed correctly.
Decoder
- Neurosymbolic: An approach to AI that combines the pattern-recognition capabilities of neural networks (LLMs) with the formal, logic-based reasoning of symbolic AI.
Original article
Tytan: Interactive Neurosymbolic Construction of Analytic Semantic Schemas from Relational Data
From natural-language query interfaces to automated report generation, data analysis tools need a description of the data: the real-world entities it contains, which columns function as measures or identifiers, and how tables connect into units of analysis. Today, this semantic layer is usually written by hand. This is a knowledge-acquisition bottleneck that limits the scalability of analytic systems, keeps non-technical users dependent on experts, and is itself error-prone. We present TYTAN, a system for automatically constructing an analytic semantic schema from a relational database and, when available, a short user-provided description. TYTAN combines symbolic analysis of the database with LLM-based semantic inference for entity proposal, role assignment, and naming. When the evidence leaves a decision ambiguous, TYTAN asks the user a targeted natural-language question. We evaluate TYTAN on eight databases spanning real-world and benchmark domains along the three axes that define a schema's functional utility: (i) coverage, are all important entities and features captured?; (ii) retrieval correctness, do the schema's instructions actually reach the data; and (iii) characterization accuracy, are semantic types correct? Across the seven reference domains, TYTAN reaches every entity, attribute, and aggregable feature of the expert-corrected reference schemas (100% coverage). Additionally, 100% of its retrieval instructions execute correctly (1,678 of 1,678 self-generated claims), and semantic roles agree with the reference on 92-100% of matched attributes. Checking the underlying data showed the small disagreement is in the reference, not in TYTAN. On a held-out blind test (a live, ten-table database with no declared keys), TYTAN recovers the full entity structure with verified keys and satisfies 100% of the satisfiable expectations of five independent blind annotators.
Explore all 68 articles in today's digest
Fresh dev news, AI-digested daily. Never miss a trend at devoured.fyi