The semantic reasoning tool for revealing patterns across versatile datastores

Envion Software’s NLP, Semantic Web, and ETL experts contributed to the successful implementation of the solution.

Our joint team developed a solution consisting of the following core modules:

• NLP module for processing natural-language requests of a user: it was built using Python and Spacy so that the system was able to capture key concepts of interest to the data analyst while searching through the multiple datastores.
• ETL module allowed to unify datasets of versatile format (csv, xls, rdf, owl, ttl) into the canonical one for further semantic reasoning (Virtuoso Server, Pentaho Kettle, Google Refine, AlignAPI, Java 8).
• Semantic Web module included numerous industry-standard ontologies and per-business-case semantic reasoning logic over triple stores (Protégé Framework, OWL, RDF, SPARQL, Python 3.5).

As a result, the entire solution made it possible to identify the most relevant datasets for a given analytical problem, empowering a data scientist with valuable insights regarding non-obvious patterns hidden in raw data.  

Furthermore, the technology developed was flexible enough to customize it and apply it to multiple data analysis requests within numerous domains.