Mapping machine intelligence

We are developing a comprehensive formal model of human and artificial intelligence tasks, benchmarks, performance measures, datasets and the current state-of-the-art in AI.

Intelligence Task Ontology

The Intelligence Task Ontology (ITO) provides a comprehensive map of artificial intelligence tasks, as well as broader human intelligence or hybrid human/machine intelligence tasks.

ITO project on Github

Examples

ITO aims to provide a richly structured hierarchy of processes, algorithms, data and performance metrics. Data on thousands of AI benchmark results have been imported from Papers With Code and are further curated.

An example of a benchmark result embedded in an ontological hierarchy:

MRI Example Hierarchy

Exploring the class hierarchy:

Class hierarchy screen capture

Exploring the hierarchy of performance measures:

Property hierarchy screen capture

Current status

The ontology and associated resources are still under intense development. If you have questions or are interested in collaborations, please contact us!

Using ITO

The ITO model is made available as an OWL (Web Ontology Language) file. You can use the Protege ontology editor to explore and edit the ontology. You can use a wide variety of frameworks for OWL, RDF and the SPARQL graph query language to access and query the ontology. We recommend using the Owlready2 Python library.

Example: Google Colab notebook demonstrating SPARQL queries with ITO.

Licensing

The ontology file is distributed under a CC-BY-SA license.

ITO includes data from the Papers With Code project (https://paperswithcode.com/). Papers With Code is licensed under the CC-BY-SA license. Data from Papers With Code are partially altered (manual curation to improve ontological structure and data quality).

ITO includes data from the EDAM ontology. The EDAM ontology is licensed under a CC-BY-SA license.

We offer ITO and related resources as-is and make no representations or warranties of any kind concerning the resources, express, implied, statutory or otherwise, including without limitation warranties of title, merchantability, fitness for a particular purpose, non infringement, or the absence of latent or other defects, accuracy, or the present or absence of errors, whether or not discoverable, all to the greatest extent permissible under applicable law.