Addressed by:
- Benchmarking of AI system capabilities
- Creating and establishing good standard benchmarks (...)
- Organizing events for system benchmarking
- Creating transparent platforms for publishing and comparing benchmark results of multiple systems
- Incentivizing benchmarking (e.g., monetary rewards)
- Creating metrics for benchmark coverage of certain problem domains
- AI for specific data modalities
- Improving specific AI capabilities
- Improving generative modeling
- Improving causal reasoning
- Inducing useful representations of data (...)
- Improving the ability of algorithms to work with unstructured data directly, decreasing the need for structured data
- Interaction of AI systems with the physical world
- Automated question answering
- Improving generation of explanations of observations and inferences (...)
- Improving the ecosystem, workflow and tool chain for creating new AI systems