The Collective Knowledge project (CK) is motivated by our tedious experience reproducing experiments from 150 research papers and validating them in the real world - we decided to develop a universal and human-readable interface to access any software project and run it on any platform with any software, hardware and data.
The Collective Mind tool (CM) helps users to add this universal interface to their software projects and transform them into a database of portable and reusable components in a transparent and non-intrusive way.
CM is being developed by the open MLCommons taskforce to solve the "dependency hell" for ML and AI systems, reduce their development, benchmarking, optimization and deployment time and costs, and automate reproducibility initiatives and artifact evaluation at conferences.
2021-2023 MLCommons
This project is supported by MLCommons, OctoML and individual contributors.