I believe in the use of challenges (competitions or benchmarks) to find solutions to complex machine learning problems.
All Philosoph-IA Blog PostsIn Philosoph-IA, we explore philosophical and societal implications of IA (in French 🇫🇷). Click here to access all episodes' posts.
Keep Confidential Data Private in AI BenchmarkHow to deploy public benchmarks on protected data? AI competitions and benchmarks are extremely effective ways of crowdsourcing science and solving complex problems. However, giving public access to data is absolutely...
🌐 What is Codabench?Codabench is a web-based platform designed for organizing scientific challenges and benchmarks in Artificial Intelligence. In practice, the system allows AI algorithms to...
ML Challenges: Result Submission VS Code SubmissionMany competitions are organized each year on platforms such as Kaggle, CodaLab Competitions or EvalAI. Some allow you to upload your model’s predictions, while others allow you to upload directly your...
A brief history of competitions in machine learningThe idea of leveraging a community of experts and non-experts to solve a scientific problem has been around for hundreds of years. The long history of scientific challenges begin with...
Beyond Accuracy: Exploring Exotic Metrics for Holistic Evaluation of Machine Learning ModelsMachine learning has undoubtedly become a powerful tool in today’s data-driven world, but are we truly tapping into its full potential? Traditional evaluation metrics like...
The Benefits of Organizing AI ChallengesHosting a competition or a benchmark is a way to effectively address complex problems in artificial intelligence. Having independant participants encourage performance and innovation, while avoiding...
How to Create your First Benchmark on CodabenchThe progress in the field of machine learning mostly relies on benchmarks, which are fair comparisons between multiple models on the same problem. Platforms such as...
How to transition from CodaLab to Codabench?Codabench serves as a modern, faster, and more reliable upgrade to CodaLab, designed to supersede it. This quick guide is meant for CodaLab users wondering how to successfully adopt...
How to create your first competition on CodaLabOrganizing a challenge allows you to crowd-source the most difficult machine learning problems. It is also...
Designing a Data Science Competition is an Excellent Way to LearnOver the past few years, we have explored the benefits of involving students both in organizing and in participating in challenges as a...
Learning to Run a Power Network with Renewable Energies: a Challenge Design and AnalysisAs the climate is rapidly changing, it is crucial that we change the way we produce and consume energy to reduce the amount of carbon and other greenhouse gases being produced. In this context, we propose a challenge that...