feat(data): Refactor SQL files for dumping data into openchallenges-db

[vpchung]

Fixes #2047 ; goes hand-in-hand with #2114

Due to downloading the OC Data as CSVs in order to generate the flat files, this also fixes #2169 and fixes #2176

Changelog

• Enable local_infile feature in mariadb server
• Refactor *data.sql files to load data directly from flat files
• Update database with snapshot date of 2023-09-28
  • Added challenges from CAGI, CodaBench, and CodaLab
  • Added new organizations, incl. Research to the People
  • General updates to challenges and organizations

Preview

[vpchung]

Hmm, looks like I'm also not able to generate the cards on the home page either:

Not sure if this is related to the "Other" facet mentioned earlier... Reverting this back to drafts.

[vpchung]

everything worked as expected except the Other option for the Platform facet.

Whoops, the error also reproduces when selecting Upcoming from Status, Starting Soon from Category, and 2023, 2022, or 2017 - 2021 from Challenge Year:

[vpchung]

After playing around with web app, I think the issue stems from one challenge:

Jan2024: Rare Disease AI Hackathon

I noticed that using any search terms related to this challenge, e.g. rare, disease, would also give us the error; hence why I think this particular challenge is the issue. Plus, it has a status = upcoming and platform = other so that tracks with the patterns mentioned above.

[vpchung]

FOUND THE 🐛 !! It was actually not just the hackathon that caused the issue, but any challenges that had doker as its submission type (instead of container_image). Updating these values has fixed the issue:

Data contributors have been notified of this as to help prevent this in the future.

This PR is now ready for review ✅