Skip to content

LauzHack/llms-api-hackathon

Repository files navigation

Mini-hackathon on LLMs and GenAI APIs

Come join us for a fun and innovative hackathon exploring APIs and LLM architecture modifications! Let's build exciting projects together 🎉

1. General Information
2. Themes
3. Resources
4. Schedule
5. Team Formation
6. Submission Process
7. Communication (Discord)
8. Evaluation Criteria
9. Jury
10. Acknowledgements

1. General Information

Date & Time:

  • Date: Friday, April 19 to Saturday, April 20
  • Time: 6:00 PM (Apr 19) to 5:00 PM (Apr 20)

Location:

2. Themes

LauzHack is hosting a mini-hackathon with two exciting tracks:

  1. GenAI Applications:
  • The use of GenAI APIs and models (OpenAI, Langchain, HuggingFace, etc).
  • The Telegram bot builder API can be optionally used for a quick-and-dirty user interface, or a web app (example1, example2).
  • Build innovative products by combining APIs for new applications!
  1. LLM Architecture Modifications:
  • Identify practical tricks to enhance efficiency and accuracy of LLMs (Large Language Models) on a given dataset.

3. Resources

  1. GenAI Applications:
  • Tutorial on making a Telegram bot with GenAI APIs. This will be done on Friday!
  • Message Eric (organizer) on the LauzHack Discord for an OpenAI key!
  1. LLM Architecture Modifications:

Below are links to complementary resources/tutorials which will NOT be covered during the hackathon:

4. Schedule

Friday, April 19:

  • 6:00 PM: Tutorials/Workshops (BC420)
    • Intro to the event
    • Tutorial on making a Telegram bot with GenAI APIs
    • Pizza
    • (Around 8) Tutorial on training LLM baseline
    • Spontaneous tutorials based on people's interests.
  • 10:00 PM: End of day. You CANNOT stay overnight, but you can continue working remotely.

Saturday, April 20 (only for partipants whose application was approved):

  • 10:00 AM: Breakfast (BC410)
  • Till 3:00 PM: Hack, hack, hack!
  • 3:30 PM: Demos (for everyone) then prizes 🏆 (for application track)

Aftermath:

  • Sunday April 21, midnight: submission deadline for track 2 (training LLMs)
  • Tuesday April 23, 4pm: announcement of winners of track 2

😋 We will provide dinner on Friday and (breakfast, lunch) on Saturday.

5. Team Formation

Up to 4 members per team. Declare your team here.

6. Submission Process

⚠️ All projects should be submitted on DevPost. And make sure your team is up-to-date in the team formation document.

In order to be considered for a prize, all projects should demo/present (3 min for API track, and 2 min for LLM track) on Saturday afternoon.

When submitting your project, in the Additional info step, please select the track that you are competing for (LLM track or App track) as in the attached image.

Screenshot 2024-04-20 at 11 47 33 AM

Particularies for the LLM Architecture Modifications track

Due to potentially long trainings, submission can be made until Sunday April 21, 23:59:59. Teams are still expected to demo/present on Saturday afternoon, but winners for this track will be announced on Tuesday April 23. Resources:

  1. Getting started guide for GPU cluster
  2. llm-baselines code to start from. Submission consist in a link to your github repo (see criteria below), to be made to Prof. Martin Jaggi's lab via discord.

7. Communication (Discord)

Real-time information about the event, food service details, and questions related to the challenges will be posted in our personal Discord server (#hack-apr2024 channel). Please use the link sent to you via Luma (as this will add you to the private channel for the event).

8. Evaluation Criteria

Only work done during hackathon will be considered (and should be made explicit) for the project evaluation.

GenAI Applications

Criteria Allocated points
1. Technical Impressiveness 6
   1.1. How impressive is the project from a technical perspective? 3
   1.2. How reasonable the technical and programming solutions are, given the limited timeframe of a hackathon? 3
2. Idea 6
   2.1. How innovative, original and unexpected the project is? 3
   2.2. How usable the idea is for the real-world target population to which the project is aimed?hackathon? 3
3. Prototype 8
   3.1. Does the prototype work as advertised by the team, and as expected from a one-day work? 4
   3.2. Does the prototype provide a good user experience and usability? 4
4. Presentation 4
5. Integrity Check
TOTAL 24

A detailed judging criteria can be found at the following link.

LLM Training and Architectures Track

Criteria Allocated points
1. Performance reached in 3h on 1 GPU 20
2. Innovativeness of the approach 10
TOTAL 30

Final submission deadline: Sunday midnight. Submitting the link to your GitHub repository. The ReadMe of your repo needs:

  1. A short description of your idea and approach
  2. A link to the final model weights of your trained model
  3. The training script and config so we can reproduce your training (must be easy to run on EPFL cluster). We will verify submissions and run to check reproducibility.

9. Jury

Prof. Martin Jaggi
Prof. Martin Jaggi
Dr. Javier Picorel
Dr. Javier Picorel
Prof. Marcel Salathe
Prof. Marcel Salathé
Eric Bezzam
Eric Bezzam
Luca Fusar Bassini
Luca Fusar Bassini
Seyed Parsa Neshaei
Seyed Parsa Neshaei

10. Acknowledgements

A BIG thanks to the MLO lab at EPFL for technical support and Track #2, and to Huawei for sponsoring 🙏

About

Practical info for LauzHack's mini-hackathon: https://lu.ma/lauzhack-llms-apis

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 3

  •  
  •  
  •