Skip to content

ucsd-ml-arts/generative-audio-yudididi

Repository files navigation

Project 3 Melody of China

Yudi Wang, [email protected]

Abstract

Traditional Chinese music are quite different from the western classic music in many aspects. First, their theoretical basis is different. Western classical music is based on twelve temperament, and China is "Gong Shang Jue Zhi Yu". Second, Chinese folk music instrument are designed to perform solo and have clear characteristic, whereas many western and brass instrument are designed to perform together. Thus, third point is, Chinese music care about the pursuit of nature, artistic conception and emotional experience, and its form has been very simple, mainly single melody.

In this project, I use the LSTM algorithm to generate traditional Chinese melody. Since the dataset is quite large, I make adjustment of the batch size from 64 to 256, which reach a balance before speed and RAM. After 40 iterations, the loss become 0.7, which is a suitable value to create some new melody. Sample pieces are generated and we can clear figure out the three above mentioned characteristics from these samples. Finally, I try to combine these generated piece with drummer's performance to create some music work, which should be a way to let the old art rejuvenate.

Model/Data

Code

  • Jupyter notebooks: LSTM_ChineseMusic.ipynb

Results

Folder: Generated Sample, including 16 sample pieces generated by algorithm(.midi documents).

Presentation Slides: Melody of China - Yudi Wang.pdf

Sample performed by three different stringed instrument:

https://drive.google.com/file/d/19UZpb2QT87PTFB8Cltw1bbAuHNqSTkNq/view?usp=sharing

Sample mixed with drummers' performance:

https://drive.google.com/file/d/1Pl2kKh_FOkcODIUxEE-aOmdI0Rx2dK1K/view?usp=sharing

Technical Notes

  • Need to pip another packages: music21, glob, pickle, keras

  • This project need to run on Colab to use GPU resources, google.colab package and Google Drive

  • Use MuseScore3 for the display of notes and tabs,

  • Use GarageBand on the Mac OS system to play and edit music.

Reference

Refer to Music generation with LSTM in Keras offered by Google

https://colab.research.google.com/drive/19TQqekOlnOSW36VCL8CPVEQKBBukmaEQ

About

generative-audio-yudididi created by GitHub Classroom

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published