InfoShape: Task-Based Neural Data Shaping via Mutual Information
Appeared in the 2023 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2023)
Developers: Homa Esfahanizadeh, William (Bill) Wu, Manya Ghobadi, Regina Barzilay, Muriel Medard
Based on and Inspired by the public repositories of the following papers:
I. Belghazi, S. Rajeswar, A. Baratin, R. D. Hjelm, and A. C. Courville, “MINE: mutual information neural estimation,” PMLR, 2018.
K. Choi and S. Lee, “Regularized mutual information neural estimation,” Openreview, 2021.
TexShape: Information Theoretic Sentence Embedding for Language Models
Appeared in the 2024 IEEE International Symposium on Information Theory (ISIT 2024)
Developers: H. Kaan Kale, Homa Esfahanizadeh, Noel Elias, Oguzhan Baser, Muriel Medard, Sriram Vishwanath