Offering Chinese Translation 我提供了一个中文翻译

[Intelligence-Manifesto]

我对大部分章节进行了中文翻译和额外的注释，欢迎阅读。
I have translated and added extra comments to most chapters in Chinese. Feel free to read.
https://github.com/Intelligence-Manifesto/LLMs-from-scratch

[rasbt]

Thanks for sharing!

[dengyunsheng250]

中文翻译会持续维护吗

Will the Chinese translation be continuously maintained?

[Intelligence-Manifesto]

当然会持续维护，只是最近个人出了较大变故，应该是会托更大半年了。万分抱歉。
Of course, it will continue to be maintained, but there has been a big personal change recently, and it should be more than half a year. I'm so sorry.

[TITC]

I'm creating a Zhihu version of my study notes, which will have some differences from Sebastian's original text.

The differences stem from areas where I encountered difficulties during my learning process. For instance, in Chapter 2 on the BPE tokenizer, I became curious about why the vocabulary contains many prefixes like \u0120, leading me to look up additional information Why \u0120 (Ġ) is in so many pairs? and further explore why the offset is 0x100. I've also revisited some forgotten concepts, like differentiable functions, and delved into topics of interest, such as comparing the computational efficiency of the 4090, 4090D, and A100 (I happen to have these GPUs, and I've heard that the 4090D in China is a downgraded version, so I'm curious about the performance difference). These are just a few examples. Currently, I've written up to Chapter 06, and if you're interested, you can take a look.

• LLMs-from-scratch|Notes|Chapter 02
• LLMs-from-scratch|Notes|Chapter 03
• LLMs-from-scratch|Notes|Chapter 04
• LLMs-from-scratch|Notes|Chapter 05
• LLMs-from-scratch|Notes|Chapter 06
• I'll update it whenever I find some free time.

---

留一个知乎版本的学习笔记，会和Sebastian的原文有一些出入。

出入指的是在学习过程中我有遇到一些不明白的地方。比如在第二章，BPE tokenizer，我会比较在意词表里面的\u0120是什么，然后查了一些资料进行补充 Why \u0120 (Ġ) is in so many pairs? ，以及进一步好奇为什么要偏移0x100。以及一些我遗忘的知识，比如可微函数之类的东西。以及一些感兴趣的东西，比如进行4090 和4090D，A100的运算效率比较（恰好手里有，也听说中国的4090D是阉割版本，好奇性能差多少），诸如此类的，目前写到chapter 06，如果有兴趣的话可以看看。

• LLMs-from-scratch|笔记|Chapter02
• LLMs-from-scratch|笔记|Chapter03
• LLMs-from-scratch|笔记|Chapter04
• LLMs-from-scratch|笔记|Chapter05
• LLMs-from-scratch|笔记|Chapter06
• 摸鱼的时候会更新