Skip to content

Commit

Permalink
deploy: e4b277d
Browse files Browse the repository at this point in the history
  • Loading branch information
RaymondWang0 committed Oct 23, 2023
1 parent aa5d8ee commit 1cbebaa
Showing 1 changed file with 12 additions and 2 deletions.
14 changes: 12 additions & 2 deletions index.html
Original file line number Diff line number Diff line change
Expand Up @@ -79,10 +79,20 @@ <h1><a class="anchor" id="autotoc_md0"></a>
<p>This is enabled by LLM model compression technique: <a href="https://github.com/mit-han-lab/smoothquant">SmoothQuant</a> and <a href="https://github.com/mit-han-lab/llm-awq">AWQ (Activation-aware Weight Quantization)</a>, co-designed with TinyChatEngine that implements the compressed low-precision model.</p>
<h3><a class="anchor" id="autotoc_md1"></a>
Demo on an NVIDIA GeForce RTX 4070 laptop:</h3>
<p><img src="assets/figures/chat_demo_gpu.gif" alt="chat_demo_gpu" width="49%" class="inline"/> <img src="assets/figures/coding_demo_gpu.gif" alt="coding_demo_gpu" width="49%" class="inline"/></p>
<table class="doxtable">
<tr>
<td><img src="assets/figures/chat_demo_gpu.gif" alt="chat_demo_gpu" width="100%" class="inline"/> </td><td><img src="assets/figures/coding_demo_gpu.gif" alt="coding_demo_gpu" width="100%" class="inline"/> </td></tr>
<tr>
<td align="center">LLaMA Chat </td><td align="center">Code LLaMA </td></tr>
</table>
<h3><a class="anchor" id="autotoc_md2"></a>
Demo on an Apple MacBook Pro (M1, 2021):</h3>
<p><img src="assets/figures/chat_demo_m1.gif" alt="chat_demo_m1" width="49%" class="inline"/> <img src="assets/figures/coding_demo_m1.gif" alt="coding_demo_m1" width="49%" class="inline"/></p>
<table class="doxtable">
<tr>
<td><img src="assets/figures/chat_demo_m1.gif" alt="chat_demo_m1" width="100%" class="inline"/> </td><td><img src="assets/figures/coding_demo_m1.gif" alt="coding_demo_m1" width="100%" class="inline"/> </td></tr>
<tr>
<td align="center">LLaMA Chat </td><td align="center">Code LLaMA </td></tr>
</table>
<p>Feel free to check out our <a href="assets/slides.pdf">slides</a> for more details!</p>
<h2><a class="anchor" id="autotoc_md3"></a>
Overview</h2>
Expand Down

0 comments on commit 1cbebaa

Please sign in to comment.