Update README.md
Browse files
README.md
CHANGED
|
@@ -7,8 +7,11 @@ license: apache-2.0
|
|
| 7 |
|
| 8 |
### Model Details
|
| 9 |
We introduce a new streaming paradigm that enables large language models to achieve strong performance and generalization in streaming settings, without requiring any architectural modifications.
|
| 10 |
-
*
|
| 11 |
-
|
|
|
|
|
|
|
|
|
|
| 12 |
|
| 13 |
|
| 14 |
### Model Sources
|
|
|
|
| 7 |
|
| 8 |
### Model Details
|
| 9 |
We introduce a new streaming paradigm that enables large language models to achieve strong performance and generalization in streaming settings, without requiring any architectural modifications.
|
| 10 |
+
* Streaming-processing: The LLMs process the input as it arrives, incrementally and in real time.
|
| 11 |
+
<img src="streaming.gif" alt="Streaming-processing" width="900"/>
|
| 12 |
+
|
| 13 |
+
* Batch-processing: The LLMs process inputs all at once after receiving the full sequence.
|
| 14 |
+
<img src="batch.gif" alt="Batch-processing" width="900"/>
|
| 15 |
|
| 16 |
|
| 17 |
### Model Sources
|