Update README.md
Browse files
README.md
CHANGED
|
@@ -10,6 +10,8 @@ language:
|
|
| 10 |
pipeline_tag: text-generation
|
| 11 |
---
|
| 12 |
|
|
|
|
|
|
|
| 13 |
# Model Card for MiniModel-200M-Base
|
| 14 |
|
| 15 |
This model card provides an overview of **MiniModel-200M-Base**, a highly efficient 200M-parameter decoder-only transformer trained with state-of-the-art techniques for maximum data and compute efficiency.
|
|
|
|
| 10 |
pipeline_tag: text-generation
|
| 11 |
---
|
| 12 |
|
| 13 |
+
Full pretraining code can be found in this Github repo: https://github.com/xTimeCrystal/MiniModel
|
| 14 |
+
|
| 15 |
# Model Card for MiniModel-200M-Base
|
| 16 |
|
| 17 |
This model card provides an overview of **MiniModel-200M-Base**, a highly efficient 200M-parameter decoder-only transformer trained with state-of-the-art techniques for maximum data and compute efficiency.
|