Project-Prism/Orion-Flagship-2B-T2.2-Instruct-AgentML
Updated
๐๏ธ Building on HF
Boning Cui
Bc-AI
P(doom) 1%
AI & ML interests
He/Him. I like LLM's and VLM's. I work with my other friends to make stuff. We are in year 7 and we are enthusiastic about AI. We are based in Australia ๐ฆ๐บ
Recent Activity
new activity about 9 hours ago
Project-Prism/Orion-Flagship-2B-T2.2-Instruct-AgentML:PLEASE updated a model about 17 hours ago
Project-Prism/Orion-Flagship-2B-T2.2-Instruct-AgentML new activity 1 day ago
Compactbot/about-me:Hello!Organizations
PLEASE
18
#1 opened 1 day ago
by 
Banaxi-Tech
updated a
model about 17 hours ago
published a
model 1 day ago
updated a
model 3 days ago
New model request: SuperSmallJokeClaude
64
#29 opened 8 days ago
by Bc-AI
liked a
dataset 3 days ago
liked a
model 4 days ago
reacted to raincandy-u's post with ๐๐๐๐ฅ 4 days ago
Post
3731
20K parameters can tell a story. ๐
๐ค We trained a ~20k-parameter Transformer that can actually write stories!
raincandy-u/MacroStories
โ ~50ร smaller than the 1M-parameter TinyStories model
โ ~3,000ร smaller than AlexNet
โ 81 KB in FP32
yayyy the whole model. เซฎ หถแต แต แตหถ แ
She has a 32-dimensional hidden state, a 378-token vocabulary, and just one decoder block โ recurrently applied 4 times with shared weights.
Despite having only 19,969 parameters, she can maintain a simple narrative across 100โ300 words: establish a goal, encounter a problem, take relevant actions, and reach an outcome.
She runs extremely fast on CPU โ no GPU required. The entire model is tiny enough to load almost instantly! โบ๏ธ
๐ค We trained a ~20k-parameter Transformer that can actually write stories!
raincandy-u/MacroStories
โ ~50ร smaller than the 1M-parameter TinyStories model
โ ~3,000ร smaller than AlexNet
โ 81 KB in FP32
yayyy the whole model. เซฎ หถแต แต แตหถ แ
She has a 32-dimensional hidden state, a 378-token vocabulary, and just one decoder block โ recurrently applied 4 times with shared weights.
Despite having only 19,969 parameters, she can maintain a simple narrative across 100โ300 words: establish a goal, encounter a problem, take relevant actions, and reach an outcome.
She runs extremely fast on CPU โ no GPU required. The entire model is tiny enough to load almost instantly! โบ๏ธ
- 3 replies
Not training ready
โค๏ธ๐ 12
12
#2 opened 25 days ago
by 
armand0e
updated a
model 4 days ago
liked a
model 5 days ago
Please
11
#1 opened 5 days ago
by 
Banaxi-Tech
published a
model 5 days ago
Please
11
#1 opened 5 days ago
by Banaxi-Tech
Please
11
#1 opened 5 days ago
by Banaxi-Tech