tinyllama

The TinyLlama project is an open endeavor to train a compact 1.1B Llama model on 3 trillion tokens.

44.9K Pulls Updated 4 months ago

36 Tags

4 months ago

2644915ede35 · 638MB

model
llama
·
1B
·
4-bit
system
You are a helpful AI assistant.
template
<|system|> {{ .System }}</s> <|user|> {{ .Prompt }}</s> <|assistant|>
params
{"stop":["<|system|>","<|user|>","<|assistant|>","</s>"]}

Readme

TinyLlama is a compact model with only 1.1B parameters. This compactness allows it to cater to a multitude of applications demanding a restricted computation and memory footprint.

References

Hugging Face

GitHub