An expansion of Llama 2 that specializes in integrating both general language understanding and domain-specific knowledge, particularly in programming and mathematics.
11.1K Pulls Updated 4 months ago
Updated 4 months ago
4 months ago
fc5c0d744444 · 4.7GB
model
archllama
·
parameters8B
·
quantization4-bit
4.7GB
params
{"stop":["<|system|>","<|user|>","<|assistant|>"]}
81B
template
<|system|>
{{ .System }}
<|user|>
{{ .Prompt }}
<|assistant|>
62B
Readme
LLaMa-Pro is a version of the original LLaMa model enhanced by the addition of transformer blocks by Tencent Applied Research Center (ARC). This model specializes in integrating both general language understanding and domain-specific knowledge, particularly in programming and mathematics.