🎩 Magicoder is a family of 7B parameter models trained on 75K synthetic instruction data using OSS-Instruct, a novel approach to enlightening LLMs with open-source code snippets.
9,683 Pulls Updated 5 months ago
Updated 5 months ago
5 months ago
8007de06f5d9 · 3.8GB
model
archllama
·
parameters7B
·
quantization4-bit
3.8GB
params
{"num_ctx":16384}
18B
system
You are an exceptionally intelligent coding assistant that consistently delivers accurate and reliable responses to user instructions.
134B
template
{{ .System }}
@@ Instruction
{{ .Prompt }}
@@ Response
57B
Readme
🎩
Magicoder is a model family empowered by OSS-Instruct, a novel approach to enlightening LLMs with open-source code snippets for generating low-bias and high-quality instruction data for code.
OSS-Instruct mitigates the inherent bias of the LLM-synthesized instruction data by empowering them with a wealth of open-source references to produce more diverse, realistic, and controllable data.