codellama

Code Llama is a model for generating and discussing code, built on top of Llama 2. It’s designed to make workflows faster and efficient for developers and make it easier for people to learn how to code. It can generate both code and natural language about code. Code Llama supports many of the most popular programming languages used today, including Python, C++, Java, PHP, Typescript (Javascript), C#, Bash and more.

Parameter counts

Parameter Count
7 billion	View	`ollama run codellama:7b`
13 billion	View	`ollama run codellama:13b`
34 billion	View	`ollama run codellama:34b`
70 billion	View	`ollama run codellama:70b`

Usage

CLI

ollama run codellama "Write me a function that outputs the fibonacci sequence"

API

curl -X POST http://localhost:11434/api/generate -d '{
  "model": "codellama",
  "prompt": "Write me a function that outputs the fibonacci sequence"
}'

Variations


`instruct`	Fine-tuned to generate helpful and safe answers in natural language
`python`	A specialized variation of Code Llama further fine-tuned on 100B tokens of Python code
`code`	Base model for code completion

Example prompts

Ask questions

ollama run codellama:7b-instruct 'You are an expert programmer that writes simple, concise code and explanations. Write a python function to generate the nth fibonacci number.'

Fill-in-the-middle (FIM) or infill

ollama run codellama:7b-code '<PRE> def compute_gcd(x, y): <SUF>return result <MID>'

Fill-in-the-middle (FIM) is a special prompt format supported by the code completion model can complete code between two already written code blocks. Code Llama expects a specific format for infilling code:

<PRE> {prefix} <SUF>{suffix} <MID>

<PRE>, <SUF> and <MID> are special tokens that guide the model.

Code review

ollama run codellama '
Where is the bug in this code?

def fib(n):
    if n <= 0:
        return n
    else:
        return fib(n-1) + fib(n-2)
'

Writing tests

ollama run codellama "write a unit test for this function: $(cat example.py)"

Code completion

ollama run codellama:7b-code '# A simple python function to remove whitespace from a string:'

More information

Code Llama is a model for generating and discussing code, built on top of [Llama 2](https://ollama.ai/library/llama2). It's designed to make workflows faster and efficient for developers and make it easier for people to learn how to code. It can generate both code and natural language about code. Code Llama supports many of the most popular programming languages used today, including Python, C++, Java, PHP, Typescript (Javascript), C#, Bash and more.

## Parameter counts

| Parameter Count |                                |                            |
| --------------- | ------------------------------ | -------------------------- |
| 7 billion       | [View](/library/codellama:7b)  | `ollama run codellama:7b`  |
| 13 billion      | [View](/library/codellama:13b) | `ollama run codellama:13b` |
| 34 billion      | [View](/library/codellama:34b) | `ollama run codellama:34b` |
| 70 billion      | [View](/library/codellama:70b) | `ollama run codellama:70b` |

## Usage

### CLI

```
ollama run codellama "Write me a function that outputs the fibonacci sequence"
```

### API

```
curl -X POST http://localhost:11434/api/generate -d '{
  "model": "codellama",
  "prompt": "Write me a function that outputs the fibonacci sequence"
}'
```

## Variations

|            |                                                                                        |
| ---------- | -------------------------------------------------------------------------------------- |
| `instruct` | Fine-tuned to generate helpful and safe answers in natural language                    |
| `python`   | A specialized variation of Code Llama further fine-tuned on 100B tokens of Python code |
| `code`     | Base model for code completion                                                         |

## Example prompts

### Ask questions

```
ollama run codellama:7b-instruct 'You are an expert programmer that writes simple, concise code and explanations. Write a python function to generate the nth fibonacci number.'
```

### Fill-in-the-middle (FIM) or infill

```
ollama run codellama:7b-code '<PRE> def compute_gcd(x, y): <SUF>return result <MID>'
```

```
<PRE> {prefix} <SUF>{suffix} <MID>
```

`<PRE>`, `<SUF>` and `<MID>` are special tokens that guide the model.

### Code review

```
ollama run codellama '
Where is the bug in this code?

def fib(n):
    if n <= 0:
        return n
    else:
        return fib(n-1) + fib(n-2)
'
```

### Writing tests

```
ollama run codellama "write a unit test for this function: $(cat example.py)"
```

### Code completion

```
ollama run codellama:7b-code '# A simple python function to remove whitespace from a string:'
```

## More information

- [How to prompt Code Llama](https://ollama.ai/blog/how-to-prompt-code-llama)
- [Whitepaper](https://arxiv.org/abs/2308.12950)
- [CodeLlama GitHub](https://github.com/facebookresearch/codellama)
- [Hugging Face](https://huggingface.co/codellama)

Paste, drop or click to upload images (.png, .jpeg, .jpg, .svg, .gif)