A compact, yet powerful 10.7B large language model designed for single-turn conversation.
11B
21.5K Pulls Updated 5 months ago
10.7b-instruct-v1-q4_0
6.1GB
10.7b-instruct-v1-q4_1
6.7GB
10.7b-instruct-v1-q5_0
7.4GB
10.7b-instruct-v1-q5_1
8.1GB
10.7b-instruct-v1-q8_0
11GB
10.7b-instruct-v1-q2_K
4.5GB
10.7b-instruct-v1-q3_K_S
4.7GB
10.7b-instruct-v1-q3_K_M
5.2GB
10.7b-instruct-v1-q3_K_L
5.7GB
10.7b-instruct-v1-q4_K_S
6.1GB
10.7b-instruct-v1-q4_K_M
6.5GB
10.7b-instruct-v1-q5_K_S
7.4GB
10.7b-instruct-v1-q5_K_M
7.6GB
10.7b-instruct-v1-q6_K
8.8GB
10.7b-instruct-v1-fp16
21GB
10.7b-text-v1-q4_0
6.1GB
10.7b-text-v1-q4_1
6.7GB
10.7b-text-v1-q5_0
7.4GB
10.7b-text-v1-q5_1
8.1GB
10.7b-text-v1-q8_0
11GB
10.7b-text-v1-q2_K
4.5GB
10.7b-text-v1-q3_K_S
4.7GB
10.7b-text-v1-q3_K_M
5.2GB
10.7b-text-v1-q3_K_L
5.7GB
10.7b-text-v1-q4_K_S
6.1GB
10.7b-text-v1-q4_K_M
6.5GB
10.7b-text-v1-q5_K_S
7.4GB
10.7b-text-v1-q5_K_M
7.6GB
10.7b-text-v1-q6_K
8.8GB
10.7b-text-v1-fp16
21GB