A family of open-source models trained on a wide variety of data, surpassing ChatGPT on various benchmarks. Updated to version 3.5-0106.
7B
47.2K Pulls Updated 4 months ago
7b-v3.5
4.1GB
7b-v3.5-1210
4.1GB
7b-v3.5-0106
4.1GB
7b-v3.5-q4_0
4.1GB
7b-v3.5-q4_1
4.6GB
7b-v3.5-q5_0
5.0GB
7b-v3.5-q5_1
5.4GB
7b-v3.5-q8_0
7.7GB
7b-v3.5-q2_K
3.1GB
7b-v3.5-q3_K_S
3.2GB
7b-v3.5-q3_K_M
3.5GB
7b-v3.5-q3_K_L
3.8GB
7b-v3.5-q4_K_S
4.1GB
7b-v3.5-q4_K_M
4.4GB
7b-v3.5-q5_K_S
5.0GB
7b-v3.5-q5_K_M
5.1GB
7b-v3.5-q6_K
5.9GB
7b-v3.5-fp16
14GB
7b-v3.5-1210-q4_0
4.1GB
7b-v3.5-0106-q4_0
4.1GB
7b-v3.5-0106-q4_1
4.6GB
7b-v3.5-1210-q4_1
4.6GB
7b-v3.5-0106-q5_0
5.0GB
7b-v3.5-1210-q5_0
5.0GB
7b-v3.5-1210-q5_1
5.4GB
7b-v3.5-0106-q5_1
5.4GB
7b-v3.5-1210-q8_0
7.7GB
7b-v3.5-0106-q8_0
7.7GB
7b-v3.5-1210-q2_K
3.1GB
7b-v3.5-0106-q2_K
3.1GB
7b-v3.5-0106-q3_K_S
3.2GB
7b-v3.5-1210-q3_K_S
3.2GB
7b-v3.5-0106-q3_K_M
3.5GB
7b-v3.5-1210-q3_K_M
3.5GB
7b-v3.5-0106-q3_K_L
3.8GB
7b-v3.5-1210-q3_K_L
3.8GB
7b-v3.5-1210-q4_K_S
4.1GB
7b-v3.5-0106-q4_K_S
4.1GB
7b-v3.5-0106-q4_K_M
4.4GB
7b-v3.5-1210-q4_K_M
4.4GB
7b-v3.5-1210-q5_K_S
5.0GB
7b-v3.5-0106-q5_K_S
5.0GB
7b-v3.5-1210-q5_K_M
5.1GB
7b-v3.5-0106-q5_K_M
5.1GB
7b-v3.5-0106-q6_K
5.9GB
7b-v3.5-1210-q6_K
5.9GB
7b-v3.5-1210-fp16
14GB
7b-v3.5-0106-fp16
14GB