Llama 2 based model fine tuned on an Orca-style dataset. Originally called Free Willy.

12.9K Pulls Updated 6 months ago

6 months ago

e5d7b4def1b8 · 3.8GB

model
llama
·
7B
·
4-bit
system
This is a system prompt, please behave and help the user.
params
{"stop":["### System:","### User:","### Assistant:"]}
template
{{- if .System }} ### System: {{ .System }} {{- end }} ### User: {{ .Prompt }} ### Assistant:
license
STABLE BELUGA NON-COMMERCIAL COMMUNITY LICENSE AGREEMENT Dated: July 27, 2023 "Agreement" means the terms and conditions for use, reproduction, distribution and modification of the Software Products set forth herein. “Documentation” means any specifications, manuals, documentation, and other written information provided by Stability AI related to the Software. "Licensee" or "you" means you, or your employer or any other person or entity (if you are entering into this Agreement on such person or entity's behalf), of the age required under applicable laws, rules or regulations to provide legal consent and that has legal authority to bind your employer or such other person or entity if you are entering in this Agreement on their behalf. "Stability AI" or "we" means Stability AI Ltd. "Software" means, collectively, Stability AI’s proprietary Stability Beluga 1 and 2 made available under this Agreement. “Software Products” means Software and Documentation. By using or distributing any portion or element of the Software Products, you agree to be bound by this Agreement. License Rights and Redistribution. Stability AI grants you a non-exclusive, worldwide, non-transferable, non-sublicensable, revocable, royalty free and limited license under Stability AI’s intellectual property or other rights owned by Stability AI embodied in the Software Products to reproduce, distribute, and create derivative works of the Software Products for purposes other than commercial or production use. b. If you distribute or make the Software Products, or any derivative works thereof, available to a third party, you shall (i) provide a copy of this Agreement to such third party, and (ii) retain the following attribution notice within a "Notice" text file distributed as a part of such copies: "Stability Beluga is licensed under the Stability Beluga Research License, Copyright (c) Stability AI Ltd. All Rights Reserved.” c. The licenses granted to you under this Agreement are conditioned upon your compliance with the Documentation, this Agreement, and the Llama 2 Acceptable Use Policy available at ai.meta.com/llama/use-policy, which is hereby incorporated herein by reference, and whose restrictions will apply to both Llama 2 and the Software Products for purposes of this Agreement. 2. Disclaimer of Warranty. UNLESS REQUIRED BY APPLICABLE LAW, THE SOFTWARE PRODUCTS AND ANY OUTPUT AND RESULTS THEREFROM ARE PROVIDED ON AN "AS IS" BASIS, WITHOUT WARRANTIES OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING, WITHOUT LIMITATION, ANY WARRANTIES OF TITLE, NON-INFRINGEMENT, MERCHANTABILITY, OR FITNESS FOR A PARTICULAR PURPOSE. YOU ARE SOLELY RESPONSIBLE FOR DETERMINING THE APPROPRIATENESS OF USING OR REDISTRIBUTING THE SOFTWARE PRODUCTS AND ASSUME ANY RISKS ASSOCIATED WITH YOUR USE OF THE SOFTWARE PRODUCTS AND ANY OUTPUT AND RESULTS. 3. Limitation of Liability. IN NO EVENT WILL STABILITY AI OR ITS AFFILIATES BE LIABLE UNDER ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, TORT, NEGLIGENCE, PRODUCTS LIABILITY, OR OTHERWISE, ARISING OUT OF THIS AGREEMENT, FOR ANY LOST PROFITS OR ANY INDIRECT, SPECIAL, CONSEQUENTIAL, INCIDENTAL, EXEMPLARY OR PUNITIVE DAMAGES, EVEN IF STABILITY AI OR ITS AFFILIATES HAVE BEEN ADVISED OF THE POSSIBILITY OF ANY OF THE FOREGOING. 3. Intellectual Property. a. No trademark licenses are granted under this Agreement, and in connection with the Software Products, neither Stability AI nor Licensee may use any name or mark owned by or associated with the other or any of its affiliates, except as required for reasonable and customary use in describing and redistributing the Software Products. Subject to Stability AI’s ownership of the Software Products and derivatives made by or for Stability AI, with respect to any derivative works and modifications of the Software Products that are made by you, as between you and Stability AI, you are and will be the owner of such derivative works and modifications. If you institute litigation or other proceedings against Stability AI (including a cross-claim or counterclaim in a lawsuit) alleging that the Software Products or associated outputs or results, or any portion of any of the foregoing, constitutes infringement of intellectual property or other rights owned or licensable by you, then any licenses granted to you under this Agreement shall terminate as of the date such litigation or claim is filed or instituted. You will indemnify and hold harmless Stability AI from and against any claim by any third party arising out of or related to your use or distribution of the Software Products in violation of this Agreement. 4. Term and Termination. The term of this Agreement will commence upon your acceptance of this Agreement or access to the Software Products and will continue in full force and effect until terminated in accordance with the terms and conditions herein. Stability AI may terminate this Agreement if you are in breach of any term or condition of this Agreement. Upon termination of this Agreement, you shall delete and cease use of the Software Products. Sections 2-4 shall survive the termination of this Agreement.

Readme

Stable Beluga is based on Llama 2 and then fine-tuned on an Orca-style dataset. It is available in 7B, 13B, and 70B parameter sizes. It was created by Stability AI.

Get started with Stable Beluga

The model used in the example below is the Stable Beluga model, with 7b parameters, which is a general-use model.

API

  1. Start Ollama server (Run ollama serve)
  2. Run the model
curl -X POST http://localhost:11434/api/generate -d '{
  "model": "stable-beluga",
  "prompt":"Explain the process of how a refrigerator works to keep the contents inside cold."
 }'

CLI

  1. Install Ollama
  2. Open the terminal and run ollama run stable-beluga

Note: The ollama run command performs an ollama pull if the model is not already downloaded. To download the model without running it, use ollama pull stable-beluga

Memory requirements

  • 7b models generally require at least 8GB of RAM
  • 13b models generally require at least 16GB of RAM
  • 70b models generally require at least 64GB of RAM

If you run into issues with higher quantization levels, try using the q4 model or shut down any other programs that are using a lot of memory.

Model variants

By default, Ollama uses 4-bit quantization. To try other quantization levels, please try the other tags. The number after the q represents the number of bits used for quantization (i.e. q4 means 4-bit quantization). The higher the number, the more accurate the model is, but the slower it runs, and the more memory it requires.

Aliases
latest, 7b, 7b-q4_0
13b, 13b-q4_0
70b, 70b-q4_0

Model source

Stable Beluga source on Ollama

7b parameters original source: Stability AI

13b parameters original source: Stability AI

70b parameters original source: Stability AI