LLaMA 2 Notes

1. About

2. Install

2.1. Get Weights and Tokenizer URL

  1. Request from here.

  2. Wait for the email.

    The links expire in 24 hours

2.2. Download Repo

  1. Download from here.

  2. Run the ./download.sh script and provide the URL recieved in the email.

2.3. Create Docker Image

  1. Create a Dockerfile file

    FROM python:3.9-slim-buster

# Set the working directory to /app
WORKDIR /app

# Copy the requirements file
COPY requirements.txt .

# Install the dependencies
RUN pip install -r requirements.txt

# Copy the Llama2 model and data
COPY llama2.pth .
COPY llama2_data .

# Set the command to run the model
CMD ["python", "-m", "llama2.run_llama2"]