Update README.md

README.md

@@ -30,36 +30,25 @@ By accessing this model, you are agreeing to the Llama 2 terms and conditions of
 CodeLlama-7B-QML requires significant computing resources to perform with inference (response) times suitable for automatic code completion. Therefore, it should be used with a GPU accelerator. 
 
 Large Language Models, including CodeLlama-7B-QML, are not designed to be deployed in isolation but instead should be deployed as part of an overall AI system with additional safety guardrails as required. Developers are expected to deploy system safeguards when building AI systems.
+ 
+## How to run CodeLlama-7B-QML:
 
-The repository contains multiple files with adapters. 
-
-## How to run CodeLlama-7B-QML in cloud deployment:
-
-The configuration depends on the chosen cloud technology.
-
-Running a CodeLlama-7b-QML in the cloud requires working with Docker and vLLM for optimal performance. Make sure all required dependencies are installed (transformers, accelerate and peft modules). Use bfloat16 precision. The setup leverages the base model from Hugging Face (requiring an access token) combined with adapter weights from the repository. Using vLLM enables efficient inference with an OpenAI-compatible API endpoint, making integration straightforward. vLLM serves as a highly optimized backend that implements request batching and queuing mechanisms, providing excellent serving optimization. The docker container should be run on an instance with GPU accelerator. The configuration has been thoroughly tested on Ubuntu 22.04 LTS running NVIDIA driver with A100 80GB GPUs, demonstrating stable and efficient performance.
-
-## How to run CodeLlama-7B-QML in ollama:
-
-The model can be downloaded either from Hugging Face or Ollama. If the choice is Hugging Face, follow all the instruction steps. In case of Ollama, execute steps 1 and 5.
-
-#### 1. Install ollama
+1. Install ollama with the following command:
+```
 https://ollama.com/download
-
-#### 2. Clone the model repository
-
-#### 3. Open the terminal and go to the repository
-
-#### 4. Build the model in ollama
+```
+2. Clone this model repository. Click three dots in the top right corner and choose 'Clone repository'.
+3. Open the terminal and go to the just cloned repository.
+4. Build the model in ollama by executing the given command in the terminal:
 ```
 ollama create theqtcompany/codellama-7b-qml -f Modelfile
 ```
 The model's name must be exactly as above if one wants to use the model in the Qt Creator 
-
-#### 5. Run the model
+5. Run the model by entering the provided command int he terminal:
 ```
 ollama run theqtcompany/codellama-7b-qml
 ```
+
 You can start writing prompts in the terminal or send curl requests now.
 
 Here is a curl request example: