File size: 1,038 Bytes
d40988a 91ad4d3 d40988a 91ad4d3 d40988a 91ad4d3 d40988a 91ad4d3 d40988a 91ad4d3 d40988a 91ad4d3 d40988a 91ad4d3 d40988a 91ad4d3 d40988a 91ad4d3 d40988a 91ad4d3 d40988a 91ad4d3 d40988a 91ad4d3 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 |
---
language:
- en
tags:
- llama
- peft
- lora
license: apache-2.0
---
# 70_percent_model
LoRA-finetuned Llama-400M model
## Model Details
This model is a LoRA-finetuned version of [YongganFu/Llama-400M-12L](https://huggingface.co/YongganFu/Llama-400M-12L).
## Usage
```python
from transformers import AutoTokenizer, AutoModelForCausalLM
model_name = "lxaw/70_percent_model"
tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModelForCausalLM.from_pretrained(model_name)
# Example usage
input_text = "What is the capital of France?"
inputs = tokenizer(input_text, return_tensors="pt")
outputs = model.generate(inputs.input_ids, max_length=50)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))
```
## Example Output
**Input:** What is the capital of France?
**Output:** What is the capital of France?
The capital of France is Paris, which is located in the country of France. The capital is the largest city in France and is known for its beautiful architecture, delicious food, and friendly people.
|