Spaces:
Sleeping
Sleeping
Update README.md
Browse files
README.md
CHANGED
@@ -45,8 +45,11 @@ Augmentations used : Center crop, Random Flip
|
|
45 |
Gradient accumulation steps : Tried 1, 3, and 4 for different experiments. 4 gave decent results.
|
46 |
|
47 |
text2image_fine-tune :
|
|
|
48 |
**wandb dashboard : https://wandb.ai/asrimanth/text2image_fine-tune**
|
|
|
49 |
**Model card for asrimanth/person-thumbs-up-lora: https://huggingface.co/asrimanth/person-thumbs-up-lora**
|
|
|
50 |
**Prompt: ```<tom_cruise> #thumbsup```**
|
51 |
|
52 |
Deployed models:
|
@@ -54,18 +57,27 @@ Deployed models:
|
|
54 |
When the above experiment failed, I had to try different datasets. One of them was "tom cruise".
|
55 |
|
56 |
srimanth-thumbs-up-lora-plain : We use the plain dataset with srimanth mentioned above.
|
|
|
57 |
**wandb link: https://wandb.ai/asrimanth/srimanth-thumbs-up-lora-plain**
|
|
|
58 |
**Model card for srimanth-thumbs-up-lora-plain: https://huggingface.co/asrimanth/srimanth-thumbs-up-lora-plain**
|
|
|
59 |
**Prompt: ```srimanth thumbs up```**
|
60 |
|
61 |
-
person-thumbs-up-plain-lora wandb : We use the
|
|
|
62 |
**wandb link: https://wandb.ai/asrimanth/person-thumbs-up-plain-lora**
|
|
|
63 |
**Model card for asrimanth/person-thumbs-up-plain-lora: https://huggingface.co/asrimanth/person-thumbs-up-plain-lora**
|
|
|
64 |
**Prompt: ```tom cruise thumbs up```**
|
65 |
|
66 |
-
person-thumbs-up-lora-no-cap wandb dashboard:
|
|
|
67 |
**https://wandb.ai/asrimanth/person-thumbs-up-lora-no-cap**
|
|
|
68 |
**Model card for asrimanth/person-thumbs-up-lora-no-cap: https://huggingface.co/asrimanth/person-thumbs-up-lora-no-cap**
|
|
|
69 |
**Prompt: ```<tom_cruise> #thumbsup```**
|
70 |
|
71 |
### Inference
|
@@ -75,6 +87,7 @@ person-thumbs-up-lora-no-cap wandb dashboard:
|
|
75 |
+ During local inference (25 steps), I found the person-thumbs-up-plain-lora to show 35 out of 50 images with a decent thumbs up result for tom cruise, 5 incomplete thumbs up.
|
76 |
+ While I could not evaluate the model with metrics due to insufficient time, I chose the visual approach. To view the inference images, check the `results` folder.
|
77 |
+ To evaulate diffusion models, I would start with this: https://huggingface.co/docs/diffusers/conceptual/evaluation
|
|
|
78 |
|
79 |
### Deployment
|
80 |
|
|
|
45 |
Gradient accumulation steps : Tried 1, 3, and 4 for different experiments. 4 gave decent results.
|
46 |
|
47 |
text2image_fine-tune :
|
48 |
+
|
49 |
**wandb dashboard : https://wandb.ai/asrimanth/text2image_fine-tune**
|
50 |
+
|
51 |
**Model card for asrimanth/person-thumbs-up-lora: https://huggingface.co/asrimanth/person-thumbs-up-lora**
|
52 |
+
|
53 |
**Prompt: ```<tom_cruise> #thumbsup```**
|
54 |
|
55 |
Deployed models:
|
|
|
57 |
When the above experiment failed, I had to try different datasets. One of them was "tom cruise".
|
58 |
|
59 |
srimanth-thumbs-up-lora-plain : We use the plain dataset with srimanth mentioned above.
|
60 |
+
|
61 |
**wandb link: https://wandb.ai/asrimanth/srimanth-thumbs-up-lora-plain**
|
62 |
+
|
63 |
**Model card for srimanth-thumbs-up-lora-plain: https://huggingface.co/asrimanth/srimanth-thumbs-up-lora-plain**
|
64 |
+
|
65 |
**Prompt: ```srimanth thumbs up```**
|
66 |
|
67 |
+
person-thumbs-up-plain-lora wandb : We use the plain dataset with tom cruise images.
|
68 |
+
|
69 |
**wandb link: https://wandb.ai/asrimanth/person-thumbs-up-plain-lora**
|
70 |
+
|
71 |
**Model card for asrimanth/person-thumbs-up-plain-lora: https://huggingface.co/asrimanth/person-thumbs-up-plain-lora**
|
72 |
+
|
73 |
**Prompt: ```tom cruise thumbs up```**
|
74 |
|
75 |
+
person-thumbs-up-lora-no-cap wandb dashboard: We use the no-cap dataset with tom cruise images.
|
76 |
+
|
77 |
**https://wandb.ai/asrimanth/person-thumbs-up-lora-no-cap**
|
78 |
+
|
79 |
**Model card for asrimanth/person-thumbs-up-lora-no-cap: https://huggingface.co/asrimanth/person-thumbs-up-lora-no-cap**
|
80 |
+
|
81 |
**Prompt: ```<tom_cruise> #thumbsup```**
|
82 |
|
83 |
### Inference
|
|
|
87 |
+ During local inference (25 steps), I found the person-thumbs-up-plain-lora to show 35 out of 50 images with a decent thumbs up result for tom cruise, 5 incomplete thumbs up.
|
88 |
+ While I could not evaluate the model with metrics due to insufficient time, I chose the visual approach. To view the inference images, check the `results` folder.
|
89 |
+ To evaulate diffusion models, I would start with this: https://huggingface.co/docs/diffusers/conceptual/evaluation
|
90 |
+
+ The half-precision inference was not working on CPU, so we've used torch.float32 instead.
|
91 |
|
92 |
### Deployment
|
93 |
|