asrimanth commited on
Commit
f8a7eac
·
1 Parent(s): 42a9d1a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +15 -2
README.md CHANGED
@@ -45,8 +45,11 @@ Augmentations used : Center crop, Random Flip
45
  Gradient accumulation steps : Tried 1, 3, and 4 for different experiments. 4 gave decent results.
46
 
47
  text2image_fine-tune :
 
48
  **wandb dashboard : https://wandb.ai/asrimanth/text2image_fine-tune**
 
49
  **Model card for asrimanth/person-thumbs-up-lora: https://huggingface.co/asrimanth/person-thumbs-up-lora**
 
50
  **Prompt: ```<tom_cruise> #thumbsup```**
51
 
52
  Deployed models:
@@ -54,18 +57,27 @@ Deployed models:
54
  When the above experiment failed, I had to try different datasets. One of them was "tom cruise".
55
 
56
  srimanth-thumbs-up-lora-plain : We use the plain dataset with srimanth mentioned above.
 
57
  **wandb link: https://wandb.ai/asrimanth/srimanth-thumbs-up-lora-plain**
 
58
  **Model card for srimanth-thumbs-up-lora-plain: https://huggingface.co/asrimanth/srimanth-thumbs-up-lora-plain**
 
59
  **Prompt: ```srimanth thumbs up```**
60
 
61
- person-thumbs-up-plain-lora wandb : We use the
 
62
  **wandb link: https://wandb.ai/asrimanth/person-thumbs-up-plain-lora**
 
63
  **Model card for asrimanth/person-thumbs-up-plain-lora: https://huggingface.co/asrimanth/person-thumbs-up-plain-lora**
 
64
  **Prompt: ```tom cruise thumbs up```**
65
 
66
- person-thumbs-up-lora-no-cap wandb dashboard:
 
67
  **https://wandb.ai/asrimanth/person-thumbs-up-lora-no-cap**
 
68
  **Model card for asrimanth/person-thumbs-up-lora-no-cap: https://huggingface.co/asrimanth/person-thumbs-up-lora-no-cap**
 
69
  **Prompt: ```<tom_cruise> #thumbsup```**
70
 
71
  ### Inference
@@ -75,6 +87,7 @@ person-thumbs-up-lora-no-cap wandb dashboard:
75
  + During local inference (25 steps), I found the person-thumbs-up-plain-lora to show 35 out of 50 images with a decent thumbs up result for tom cruise, 5 incomplete thumbs up.
76
  + While I could not evaluate the model with metrics due to insufficient time, I chose the visual approach. To view the inference images, check the `results` folder.
77
  + To evaulate diffusion models, I would start with this: https://huggingface.co/docs/diffusers/conceptual/evaluation
 
78
 
79
  ### Deployment
80
 
 
45
  Gradient accumulation steps : Tried 1, 3, and 4 for different experiments. 4 gave decent results.
46
 
47
  text2image_fine-tune :
48
+
49
  **wandb dashboard : https://wandb.ai/asrimanth/text2image_fine-tune**
50
+
51
  **Model card for asrimanth/person-thumbs-up-lora: https://huggingface.co/asrimanth/person-thumbs-up-lora**
52
+
53
  **Prompt: ```<tom_cruise> #thumbsup```**
54
 
55
  Deployed models:
 
57
  When the above experiment failed, I had to try different datasets. One of them was "tom cruise".
58
 
59
  srimanth-thumbs-up-lora-plain : We use the plain dataset with srimanth mentioned above.
60
+
61
  **wandb link: https://wandb.ai/asrimanth/srimanth-thumbs-up-lora-plain**
62
+
63
  **Model card for srimanth-thumbs-up-lora-plain: https://huggingface.co/asrimanth/srimanth-thumbs-up-lora-plain**
64
+
65
  **Prompt: ```srimanth thumbs up```**
66
 
67
+ person-thumbs-up-plain-lora wandb : We use the plain dataset with tom cruise images.
68
+
69
  **wandb link: https://wandb.ai/asrimanth/person-thumbs-up-plain-lora**
70
+
71
  **Model card for asrimanth/person-thumbs-up-plain-lora: https://huggingface.co/asrimanth/person-thumbs-up-plain-lora**
72
+
73
  **Prompt: ```tom cruise thumbs up```**
74
 
75
+ person-thumbs-up-lora-no-cap wandb dashboard: We use the no-cap dataset with tom cruise images.
76
+
77
  **https://wandb.ai/asrimanth/person-thumbs-up-lora-no-cap**
78
+
79
  **Model card for asrimanth/person-thumbs-up-lora-no-cap: https://huggingface.co/asrimanth/person-thumbs-up-lora-no-cap**
80
+
81
  **Prompt: ```<tom_cruise> #thumbsup```**
82
 
83
  ### Inference
 
87
  + During local inference (25 steps), I found the person-thumbs-up-plain-lora to show 35 out of 50 images with a decent thumbs up result for tom cruise, 5 incomplete thumbs up.
88
  + While I could not evaluate the model with metrics due to insufficient time, I chose the visual approach. To view the inference images, check the `results` folder.
89
  + To evaulate diffusion models, I would start with this: https://huggingface.co/docs/diffusers/conceptual/evaluation
90
+ + The half-precision inference was not working on CPU, so we've used torch.float32 instead.
91
 
92
  ### Deployment
93