LPX55 commited on
Commit
88007c3
·
verified ·
1 Parent(s): 23eb3e8

Create flux-dev-layers

Browse files
Files changed (1) hide show
  1. flux-dev-layers +494 -0
flux-dev-layers ADDED
@@ -0,0 +1,494 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ transformer.transformer_blocks.0.norm1.linear
2
+ transformer.transformer_blocks.0.norm1_context.linear
3
+ transformer.transformer_blocks.0.attn.to_q
4
+ transformer.transformer_blocks.0.attn.to_k
5
+ transformer.transformer_blocks.0.attn.to_v
6
+ transformer.transformer_blocks.0.attn.add_k_proj
7
+ transformer.transformer_blocks.0.attn.add_v_proj
8
+ transformer.transformer_blocks.0.attn.add_q_proj
9
+ transformer.transformer_blocks.0.attn.to_out.0
10
+ transformer.transformer_blocks.0.attn.to_add_out
11
+ transformer.transformer_blocks.0.ff.net.0.proj
12
+ transformer.transformer_blocks.0.ff.net.2
13
+ transformer.transformer_blocks.0.ff_context.net.0.proj
14
+ transformer.transformer_blocks.0.ff_context.net.2
15
+ transformer.transformer_blocks.1.norm1.linear
16
+ transformer.transformer_blocks.1.norm1_context.linear
17
+ transformer.transformer_blocks.1.attn.to_q
18
+ transformer.transformer_blocks.1.attn.to_k
19
+ transformer.transformer_blocks.1.attn.to_v
20
+ transformer.transformer_blocks.1.attn.add_k_proj
21
+ transformer.transformer_blocks.1.attn.add_v_proj
22
+ transformer.transformer_blocks.1.attn.add_q_proj
23
+ transformer.transformer_blocks.1.attn.to_out.0
24
+ transformer.transformer_blocks.1.attn.to_add_out
25
+ transformer.transformer_blocks.1.ff.net.0.proj
26
+ transformer.transformer_blocks.1.ff.net.2
27
+ transformer.transformer_blocks.1.ff_context.net.0.proj
28
+ transformer.transformer_blocks.1.ff_context.net.2
29
+ transformer.transformer_blocks.2.norm1.linear
30
+ transformer.transformer_blocks.2.norm1_context.linear
31
+ transformer.transformer_blocks.2.attn.to_q
32
+ transformer.transformer_blocks.2.attn.to_k
33
+ transformer.transformer_blocks.2.attn.to_v
34
+ transformer.transformer_blocks.2.attn.add_k_proj
35
+ transformer.transformer_blocks.2.attn.add_v_proj
36
+ transformer.transformer_blocks.2.attn.add_q_proj
37
+ transformer.transformer_blocks.2.attn.to_out.0
38
+ transformer.transformer_blocks.2.attn.to_add_out
39
+ transformer.transformer_blocks.2.ff.net.0.proj
40
+ transformer.transformer_blocks.2.ff.net.2
41
+ transformer.transformer_blocks.2.ff_context.net.0.proj
42
+ transformer.transformer_blocks.2.ff_context.net.2
43
+ transformer.transformer_blocks.3.norm1.linear
44
+ transformer.transformer_blocks.3.norm1_context.linear
45
+ transformer.transformer_blocks.3.attn.to_q
46
+ transformer.transformer_blocks.3.attn.to_k
47
+ transformer.transformer_blocks.3.attn.to_v
48
+ transformer.transformer_blocks.3.attn.add_k_proj
49
+ transformer.transformer_blocks.3.attn.add_v_proj
50
+ transformer.transformer_blocks.3.attn.add_q_proj
51
+ transformer.transformer_blocks.3.attn.to_out.0
52
+ transformer.transformer_blocks.3.attn.to_add_out
53
+ transformer.transformer_blocks.3.ff.net.0.proj
54
+ transformer.transformer_blocks.3.ff.net.2
55
+ transformer.transformer_blocks.3.ff_context.net.0.proj
56
+ transformer.transformer_blocks.3.ff_context.net.2
57
+ transformer.transformer_blocks.4.norm1.linear
58
+ transformer.transformer_blocks.4.norm1_context.linear
59
+ transformer.transformer_blocks.4.attn.to_q
60
+ transformer.transformer_blocks.4.attn.to_k
61
+ transformer.transformer_blocks.4.attn.to_v
62
+ transformer.transformer_blocks.4.attn.add_k_proj
63
+ transformer.transformer_blocks.4.attn.add_v_proj
64
+ transformer.transformer_blocks.4.attn.add_q_proj
65
+ transformer.transformer_blocks.4.attn.to_out.0
66
+ transformer.transformer_blocks.4.attn.to_add_out
67
+ transformer.transformer_blocks.4.ff.net.0.proj
68
+ transformer.transformer_blocks.4.ff.net.2
69
+ transformer.transformer_blocks.4.ff_context.net.0.proj
70
+ transformer.transformer_blocks.4.ff_context.net.2
71
+ transformer.transformer_blocks.5.norm1.linear
72
+ transformer.transformer_blocks.5.norm1_context.linear
73
+ transformer.transformer_blocks.5.attn.to_q
74
+ transformer.transformer_blocks.5.attn.to_k
75
+ transformer.transformer_blocks.5.attn.to_v
76
+ transformer.transformer_blocks.5.attn.add_k_proj
77
+ transformer.transformer_blocks.5.attn.add_v_proj
78
+ transformer.transformer_blocks.5.attn.add_q_proj
79
+ transformer.transformer_blocks.5.attn.to_out.0
80
+ transformer.transformer_blocks.5.attn.to_add_out
81
+ transformer.transformer_blocks.5.ff.net.0.proj
82
+ transformer.transformer_blocks.5.ff.net.2
83
+ transformer.transformer_blocks.5.ff_context.net.0.proj
84
+ transformer.transformer_blocks.5.ff_context.net.2
85
+ transformer.transformer_blocks.6.norm1.linear
86
+ transformer.transformer_blocks.6.norm1_context.linear
87
+ transformer.transformer_blocks.6.attn.to_q
88
+ transformer.transformer_blocks.6.attn.to_k
89
+ transformer.transformer_blocks.6.attn.to_v
90
+ transformer.transformer_blocks.6.attn.add_k_proj
91
+ transformer.transformer_blocks.6.attn.add_v_proj
92
+ transformer.transformer_blocks.6.attn.add_q_proj
93
+ transformer.transformer_blocks.6.attn.to_out.0
94
+ transformer.transformer_blocks.6.attn.to_add_out
95
+ transformer.transformer_blocks.6.ff.net.0.proj
96
+ transformer.transformer_blocks.6.ff.net.2
97
+ transformer.transformer_blocks.6.ff_context.net.0.proj
98
+ transformer.transformer_blocks.6.ff_context.net.2
99
+ transformer.transformer_blocks.7.norm1.linear
100
+ transformer.transformer_blocks.7.norm1_context.linear
101
+ transformer.transformer_blocks.7.attn.to_q
102
+ transformer.transformer_blocks.7.attn.to_k
103
+ transformer.transformer_blocks.7.attn.to_v
104
+ transformer.transformer_blocks.7.attn.add_k_proj
105
+ transformer.transformer_blocks.7.attn.add_v_proj
106
+ transformer.transformer_blocks.7.attn.add_q_proj
107
+ transformer.transformer_blocks.7.attn.to_out.0
108
+ transformer.transformer_blocks.7.attn.to_add_out
109
+ transformer.transformer_blocks.7.ff.net.0.proj
110
+ transformer.transformer_blocks.7.ff.net.2
111
+ transformer.transformer_blocks.7.ff_context.net.0.proj
112
+ transformer.transformer_blocks.7.ff_context.net.2
113
+ transformer.transformer_blocks.8.norm1.linear
114
+ transformer.transformer_blocks.8.norm1_context.linear
115
+ transformer.transformer_blocks.8.attn.to_q
116
+ transformer.transformer_blocks.8.attn.to_k
117
+ transformer.transformer_blocks.8.attn.to_v
118
+ transformer.transformer_blocks.8.attn.add_k_proj
119
+ transformer.transformer_blocks.8.attn.add_v_proj
120
+ transformer.transformer_blocks.8.attn.add_q_proj
121
+ transformer.transformer_blocks.8.attn.to_out.0
122
+ transformer.transformer_blocks.8.attn.to_add_out
123
+ transformer.transformer_blocks.8.ff.net.0.proj
124
+ transformer.transformer_blocks.8.ff.net.2
125
+ transformer.transformer_blocks.8.ff_context.net.0.proj
126
+ transformer.transformer_blocks.8.ff_context.net.2
127
+ transformer.transformer_blocks.9.norm1.linear
128
+ transformer.transformer_blocks.9.norm1_context.linear
129
+ transformer.transformer_blocks.9.attn.to_q
130
+ transformer.transformer_blocks.9.attn.to_k
131
+ transformer.transformer_blocks.9.attn.to_v
132
+ transformer.transformer_blocks.9.attn.add_k_proj
133
+ transformer.transformer_blocks.9.attn.add_v_proj
134
+ transformer.transformer_blocks.9.attn.add_q_proj
135
+ transformer.transformer_blocks.9.attn.to_out.0
136
+ transformer.transformer_blocks.9.attn.to_add_out
137
+ transformer.transformer_blocks.9.ff.net.0.proj
138
+ transformer.transformer_blocks.9.ff.net.2
139
+ transformer.transformer_blocks.9.ff_context.net.0.proj
140
+ transformer.transformer_blocks.9.ff_context.net.2
141
+ transformer.transformer_blocks.10.norm1.linear
142
+ transformer.transformer_blocks.10.norm1_context.linear
143
+ transformer.transformer_blocks.10.attn.to_q
144
+ transformer.transformer_blocks.10.attn.to_k
145
+ transformer.transformer_blocks.10.attn.to_v
146
+ transformer.transformer_blocks.10.attn.add_k_proj
147
+ transformer.transformer_blocks.10.attn.add_v_proj
148
+ transformer.transformer_blocks.10.attn.add_q_proj
149
+ transformer.transformer_blocks.10.attn.to_out.0
150
+ transformer.transformer_blocks.10.attn.to_add_out
151
+ transformer.transformer_blocks.10.ff.net.0.proj
152
+ transformer.transformer_blocks.10.ff.net.2
153
+ transformer.transformer_blocks.10.ff_context.net.0.proj
154
+ transformer.transformer_blocks.10.ff_context.net.2
155
+ transformer.transformer_blocks.11.norm1.linear
156
+ transformer.transformer_blocks.11.norm1_context.linear
157
+ transformer.transformer_blocks.11.attn.to_q
158
+ transformer.transformer_blocks.11.attn.to_k
159
+ transformer.transformer_blocks.11.attn.to_v
160
+ transformer.transformer_blocks.11.attn.add_k_proj
161
+ transformer.transformer_blocks.11.attn.add_v_proj
162
+ transformer.transformer_blocks.11.attn.add_q_proj
163
+ transformer.transformer_blocks.11.attn.to_out.0
164
+ transformer.transformer_blocks.11.attn.to_add_out
165
+ transformer.transformer_blocks.11.ff.net.0.proj
166
+ transformer.transformer_blocks.11.ff.net.2
167
+ transformer.transformer_blocks.11.ff_context.net.0.proj
168
+ transformer.transformer_blocks.11.ff_context.net.2
169
+ transformer.transformer_blocks.12.norm1.linear
170
+ transformer.transformer_blocks.12.norm1_context.linear
171
+ transformer.transformer_blocks.12.attn.to_q
172
+ transformer.transformer_blocks.12.attn.to_k
173
+ transformer.transformer_blocks.12.attn.to_v
174
+ transformer.transformer_blocks.12.attn.add_k_proj
175
+ transformer.transformer_blocks.12.attn.add_v_proj
176
+ transformer.transformer_blocks.12.attn.add_q_proj
177
+ transformer.transformer_blocks.12.attn.to_out.0
178
+ transformer.transformer_blocks.12.attn.to_add_out
179
+ transformer.transformer_blocks.12.ff.net.0.proj
180
+ transformer.transformer_blocks.12.ff.net.2
181
+ transformer.transformer_blocks.12.ff_context.net.0.proj
182
+ transformer.transformer_blocks.12.ff_context.net.2
183
+ transformer.transformer_blocks.13.norm1.linear
184
+ transformer.transformer_blocks.13.norm1_context.linear
185
+ transformer.transformer_blocks.13.attn.to_q
186
+ transformer.transformer_blocks.13.attn.to_k
187
+ transformer.transformer_blocks.13.attn.to_v
188
+ transformer.transformer_blocks.13.attn.add_k_proj
189
+ transformer.transformer_blocks.13.attn.add_v_proj
190
+ transformer.transformer_blocks.13.attn.add_q_proj
191
+ transformer.transformer_blocks.13.attn.to_out.0
192
+ transformer.transformer_blocks.13.attn.to_add_out
193
+ transformer.transformer_blocks.13.ff.net.0.proj
194
+ transformer.transformer_blocks.13.ff.net.2
195
+ transformer.transformer_blocks.13.ff_context.net.0.proj
196
+ transformer.transformer_blocks.13.ff_context.net.2
197
+ transformer.transformer_blocks.14.norm1.linear
198
+ transformer.transformer_blocks.14.norm1_context.linear
199
+ transformer.transformer_blocks.14.attn.to_q
200
+ transformer.transformer_blocks.14.attn.to_k
201
+ transformer.transformer_blocks.14.attn.to_v
202
+ transformer.transformer_blocks.14.attn.add_k_proj
203
+ transformer.transformer_blocks.14.attn.add_v_proj
204
+ transformer.transformer_blocks.14.attn.add_q_proj
205
+ transformer.transformer_blocks.14.attn.to_out.0
206
+ transformer.transformer_blocks.14.attn.to_add_out
207
+ transformer.transformer_blocks.14.ff.net.0.proj
208
+ transformer.transformer_blocks.14.ff.net.2
209
+ transformer.transformer_blocks.14.ff_context.net.0.proj
210
+ transformer.transformer_blocks.14.ff_context.net.2
211
+ transformer.transformer_blocks.15.norm1.linear
212
+ transformer.transformer_blocks.15.norm1_context.linear
213
+ transformer.transformer_blocks.15.attn.to_q
214
+ transformer.transformer_blocks.15.attn.to_k
215
+ transformer.transformer_blocks.15.attn.to_v
216
+ transformer.transformer_blocks.15.attn.add_k_proj
217
+ transformer.transformer_blocks.15.attn.add_v_proj
218
+ transformer.transformer_blocks.15.attn.add_q_proj
219
+ transformer.transformer_blocks.15.attn.to_out.0
220
+ transformer.transformer_blocks.15.attn.to_add_out
221
+ transformer.transformer_blocks.15.ff.net.0.proj
222
+ transformer.transformer_blocks.15.ff.net.2
223
+ transformer.transformer_blocks.15.ff_context.net.0.proj
224
+ transformer.transformer_blocks.15.ff_context.net.2
225
+ transformer.transformer_blocks.16.norm1.linear
226
+ transformer.transformer_blocks.16.norm1_context.linear
227
+ transformer.transformer_blocks.16.attn.to_q
228
+ transformer.transformer_blocks.16.attn.to_k
229
+ transformer.transformer_blocks.16.attn.to_v
230
+ transformer.transformer_blocks.16.attn.add_k_proj
231
+ transformer.transformer_blocks.16.attn.add_v_proj
232
+ transformer.transformer_blocks.16.attn.add_q_proj
233
+ transformer.transformer_blocks.16.attn.to_out.0
234
+ transformer.transformer_blocks.16.attn.to_add_out
235
+ transformer.transformer_blocks.16.ff.net.0.proj
236
+ transformer.transformer_blocks.16.ff.net.2
237
+ transformer.transformer_blocks.16.ff_context.net.0.proj
238
+ transformer.transformer_blocks.16.ff_context.net.2
239
+ transformer.transformer_blocks.17.norm1.linear
240
+ transformer.transformer_blocks.17.norm1_context.linear
241
+ transformer.transformer_blocks.17.attn.to_q
242
+ transformer.transformer_blocks.17.attn.to_k
243
+ transformer.transformer_blocks.17.attn.to_v
244
+ transformer.transformer_blocks.17.attn.add_k_proj
245
+ transformer.transformer_blocks.17.attn.add_v_proj
246
+ transformer.transformer_blocks.17.attn.add_q_proj
247
+ transformer.transformer_blocks.17.attn.to_out.0
248
+ transformer.transformer_blocks.17.attn.to_add_out
249
+ transformer.transformer_blocks.17.ff.net.0.proj
250
+ transformer.transformer_blocks.17.ff.net.2
251
+ transformer.transformer_blocks.17.ff_context.net.0.proj
252
+ transformer.transformer_blocks.17.ff_context.net.2
253
+ transformer.transformer_blocks.18.norm1.linear
254
+ transformer.transformer_blocks.18.norm1_context.linear
255
+ transformer.transformer_blocks.18.attn.to_q
256
+ transformer.transformer_blocks.18.attn.to_k
257
+ transformer.transformer_blocks.18.attn.to_v
258
+ transformer.transformer_blocks.18.attn.add_k_proj
259
+ transformer.transformer_blocks.18.attn.add_v_proj
260
+ transformer.transformer_blocks.18.attn.add_q_proj
261
+ transformer.transformer_blocks.18.attn.to_out.0
262
+ transformer.transformer_blocks.18.attn.to_add_out
263
+ transformer.transformer_blocks.18.ff.net.0.proj
264
+ transformer.transformer_blocks.18.ff.net.2
265
+ transformer.transformer_blocks.18.ff_context.net.0.proj
266
+ transformer.transformer_blocks.18.ff_context.net.2
267
+ transformer.single_transformer_blocks.0.norm.linear
268
+ transformer.single_transformer_blocks.0.proj_mlp
269
+ transformer.single_transformer_blocks.0.proj_out
270
+ transformer.single_transformer_blocks.0.attn.to_q
271
+ transformer.single_transformer_blocks.0.attn.to_k
272
+ transformer.single_transformer_blocks.0.attn.to_v
273
+ transformer.single_transformer_blocks.1.norm.linear
274
+ transformer.single_transformer_blocks.1.proj_mlp
275
+ transformer.single_transformer_blocks.1.proj_out
276
+ transformer.single_transformer_blocks.1.attn.to_q
277
+ transformer.single_transformer_blocks.1.attn.to_k
278
+ transformer.single_transformer_blocks.1.attn.to_v
279
+ transformer.single_transformer_blocks.2.norm.linear
280
+ transformer.single_transformer_blocks.2.proj_mlp
281
+ transformer.single_transformer_blocks.2.proj_out
282
+ transformer.single_transformer_blocks.2.attn.to_q
283
+ transformer.single_transformer_blocks.2.attn.to_k
284
+ transformer.single_transformer_blocks.2.attn.to_v
285
+ transformer.single_transformer_blocks.3.norm.linear
286
+ transformer.single_transformer_blocks.3.proj_mlp
287
+ transformer.single_transformer_blocks.3.proj_out
288
+ transformer.single_transformer_blocks.3.attn.to_q
289
+ transformer.single_transformer_blocks.3.attn.to_k
290
+ transformer.single_transformer_blocks.3.attn.to_v
291
+ transformer.single_transformer_blocks.4.norm.linear
292
+ transformer.single_transformer_blocks.4.proj_mlp
293
+ transformer.single_transformer_blocks.4.proj_out
294
+ transformer.single_transformer_blocks.4.attn.to_q
295
+ transformer.single_transformer_blocks.4.attn.to_k
296
+ transformer.single_transformer_blocks.4.attn.to_v
297
+ transformer.single_transformer_blocks.5.norm.linear
298
+ transformer.single_transformer_blocks.5.proj_mlp
299
+ transformer.single_transformer_blocks.5.proj_out
300
+ transformer.single_transformer_blocks.5.attn.to_q
301
+ transformer.single_transformer_blocks.5.attn.to_k
302
+ transformer.single_transformer_blocks.5.attn.to_v
303
+ transformer.single_transformer_blocks.6.norm.linear
304
+ transformer.single_transformer_blocks.6.proj_mlp
305
+ transformer.single_transformer_blocks.6.proj_out
306
+ transformer.single_transformer_blocks.6.attn.to_q
307
+ transformer.single_transformer_blocks.6.attn.to_k
308
+ transformer.single_transformer_blocks.6.attn.to_v
309
+ transformer.single_transformer_blocks.7.norm.linear
310
+ transformer.single_transformer_blocks.7.proj_mlp
311
+ transformer.single_transformer_blocks.7.proj_out
312
+ transformer.single_transformer_blocks.7.attn.to_q
313
+ transformer.single_transformer_blocks.7.attn.to_k
314
+ transformer.single_transformer_blocks.7.attn.to_v
315
+ transformer.single_transformer_blocks.8.norm.linear
316
+ transformer.single_transformer_blocks.8.proj_mlp
317
+ transformer.single_transformer_blocks.8.proj_out
318
+ transformer.single_transformer_blocks.8.attn.to_q
319
+ transformer.single_transformer_blocks.8.attn.to_k
320
+ transformer.single_transformer_blocks.8.attn.to_v
321
+ transformer.single_transformer_blocks.9.norm.linear
322
+ transformer.single_transformer_blocks.9.proj_mlp
323
+ transformer.single_transformer_blocks.9.proj_out
324
+ transformer.single_transformer_blocks.9.attn.to_q
325
+ transformer.single_transformer_blocks.9.attn.to_k
326
+ transformer.single_transformer_blocks.9.attn.to_v
327
+ transformer.single_transformer_blocks.10.norm.linear
328
+ transformer.single_transformer_blocks.10.proj_mlp
329
+ transformer.single_transformer_blocks.10.proj_out
330
+ transformer.single_transformer_blocks.10.attn.to_q
331
+ transformer.single_transformer_blocks.10.attn.to_k
332
+ transformer.single_transformer_blocks.10.attn.to_v
333
+ transformer.single_transformer_blocks.11.norm.linear
334
+ transformer.single_transformer_blocks.11.proj_mlp
335
+ transformer.single_transformer_blocks.11.proj_out
336
+ transformer.single_transformer_blocks.11.attn.to_q
337
+ transformer.single_transformer_blocks.11.attn.to_k
338
+ transformer.single_transformer_blocks.11.attn.to_v
339
+ transformer.single_transformer_blocks.12.norm.linear
340
+ transformer.single_transformer_blocks.12.proj_mlp
341
+ transformer.single_transformer_blocks.12.proj_out
342
+ transformer.single_transformer_blocks.12.attn.to_q
343
+ transformer.single_transformer_blocks.12.attn.to_k
344
+ transformer.single_transformer_blocks.12.attn.to_v
345
+ transformer.single_transformer_blocks.13.norm.linear
346
+ transformer.single_transformer_blocks.13.proj_mlp
347
+ transformer.single_transformer_blocks.13.proj_out
348
+ transformer.single_transformer_blocks.13.attn.to_q
349
+ transformer.single_transformer_blocks.13.attn.to_k
350
+ transformer.single_transformer_blocks.13.attn.to_v
351
+ transformer.single_transformer_blocks.14.norm.linear
352
+ transformer.single_transformer_blocks.14.proj_mlp
353
+ transformer.single_transformer_blocks.14.proj_out
354
+ transformer.single_transformer_blocks.14.attn.to_q
355
+ transformer.single_transformer_blocks.14.attn.to_k
356
+ transformer.single_transformer_blocks.14.attn.to_v
357
+ transformer.single_transformer_blocks.15.norm.linear
358
+ transformer.single_transformer_blocks.15.proj_mlp
359
+ transformer.single_transformer_blocks.15.proj_out
360
+ transformer.single_transformer_blocks.15.attn.to_q
361
+ transformer.single_transformer_blocks.15.attn.to_k
362
+ transformer.single_transformer_blocks.15.attn.to_v
363
+ transformer.single_transformer_blocks.16.norm.linear
364
+ transformer.single_transformer_blocks.16.proj_mlp
365
+ transformer.single_transformer_blocks.16.proj_out
366
+ transformer.single_transformer_blocks.16.attn.to_q
367
+ transformer.single_transformer_blocks.16.attn.to_k
368
+ transformer.single_transformer_blocks.16.attn.to_v
369
+ transformer.single_transformer_blocks.17.norm.linear
370
+ transformer.single_transformer_blocks.17.proj_mlp
371
+ transformer.single_transformer_blocks.17.proj_out
372
+ transformer.single_transformer_blocks.17.attn.to_q
373
+ transformer.single_transformer_blocks.17.attn.to_k
374
+ transformer.single_transformer_blocks.17.attn.to_v
375
+ transformer.single_transformer_blocks.18.norm.linear
376
+ transformer.single_transformer_blocks.18.proj_mlp
377
+ transformer.single_transformer_blocks.18.proj_out
378
+ transformer.single_transformer_blocks.18.attn.to_q
379
+ transformer.single_transformer_blocks.18.attn.to_k
380
+ transformer.single_transformer_blocks.18.attn.to_v
381
+ transformer.single_transformer_blocks.19.norm.linear
382
+ transformer.single_transformer_blocks.19.proj_mlp
383
+ transformer.single_transformer_blocks.19.proj_out
384
+ transformer.single_transformer_blocks.19.attn.to_q
385
+ transformer.single_transformer_blocks.19.attn.to_k
386
+ transformer.single_transformer_blocks.19.attn.to_v
387
+ transformer.single_transformer_blocks.20.norm.linear
388
+ transformer.single_transformer_blocks.20.proj_mlp
389
+ transformer.single_transformer_blocks.20.proj_out
390
+ transformer.single_transformer_blocks.20.attn.to_q
391
+ transformer.single_transformer_blocks.20.attn.to_k
392
+ transformer.single_transformer_blocks.20.attn.to_v
393
+ transformer.single_transformer_blocks.21.norm.linear
394
+ transformer.single_transformer_blocks.21.proj_mlp
395
+ transformer.single_transformer_blocks.21.proj_out
396
+ transformer.single_transformer_blocks.21.attn.to_q
397
+ transformer.single_transformer_blocks.21.attn.to_k
398
+ transformer.single_transformer_blocks.21.attn.to_v
399
+ transformer.single_transformer_blocks.22.norm.linear
400
+ transformer.single_transformer_blocks.22.proj_mlp
401
+ transformer.single_transformer_blocks.22.proj_out
402
+ transformer.single_transformer_blocks.22.attn.to_q
403
+ transformer.single_transformer_blocks.22.attn.to_k
404
+ transformer.single_transformer_blocks.22.attn.to_v
405
+ transformer.single_transformer_blocks.23.norm.linear
406
+ transformer.single_transformer_blocks.23.proj_mlp
407
+ transformer.single_transformer_blocks.23.proj_out
408
+ transformer.single_transformer_blocks.23.attn.to_q
409
+ transformer.single_transformer_blocks.23.attn.to_k
410
+ transformer.single_transformer_blocks.23.attn.to_v
411
+ transformer.single_transformer_blocks.24.norm.linear
412
+ transformer.single_transformer_blocks.24.proj_mlp
413
+ transformer.single_transformer_blocks.24.proj_out
414
+ transformer.single_transformer_blocks.24.attn.to_q
415
+ transformer.single_transformer_blocks.24.attn.to_k
416
+ transformer.single_transformer_blocks.24.attn.to_v
417
+ transformer.single_transformer_blocks.25.norm.linear
418
+ transformer.single_transformer_blocks.25.proj_mlp
419
+ transformer.single_transformer_blocks.25.proj_out
420
+ transformer.single_transformer_blocks.25.attn.to_q
421
+ transformer.single_transformer_blocks.25.attn.to_k
422
+ transformer.single_transformer_blocks.25.attn.to_v
423
+ transformer.single_transformer_blocks.26.norm.linear
424
+ transformer.single_transformer_blocks.26.proj_mlp
425
+ transformer.single_transformer_blocks.26.proj_out
426
+ transformer.single_transformer_blocks.26.attn.to_q
427
+ transformer.single_transformer_blocks.26.attn.to_k
428
+ transformer.single_transformer_blocks.26.attn.to_v
429
+ transformer.single_transformer_blocks.27.norm.linear
430
+ transformer.single_transformer_blocks.27.proj_mlp
431
+ transformer.single_transformer_blocks.27.proj_out
432
+ transformer.single_transformer_blocks.27.attn.to_q
433
+ transformer.single_transformer_blocks.27.attn.to_k
434
+ transformer.single_transformer_blocks.27.attn.to_v
435
+ transformer.single_transformer_blocks.28.norm.linear
436
+ transformer.single_transformer_blocks.28.proj_mlp
437
+ transformer.single_transformer_blocks.28.proj_out
438
+ transformer.single_transformer_blocks.28.attn.to_q
439
+ transformer.single_transformer_blocks.28.attn.to_k
440
+ transformer.single_transformer_blocks.28.attn.to_v
441
+ transformer.single_transformer_blocks.29.norm.linear
442
+ transformer.single_transformer_blocks.29.proj_mlp
443
+ transformer.single_transformer_blocks.29.proj_out
444
+ transformer.single_transformer_blocks.29.attn.to_q
445
+ transformer.single_transformer_blocks.29.attn.to_k
446
+ transformer.single_transformer_blocks.29.attn.to_v
447
+ transformer.single_transformer_blocks.30.norm.linear
448
+ transformer.single_transformer_blocks.30.proj_mlp
449
+ transformer.single_transformer_blocks.30.proj_out
450
+ transformer.single_transformer_blocks.30.attn.to_q
451
+ transformer.single_transformer_blocks.30.attn.to_k
452
+ transformer.single_transformer_blocks.30.attn.to_v
453
+ transformer.single_transformer_blocks.31.norm.linear
454
+ transformer.single_transformer_blocks.31.proj_mlp
455
+ transformer.single_transformer_blocks.31.proj_out
456
+ transformer.single_transformer_blocks.31.attn.to_q
457
+ transformer.single_transformer_blocks.31.attn.to_k
458
+ transformer.single_transformer_blocks.31.attn.to_v
459
+ transformer.single_transformer_blocks.32.norm.linear
460
+ transformer.single_transformer_blocks.32.proj_mlp
461
+ transformer.single_transformer_blocks.32.proj_out
462
+ transformer.single_transformer_blocks.32.attn.to_q
463
+ transformer.single_transformer_blocks.32.attn.to_k
464
+ transformer.single_transformer_blocks.32.attn.to_v
465
+ transformer.single_transformer_blocks.33.norm.linear
466
+ transformer.single_transformer_blocks.33.proj_mlp
467
+ transformer.single_transformer_blocks.33.proj_out
468
+ transformer.single_transformer_blocks.33.attn.to_q
469
+ transformer.single_transformer_blocks.33.attn.to_k
470
+ transformer.single_transformer_blocks.33.attn.to_v
471
+ transformer.single_transformer_blocks.34.norm.linear
472
+ transformer.single_transformer_blocks.34.proj_mlp
473
+ transformer.single_transformer_blocks.34.proj_out
474
+ transformer.single_transformer_blocks.34.attn.to_q
475
+ transformer.single_transformer_blocks.34.attn.to_k
476
+ transformer.single_transformer_blocks.34.attn.to_v
477
+ transformer.single_transformer_blocks.35.norm.linear
478
+ transformer.single_transformer_blocks.35.proj_mlp
479
+ transformer.single_transformer_blocks.35.proj_out
480
+ transformer.single_transformer_blocks.35.attn.to_q
481
+ transformer.single_transformer_blocks.35.attn.to_k
482
+ transformer.single_transformer_blocks.35.attn.to_v
483
+ transformer.single_transformer_blocks.36.norm.linear
484
+ transformer.single_transformer_blocks.36.proj_mlp
485
+ transformer.single_transformer_blocks.36.proj_out
486
+ transformer.single_transformer_blocks.36.attn.to_q
487
+ transformer.single_transformer_blocks.36.attn.to_k
488
+ transformer.single_transformer_blocks.36.attn.to_v
489
+ transformer.single_transformer_blocks.37.norm.linear
490
+ transformer.single_transformer_blocks.37.proj_mlp
491
+ transformer.single_transformer_blocks.37.proj_out
492
+ transformer.single_transformer_blocks.37.attn.to_q
493
+ transformer.single_transformer_blocks.37.attn.to_k
494
+ transformer.single_transformer_blocks.37.attn.to_v