File size: 225 Bytes
c94e540 |
1 2 3 4 5 6 7 8 |
DEFAULT_stage:
DEFAULT_modifiers:
GPTQModifier:
sequential_targets: [MistralDecoderLayer]
scheme: W8A8
targets: Linear
ignore: ['re:.*lm_head', 're:vision_tower.*', 're:multi_modal_projector.*']
|