Skip to content

LoRa and diff with bitsandbytes #281

New issue
Jump to bottom
New issue
Jump to bottom
Open
Open
LoRa and diff with bitsandbytes#281
@RonanKMcGovern

Description

@RonanKMcGovern
RonanKMcGovern
opened on Aug 3, 2023
  1. What changes would I need to make for GPTQ to support LoRa for Llama 2?
  2. What's the main difference between GPTQ vs bitsandbytes? Is it that GPTQ re-adjusts the weights to keep the same loss function shape?

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions