Code

Add torch.compile for Mistral#30642

Code

Merged

ArthurZucker merged 31 commits intohuggingface:mainhuggingface/transformers:mainfrom zhenglongjiepheonix:longjie/add_torch_compile_for_mistralzhenglongjiepheonix/transformers:longjie/add_torch_compile_for_mistralCopy head branch name to clipboardMay 20, 2024

+511-236

Commits

Commits on May 13, 2024

• first version

  zhenglongjiepheonix

  committed
  dcac131

  Copy full SHA for dcac131

• fix sliding window

  zhenglongjiepheonix

  committed
  9afc73b

  Copy full SHA for 9afc73b

• fix style

  zhenglongjiepheonix

  committed
  3fa9285

  Copy full SHA for 3fa9285

• add sliding window cache

  zhenglongjiepheonix

  committed
  5246ced

  Copy full SHA for 5246ced

• fix style

  zhenglongjiepheonix

  committed
  6367154

  Copy full SHA for 6367154

• address comments

  zhenglongjiepheonix

  committed
  c74b329

  Copy full SHA for c74b329

• fix test

  zhenglongjiepheonix

  committed
  1cd711c

  Copy full SHA for 1cd711c

• fix style

  zhenglongjiepheonix

  committed
  06b64ca

  Copy full SHA for 06b64ca

• move sliding window check inside cache init

  zhenglongjiepheonix

  committed
  d46c601

  Copy full SHA for d46c601

• revert changes on irrelevant files & add comment on SlidingWindowCache

  zhenglongjiepheonix

  committed
  ec8f338

  Copy full SHA for ec8f338

• address comments & fix style

  Show description for a51b44f
  zhenglongjiepheonix

  committed
  a51b44f

  Copy full SHA for a51b44f

• update causal mask

  zhenglongjiepheonix

  committed
  c1fca1a

  Copy full SHA for c1fca1a

Commits on May 14, 2024

• Merge remote-tracking branch 'upstream/main' into longjie/add_torch_compile_for_mistral

  zhenglongjiepheonix

  committed
  ecdcff1

  Copy full SHA for ecdcff1

• [run-slow] mistral

  zhenglongjiepheonix

  committed
  233cb3b

  Copy full SHA for 233cb3b

• Merge remote-tracking branch 'upstream/main' into longjie/add_torch_compile_for_mistral

  zhenglongjiepheonix

  committed
  562a9cf

  Copy full SHA for 562a9cf

• [run-slow] mistral

  zhenglongjiepheonix

  committed
  40e0553

  Copy full SHA for 40e0553

Commits on May 15, 2024

• Merge remote-tracking branch 'upstream/main' into longjie/add_torch_compile_for_mistral

  zhenglongjiepheonix

  committed
  47c48d4

  Copy full SHA for 47c48d4

• [run-slow] mistral

  zhenglongjiepheonix

  committed
  cdb7a57

  Copy full SHA for cdb7a57

• [run-slow] mistral

  zhenglongjiepheonix

  committed
  fcbd9ad

  Copy full SHA for fcbd9ad

Commits on May 16, 2024

• fix conflict

  zhenglongjiepheonix

  committed
  902fdbc

  Copy full SHA for 902fdbc

• Merge remote-tracking branch 'upstream/main' into longjie/add_torch_compile_for_mistral

  zhenglongjiepheonix

  committed
  7e1537e

  Copy full SHA for 7e1537e

• Merge remote-tracking branch 'upstream/main' into longjie/add_torch_compile_for_mistral

  zhenglongjiepheonix

  committed
  c065bbe

  Copy full SHA for c065bbe

• [run-slow] mistral

  zhenglongjiepheonix

  committed
  691b201

  Copy full SHA for 691b201

• [run-slow] llama

  zhenglongjiepheonix

  committed
  6a9ec8c

  Copy full SHA for 6a9ec8c

• [run-slow] mistral

  zhenglongjiepheonix

  committed
  02cdb1d

  Copy full SHA for 02cdb1d

• [run-slow] mistral

  zhenglongjiepheonix

  committed
  9779556

  Copy full SHA for 9779556

• [run-slow] mistral

  zhenglongjiepheonix

  committed
  b78e2a0

  Copy full SHA for b78e2a0

Commits on May 17, 2024

• fix conflict

  zhenglongjiepheonix

  committed
  c9de82d

  Copy full SHA for c9de82d

• revert CI from a10 to t4

  zhenglongjiepheonix

  committed
  93e14ba

  Copy full SHA for 93e14ba

• wrap up

  zhenglongjiepheonix

  committed
  ee8f9fb

  Copy full SHA for ee8f9fb

Commits on May 20, 2024

• fix conflict

  zhenglongjiepheonix

  committed
  82b76af

  Copy full SHA for 82b76af