Code

GenAIComps microservices refactor#1072

Code

Merged

chensuyue merged 141 commits intomainopea-project/GenAIComps:mainfrom refactor_compsopea-project/GenAIComps:refactor_compsCopy head branch name to clipboardJan 2, 2025

+3,836-5,053

Commits

Commits on Dec 10, 2024

• [TEST] Refactor helmchart (#964)

  Show description for bdf4b21
  

  XinyaoWa

  and

  pre-commit-ci[bot]

  committed
  bdf4b21

  Copy full SHA for bdf4b21

• add deployment for 3rd party

  Show description for 6682318
  XinyaoWa

  committed
  6682318

  Copy full SHA for 6682318

• refactor src & development

  Show description for bec8360
  XinyaoWa

  committed
  bec8360

  Copy full SHA for bec8360

• fix

  Show description for 14dea41
  XinyaoWa

  committed
  14dea41

  Copy full SHA for 14dea41

• fix

  Show description for 29ce89d
  XinyaoWa

  committed
  29ce89d

  Copy full SHA for 29ce89d

Commits on Dec 11, 2024

• refactor embedding

  Show description for 36d90f4
  lvliang-intel

  committed
  36d90f4

  Copy full SHA for 36d90f4

• refactor for TGI LLM

  Show description for 67db564
  XinyaoWa

  committed
  67db564

  Copy full SHA for 67db564

Commits on Dec 12, 2024

• refactor dataprep redis

  Show description for fb57cb5
  letonghan

  committed
  fb57cb5

  Copy full SHA for fb57cb5

• fix for tgi llm

  Show description for 93a0d24
  XinyaoWa

  committed
  93a0d24

  Copy full SHA for 93a0d24

• support vllm LLM

  Show description for e0edef9
  XinyaoWa

  committed
  e0edef9

  Copy full SHA for e0edef9

• Refactor for Reranking with TEI (#1029)

  Show description for aeb0ec4
  

  3 peopleauthored
  aeb0ec4

  Copy full SHA for aeb0ec4

Commits on Dec 13, 2024

• support milvus dataprep

  Show description for 20b91d1
  letonghan

  committed
  20b91d1

  Copy full SHA for 20b91d1

• Merge branch 'refactor_comps' of https://github.com/opea-project/GenAIComps into refactor_comps

  letonghan

  committed
  b359328

  Copy full SHA for b359328

• add docker compose

  Show description for 4e3e228
  XinyaoWa

  committed
  4e3e228

  Copy full SHA for 4e3e228

Commits on Dec 17, 2024

• update embedding code

  Show description for 423a950
  lvliang-intel

  committed
  423a950

  Copy full SHA for 423a950

• Merge branch 'refactor_comps' of https://github.com/opea-project/GenAIComps into refactor_comps

  Show description for ea4913f
  lvliang-intel

  committed
  ea4913f

  Copy full SHA for ea4913f

• Merge branch 'main' of https://github.com/opea-project/GenAIComps into refactor_comps

  Show description for b852e04
  lvliang-intel

  committed
  b852e04

  Copy full SHA for b852e04

• update docker compose and test scripts

  Show description for 6945af4
  lvliang-intel

  committed
  6945af4

  Copy full SHA for 6945af4

• modify dataprep variable names

  Show description for 6da4f71
  letonghan

  committed
  6da4f71

  Copy full SHA for 6da4f71

• refactor retrievers redis

  Show description for 7b6c8f6
  letonghan

  committed
  7b6c8f6

  Copy full SHA for 7b6c8f6

• Merge branch 'refactor_comps' of https://github.com/opea-project/GenAIComps into refactor_comps

  letonghan

  committed
  bb8ff6a

  Copy full SHA for bb8ff6a

• fix merge conflict

  Show description for 843f1c0
  letonghan

  committed
  843f1c0

  Copy full SHA for 843f1c0

• Fix embedding issue

  Show description for ceb4869
  lvliang-intel

  committed
  ceb4869

  Copy full SHA for ceb4869

• Merge branch 'refactor_comps' of https://github.com/opea-project/GenAIComps into refactor_comps

  Show description for 4ec50b0
  lvliang-intel

  committed
  4ec50b0

  Copy full SHA for 4ec50b0

Commits on Dec 18, 2024

• delete redundant comments

  Show description for cb5527e
  letonghan

  committed
  cb5527e

  Copy full SHA for cb5527e

• modify test scripts

  Show description for 3494b7b
  letonghan

  committed
  3494b7b

  Copy full SHA for 3494b7b

• update milvus dataprep docker compose

  Show description for 191e58e
  letonghan

  committed
  191e58e

  Copy full SHA for 191e58e

• fix spell issue

  Show description for 3cfb65d
  letonghan

  committed
  3cfb65d

  Copy full SHA for 3cfb65d

• fix bugs

  Show description for 4f6677f
  letonghan

  committed
  4f6677f

  Copy full SHA for 4f6677f

• fix multi components issue and refine ci scripts

  Show description for 9c6f50c
  letonghan

  committed
  9c6f50c

  Copy full SHA for 9c6f50c

• refactor retriever milvus

  Show description for 06a714a
  letonghan

  committed
  06a714a

  Copy full SHA for 06a714a

Commits on Dec 19, 2024

• Refactor comps CI (#1045)

  Show description for 8e6a2bf
  chensuyue

  authored
  8e6a2bf

  Copy full SHA for 8e6a2bf

• Add multimodal embedding refactor

  Show description for c3b19b3
  lvliang-intel

  committed
  c3b19b3

  Copy full SHA for c3b19b3

• Merge branch 'refactor_comps' of https://github.com/opea-project/GenAIComps into refactor_comps

  Show description for eb3e114
  lvliang-intel

  committed
  eb3e114

  Copy full SHA for eb3e114

• Merge branch 'main' of https://github.com/opea-project/GenAIComps into refactor_comps

  Show description for 60747a8
  lvliang-intel

  committed
  60747a8

  Copy full SHA for 60747a8

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for ee3b687
  pre-commit-ci[bot]

  committed
  ee3b687

  Copy full SHA for ee3b687

• fix preci issue

  Show description for 7d7fb58
  lvliang-intel

  committed
  7d7fb58

  Copy full SHA for 7d7fb58

• Merge branch 'refactor_comps' of https://github.com/opea-project/GenAIComps into refactor_comps

  Show description for 910f77d
  lvliang-intel

  committed
  910f77d

  Copy full SHA for 910f77d

• fix docker file path

  Show description for 4977920
  lvliang-intel

  committed
  4977920

  Copy full SHA for 4977920

Commits on Dec 20, 2024

• Merge remote-tracking branch 'upstream/refactor_comps' into refactor_comps

  XinyaoWa

  committed
  c5a54b7

  Copy full SHA for c5a54b7

• fix ci issues

  Show description for 93c7a85
  lvliang-intel

  committed
  93c7a85

  Copy full SHA for 93c7a85

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for 103ac36
  pre-commit-ci[bot]

  committed
  103ac36

  Copy full SHA for 103ac36

• fix ci issues

  Show description for cf698a4
  lvliang-intel

  committed
  cf698a4

  Copy full SHA for cf698a4

• Merge branch 'refactor_comps' of https://github.com/opea-project/GenAIComps into refactor_comps

  Show description for b9a938b
  lvliang-intel

  committed
  b9a938b

  Copy full SHA for b9a938b

• Merge branch 'main' of https://github.com/opea-project/GenAIComps into refactor_comps

  Show description for 4d29328
  lvliang-intel

  committed
  4d29328

  Copy full SHA for 4d29328

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for c4d189f
  pre-commit-ci[bot]

  committed
  c4d189f

  Copy full SHA for c4d189f

• change src folder for test scripts

  Show description for 2dc93c9
  letonghan

  committed
  2dc93c9

  Copy full SHA for 2dc93c9

• update

  Show description for b5ee03c
  letonghan

  committed
  b5ee03c

  Copy full SHA for b5ee03c

• udpate folder src in python scripts

  Show description for 99f9172
  letonghan

  committed
  99f9172

  Copy full SHA for 99f9172

• update readmes

  Show description for f791ae2
  letonghan

  committed
  f791ae2

  Copy full SHA for f791ae2

• Fix dataprep/retrievers/vectorstores CI Issues (#1053)

  Show description for 40a55a8
  letonghan

  authored
  40a55a8

  Copy full SHA for 40a55a8

• add test file into test matrix only when the file still exist

  Show description for cde85ca
  chensuyue

  committed
  cde85ca

  Copy full SHA for cde85ca

• Merge remote-tracking branch 'upstream/refactor_comps' into refactor_comps

  XinyaoWa

  committed
  f327ef1

  Copy full SHA for f327ef1

• fix path

  Show description for 944ce63
  XinyaoWa

  committed
  944ce63

  Copy full SHA for 944ce63

• fix

  Show description for 7e00ace
  XinyaoWa

  committed
  7e00ace

  Copy full SHA for 7e00ace

• fix

  Show description for 03568a4
  XinyaoWa

  committed
  03568a4

  Copy full SHA for 03568a4

• revert other comps folders

  Show description for 049452a
  letonghan

  committed
  049452a

  Copy full SHA for 049452a

• fix

  Show description for 5cedcab
  XinyaoWa

  committed
  5cedcab

  Copy full SHA for 5cedcab

• Merge branch 'refactor_comps' of https://github.com/opea-project/GenAIComps into refactor_comps

  letonghan

  committed
  c03e1c4

  Copy full SHA for c03e1c4

• modify lvms path

  Show description for d78c1d3
  letonghan

  committed
  d78c1d3

  Copy full SHA for d78c1d3

• revert some microservices

  Show description for bc6d202
  lvliang-intel

  committed
  bc6d202

  Copy full SHA for bc6d202

• Merge branch 'refactor_comps' of https://github.com/opea-project/GenAIComps into refactor_comps

  Show description for 83fad17
  lvliang-intel

  committed
  83fad17

  Copy full SHA for 83fad17

• revert other dataprep comps

  Show description for bf20d83
  letonghan

  committed
  bf20d83

  Copy full SHA for bf20d83

• fix ci issues

  Show description for 7bb0707
  lvliang-intel

  committed
  7bb0707

  Copy full SHA for 7bb0707

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for 29c3c34
  pre-commit-ci[bot]

  committed
  29c3c34

  Copy full SHA for 29c3c34

• add llm ut

  Show description for 5d92450
  XinyaoWa

  committed
  5d92450

  Copy full SHA for 5d92450

• revert retrievers and vectorstores

  Show description for 0183dbc
  letonghan

  committed
  0183dbc

  Copy full SHA for 0183dbc

• Merge branch 'refactor_comps' of https://github.com/opea-project/GenAIComps into refactor_comps

  letonghan

  committed
  6c9cd31

  Copy full SHA for 6c9cd31

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for 7b3de64
  pre-commit-ci[bot]

  committed
  7b3de64

  Copy full SHA for 7b3de64

• fix

  Show description for b0bc877
  letonghan

  committed
  b0bc877

  Copy full SHA for b0bc877

• Merge branch 'refactor_comps' of https://github.com/opea-project/GenAIComps into refactor_comps

  letonghan

  committed
  394913f

  Copy full SHA for 394913f

• Merge remote-tracking branch 'upstream/refactor_comps' into refactor_comps

  XinyaoWa

  committed
  31071ea

  Copy full SHA for 31071ea

• fix llm bug

  Show description for 9ea2bb4
  XinyaoWa

  committed
  9ea2bb4

  Copy full SHA for 9ea2bb4

• fix path

  Show description for 594c7ec
  XinyaoWa

  committed
  594c7ec

  Copy full SHA for 594c7ec

• fix bug

  Show description for e206281
  XinyaoWa

  committed
  e206281

  Copy full SHA for e206281

• Merge remote-tracking branch 'upstream/refactor_comps' into refactor_comps

  XinyaoWa

  committed
  c6d8215

  Copy full SHA for c6d8215

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for 0450cde
  pre-commit-ci[bot]

  committed
  0450cde

  Copy full SHA for 0450cde

• Merge remote-tracking branch 'upstream/refactor_comps' into refactor_comps

  XinyaoWa

  committed
  3d1dc4f

  Copy full SHA for 3d1dc4f

• fix bug

  Show description for 0128f2b
  XinyaoWa

  committed
  0128f2b

  Copy full SHA for 0128f2b

• fix docker file path issue

  Show description for eb64bb1
  lvliang-intel

  committed
  eb64bb1

  Copy full SHA for eb64bb1

• Merge branch 'refactor_comps' of https://github.com/opea-project/GenAIComps into refactor_comps

  Show description for 4bb0fef
  lvliang-intel

  committed
  4bb0fef

  Copy full SHA for 4bb0fef

• fix bug

  Show description for c9d6578
  XinyaoWa

  committed
  c9d6578

  Copy full SHA for c9d6578

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for aeb8cf4
  pre-commit-ci[bot]

  committed
  aeb8cf4

  Copy full SHA for aeb8cf4

• fix readme link issues

  Show description for 3463490
  lvliang-intel

  committed
  3463490

  Copy full SHA for 3463490

• Merge branch 'refactor_comps' of https://github.com/opea-project/GenAIComps into refactor_comps

  Show description for 56f1666
  lvliang-intel

  committed
  56f1666

  Copy full SHA for 56f1666

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for e8c95c0
  pre-commit-ci[bot]

  committed
  e8c95c0

  Copy full SHA for e8c95c0

• fix finetuning issue

  Show description for 8c1de45
  lvliang-intel

  committed
  8c1de45

  Copy full SHA for 8c1de45

• Merge branch 'refactor_comps' of https://github.com/opea-project/GenAIComps into refactor_comps

  Show description for 09eaafa
  lvliang-intel

  committed
  09eaafa

  Copy full SHA for 09eaafa

• update finetune code

  Show description for 4fa3a83
  lvliang-intel

  committed
  4fa3a83

  Copy full SHA for 4fa3a83

• remove redundant docker compose

  Show description for 25285c3
  letonghan

  committed
  25285c3

  Copy full SHA for 25285c3

Commits on Dec 21, 2024

• fix ci issues

  Show description for bd7435d
  lvliang-intel

  committed
  bd7435d

  Copy full SHA for bd7435d

• Merge branch 'refactor_comps' of https://github.com/opea-project/GenAIComps into refactor_comps

  Show description for 068f9b8
  lvliang-intel

  committed
  068f9b8

  Copy full SHA for 068f9b8

• fix readme path

  Show description for 2d4130d
  lvliang-intel

  committed
  2d4130d

  Copy full SHA for 2d4130d

Commits on Dec 23, 2024

• move OpenAI LLM to OPEA LLM

  Show description for baf91a4
  XinyaoWa

  committed
  baf91a4

  Copy full SHA for baf91a4

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for da3fdd2
  pre-commit-ci[bot]

  committed
  da3fdd2

  Copy full SHA for da3fdd2

• revert folder

  Show description for e2311e0
  XinyaoWa

  committed
  e2311e0

  Copy full SHA for e2311e0

• add dataprep/retriever type control parameter, minimize requirements

  Show description for f45229c
  letonghan

  committed
  f45229c

  Copy full SHA for f45229c

• Merge branch 'refactor_comps' of https://github.com/opea-project/GenAIComps into refactor_comps

  letonghan

  committed
  83b8283

  Copy full SHA for 83b8283

• fix dockerfile path

  Show description for fb47706
  XinyaoWa

  committed
  fb47706

  Copy full SHA for fb47706

• update docker build

  Show description for 969ae6d
  lvliang-intel

  committed
  969ae6d

  Copy full SHA for 969ae6d

• Merge branch 'refactor_comps' of https://github.com/opea-project/GenAIComps into refactor_comps

  Show description for f0ca9aa
  lvliang-intel

  committed
  f0ca9aa

  Copy full SHA for f0ca9aa

• fix llm docker compose

  Show description for 808b04c
  XinyaoWa

  committed
  808b04c

  Copy full SHA for 808b04c

• fix conflict

  Show description for 14bb3ee
  XinyaoWa

  committed
  14bb3ee

  Copy full SHA for 14bb3ee

• update test matrix

  Show description for eb2e858
  chensuyue

  committed
  eb2e858

  Copy full SHA for eb2e858

• Merge remote-tracking branch 'origin/refactor_comps' into refactor_comps

  chensuyue

  committed
  865687c

  Copy full SHA for 865687c

• update test matrix

  Show description for 66ab254
  chensuyue

  committed
  66ab254

  Copy full SHA for 66ab254

• update log print for test matrix

  Show description for bb24747
  chensuyue

  committed
  bb24747

  Copy full SHA for bb24747

• rename test scripts

  Show description for 8346d93
  letonghan

  committed
  8346d93

  Copy full SHA for 8346d93

• add print logs

  Show description for aa2d1a1
  chensuyue

  committed
  aa2d1a1

  Copy full SHA for aa2d1a1

• Merge remote-tracking branch 'origin/refactor_comps' into refactor_comps

  chensuyue

  committed
  0577689

  Copy full SHA for 0577689

• rename llm

  Show description for 3fd7fae
  XinyaoWa

  committed
  3fd7fae

  Copy full SHA for 3fd7fae

• rename python files

  Show description for 493b5b2
  letonghan

  committed
  493b5b2

  Copy full SHA for 493b5b2

• Merge branch 'refactor_comps' of https://github.com/opea-project/GenAIComps into refactor_comps

  letonghan

  committed
  7b07925

  Copy full SHA for 7b07925

Commits on Dec 24, 2024

• refine 3rd party folder (#1063)

  Show description for b6eaeb4
  XinyaoWa

  authored
  b6eaeb4

  Copy full SHA for b6eaeb4

• remove openvino ut to fix pr, will add later

  Show description for 354c480
  XinyaoWa

  committed
  354c480

  Copy full SHA for 354c480

• Update CI Infra (#1060)

  Show description for 1250d42
  chensuyue

  authored
  1250d42

  Copy full SHA for 1250d42

• fix retrievers pinecone (#1064)

  Show description for d72f05f
  letonghan

  authored
  d72f05f

  Copy full SHA for d72f05f

• fix dataprep pinecone

  Show description for d9eac3c
  letonghan

  committed
  d9eac3c

  Copy full SHA for d9eac3c

• update comps ci (#1066)

  Show description for dba68e2
  chensuyue

  authored
  dba68e2

  Copy full SHA for dba68e2

• fix dataprep pinecone (#1067)

  Show description for 58813c2
  letonghan

  authored
  58813c2

  Copy full SHA for 58813c2

• fix dataprep redis llama_index (#1068)

  Show description for a6098f0
  letonghan

  authored
  a6098f0

  Copy full SHA for a6098f0

• fix redis langchain ray ci issue (#1069)

  Show description for b83f246
  letonghan

  authored
  b83f246

  Copy full SHA for b83f246

• Temporarily comment out the rerank test script.

  Show description for be48b85
  

  WenjiaoYue

  authored and

  WenjiaoYue

  committed
  be48b85

  Copy full SHA for be48b85

• Temporarily comment out the rerank test script

  Show description for 0750c64
  

  WenjiaoYue

  authored and

  WenjiaoYue

  committed
  0750c64

  Copy full SHA for 0750c64

• Remove MOSEC dependency microservice (#1071)

  Show description for 5f881ef
  lvliang-intel

  authored
  5f881ef

  Copy full SHA for 5f881ef

Commits on Dec 25, 2024

• Merge branch 'refactor_comps' of https://github.com/opea-project/GenAIComps into refactor_comps

  letonghan

  committed
  0438742

  Copy full SHA for 0438742

• fix finetuning ci

  Show description for 6841ab8
  letonghan

  committed
  6841ab8

  Copy full SHA for 6841ab8

• Refactor finetuning (#1074)

  Show description for 39adddc
  letonghan

  authored
  39adddc

  Copy full SHA for 39adddc

• fix path

  Show description for 0dd6da2
  XinyaoWa

  committed
  0dd6da2

  Copy full SHA for 0dd6da2

• Merge branch 'refactor_comps' of https://github.com/opea-project/GenAIComps into refactor_comps

  letonghan

  committed
  2b1bd23

  Copy full SHA for 2b1bd23

• fix nginx template path

  Show description for d61a2c1
  letonghan

  committed
  d61a2c1

  Copy full SHA for d61a2c1

Commits on Dec 27, 2024

• Refactor rerank tei (#1082)

  Show description for 64c547e
  WenjiaoYue

  authored
  64c547e

  Copy full SHA for 64c547e

• Merge branch 'main' into refactor_comps

  letonghan

  authored
  9d9c919

  Copy full SHA for 9d9c919

Commits on Dec 28, 2024

• modify dataprep utils path

  Show description for c0f794c
  letonghan

  committed
  c0f794c

  Copy full SHA for c0f794c

Commits on Dec 30, 2024

• Add multimodal retrievers (#1090)

  Show description for 998ab53
  

  letonghan

  and

  pre-commit-ci[bot]

  authored
  998ab53

  Copy full SHA for 998ab53

Commits on Dec 31, 2024

• fix nginx test path (#1094)

  Show description for 908729e
  chensuyue

  authored
  908729e

  Copy full SHA for 908729e

• revert test code

  Show description for 77afe9e
  chensuyue

  committed
  77afe9e

  Copy full SHA for 77afe9e

• Merge branch 'main' into refactor_comps

  chensuyue

  authored
  5efac57

  Copy full SHA for 5efac57

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for cab7de4
  pre-commit-ci[bot]

  committed
  cab7de4

  Copy full SHA for cab7de4

Commits on Jan 1, 2025

• resolve conflict

  Show description for ebe8164
  chensuyue

  committed
  ebe8164

  Copy full SHA for ebe8164

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for c26caa0
  pre-commit-ci[bot]

  committed
  c26caa0

  Copy full SHA for c26caa0