Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Road to v1.0 #2

Merged
merged 35 commits into from
Dec 3, 2024
Merged
Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
35 commits
Select commit Hold shift + click to select a range
f21634b
deploy(local): arrange for local deployment working
May 27, 2024
2dce8f3
refactor(models): remove useless parameters
May 31, 2024
87d97fe
refactor(package): change for com.datagen
May 31, 2024
bd60367
build(java-spring): set java to version 17 and spring boot to version…
Jun 2, 2024
140b73c
build(swagger): use new version of swagger
Jun 3, 2024
a346368
fezt(ai): adding fields derived from LLM
Jun 10, 2024
530caf1
build(properties): add missing default properties
Jun 10, 2024
aeb95b2
fix(ai): add context possibiloty
Jun 12, 2024
14655d7
feat(v1.0): first steps toward v1.0, with first alpha version
Sep 5, 2024
dcaa640
release(version): upgrade to 0.8.1
Sep 6, 2024
06fc6cd
fix(view): arrange footer, add doc link and add progress bar percentage
Sep 11, 2024
8c5f6c4
feat(auth): add authentication on views
Sep 18, 2024
26354df
feat(security): setup security for swagger
Sep 20, 2024
0f9d4df
Delete src/main/bundles/prod.bundle
frischHWC Sep 25, 2024
7acbe51
build(bundle): remove commit bundles
Sep 25, 2024
efc7499
fix: fixes and add users part
Oct 29, 2024
e921740
fix: ldap required settings - float value - hashmd5 not recognized
Oct 31, 2024
532a252
build: add deployment of index files for models
Nov 5, 2024
2bc8340
refactor: launch updated to ease launch on different cloud providers …
frischHWC Nov 15, 2024
36a1c61
fix(import): fix bugs on importing model and remove blob field
frischHWC Nov 18, 2024
536c33e
deploy(model): add full models
frischHWC Nov 18, 2024
f8c1390
fix: full model fixed
frischHWC Nov 18, 2024
c1f5cee
doc: add model full with no blob
frischHWC Nov 19, 2024
b7d0bd2
fix: name fixed with all override
frischHWC Nov 19, 2024
233bf05
fix: name for ORC
frischHWC Nov 19, 2024
90ff8df
fix(ui): min/max long for increment_long + add models
frischHWC Nov 20, 2024
bfa76b3
models: stores changed llm to local_llm
frischHWC Nov 20, 2024
7061521
fix(js): hotfix the js evaluator which is not multi-threaded leading …
frischHWC Nov 21, 2024
3ea50ba
doc(model): set proper name for employee model
frischHWC Nov 21, 2024
64f247f
feat: parallelize js evaluators by adding possibility to start multip…
frischHWC Nov 22, 2024
e5a4a54
fix(models): for use cases sey different col names
frischHWC Nov 22, 2024
9be67f4
fix(urls): calls fixed to urls
frischHWC Nov 26, 2024
267f081
feat(ui): change ui style and add icon
frischHWC Nov 28, 2024
6571316
deploy(docker): add docker and kubernetes as deployment
frischHWC Dec 2, 2024
98845f1
doc: add gif
frischHWC Dec 3, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
fix(models): for use cases sey different col names
  • Loading branch information
frischHWC committed Nov 22, 2024
commit e5a4a546691ae100b4c1ccb35b6877ce395eb43a
10 changes: 5 additions & 5 deletions src/main/resources/models/use-cases/stores/customer.json
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
{
"model_name" : "customer-stores",
"Fields" : [ {
"name" : "name",
"name" : "customer_name",
"type" : "NAME",
"filters" : [ "USA" ]
}, {
Expand All @@ -16,15 +16,15 @@
}, {
"name" : "customer_country",
"type" : "LINK",
"link" : "$city.country"
"link" : "$customer_city.country"
}, {
"name" : "city_lat",
"type" : "LINK",
"link" : "$city.lat"
"link" : "$customer_city.lat"
}, {
"name" : "city_long",
"type" : "LINK",
"link" : "$city.long"
"link" : "$customer_city.long"
}, {
"name" : "customer_email",
"type" : "EMAIL",
Expand Down Expand Up @@ -170,7 +170,7 @@
}, {
"name" : "customer_gender",
"type" : "LINK",
"link" : "$name.sex"
"link" : "$customer_name.sex"
} ],
"Table_Names" : {
"HIVE_HDFS_FILE_PATH" : "/tmp/datagen-customer/",
Expand Down
2 changes: 1 addition & 1 deletion src/main/resources/models/use-cases/stores/employee.json
Original file line number Diff line number Diff line change
Expand Up @@ -50,7 +50,7 @@
}, {
"name" : "annual_salary",
"type" : "INTEGER",
"formula" : "var factor=1\nvar base=41234\nvar additional=0\n\nif ( \"${gender}\" == \"female\") {\nfactor-=0.1\n}\n\nswitch(\"${seniority_level}\") {\ncase \"SKILLED\": \nfactor+=0.5\nbreak;\ncase \"SENIOR\": \nfactor+=1\nbreak;\ndefault:\nfactor+=0.1\n}\n\nif ( \"${specialty}\" == \"Kids\") {\nadditional+=1000\n}\n\nif ( \"${specialty}\" == \"Women's dress\" && \"${gender}\" == \"FEMALE\") {\nadditional+=2000\n}\n\nif ( \"${specialty}\" == \"Women's top\" && \"${gender}\" == \"MALE\") {\nadditional+=800\n}\n\nif ( \"${specialty}\" == \"Men's shirts\" && \"${gender}\" == \"MALE\") {\nadditional-=500\n}\n\nif ( \"${specialty}\" == \"Men's pants\" && \"${gender}\" == \"FEMALE\") {\nadditional+=1500\n}\n\nif ( \"${specialty}\" == \"Jackets & Coats\") {\nfactor+=0.3\n}\n\n\nMath.round((base + additional)*factor)\n\n"
"formula" : "var factor=1\nvar base=41234\nvar additional=0\n\nif ( \"${employee_gender}\" == \"female\") {\nfactor-=0.1\n}\n\nswitch(\"${seniority_level}\") {\ncase \"SKILLED\": \nfactor+=0.5\nbreak;\ncase \"SENIOR\": \nfactor+=1\nbreak;\ndefault:\nfactor+=0.1\n}\n\nif ( \"${specialty}\" == \"Kids\") {\nadditional+=1000\n}\n\nif ( \"${specialty}\" == \"Women's dress\" && \"${employee_gender}\" == \"FEMALE\") {\nadditional+=2000\n}\n\nif ( \"${specialty}\" == \"Women's top\" && \"${employee_gender}\" == \"MALE\") {\nadditional+=800\n}\n\nif ( \"${specialty}\" == \"Men's shirts\" && \"${employee_gender}\" == \"MALE\") {\nadditional-=500\n}\n\nif ( \"${specialty}\" == \"Men's pants\" && \"${employee_gender}\" == \"FEMALE\") {\nadditional+=1500\n}\n\nif ( \"${specialty}\" == \"Jackets & Coats\") {\nfactor+=0.3\n}\n\n\nMath.round((base + additional)*factor)\n\n"
},{
"name" : "hiring_date",
"type" : "BIRTHDATE",
Expand Down
8 changes: 4 additions & 4 deletions src/main/resources/models/use-cases/stores/stores-nodesc.json
Original file line number Diff line number Diff line change
Expand Up @@ -5,13 +5,13 @@
"type" : "INCREMENT_INTEGER",
"min" : 0
}, {
"name" : "city",
"name" : "city_of_store",
"type" : "CITY",
"filters" : [ "USA" ]
}, {
"name" : "country",
"name" : "country_of_store",
"type" : "LINK",
"link" : "$city.country"
"link" : "$city_of_store.country"
}, {
"name" : "opening_date",
"type" : "BIRTHDATE",
Expand Down Expand Up @@ -126,7 +126,7 @@
"length" : 20,
"formula" : "if(${square_meters} < 100) {\n\"small\"\n} else if(${square_meters} < 250) {\n\"medium\"\n} else if(${square_meters} < 450) {\n\"large\" \n} else {\n\"extra-large\"\n}"
}, {
"name" : "employees",
"name" : "number_of_employees",
"type" : "INTEGER",
"formula" : "var extra_factor = 0\nif(${open-sunday} == true){\nextra_factor+=1\n}\nif(${extra-night-hours-week}==1) {\nextra_factor+=0.7\n} else if(${extra-night-hours-week}==2) {\nextra_factor+=1\n}\nif(${extra-night-hours-week-end}==1) {\nextra_factor+=0.6\n} else if(${extra-night-hours-week-end}>=2) {\nextra_factor+=1.1\n}\n1+Math.round((${square_meters}/17.5)+extra_factor)"
}],
Expand Down
4 changes: 2 additions & 2 deletions src/main/resources/models/use-cases/stores/stores.json
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@
}, {
"name" : "country_of_store",
"type" : "LINK",
"link" : "$city.country"
"link" : "$city_of_store.country"
}, {
"name" : "opening_date",
"type" : "BIRTHDATE",
Expand Down Expand Up @@ -132,7 +132,7 @@
}, {
"name" : "description",
"type" : "OLLAMA",
"request" : "write a short description about your ${size} clothing store located in ${city}, ${country}",
"request" : "write a short description about your ${size} clothing store located in ${city_of_store}, ${country_of_store}",
"context" : "You are owner of a clothing store. Write short description to present it to customers. Description is less than 100 characters. Provide only short description. Provide only description, no metadata, no annotations.",
"file" : "https://huggingface.co/TheBloke/CapybaraHermes-2.5-Mistral-7B-GGUF/resolve/main/capybarahermes-2.5-mistral-7b.Q2_K.gguf",
"model_type" : "llama3"
Expand Down