This project is a collection of extensions for Byzer.
The user should install the byzer-lang in your local maven repository before compiling this project.
- Python >= 3.6
- Maven >= 3.0
Clone byzer-lang, and run the following command to install it in your local maven repository.
mvn clean install -DskipTests -Ponline -pl streamingpro-mlsql -am
mlsql_plugin_tool is a tool to build tool for Byzer extensions.
Installing command:
pip install mlsql_plugin_tool
Now you can try the following command to check if the tool is installed successfully.
mlsql_plugin_tool build --module_name xxxxx --spark spark330
- spark: spark243, spark311 and spark330.
- module_name e.g mlsql-excel, byzer-simple-auth
Once build success, the system will show message like fowllowing:
====Build success!=====
File location 0:
/Users/allwefantasy/Volumes/Samsung_T5/allwefantasy/CSDNWorkSpace/mlsqlplugins/xxx/target/xxx-0.1.0-SNAPSHOT.jar
Extension | Description |
---|---|
byzer-simple-auth | A simple auth extension for Byzer. |
byzer-yaml-visulization | A yaml visulization extension for Byzer. |
byzer-eval | Byzer-eval is an extension which can execute string variable as Byzer script. |
byzer-doris | Doris datasource extension for Byzer. |
byzer-expand-include | Expand include extension for Byzer. |
byzer-objectstore-blob | Azure Object Storage |
byzer-objectstore-cos | Tencent Cloud Object Storage |
byzer-objectstore-s3 | Amazon S3 Object Storage |
byzer-objectstore-oss | Alibaba Cloud Object Storage |
byzer-objectstore-obs | Huawei Cloud Object Storage |
byzer-openmldb | OpenMLDB extension for Byzer. |
byzer-xgboost | XGBoost extension for Byzer. |
connect-persist | Persist the connect statement to delta lake |
delta-enhancer | Delta lake tools for Byzer. |
last-command | Get the result of last statement. This is useful for reference the output of command |
mlsql-excel | Excel datasource extension for Byzer. |
mlsql-assert | Assert function support for Byzer. |
mlsql-canal | Replay the CDC which is generated from canal to Delta Lake |
mlsql-shell | Execute shell command in Byzer. |
mlsql-ke | A tool to operate Kyligence Enterprise. |
stream-persist | Persist the stream job to delta lake for recovery |
table-repartition | Repartition the table for better performance. |
mlsql-mllib | Some statistical extensions for Byzer. |
mlsql-ext-ets | Some extension collection for Byzer. |
mlsql-ds | Some datasource collection for Byzer. |
echo-controller | A simple demo extension for new http request. |