Name		Name	Last commit message	Last commit date
parent directory ..
pipeline_parallel		pipeline_parallel
runtime		runtime
serve		serve
shard_parallel		shard_parallel
torch_frontend		torch_frontend
tpu		tpu
util		util
README.md		README.md
__init__.py		__init__.py
killall_python.sh		killall_python.sh
run_all.py		run_all.py

README.md

Unit test

Requirement

A machine with at least 4 gpus.

Run all test cases

Start a ray cluster

ray start --head

Run all tests

python3 run_all.py

Run specific files

For debug usage:

python3 shard_parallel/test_basic.py

More similar to how CI runs files

# Run one file
python3 run_all.py --run-pattern shard_parallel/test_basic.py

# Run a folder
python3 run_all.py --run-pattern shard_parallel