Skip to content

Latest commit

 

History

History

inference

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
 
 
 
 
 
 
 
 

Inference Examples with Pre-trained iVideoGPTs

Action-free Prediction

python inference/predict.py --pretrained_model_name_or_path "thuml/ivideogpt-oxe-64-act-free" --input_path inference/samples/fractal_sample.npz --dataset_name fractal20220817_data
python inference/predict.py --pretrained_model_name_or_path "thuml/ivideogpt-oxe-64-act-free-medium" --input_path inference/samples/fractal_sample.npz --dataset_name fractal20220817_data
python inference/predict.py --pretrained_model_name_or_path "thuml/ivideogpt-oxe-256-act-free" --input_path inference/samples/fractal_sample.npz --dataset_name fractal20220817_data --resolution 256 --repeat_times 1
python inference/predict.py --pretrained_model_name_or_path "thuml/ivideogpt-bair-64-act-free" --input_path inference/samples/bair_sample.npz --dataset_name bair_robot_pushing --context_length 1

Action-conditioned Prediction

python inference/predict.py --pretrained_model_name_or_path "thuml/ivideogpt-robonet-64-act-cond" --input_path inference/samples/robonet_sample.npz --dataset_name tfds_robonet --context_length 2 --segment_length 12 --action_conditioned --action_dim 5
python inference/predict.py --pretrained_model_name_or_path "thuml/ivideogpt-bair-64-act-cond" --input_path inference/samples/bair_sample.npz --dataset_name bair_robot_pushing --context_length 1 --segment_length 16 --action_conditioned --action_dim 4

Goal-conditioned Prediction

python inference/predict.py --pretrained_model_name_or_path "thuml/ivideogpt-oxe-64-goal-cond" --input_path inference/samples/fractal_sample.npz --dataset_name fractal20220817_data --goal_conditioned

More Samples

To try more samples, download datasets from Open X-Embodiment and extract single episodes as follows:

python datasets/oxe_data_converter.py --dataset_name {dataset_name, e.g. bridge} --input_path {path to OXE} --output_path inference/samples --max_num_episodes 10