New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Runtime] Support CUDA Graph execution in session run. #468

Merged

liutongxuan merged 1 commit into DeepRec-AI:main from francktcheng:main

Sep 30, 2022

Contributor

francktcheng commented Sep 28, 2022

Implement runtime support for using NVIDIA CUDA Graph when executing TF graphs via direct session.
Provide multiple configuration of CUDA Graph in SessionOptions.
Support a fallback execution of using TF default runtime when CUDA Graph execution failed.

francktcheng force-pushed the main branch from 48fe3dc to 9d343a4 Compare

September 30, 2022 03:42


          [Runtime] Support CUDA Graph execution in session run.

84502a1

francktcheng force-pushed the main branch from 9d343a4 to 84502a1 Compare

September 30, 2022 06:55

liutongxuan approved these changes

View reviewed changes

liutongxuan merged commit 80206f3 into DeepRec-AI:main

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet