Skip to content

[BUG] fp_quantizer is not correctly built when non-jit installationΒ #5535

Closed
@twaka

Description

Describe the bug
fp_quantizer is not correctly built when non-jit installation.

To Reproduce
Steps to reproduce the behavior:

DS_BUILD_FP_QUANTIZER=1 pip install deepspeed

install will succeed but

from deepspeed.ops.fp_quantizer import FP_Quantize
FP_Quantize()

will raise ImportError: dynamic module does not define module export function (PyInit_fp_quantizer_op)

Expected behavior

Renaming csrc/fp_quantizer/quantize.cu may solve the issue.
This restriction seems to be cause of the bug.

Note that setuptools cannot handle files with the same name but different extensions
https://pytorch.org/tutorials/advanced/cpp_extension.html

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions