Crossfit fails with cudf 25.02 due to 'cudf._lib' has no attribute 'transform' #104
Open
Description
File "/opt/conda/envs/rapids/lib/python3.10/site-packages/crossfit/op/base.py", line 100, in __call__
output = self.call(data, *args, **kwargs)
File "/opt/conda/envs/rapids/lib/python3.10/site-packages/crossfit/op/tokenize.py", line 155, in call
input_ids, attention_mask = self.call_column(data[col])
File "/opt/conda/envs/rapids/lib/python3.10/site-packages/crossfit/op/tokenize.py", line 129, in call_column
input_ids = create_list_series_from_1d_or_2d_ar(
File "/opt/conda/envs/rapids/lib/python3.10/site-packages/crossfit/backend/cudf/series.py", line 95, in create_list_series_from_1d_or_2d_ar
mask = cudf._lib.transform.bools_to_mask(as_column(mask_col))
AttributeError: module 'cudf._lib' has no attribute 'transform'
From https://github.com/rapidsai/cudf/pull/17505/files
Probably the following solves it
import pylibcudf as plc
plc.transform(...)Metadata
Assignees
Labels
No labels
Activity