Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove parallel for from data table to fix computed column threading issue in #1831 #1835

Closed
wants to merge 2 commits into from

Conversation

timkpaine
Copy link
Member

No description provided.

@timkpaine timkpaine added bug Concrete, reproducible bugs internal Internal refactoring and code quality improvement labels Jun 4, 2022
@@ -208,7 +208,7 @@ class PERSPECTIVE_EXPORT t_gnode {
std::shared_ptr<t_expression_vocab> get_expression_vocab() const;
std::shared_ptr<t_regex_mapping> get_expression_regex_mapping() const;

#ifdef PSP_PARALLEL_FOR
#ifdef PSP_ENABLE_PYTHON
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is unrelated but should be enabled conditional on PYTHON, not PARALLEL_FOR

@timkpaine
Copy link
Member Author

@texodus might need your help benchmarking this, if it causes a substantial degradation in performance I can try to break this loop apart to reenable some part in parallel

@timkpaine timkpaine requested a review from texodus June 5, 2022 21:25
Copy link
Member

@texodus texodus left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's not clear to my why this change would impact the test provided, so on a hunch I forked just this test to a new branch and it passes just the same on all Linux builds. What am I missing?

@timkpaine
Copy link
Member Author

This test fails on my Linux machine, validated on 2 other Linux machines

@timkpaine
Copy link
Member Author

timkpaine commented Jun 6, 2022

See #1831 for more details

@timkpaine
Copy link
Member Author

My guess would be either azure or the manylinux images themselves don't trigger the test case to fail.

@timkpaine timkpaine added this to the 1.4 milestone Jun 6, 2022
@texodus texodus removed this from the 1.4 milestone Jun 6, 2022
@timkpaine
Copy link
Member Author

Some additional testing suggests this might've been fixed already via the arrow upgrade #1816

@timkpaine timkpaine closed this Jun 12, 2022
@timkpaine timkpaine deleted the tkp/threadcc branch June 12, 2022 13:09
@texodus
Copy link
Member

texodus commented Jun 12, 2022

So thanks to the accompanying test (which I do want to merge), I can confirm that this issue was resolved by #1793, and is unrelated to Arrow/threading. Fix version is 1.3.11.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Concrete, reproducible bugs internal Internal refactoring and code quality improvement
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants