-
-
Notifications
You must be signed in to change notification settings - Fork 8.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[WIP] Remove test spam Continued #15881
Conversation
Uses assertLogs to prevent spam in test-backend output.
This avoids spam in test-backend output.
This removes spam in test-backend output caused by print statement.
This is to avoid spam in test-backend output.
This will prevent it to propagating to root logger and causing flaky behavior in tests which verify logs by root logger using assertLogs.
These changes are all great, merged, thanks @thedeveloperr! How close are we to finishing this effort? |
|
These are the stuff which i am not able to solve right now |
@timabbott 14 more spam found (few of them just started appearing in the output, they were not appearing before) I think 1 or 2 day more. The slowest step in doing this is running the test again and again. Running single module test is not enough because single module produces different spam and that spam doesn't appear when running test for all modules. |
For zerver.tests.test_push_notifications.PushBouncerNotificationTest.test_push_bouncer_api, I'll just do a quick fix; it's just a loop: 4a7eb47. @mateuszmandera may be able to help with adding an appropriate assertLogs for Some spam may be nondeterministic; happy to help figure out a plan for any of those. But I'm excited we're close! |
@timabbott I made a similar fix but it was failing sometimes. I am not sure why. 9861937 |
It's possible the issue is the way you nested things? I guess we'll see if the version I did fails; I wouldn't expect it to. |
#1587 This is the 3rd PR in series of PR which aims to hunt and remove spam from test-backend output.
Testing Plan:
GIFs or Screenshots: