Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Convert continuous computations to cron jobs, where appropriate. #2063

Closed
2 tasks done
seanlip opened this issue Jun 8, 2016 · 2 comments
Closed
2 tasks done

Convert continuous computations to cron jobs, where appropriate. #2063

seanlip opened this issue Jun 8, 2016 · 2 comments
Assignees
@seanlip
Labels
backend

Comments

@seanlip
Copy link
Member

seanlip commented Jun 8, 2016 •
edited
Loading

We have some computations that run continuously but don't really need to, either because the data being computed doesn't get updated very often, or because having up-to-date data is not particularly necessary. This leads to unnecessary work, and increased frontend usage + costs.

The aim of this issue is therefore to turn the following these jobs into weekly crons:

  • SearchRanker
  • ExplorationRecommendationsAggregator
@BenHenning
Copy link
Member

BenHenning commented Jun 10, 2016 •
edited
Loading

Can this issue list the specific jobs which can be converted? It seems too vague at the moment. It's also not providing any actionable work.

@seanlip
Copy link
Member Author

seanlip commented Jun 13, 2016

Thanks, good catch. I listed the specific jobs.

Does this address your comment about "not providing any actionable work"?

@seanlip seanlip changed the title Convert continuous computations to daily cron jobs, where appropriate. Convert continuous computations to cron jobs, where appropriate. Aug 2, 2016
@seanlip seanlip self-assigned this Aug 2, 2016
wxyxinyu pushed a commit that referenced this issue Aug 8, 2016
@seanlip @wxyxinyu
Fix #2063: convert continuous jobs into one-off jobs. (#2320)
9aa6f61 
* Change continuous recommendations job into a one-off cron job.

* Change continuous search ranker job to a one-off job.

* Fix lint issues.

* Decrease queue rate.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@seanlip seanlip

Labels
backend
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@seanlip @BenHenning