Skip to content
This repository has been archived by the owner on Apr 18, 2018. It is now read-only.

Allow for generic dynamic tag for testing frameworks to fill in data #126

Merged
merged 7 commits into from
Nov 12, 2014

Conversation

kkellyy
Copy link
Contributor

@kkellyy kkellyy commented Nov 5, 2014

Allows for user to define a name and API endpoints for a dynamic tag that can be populated arbitrarily with test results for a request. Also allows for API endpoints so that the tag can link to a detailed results page of the tests.

@kkellyy kkellyy assigned kkellyy and ymilki and unassigned kkellyy Nov 5, 2014
@kkellyy kkellyy force-pushed the test_framework_dyn_tag branch from 474f462 to c9eadee Compare November 5, 2014 18:17
try:
api_url = Settings['tests_tag']['tag_api_endpoint'].replace('%SHA%', request['revision'])
api_body = Settings['tests_tag']['tag_api_body'].replace('%SHA%', request['revision'])
resp = urllib2.urlopen(api_url, api_body)
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is it possible for this to take a long time? We use asynchronous calls for the buildbot tag so that we don't delay page loads.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's possible. My planned endpoint is currently http-only currently, so making an async call from JS throws an error and fails. I can potentially cache on the api-side if slowness becomes an issue, but it's still possible.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you smoke test this for a page with 20+ requests and see if performance is an issue? This will not be scalable, but it may be ok for now.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Smoke tests show very heavy perf hit, especially if the test server is slow to respond.

@kkellyy
Copy link
Contributor Author

kkellyy commented Nov 10, 2014

Under load or slow response from test API, pushmanager's perf is severely impacted as well. Refactoring this now to make it asynchronous.

@kkellyy kkellyy force-pushed the test_framework_dyn_tag branch 2 times, most recently from 2657ba9 to a3f0e09 Compare November 11, 2014 02:43
#User-added tag that will be replaced with api result
tag: "test-framework"
# JSON 'tag' value from POST response of this URL will replace tag
tag_api_endpoint: "http://example.com/api/v1/tests_tag"
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Let's add a note here for the endpoints that this call could be either non-ssl or ssl regardless if the app itself is non-ssl or ssl.

@kkellyy kkellyy force-pushed the test_framework_dyn_tag branch from a3f0e09 to d2149e3 Compare November 11, 2014 22:07
@ymilki
Copy link
Member

ymilki commented Nov 12, 2014

Looks good now. shipit.

kkellyy added a commit that referenced this pull request Nov 12, 2014
Allow for generic dynamic tag for testing frameworks to fill in data
@kkellyy kkellyy merged commit 81ef2d1 into master Nov 12, 2014
kkellyy added a commit that referenced this pull request Nov 12, 2014
IMPROVEMENTS

* Seagull is included in the quick tag list

* Tests tag allows for generic support for any testing framework to dynamically
  populate a tag with test results and link to framework, similar to buidlbot
  (kkelly, #126)
@kkellyy kkellyy deleted the test_framework_dyn_tag branch November 24, 2014 22:44
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants