All keywords dropped to 0 - serpbear unable to query google results? #272
Open
Description
Environment
- Serpbear: v2.0.6 in Docker
- Scraper: I tried my usual scraping robot config as well as a proxy configuration for testing
Problem Description
Since about 2 days, my serpbear instance is unable to crawl any keywords, which results in the position dropping to 0.
The log shows no issues on keyword update:
[0] POST /api/refresh?id=5
[0] keywordIDs: [ 5 ]
[0] START SCRAPE: mykeyword
[0] GET /api/keywords?domain=mydomain.de
[0] GET /api/keyword?id=5
[0] [SERP]: mykeyword 0
[0] [SUCCESS] Updating the Keyword: mykeyword
[0] time taken: 1929.1866679999512ms
Nevertheless, the search results stay empty:
Issues with that
- If no search results are gathered at all, serpbear should probably return an error instead of changing position to 0
- It seems to me, that this is a parsing issue in serpbear as the domain clearly shows up in the search results when manually searching with a browser or curl using the same proxy I tried with serpbear.
Any help would be greatly appreciated 😊
Metadata
Assignees
Labels
No labels