Skip to content

All keywords dropped to 0 - serpbear unable to query google results? #272

Open
@phoehnel

Description

Environment

  • Serpbear: v2.0.6 in Docker
  • Scraper: I tried my usual scraping robot config as well as a proxy configuration for testing

Problem Description

Since about 2 days, my serpbear instance is unable to crawl any keywords, which results in the position dropping to 0.

The log shows no issues on keyword update:

[0] POST /api/refresh?id=5
[0] keywordIDs:  [ 5 ]
[0] START SCRAPE:  mykeyword
[0] GET /api/keywords?domain=mydomain.de
[0] GET /api/keyword?id=5
[0] [SERP]:  mykeyword 0 
[0] [SUCCESS] Updating the Keyword:  mykeyword
[0] time taken: 1929.1866679999512ms

Nevertheless, the search results stay empty:

Image

Issues with that

  • If no search results are gathered at all, serpbear should probably return an error instead of changing position to 0
  • It seems to me, that this is a parsing issue in serpbear as the domain clearly shows up in the search results when manually searching with a browser or curl using the same proxy I tried with serpbear.

Any help would be greatly appreciated 😊

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions