Using ghprb plugin, we have discovered that closing pull request is not working:

SEVERE: Couldn't close the pullrequest #10582: '
java.io.FileNotFoundException: https://api.github.com/repos/USER/REPO/issues/10582

As Github API says, pull requests must be accesed in this way:

GET /repos/:owner/:repo/pulls/:number

Using pulls intead of issues.