Pull request endpoints 404ing on repos with PRs disabled

[collectoss-issue-migrator]

Note

Migrated from augurlabs/augur#3731
Originally opened by @MoralCode on 2026-02-23

---

Looks like github just rolled out the ability to disable PRs for repos and its causing failures

example repo: https://github.com/gstreamer/gst-plugins-base

Failing task: augur.tasks.github.pull_requests.tasks.collect_pull_requests

Stack Trace

Traceback (most recent call last):
  File "/augur/.venv/lib/python3.11/site-packages/celery/app/trace.py", line 453, in trace_task
    R = retval = fun(*args, **kwargs)
                 ^^^^^^^^^^^^^^^^^^^^
  File "/augur/.venv/lib/python3.11/site-packages/celery/app/trace.py", line 736, in __protected_call__
    return self.run(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/augur/augur/tasks/github/pull_requests/tasks.py", line 46, in collect_pull_requests
    for pr in retrieve_all_pr_data(repo_git, logger, manifest.key_auth, core_data_last_collected):
  File "/augur/augur/tasks/github/pull_requests/tasks.py", line 79, in retrieve_all_pr_data
    num_pages = github_data_access.get_resource_page_count(url)
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/augur/augur/tasks/github/util/github_data_access.py", line 90, in get_resource_page_count
    response = self.make_request_with_retries(url, method="HEAD")
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/augur/augur/tasks/github/util/github_data_access.py", line 163, in make_request_with_retries
    return self.__make_request_with_retries(url, method, timeout)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/augur/.venv/lib/python3.11/site-packages/tenacity/__init__.py", line 330, in wrapped_f
    return self(f, *args, **kw)
           ^^^^^^^^^^^^^^^^^^^^
  File "/augur/.venv/lib/python3.11/site-packages/tenacity/__init__.py", line 467, in __call__
    do = self.iter(retry_state=retry_state)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/augur/.venv/lib/python3.11/site-packages/tenacity/__init__.py", line 368, in iter
    result = action(retry_state)
             ^^^^^^^^^^^^^^^^^^^
  File "/augur/.venv/lib/python3.11/site-packages/tenacity/__init__.py", line 390, in <lambda>
    self._add_action_func(lambda rs: rs.outcome.result())
                                     ^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/concurrent/futures/_base.py", line 449, in result
    return self.__get_result()
           ^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/concurrent/futures/_base.py", line 401, in __get_result
    raise self._exception
  File "/augur/.venv/lib/python3.11/site-packages/tenacity/__init__.py", line 470, in __call__
    result = fn(*args, **kwargs)
             ^^^^^^^^^^^^^^^^^^^
  File "/augur/augur/tasks/github/util/github_data_access.py", line 185, in __make_request_with_retries
    result = self.make_request(url, method, timeout)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/augur/augur/tasks/github/util/github_data_access.py", line 133, in make_request
    raise UrlNotFoundException(f"Could not find {url}")
augur.tasks.github.util.github_data_access.UrlNotFoundException: Could not find https://api.github.com/repos/gstreamer/gst-plugins-base/pulls?state=all&direction=desc&sort=updated

[collectoss-issue-migrator]

Note

Migrated comment from original
Originally posted by @MoralCode on 2026-02-23

---

lots of other repos, especially in the gstreamer org, are affected too

[collectoss-issue-migrator]

Note

Migrated comment from original
Originally posted by @iGufrankhan on 2026-03-01

---

I implemented PR detection at the task level using a helper function.
Each PR-related task probes the /pulls endpoint once and returns early if it receives a 404.

While testing with GStreamer/gst-plugins base, I observed that when has_issues is false, has_pull_requests is also false for this repository. In this case, issue-related endpoints such as /issues/comments also return 404, causing failures in message collection tasks.

Although the API documentation does not explicitly state that disabling issues implies disabling pull requests, pull requests are implemented as a special type of issue in GitHub’s data model, which may explain this behavior.

Given this, I think we should consider handling both PR-disabled and issue-disabled cases consistently at the task level, rather than solving only PR-related endpoints. What do you think?

helper function which is used is

def prs_enabled(owner: str, repo: str, key_auth, logger) -> bool:
    """
    Checks whether pull requests are enabled for a repository.
    Returns False if PRs are disabled (404 on /pulls).
    """

    url = f"https://api.github.com/repos/{owner}/{repo}/pulls?per_page=1"

    github_data_access = GithubDataAccess(key_auth, logger)

    try:
       
        github_data_access.get_resource_page_count(url)
        return True

    except UrlNotFoundException:
        logger.info(f"{owner}/{repo}: Pull requests are disabled. Skipping PR collection.")
        return False

[collectoss-issue-migrator]

Note

Migrated comment from original
Originally posted by @MoralCode on 2026-03-08

---

While testing with GStreamer/gst-plugins base, I observed that when has_issues is false, has_pull_requests is also false for this repository. In this case, issue-related endpoints such as /issues/comments also return 404, causing failures in message collection tasks.

This is just because this one repo happens to have both issues and PRs disabled

issues have been possible to disable for a while.

I think a solution i would like to see is to query an endpoint (if one exists, maybe in the API response for a whole repo?) in the github API to determine if issues and/or PRs are enabled and use that to exit early from tasks that are related to either of those.

Since PRs are the newer change on github, i would focus specifically on that as its the thing currently causing issues.

[collectoss-issue-migrator]

Note

Migrated comment from original
Originally posted by @MoralCode on 2026-03-20

---

found in the logs while testing - this happened during event processing.

related Stack Traces

[augur]        | [2026-03-20 16:09:19,876: INFO/ForkPoolWorker-2] Task augur.tasks.github.traffic.collect_github_repo_clones_data[15c7ed25-5d06-4b15-8192-9977a9bfa10e] succeeded in 0.009023491002153605s: None
[augur]        | [2026-03-20 16:09:19,963: WARNING/ForkPoolWorker-4] 2026-03-20 16:09:19 966df2002621 core_task_failure[286] ERROR Task 5d6dc1cb-9dd0-4151-81ea-76ef4992e12b raised exception: Could not find https://api.github.com/repos/gstreamer/gst-plugins-base/issues/comments?per_page=100
[augur]        |  Traceback: Traceback (most recent call last):
[augur]        |   File "/augur/.venv/lib/python3.11/site-packages/celery/app/trace.py", line 453, in trace_task
[augur]        |     R = retval = fun(*args, **kwargs)
[augur]        |                  ^^^^^^^^^^^^^^^^^^^^
[augur]        |   File "/augur/.venv/lib/python3.11/site-packages/celery/app/trace.py", line 736, in __protected_call__
[augur]        |     return self.run(*args, **kwargs)
[augur]        |            ^^^^^^^^^^^^^^^^^^^^^^^^^
[augur]        |   File "/augur/augur/tasks/github/messages.py", line 43, in collect_github_messages
[augur]        |     message_data = fast_retrieve_all_pr_and_issue_messages(repo_git, logger, manifest.key_auth, task_name, core_data_last_collected)
[augur]        |                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[augur]        |   File "/augur/augur/tasks/github/messages.py", line 78, in fast_retrieve_all_pr_and_issue_messages
[augur]        |     message_count = github_data_access.get_resource_count(url)
[augur]        |                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[augur]        |   File "/augur/augur/tasks/github/util/github_data_access.py", line 83, in get_resource_count
[augur]        |     num_pages = self.get_resource_page_count(url)
[augur]        |                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[augur]        |   File "/augur/augur/tasks/github/util/github_data_access.py", line 135, in get_resource_page_count
[augur]        |     response = self.make_request_with_retries(url, method="HEAD")
[augur]        |                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[augur]        |   File "/augur/augur/tasks/github/util/github_data_access.py", line 208, in make_request_with_retries
[augur]        |     return self.__make_request_with_retries(url, method, timeout)
[augur]        |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[augur]        |   File "/augur/.venv/lib/python3.11/site-packages/tenacity/__init__.py", line 330, in wrapped_f
[augur]        |     return self(f, *args, **kw)
[augur]        |            ^^^^^^^^^^^^^^^^^^^^
[augur]        |   File "/augur/.venv/lib/python3.11/site-packages/tenacity/__init__.py", line 467, in __call__
[augur]        |     do = self.iter(retry_state=retry_state)
[augur]        |          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[augur]        |   File "/augur/.venv/lib/python3.11/site-packages/tenacity/__init__.py", line 368, in iter
[augur]        |     result = action(retry_state)
[augur]        |              ^^^^^^^^^^^^^^^^^^^
[augur]        |   File "/augur/.venv/lib/python3.11/site-packages/tenacity/__init__.py", line 390, in <lambda>
[augur]        |     self._add_action_func(lambda rs: rs.outcome.result())
[augur]        |                                      ^^^^^^^^^^^^^^^^^^^
[augur]        |   File "/usr/local/lib/python3.11/concurrent/futures/_base.py", line 449, in result
[augur]        |     return self.__get_result()
[augur]        |            ^^^^^^^^^^^^^^^^^^^
[augur]        |   File "/usr/local/lib/python3.11/concurrent/futures/_base.py", line 401, in __get_result
[augur]        |     raise self._exception
[augur]        |   File "/augur/.venv/lib/python3.11/site-packages/tenacity/__init__.py", line 470, in __call__
[augur]        |     result = fn(*args, **kwargs)
[augur]        |              ^^^^^^^^^^^^^^^^^^^
[augur]        |   File "/augur/augur/tasks/github/util/github_data_access.py", line 230, in __make_request_with_retries
[augur]        |     result = self.make_request(url, method, timeout)
[augur]        |              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[augur]        |   File "/augur/augur/tasks/github/util/github_data_access.py", line 178, in make_request
[augur]        |     raise UrlNotFoundException(f"Could not find {url}")
[augur]        | augur.tasks.github.util.github_data_access.UrlNotFoundException: Could not find https://api.github.com/repos/gstreamer/gst-plugins-base/issues/comments?per_page=100
[augur]        | [2026-03-20 16:09:19,964: WARNING/ForkPoolWorker-4] 2026-03-20 16:09:19 966df2002621 core_task_failure[286] INFO Repo git: https://github.com/gstreamer/gst-plugins-base
[augur]        | [2026-03-20 16:09:19,993: ERROR/ForkPoolWorker-4] Task augur.tasks.github.messages.collect_github_messages[5d6dc1cb-9dd0-4151-81ea-76ef4992e12b] raised unexpected: UrlNotFoundException('Could not find https://api.github.com/repos/gstreamer/gst-plugins-base/issues/comments?per_page=100')
[augur]        | Traceback (most recent call last):
[augur]        |   File "/augur/.venv/lib/python3.11/site-packages/celery/app/trace.py", line 453, in trace_task
[augur]        |     R = retval = fun(*args, **kwargs)
[augur]        |                  ^^^^^^^^^^^^^^^^^^^^
[augur]        |   File "/augur/.venv/lib/python3.11/site-packages/celery/app/trace.py", line 736, in __protected_call__
[augur]        |     return self.run(*args, **kwargs)
[augur]        |            ^^^^^^^^^^^^^^^^^^^^^^^^^
[augur]        |   File "/augur/augur/tasks/github/messages.py", line 43, in collect_github_messages
[augur]        |     message_data = fast_retrieve_all_pr_and_issue_messages(repo_git, logger, manifest.key_auth, task_name, core_data_last_collected)
[augur]        |                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[augur]        |   File "/augur/augur/tasks/github/messages.py", line 78, in fast_retrieve_all_pr_and_issue_messages
[augur]        |     message_count = github_data_access.get_resource_count(url)
[augur]        |                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[augur]        |   File "/augur/augur/tasks/github/util/github_data_access.py", line 83, in get_resource_count
[augur]        |     num_pages = self.get_resource_page_count(url)
[augur]        |                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[augur]        |   File "/augur/augur/tasks/github/util/github_data_access.py", line 135, in get_resource_page_count
[augur]        |     response = self.make_request_with_retries(url, method="HEAD")
[augur]        |                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[augur]        |   File "/augur/augur/tasks/github/util/github_data_access.py", line 208, in make_request_with_retries
[augur]        |     return self.__make_request_with_retries(url, method, timeout)
[augur]        |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[augur]        |   File "/augur/.venv/lib/python3.11/site-packages/tenacity/__init__.py", line 330, in wrapped_f
[augur]        |     return self(f, *args, **kw)
[augur]        |            ^^^^^^^^^^^^^^^^^^^^
[augur]        |   File "/augur/.venv/lib/python3.11/site-packages/tenacity/__init__.py", line 467, in __call__
[augur]        |     do = self.iter(retry_state=retry_state)
[augur]        |          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[augur]        |   File "/augur/.venv/lib/python3.11/site-packages/tenacity/__init__.py", line 368, in iter
[augur]        |     result = action(retry_state)
[augur]        |              ^^^^^^^^^^^^^^^^^^^
[augur]        |   File "/augur/.venv/lib/python3.11/site-packages/tenacity/__init__.py", line 390, in <lambda>
[augur]        |     self._add_action_func(lambda rs: rs.outcome.result())
[augur]        |                                      ^^^^^^^^^^^^^^^^^^^
[augur]        |   File "/usr/local/lib/python3.11/concurrent/futures/_base.py", line 449, in result
[augur]        |     return self.__get_result()
[augur]        |            ^^^^^^^^^^^^^^^^^^^
[augur]        |   File "/usr/local/lib/python3.11/concurrent/futures/_base.py", line 401, in __get_result
[augur]        |     raise self._exception
[augur]        |   File "/augur/.venv/lib/python3.11/site-packages/tenacity/__init__.py", line 470, in __call__
[augur]        |     result = fn(*args, **kwargs)
[augur]        |              ^^^^^^^^^^^^^^^^^^^
[augur]        |   File "/augur/augur/tasks/github/util/github_data_access.py", line 230, in __make_request_with_retries
[augur]        |     result = self.make_request(url, method, timeout)
[augur]        |              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[augur]        |   File "/augur/augur/tasks/github/util/github_data_access.py", line 178, in make_request
[augur]        |     raise UrlNotFoundException(f"Could not find {url}")
[augur]        | augur.tasks.github.util.github_data_access.UrlNotFoundException: Could not find https://api.github.com/repos/gstreamer/gst-plugins-base/issues/comments?per_page=100

[collectoss-issue-migrator]

Note

Migrated comment from original
Originally posted by @MoralCode on 2026-03-20

---

so this error is later in the chain compared to the PR, so that suggests the PR works, but we uncovered more issues.

@sgoggins this is more of a problem than i initially thought.

how do you want to handle it

[cdolfi]

same exception as #299

[MoralCode]

same exception as #299

While they are both URLNotFoundException, they occur on different endpoints and thus are different issues.

I have hidden the followup stack trace in this issue as off topic and moved/copied it to #306.