[Provider] - Internal server error when creating a new provider from GitHub

[matheusfenolio]

Hello!

Trying to create a new provider from my private repository. I was able to list, and check against the GPG key, but now I'm getting 'Internal Server error'.

Terrareg version: 4.2.0
Environment: Docker
Github authentication: Token

terrareg  | /app/terrareg/database.py:887: SAWarning: nested transaction already deassociated from connection
terrareg  |   nested.rollback()
terrareg  | [2025-12-18 16:16:04,801] ERROR in app: Exception on /github/repositories/959332637/publish-provider [POST]
terrareg  | Traceback (most recent call last):
terrareg  |   File "/app/.venv/lib/python3.12/site-packages/flask/app.py", line 1823, in full_dispatch_request
terrareg  |     rv = self.dispatch_request()
terrareg  |          ^^^^^^^^^^^^^^^^^^^^^^^
terrareg  |   File "/app/.venv/lib/python3.12/site-packages/flask/app.py", line 1799, in dispatch_request
terrareg  |     return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args)
terrareg  |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
terrareg  |   File "/app/.venv/lib/python3.12/site-packages/flask_restful/__init__.py", line 467, in wrapper
terrareg  |     resp = resource(*args, **kwargs)
terrareg  |            ^^^^^^^^^^^^^^^^^^^^^^^^^
terrareg  |   File "/app/.venv/lib/python3.12/site-packages/flask/views.py", line 107, in view
terrareg  |     return current_app.ensure_sync(self.dispatch_request)(**kwargs)
terrareg  |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
terrareg  |   File "/app/.venv/lib/python3.12/site-packages/flask_restful/__init__.py", line 582, in dispatch_request
terrareg  |     resp = meth(*args, **kwargs)
terrareg  |            ^^^^^^^^^^^^^^^^^^^^^
terrareg  |   File "/app/terrareg/auth_wrapper.py", line 48, in wrapper
terrareg  |     return func(*args, **kwargs)
terrareg  |            ^^^^^^^^^^^^^^^^^^^^^
terrareg  |   File "/app/terrareg/server/error_catching_resource.py", line 52, in post
terrareg  |     return self._post(*args, **kwargs)
terrareg  |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^
terrareg  |   File "/app/terrareg/server/api/github/github_repository_publish_provider.py", line 108, in _post
terrareg  |     versions = provider.refresh_versions(limit=1)
terrareg  |                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
terrareg  |   File "/app/terrareg/provider_model.py", line 395, in refresh_versions
terrareg  |     provider_extractor.process_version()
terrareg  |   File "/app/terrareg/provider_extractor.py", line 114, in process_version
terrareg  |     self.extract_documentation()
terrareg  |   File "/app/terrareg/provider_extractor.py", line 179, in extract_documentation
terrareg  |     with self._obtain_source_code() as source_dir:
terrareg  |          ^^^^^^^^^^^^^^^^^^^^^^^^^^
terrareg  |   File "/usr/local/lib/python3.12/contextlib.py", line 137, in __enter__
terrareg  |     return next(self.gen)
terrareg  |            ^^^^^^^^^^^^^^
terrareg  |   File "/app/terrareg/provider_extractor.py", line 149, in _obtain_source_code
terrareg  |     os.rename(
terrareg  | FileNotFoundError: [Errno 2] No such file or directory: '/tmp/tmpqvq2e0qt/matheus/matheus-org-terraform-provider-matheus-92aba16' -> '/tmp/tmpqvq2e0qt/matheus/terraform-provider-matheus'

[MatthewJohn]

Hey @matheusfenolio ,

I can take a look into this.
Could you do me a favour, could you take a source archive of the latest release of the provider (.tar.gz) and list the content (tar -vtf tarname.tar.gz) please?

Many thanks
Matt

[MatthewJohn]

Created gitlab issue: https://gitlab.dockstudios.co.uk/pub/terrareg/-/issues/572
gitlab-issue-id:572

[matheusfenolio]

Thanks for the fast response!

Here it is. Let me know if anything else could be helpful

drwxrwxr-x root/root         0 2025-12-18 11:27 terraform-provider-hub-0.1.0/
drwxrwxr-x root/root         0 2025-12-18 11:27 terraform-provider-hub-0.1.0/.github/
-rw-rw-r-- root/root        41 2025-12-18 11:27 terraform-provider-hub-0.1.0/.github/CODEOWNERS
drwxrwxr-x root/root         0 2025-12-18 11:27 terraform-provider-hub-0.1.0/.github/workflows/
-rw-rw-r-- root/root      1357 2025-12-18 11:27 terraform-provider-hub-0.1.0/.github/workflows/releaser.yml
-rw-rw-r-- root/root       226 2025-12-18 11:27 terraform-provider-hub-0.1.0/.github/workflows/validate_pr.yml
-rw-rw-r-- root/root         6 2025-12-18 11:27 terraform-provider-hub-0.1.0/.gitignore
-rw-rw-r-- root/root      2455 2025-12-18 11:27 terraform-provider-hub-0.1.0/.golangci.yml
-rw-rw-r-- root/root      1618 2025-12-18 11:27 terraform-provider-hub-0.1.0/.goreleaser.yml
-rw-rw-r-- root/root      1182 2025-12-18 11:27 terraform-provider-hub-0.1.0/.terraform.lock.hcl
-rw-rw-r-- root/root       358 2025-12-18 11:27 terraform-provider-hub-0.1.0/Makefile
drwxrwxr-x root/root         0 2025-12-18 11:27 terraform-provider-hub-0.1.0/config/
-rw-rw-r-- root/root       428 2025-12-18 11:27 terraform-provider-hub-0.1.0/config/config.go
-rw-rw-r-- root/root      2092 2025-12-18 11:27 terraform-provider-hub-0.1.0/go.mod
-rw-rw-r-- root/root     12659 2025-12-18 11:27 terraform-provider-hub-0.1.0/go.sum
drwxrwxr-x root/root         0 2025-12-18 11:27 terraform-provider-hub-0.1.0/internal/
drwxrwxr-x root/root         0 2025-12-18 11:27 terraform-provider-hub-0.1.0/internal/adapter/
-rw-rw-r-- root/root      7765 2025-12-18 11:27 terraform-provider-hub-0.1.0/internal/adapter/user.go
-rw-rw-r-- root/root      5963 2025-12-18 11:27 terraform-provider-hub-0.1.0/internal/adapter/user_test.go
drwxrwxr-x root/root         0 2025-12-18 11:27 terraform-provider-hub-0.1.0/internal/common/
-rw-rw-r-- root/root        59 2025-12-18 11:27 terraform-provider-hub-0.1.0/internal/common/constants.go
-rw-rw-r-- root/root       577 2025-12-18 11:27 terraform-provider-hub-0.1.0/internal/common/logging.go
drwxrwxr-x root/root         0 2025-12-18 11:27 terraform-provider-hub-0.1.0/internal/core/
drwxrwxr-x root/root         0 2025-12-18 11:27 terraform-provider-hub-0.1.0/internal/core/domain/
-rw-rw-r-- root/root       682 2025-12-18 11:27 terraform-provider-hub-0.1.0/internal/core/domain/error.go
-rw-rw-r-- root/root       105 2025-12-18 11:27 terraform-provider-hub-0.1.0/internal/core/domain/query.go
-rw-rw-r-- root/root      2039 2025-12-18 11:27 terraform-provider-hub-0.1.0/internal/core/domain/user.go
drwxrwxr-x root/root         0 2025-12-18 11:27 terraform-provider-hub-0.1.0/internal/core/port/
-rw-rw-r-- root/root        68 2025-12-18 11:27 terraform-provider-hub-0.1.0/internal/core/port/resourceData.go
-rw-rw-r-- root/root        61 2025-12-18 11:27 terraform-provider-hub-0.1.0/internal/core/port/token.go
-rw-rw-r-- root/root       728 2025-12-18 11:27 terraform-provider-hub-0.1.0/internal/core/port/user.go
drwxrwxr-x root/root         0 2025-12-18 11:27 terraform-provider-hub-0.1.0/internal/core/usecase/
-rw-rw-r-- root/root      3291 2025-12-18 11:27 terraform-provider-hub-0.1.0/internal/core/usecase/password_generator.go
-rw-rw-r-- root/root     13371 2025-12-18 11:27 terraform-provider-hub-0.1.0/internal/core/usecase/words.txt
drwxrwxr-x root/root         0 2025-12-18 11:27 terraform-provider-hub-0.1.0/internal/ephemerals/
-rw-rw-r-- root/root      2133 2025-12-18 11:27 terraform-provider-hub-0.1.0/internal/ephemerals/service_account_password.go
drwxrwxr-x root/root         0 2025-12-18 11:27 terraform-provider-hub-0.1.0/internal/provider/
-rw-rw-r-- root/root       460 2025-12-18 11:27 terraform-provider-hub-0.1.0/internal/provider/model.go
-rw-rw-r-- root/root      5272 2025-12-18 11:27 terraform-provider-hub-0.1.0/internal/provider/provider.go
drwxrwxr-x root/root         0 2025-12-18 11:27 terraform-provider-hub-0.1.0/internal/resources/
-rw-rw-r-- root/root      7412 2025-12-18 11:27 terraform-provider-hub-0.1.0/internal/resources/service_account_role_v1.go
-rw-rw-r-- root/root      7438 2025-12-18 11:27 terraform-provider-hub-0.1.0/internal/resources/service_account_v1.go
-rw-rw-r-- root/root       779 2025-12-18 11:27 terraform-provider-hub-0.1.0/main.go
-rw-rw-r-- root/root        73 2025-12-18 11:27 terraform-provider-hub-0.1.0/terraform-registry-manifest.json
drwxrwxr-x root/root         0 2025-12-18 11:27 terraform-provider-hub-0.1.0/terraform/
drwxrwxr-x root/root         0 2025-12-18 11:27 terraform-provider-hub-0.1.0/terraform/.terraform/
drwxrwxr-x root/root         0 2025-12-18 11:27 terraform-provider-hub-0.1.0/terraform/.terraform/providers/
drwxrwxr-x root/root         0 2025-12-18 11:27 terraform-provider-hub-0.1.0/terraform/.terraform/providers/registry.terraform.io/
drwxrwxr-x root/root         0 2025-12-18 11:27 terraform-provider-hub-0.1.0/terraform/.terraform/providers/registry.terraform.io/hashicorp/
drwxrwxr-x root/root         0 2025-12-18 11:27 terraform-provider-hub-0.1.0/terraform/.terraform/providers/registry.terraform.io/hashicorp/vault/
drwxrwxr-x root/root         0 2025-12-18 11:27 terraform-provider-hub-0.1.0/terraform/.terraform/providers/registry.terraform.io/hashicorp/vault/5.6.0/
drwxrwxr-x root/root         0 2025-12-18 11:27 terraform-provider-hub-0.1.0/terraform/.terraform/providers/registry.terraform.io/hashicorp/vault/5.6.0/linux_amd64/
-rw-rw-r-- root/root     16761 2025-12-18 11:27 terraform-provider-hub-0.1.0/terraform/.terraform/providers/registry.terraform.io/hashicorp/vault/5.6.0/linux_amd64/LICENSE.txt
-rwxrwxr-x root/root  40657080 2025-12-18 11:27 terraform-provider-hub-0.1.0/terraform/.terraform/providers/registry.terraform.io/hashicorp/vault/5.6.0/linux_amd64/terraform-provider-vault_v5.6.0_x5
-rw-rw-r-- root/root      1734 2025-12-18 11:27 terraform-provider-hub-0.1.0/terraform/provider.tf
-rw-rw-r-- root/root      3361 2025-12-18 11:27 terraform-provider-hub-0.1.0/terraform/terraform.tfstate
-rw-rw-r-- root/root      3360 2025-12-18 11:27 terraform-provider-hub-0.1.0/terraform/terraform.tfstate.backup
-rw-rw-r-- root/root       802 2025-12-18 11:27 terraform-provider-hub-0.1.0/terraform/var.tf
drwxrwxr-x root/root         0 2025-12-18 11:27 terraform-provider-hub-0.1.0/tests/
drwxrwxr-x root/root         0 2025-12-18 11:27 terraform-provider-hub-0.1.0/tests/mock/
-rw-rw-r-- root/root       189 2025-12-18 11:27 terraform-provider-hub-0.1.0/tests/mock/mock_token.go

[MatthewJohn]

Thanks for this.
This is interesting - I'll double check, but from the error the code is expecting terraform-provider-matheus and you have terraform-provider-hub.
Is there anything named terraform-provider-matheus (in how you set it up, or naming or repo, provider etc.?)

[matheusfenolio]

Sorry, the correct name is -hub. I just had obfuscated some names from the original org. I should have said that

Repository name is: org/terraform-provider-hub

It finds the provider automatically, and validates with the public GPG key. Really got the 500 after I just added the pub GPG to the namespace.

I did also test with 4.1.0

How I setup:

Login: Using admin token
Github access: Using a PAT token with full access to that repo
Running docker command from the getting stated documentation

[MatthewJohn]

Apologies @matheusfenolio , I got distracted by Christmas and forgot about this!
I'll take another look

[matheusfenolio]

I hope you had a wonderful Christmas

No worries at all! I can only thank you for such great OSS tool