Issue with psycopg: cannot adapt type 'dict' using placeholder '%t'

[der-eismann]

Version
3.108.0

Describe the bug
I'm currently trying to setup pulp as an alternative to Nexus, however I'm struggling with the DB setup. We currently get this error from psycopg3:

/usr/local/lib/python3.11/site-packages/requests/__init__.py:113: RequestsDependencyWarning: urllib3 (2.6.3) or chardet (7.4.3)/charset_normalizer (3.4.7) doesn't match a supported version!
  warnings.warn(
/usr/local/lib/python3.11/site-packages/requests/__init__.py:113: RequestsDependencyWarning: urllib3 (2.6.3) or chardet (7.4.3)/charset_normalizer (3.4.7) doesn't match a supported version!
  warnings.warn(

Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/gunicorn/arbiter.py", line 713, in spawn_worker
    worker.init_process()
  File "/usr/local/lib/python3.11/site-packages/pulpcore/app/entrypoint.py", line 94, in init_process
    self.app_status = AppStatus.objects.create(
                      ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/pulpcore/app/models/status.py", line 33, in create
    obj = super().create(app_type=app_type, **kwargs)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/django/db/models/manager.py", line 87, in manager_method
    return getattr(self.get_queryset(), name)(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/django/db/models/query.py", line 665, in create
    obj.save(force_insert=True, using=self.db)
  File "/usr/lib64/python3.11/contextlib.py", line 81, in inner
    return func(*args, **kwds)
           ^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/django_lifecycle/mixins.py", line 166, in save
    save(*args, **kwargs)
  File "/usr/local/lib/python3.11/site-packages/django/db/models/base.py", line 902, in save
    self.save_base(
  File "/usr/local/lib/python3.11/site-packages/django/db/models/base.py", line 1008, in save_base
    updated = self._save_table(
              ^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/django/db/models/base.py", line 1169, in _save_table
    results = self._do_insert(
              ^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/django/db/models/base.py", line 1210, in _do_insert
    return manager._insert(
           ^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/django/db/models/manager.py", line 87, in manager_method
    return getattr(self.get_queryset(), name)(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/django/db/models/query.py", line 1873, in _insert
    return query.get_compiler(using=using).execute_sql(returning_fields)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/django/db/models/sql/compiler.py", line 1882, in execute_sql
    cursor.execute(sql, params)
  File "/usr/local/lib/python3.11/site-packages/django/db/backends/utils.py", line 79, in execute
    return self._execute_with_wrappers(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/django/db/backends/utils.py", line 92, in _execute_with_wrappers
    return executor(sql, params, many, context)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/django/db/backends/utils.py", line 100, in _execute
    with self.db.wrap_database_errors:
  File "/usr/local/lib/python3.11/site-packages/django/db/utils.py", line 91, in __exit__
    raise dj_exc_value.with_traceback(traceback) from exc_value
  File "/usr/local/lib/python3.11/site-packages/django/db/backends/utils.py", line 105, in _execute
    return self.cursor.execute(sql, params)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/psycopg/cursor.py", line 117, in execute
    raise ex.with_traceback(None)
django.db.utils.ProgrammingError: cannot adapt type 'dict' using placeholder '%t' (format: TEXT)
cannot adapt type 'dict' using placeholder '%t' (format: TEXT)

I'm not really proficient with Python & Django, so I don't know what to do.

To Reproduce
We're using PostgreSQL 17.9, this is our config:

    DATABASES = {
        "default": {
            "ENGINE": "django.db.backends.postgresql",
            "NAME": "pulp",
            "USER": "pulp",
            "PASSWORD": os.environ.get("PULP_DB_PASSWORD", ""),
            "HOST": os.environ.get("PULP_DB_HOST", ""),
            "PORT": "5432",
            "CONN_MAX_AGE": 0,
        }
    }

Then starting the API component with

            - "--bind"
            - "0.0.0.0:24817"
            - "--workers"
            - "2"
            - "--access-logfile"
            - "-"

Expected behavior
The app should start normally

Additional context
First time pulp user, sorry if I made dumb mistakes.

[der-eismann]

After adding this to the settings.py (suggested by Claude) it works now:

    # Register psycopg3 global JSON adapter so dicts can be serialized
    # as JSONB in database queries (required for Pulp's JSONField models)
    try:
        import psycopg
        from psycopg.types.json import JsonDumper, JsonBinaryDumper
        psycopg.adapters.register_dumper(dict, JsonDumper)
        psycopg.adapters.register_dumper(dict, JsonBinaryDumper)
    except (ImportError, AttributeError):
        pass

I can't find this in the docs, so either I overwrote something or this is a bug 🙂

[gerrod3]

@der-eismann What plugins are you also installing with pulpcore 3.108? We removed a dependency in core (gnupg) and some plugins were transiently requiring this dependency to work (pulp-ansible being one of them pulp/pulp_ansible#2516) so we are still in the middle of fixing all our plugins.