Self-hosted 25.7.7 / 25.8.5 codecov-api fails to boot with migration

[kwonoj]

Describe the bug
Was on the 25.6.2, tried to upgrade to 25.7.7 or the latest 25.8.5 and seeing the logs as below, with failing to boot the app.

Starting api
Running migrations

==> Checking License
    License is valid
    License expires 2030-12-25 00:00:00 <==

{"message": "Codecov is starting migrations...", "asctime": "2025-07-18 17:47:34,708", "name": "shared.django_apps.legacy_migrations.management.commands.migrate", "levelname": "INFO", "lineno": 117, "pathname": "/usr/local/lib/python3.13/site-packages/shared/django_apps/legacy_migrations/management/commands/migrate.py", "funcName": "handle", "threadName": "MainThread", "utctime": "2025-07-18T17:47:34.708000", "logger.name": "shared.django_apps.legacy_migrations.management.commands.migrate", "logger.thread_name": "MainThread", "level": "INFO"}
{"message": "Trying to acquire migrations lock...", "asctime": "2025-07-18 17:47:34,709", "name": "shared.django_apps.legacy_migrations.management.commands.migrate", "levelname": "INFO", "lineno": 108, "pathname": "/usr/local/lib/python3.13/site-packages/shared/django_apps/legacy_migrations/management/commands/migrate.py", "funcName": "_obtain_lock", "threadName": "MainThread", "utctime": "2025-07-18T17:47:34.709000", "logger.name": "shared.django_apps.legacy_migrations.management.commands.migrate", "logger.thread_name": "MainThread", "level": "INFO"}
{"message": "Acquired Lock('lock:djang-migrations-lock').", "asctime": "2025-07-18 17:47:34,715", "name": "redis_lock.acquire", "levelname": "INFO", "lineno": 236, "pathname": "/usr/local/lib/python3.13/site-packages/redis_lock/__init__.py", "funcName": "acquire", "threadName": "MainThread", "utctime": "2025-07-18T17:47:34.715000", "logger.name": "redis_lock.acquire", "logger.thread_name": "MainThread", "level": "INFO"}
System check identified some issues:

WARNINGS:
codecov_auth.Owner.username: (fields.W907) django.contrib.postgres.fields.CITextField is deprecated. Support for it (except in historical migrations) will be removed in Django 5.1.
	HINT: Use TextField(db_collation="…") with a case-insensitive non-deterministic collation instead.
codecov_auth.User.email: (fields.W907) django.contrib.postgres.fields.CITextField is deprecated. Support for it (except in historical migrations) will be removed in Django 5.1.
	HINT: Use TextField(db_collation="…") with a case-insensitive non-deterministic collation instead.
core.Repository.name: (fields.W907) django.contrib.postgres.fields.CITextField is deprecated. Support for it (except in historical migrations) will be removed in Django 5.1.
	HINT: Use TextField(db_collation="…") with a case-insensitive non-deterministic collation instead.
Operations to perform:
  Apply all migrations: admin, auth, billing, bundle_analysis, codecov_auth, codecov_metrics, compare, contenttypes, core, labelanalysis, legacy_migrations, reports, rollouts, sessions, staticanalysis, ta_timeseries, timeseries, upload_breadcrumbs, user_measurements
Running migrations:
  Applying core.0061_increment_version...{"message": "Codecov migrations failed for default: Constants matching query does not exist.", "asctime": "2025-07-18 17:47:39,013", "name": "shared.django_apps.legacy_migrations.management.commands.migrate", "levelname": "INFO", "lineno": 145, "pathname": "/usr/local/lib/python3.13/site-packages/shared/django_apps/legacy_migrations/management/commands/migrate.py", "funcName": "handle", "threadName": "MainThread", "utctime": "2025-07-18T17:47:39.013000", "logger.name": "shared.django_apps.legacy_migrations.management.commands.migrate", "logger.thread_name": "MainThread", "level": "INFO"}
Traceback (most recent call last):
  File "/app/apps/codecov-api/manage.py", line 17, in <module>
    execute_from_command_line(sys.argv)
    ~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^
  File "/usr/local/lib/python3.13/site-packages/django/core/management/__init__.py", line 442, in execute_from_command_line
    utility.execute()
    ~~~~~~~~~~~~~~~^^
  File "/usr/local/lib/python3.13/site-packages/django/core/management/__init__.py", line 436, in execute
    self.fetch_command(subcommand).run_from_argv(self.argv)
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/usr/local/lib/python3.13/site-packages/django/core/management/base.py", line 412, in run_from_argv
    self.execute(*args, **cmd_options)
    ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.13/site-packages/django/core/management/base.py", line 458, in execute
    output = self.handle(*args, **options)
  File "/usr/local/lib/python3.13/site-packages/shared/django_apps/legacy_migrations/management/commands/migrate.py", line 142, in handle
    super().handle(*args, **options)
    ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.13/site-packages/django/core/management/base.py", line 106, in wrapper
    res = handle_func(*args, **kwargs)
  File "/usr/local/lib/python3.13/site-packages/django/core/management/commands/migrate.py", line 356, in handle
    post_migrate_state = executor.migrate(
        targets,
    ...<3 lines>...
        fake_initial=fake_initial,
    )
  File "/usr/local/lib/python3.13/site-packages/django/db/migrations/executor.py", line 135, in migrate
    state = self._migrate_all_forwards(
        state, plan, full_plan, fake=fake, fake_initial=fake_initial
    )
  File "/usr/local/lib/python3.13/site-packages/django/db/migrations/executor.py", line 167, in _migrate_all_forwards
    state = self.apply_migration(
        state, migration, fake=fake, fake_initial=fake_initial
    )
  File "/usr/local/lib/python3.13/site-packages/django/db/migrations/executor.py", line 252, in apply_migration
    state = migration.apply(state, schema_editor)
  File "/usr/local/lib/python3.13/site-packages/django/db/migrations/migration.py", line 132, in apply
    operation.database_forwards(
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~^
        self.app_label, schema_editor, old_state, project_state
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    )
    ^
  File "/usr/local/lib/python3.13/site-packages/django/db/migrations/operations/special.py", line 193, in database_forwards
    self.code(from_state.apps, schema_editor)
    ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.13/site-packages/shared/django_apps/core/migrations/0061_increment_version.py", line 8, in update_version
    version = Constants.objects.get(key="version")
  File "/usr/local/lib/python3.13/site-packages/django/db/models/manager.py", line 87, in manager_method
    return getattr(self.get_queryset(), name)(*args, **kwargs)
           ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.13/site-packages/django/db/models/query.py", line 637, in get
    raise self.model.DoesNotExist(
        "%s matching query does not exist." % self.model._meta.object_name
    )
__fake__.Constants.DoesNotExist: Constants matching query does not exist.

Seems

__fake__.Constants.DoesNotExist: Constants matching query does not exist.

is the issue - any idea how to workaround those?

Sorry for creating dupe from #63, not sure which one's right place to report.

[linear]

CCMRG-1534 Self-hosted 25.7.7 / 25.8.5 codecov-api fails to boot with migration

[egelhaus]

I have almost the same issue
Mine just refuses to do the migrations because they already exist but not in history or something?
It seems like the documentation sample is completely broken:(

[Roman3349]

With the upgrade from 25.6.2 to 25.7.7 and higher, I get a similar error. But I'm not at all sure what could have caused it. The original installation was on version 25.5.1.

worker-1  | Starting worker
worker-1  | Running migrations
worker-1  | System check identified some issues:
worker-1  | 
worker-1  | WARNINGS:
worker-1  | codecov_auth.Owner.username: (fields.W907) django.contrib.postgres.fields.CITextField is deprecated. Support for it (except in historical migrations) will be removed in Django 5.1.
worker-1  |     HINT: Use TextField(db_collation="…") with a case-insensitive non-deterministic collation instead.
worker-1  | codecov_auth.User.email: (fields.W907) django.contrib.postgres.fields.CITextField is deprecated. Support for it (except in historical migrations) will be removed in Django 5.1.
worker-1  |     HINT: Use TextField(db_collation="…") with a case-insensitive non-deterministic collation instead.
worker-1  | core.Repository.name: (fields.W907) django.contrib.postgres.fields.CITextField is deprecated. Support for it (except in historical migrations) will be removed in Django 5.1.
worker-1  |     HINT: Use TextField(db_collation="…") with a case-insensitive non-deterministic collation instead.
worker-1  | Operations to perform:
worker-1  |   Apply all migrations: admin, auth, bundle_analysis, codecov_auth, compare, contenttypes, core, labelanalysis, legacy_migrations, pg_telemetry, reports, rollouts, sessions, staticanalysis, ta_timeseries, test_analytics, upload_breadcrumbs, user_measurements
worker-1  | Running migrations:
worker-1  |   Applying codecov_auth.0068_alter_githubappinstallation_unique_together... OK
worker-1  |   Applying codecov_auth.0069_account_sentry_org_id_alter_account_plan... OK
worker-1  |   Applying codecov_auth.0070_add_sentry_merge_plan... OK
worker-1  |   Applying codecov_auth.0071_alter_invoicebilling_account_and_more... OK
worker-1  |   Applying compare.0007_alter_commitcomparison_table_and_more... OK
worker-1  |   Applying core.0071_pull_sentry_commentid... OK
worker-1  |   Applying core.0072_pull_pulls_pullid_desc... OK
worker-1  |   Applying core.0073_increment_version... OK
worker-1  |   Applying labelanalysis.0004_alter_labelanalysisprocessingerror_table_and_more... OK
worker-1  |   Applying legacy_migrations.0009_delete_yamlhistory... OK
worker-1  |   Applying rollouts.0007_alter_featureflagvariant_value... OK
worker-1  |   Applying staticanalysis.0002_alter_staticanalysissinglefilesnapshot_state_id_and_more... OK
worker-1  |   Applying ta_timeseries.0010_auto_20250528_1540... OK
worker-1  |   Applying ta_timeseries.0011_auto_20250610_2135... OK
worker-1  |   Applying ta_timeseries.0012_add_retention_policies... OK
worker-1  |   Applying ta_timeseries.0013_set_chunk_interval... OK
worker-1  |   Applying ta_timeseries.0014_set_cagg_chunk_interval... OK
worker-1  |   Applying ta_timeseries.0015_drop_materialized_hypertable_indexes... OK
worker-1  |   Applying ta_timeseries.0016_remove_testrun_ta_ts__branch_i_and_more... OK
worker-1  |   Applying upload_breadcrumbs.0001_initial... OK
worker-1  | Operations to perform:
worker-1  |   Apply all migrations: ta_timeseries
worker-1  | Running migrations:
worker-1  |   Applying ta_timeseries.0010_auto_20250528_1540... OK
worker-1  | An error occurred: relation "ta_timeseries_testrun" does not exist
worker-1  | 
worker-1  | System check identified some issues:
worker-1  | 
worker-1  | WARNINGS:
worker-1  | codecov_auth.Owner.username: (fields.W907) django.contrib.postgres.fields.CITextField is deprecated. Support for it (except in historical migrations) will be removed in Django 5.1.
worker-1  |     HINT: Use TextField(db_collation="…") with a case-insensitive non-deterministic collation instead.
worker-1  | codecov_auth.User.email: (fields.W907) django.contrib.postgres.fields.CITextField is deprecated. Support for it (except in historical migrations) will be removed in Django 5.1.
worker-1  |     HINT: Use TextField(db_collation="…") with a case-insensitive non-deterministic collation instead.
worker-1  | core.Repository.name: (fields.W907) django.contrib.postgres.fields.CITextField is deprecated. Support for it (except in historical migrations) will be removed in Django 5.1.
worker-1  |     HINT: Use TextField(db_collation="…") with a case-insensitive non-deterministic collation instead.
worker-1  |   Applying ta_timeseries.0011_auto_20250610_2135...UserMeasurement:
worker-1  |   + 2025_nov
worker-1  |      name: 2025_nov
worker-1  |      from_values: 2025-11-01
worker-1  |      to_values: 2025-12-01
worker-1  |      size_unit: months
worker-1  |      size_value: 1
worker-1  |   + 2025_dec
worker-1  |      name: 2025_dec
worker-1  |      from_values: 2025-12-01
worker-1  |      to_values: 2026-01-01
worker-1  |      size_unit: months
worker-1  |      size_value: 1
worker-1  |   + 2026_jan
worker-1  |      name: 2026_jan
worker-1  |      from_values: 2026-01-01
worker-1  |      to_values: 2026-02-01
worker-1  |      size_unit: months
worker-1  |      size_value: 1
worker-1  |   + 2026_feb
worker-1  |      name: 2026_feb
worker-1  |      from_values: 2026-02-01
worker-1  |      to_values: 2026-03-01
worker-1  |      size_unit: months
worker-1  |      size_value: 1
worker-1  |   + 2026_mar
worker-1  |      name: 2026_mar
worker-1  |      from_values: 2026-03-01
worker-1  |      to_values: 2026-04-01
worker-1  |      size_unit: months
worker-1  |      size_value: 1
worker-1  |   + 2026_apr
worker-1  |      name: 2026_apr
worker-1  |      from_values: 2026-04-01
worker-1  |      to_values: 2026-05-01
worker-1  |      size_unit: months
worker-1  |      size_value: 1
worker-1  |   + 2026_may
worker-1  |      name: 2026_may
worker-1  |      from_values: 2026-05-01
worker-1  |      to_values: 2026-06-01
worker-1  |      size_unit: months
worker-1  |      size_value: 1
worker-1  |   + 2026_jun
worker-1  |      name: 2026_jun
worker-1  |      from_values: 2026-06-01
worker-1  |      to_values: 2026-07-01
worker-1  |      size_unit: months
worker-1  |      size_value: 1
worker-1  |   + 2026_jul
worker-1  |      name: 2026_jul
worker-1  |      from_values: 2026-07-01
worker-1  |      to_values: 2026-08-01
worker-1  |      size_unit: months
worker-1  |      size_value: 1
worker-1  |   + 2026_aug
worker-1  |      name: 2026_aug
worker-1  |      from_values: 2026-08-01
worker-1  |      to_values: 2026-09-01
worker-1  |      size_unit: months
worker-1  |      size_value: 1
worker-1  |   + 2026_sep
worker-1  |      name: 2026_sep
worker-1  |      from_values: 2026-09-01
worker-1  |      to_values: 2026-10-01
worker-1  |      size_unit: months
worker-1  |      size_value: 1
worker-1  |   + 2026_oct
worker-1  |      name: 2026_oct
worker-1  |      from_values: 2026-10-01
worker-1  |      to_values: 2026-11-01
worker-1  |      size_unit: months
worker-1  |      size_value: 1
worker-1  | 
worker-1  | DailyTestRollup:
worker-1  |   + 2025_nov
worker-1  |      name: 2025_nov
worker-1  |      from_values: 2025-11-01
worker-1  |      to_values: 2025-12-01
worker-1  |      size_unit: months
worker-1  |      size_value: 1
worker-1  |   + 2025_dec
worker-1  |      name: 2025_dec
worker-1  |      from_values: 2025-12-01
worker-1  |      to_values: 2026-01-01
worker-1  |      size_unit: months
worker-1  |      size_value: 1
worker-1  |   + 2026_jan
worker-1  |      name: 2026_jan
worker-1  |      from_values: 2026-01-01
worker-1  |      to_values: 2026-02-01
worker-1  |      size_unit: months
worker-1  |      size_value: 1
worker-1  | 
worker-1  | UploadBreadcrumb:
worker-1  |   + 2025_week_46
worker-1  |      name: 2025_week_46
worker-1  |      from_values: 2025-11-17
worker-1  |      to_values: 2025-11-24
worker-1  |      size_unit: weeks
worker-1  |      size_value: 1
worker-1  |   + 2025_week_47
worker-1  |      name: 2025_week_47
worker-1  |      from_values: 2025-11-24
worker-1  |      to_values: 2025-12-01
worker-1  |      size_unit: weeks
worker-1  |      size_value: 1
worker-1  |   + 2025_week_48
worker-1  |      name: 2025_week_48
worker-1  |      from_values: 2025-12-01
worker-1  |      to_values: 2025-12-08
worker-1  |      size_unit: weeks
worker-1  |      size_value: 1
worker-1  | 
worker-1  | 0 partitions will be deleted
worker-1  | 18 partitions will be created
worker-1  | Traceback (most recent call last):
worker-1  |   File "/usr/local/lib/python3.13/site-packages/django/db/backends/utils.py", line 87, in _execute
worker-1  |     return self.cursor.execute(sql)
worker-1  |            ~~~~~~~~~~~~~~~~~~~^^^^^
worker-1  | psycopg2.errors.CheckViolation: updated partition constraint for default partition "user_measurements_default" would be violated by some row
worker-1  | 
worker-1  | 
worker-1  | The above exception was the direct cause of the following exception:
worker-1  | 
worker-1  | Traceback (most recent call last):
worker-1  |   File "/app/apps/worker/manage.py", line 27, in <module>
worker-1  |     main()
worker-1  |     ~~~~^^
worker-1  |   File "/app/apps/worker/manage.py", line 23, in main
worker-1  |     execute_from_command_line(sys.argv)
worker-1  |     ~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^
worker-1  |   File "/usr/local/lib/python3.13/site-packages/django/core/management/__init__.py", line 442, in execute_from_command_line
worker-1  |     utility.execute()
worker-1  |     ~~~~~~~~~~~~~~~^^
worker-1  |   File "/usr/local/lib/python3.13/site-packages/django/core/management/__init__.py", line 436, in execute
worker-1  |     self.fetch_command(subcommand).run_from_argv(self.argv)
worker-1  |     ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^
worker-1  |   File "/usr/local/lib/python3.13/site-packages/django/core/management/base.py", line 412, in run_from_argv
worker-1  |     self.execute(*args, **cmd_options)
worker-1  |     ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^
worker-1  |   File "/usr/local/lib/python3.13/site-packages/django/core/management/base.py", line 458, in execute
worker-1  |     output = self.handle(*args, **options)
worker-1  |   File "/usr/local/lib/python3.13/site-packages/psqlextra/management/commands/pgpartition.py", line 94, in handle
worker-1  |     plan.apply(using=using)
worker-1  |     ~~~~~~~~~~^^^^^^^^^^^^^
worker-1  |   File "/usr/local/lib/python3.13/site-packages/psqlextra/partitioning/plan.py", line 94, in apply
worker-1  |     model_plan.apply(using=using)
worker-1  |     ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^
worker-1  |   File "/usr/local/lib/python3.13/site-packages/psqlextra/partitioning/plan.py", line 39, in apply
worker-1  |     partition.create(
worker-1  |     ~~~~~~~~~~~~~~~~^
worker-1  |         self.config.model,
worker-1  |         ^^^^^^^^^^^^^^^^^^
worker-1  |         schema_editor,
worker-1  |         ^^^^^^^^^^^^^^
worker-1  |         comment=AUTO_PARTITIONED_COMMENT,
worker-1  |         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
worker-1  |     )
worker-1  |     ^
worker-1  |   File "/usr/local/lib/python3.13/site-packages/psqlextra/partitioning/range_partition.py", line 30, in create
worker-1  |     schema_editor.add_range_partition(
worker-1  |     ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
worker-1  |         model=model,
worker-1  |         ^^^^^^^^^^^^
worker-1  |     ...<3 lines>...
worker-1  |         comment=comment,
worker-1  |         ^^^^^^^^^^^^^^^^
worker-1  |     )
worker-1  |     ^
worker-1  |   File "/usr/local/lib/python3.13/site-packages/psqlextra/backend/schema.py", line 242, in add_range_partition
worker-1  |     self.execute(sql, (from_values, to_values))
worker-1  |     ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
worker-1  |   File "/usr/local/lib/python3.13/site-packages/django/db/backends/postgresql/schema.py", line 48, in execute
worker-1  |     return super().execute(sql, None)
worker-1  |            ~~~~~~~~~~~~~~~^^^^^^^^^^^
worker-1  |   File "/usr/local/lib/python3.13/site-packages/django/db/backends/base/schema.py", line 201, in execute
worker-1  |     cursor.execute(sql, params)
worker-1  |     ~~~~~~~~~~~~~~^^^^^^^^^^^^^
worker-1  |   File "/usr/local/lib/python3.13/site-packages/django/db/backends/utils.py", line 67, in execute
worker-1  |     return self._execute_with_wrappers(
worker-1  |            ~~~~~~~~~~~~~~~~~~~~~~~~~~~^
worker-1  |         sql, params, many=False, executor=self._execute
worker-1  |         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
worker-1  |     )
worker-1  |     ^
worker-1  |   File "/usr/local/lib/python3.13/site-packages/django/db/backends/utils.py", line 80, in _execute_with_wrappers
worker-1  |     return executor(sql, params, many, context)
worker-1  |   File "/usr/local/lib/python3.13/site-packages/django/db/backends/utils.py", line 84, in _execute
worker-1  |     with self.db.wrap_database_errors:
worker-1  |          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
worker-1  |   File "/usr/local/lib/python3.13/site-packages/django/db/utils.py", line 91, in __exit__
worker-1  |     raise dj_exc_value.with_traceback(traceback) from exc_value
worker-1  |   File "/usr/local/lib/python3.13/site-packages/django/db/backends/utils.py", line 87, in _execute
worker-1  |     return self.cursor.execute(sql)
worker-1  |            ~~~~~~~~~~~~~~~~~~~^^^^^
worker-1  | django.db.utils.IntegrityError: updated partition constraint for default partition "user_measurements_default" would be violated by some row
worker-1  |