Asset in database which isn't in storage

[RenautMestdagh]

I have searched the existing issues, both open and closed, to make sure this is not a duplicate report.

• Yes

The bug

Setup:

• Remote server with immich running in docker
• Upload location is a local NAS.
• Both are connected through Tailscale

Question:
I'm uploading pictures to Immich with Immich CLI. On my currect setup (without Immich), I had a folder for each album. So I'm uploading with --album tag.
I recently had an album which said it contained 541 assets. When i selected them all, the counter said 540.
I used Immich API to find out there was an asset in immich db which wasn't on my nas. This already happened 2 times.

1st time it happened was for asset with id 9c4698af-e103-4b4a-8594-5757ef96f6a0
2nd time it happened was for asset with id f4aeba33-f52b-43f2-a543-070787b85c1f

The OS that Immich Server is running on

Ubuntu 24.04.3

Version of Immich Server

v2.3.1

Version of Immich Mobile App

v2.3.0

Platform with the issue

• Server
• Web
• Mobile

Device make and model

No response

Your docker-compose.yml content

services:
  immich-server:
    image: ghcr.io/immich-app/immich-server:${IMMICH_VERSION:-release}
    networks:
      - traefik_proxy
      - immich
    volumes:
      - ${UPLOAD_LOCATION}:/data
      - ${THUMB_LOCATION}:/data/thumbs
      - /etc/localtime:/etc/localtime:ro
    ports:
      - 2283:2283
    env_file:
      - stack.env
    depends_on:
      - redis
      - database
    restart: always
    labels:
      - "traefik.enable=true"

      # HTTP to HTTPS redirect
      - "traefik.http.routers.immich-http.entrypoints=web"
      - "traefik.http.routers.immich-http.rule=Host(`${IMMICH_TRAEFIK_HOST:?host url required}`)"
      - "traefik.http.routers.immich-http.middlewares=https-redirect@docker"
      
      # HTTPS router
      - "traefik.http.routers.immich.entrypoints=websecure"
      - "traefik.http.routers.immich.rule=Host(`${IMMICH_TRAEFIK_HOST:?host url required}`)"

      # Service definition
      - "traefik.http.services.immich.loadbalancer.server.port=2283"
    healthcheck:
      disable: false

  immich-machine-learning:
    image: ghcr.io/immich-app/immich-machine-learning:${IMMICH_VERSION:-release}
    networks:
      - immich
    volumes:
      - model-cache:/cache
    env_file:
      - stack.env
    restart: always
    healthcheck:
      disable: false

  redis:
    container_name: immich_redis
    image: docker.io/valkey/valkey:8@sha256:81db6d39e1bba3b3ff32bd3a1b19a6d69690f94a3954ec131277b9a26b95b3aa
    networks:
      - immich
    healthcheck:
      test: redis-cli ping || exit 1
    restart: always

  database:
    container_name: immich_postgres
    image: ghcr.io/immich-app/postgres:14-vectorchord0.4.3-pgvectors0.2.0@sha256:bcf63357191b76a916ae5eb93464d65c07511da41e3bf7a8416db519b40b1c23
    networks:
      - immich
    env_file:
      - stack.env
    environment:
      POSTGRES_PASSWORD: ${DB_PASSWORD}
      POSTGRES_USER: ${DB_USERNAME}
      POSTGRES_DB: ${DB_DATABASE_NAME}
      POSTGRES_INITDB_ARGS: '--data-checksums'
    volumes:
      - postgres:/var/lib/postgresql/data
    shm_size: 128mb
    restart: always

volumes:
  model-cache:
  postgres:
  thumbnails:

networks:
  immich:
    name: immich
  traefik_proxy:
    external: true

Your .env content

IMMICH_TRAEFIK_HOST=immich.mydomain.com
UPLOAD_LOCATION=/mnt/immich
THUMB_LOCATION=thumbnails
DB_DATA_LOCATION=./postgres
TZ=Europe/Brussels
IMMICH_VERSION=v2
DB_PASSWORD=abcd123
DB_USERNAME=dbusername
DB_DATABASE_NAME=immich

Reproduction steps

1. Upload images with Immich CLI
2. I'm not sure how to reproduce this error.

Relevant log output

�[31m[Nest] 7  - �[39m11/29/2025, 12:52:10 PM �[31m  ERROR�[39m �[33m[Microservices:{"id":"9c4698af-e103-4b4a-8594-5757ef96f6a0"}]�[39m �[31mUnable to run job handler (AssetExtractMetadata): Error: ENOENT: no such file or directory, stat '/data/upload/c016b5b2-5509-4657-8652-76a5838b59e4/30/ff/30ffcfe0-682c-4dec-91e7-d4564f7bf321.JPG'�[39m
Error: ENOENT: no such file or directory, stat '/data/upload/c016b5b2-5509-4657-8652-76a5838b59e4/30/ff/30ffcfe0-682c-4dec-91e7-d4564f7bf321.JPG'
    at async Object.stat (node:internal/fs/promises:1037:18)
    at async Promise.all (index 1)
    at async MetadataService.handleMetadataExtraction (/usr/src/app/server/dist/services/metadata.service.js:166:35)
    at async JobService.onJobRun (/usr/src/app/server/dist/services/job.service.js:51:30)
    at async EventRepository.onEvent (/usr/src/app/server/dist/repositories/event.repository.js:91:13)
    at async /usr/src/app/server/node_modules/.pnpm/[email protected]/node_modules/bullmq/dist/cjs/classes/worker.js:512:32






�[31m[Nest] 24  - �[39m12/02/2025, 6:08:01 PM �[31m  ERROR�[39m �[33m[Api:ErrorInterceptor~wf9gzd2m]�[39m �[31mUnknown error: Error [ERR_HTTP_HEADERS_SENT]: Cannot set headers after they are sent to the client�[39m
Error [ERR_HTTP_HEADERS_SENT]: Cannot set headers after they are sent to the client
    at ServerResponse.setHeader (node:_http_outgoing:700:11)
    at SyncController.getSyncStream (/usr/src/app/server/dist/controllers/sync.controller.js:44:17)
    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
Error: could not renew lock for job FacialRecognitionQueueAll
    at /usr/src/app/server/node_modules/.pnpm/[email protected]/node_modules/bullmq/dist/cjs/classes/worker.js:828:36
    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
    at async Worker.extendLocks (/usr/src/app/server/node_modules/.pnpm/[email protected]/node_modules/bullmq/dist/cjs/classes/worker.js:819:9)
    at async Timeout._onTimeout (/usr/src/app/server/node_modules/.pnpm/[email protected]/node_modules/bullmq/dist/cjs/classes/worker.js:750:29)
Query failed : {
  durationMs: 0.3772409986704588,
  error: Error: write CONNECTION_DESTROYED database:5432
      at Object.execute (/usr/src/app/server/node_modules/.pnpm/[email protected]/node_modules/postgres/cjs/src/connection.js:156:35)
      at Query.handler (/usr/src/app/server/node_modules/.pnpm/[email protected]/node_modules/postgres/cjs/src/index.js:230:13)
      at Query.handle (/usr/src/app/server/node_modules/.pnpm/[email protected]/node_modules/postgres/cjs/src/query.js:140:65) {
    code: 'CONNECTION_DESTROYED',
    errno: 'CONNECTION_DESTROYED',
    address: [ 'database' ],
    port: [ 5432 ]
  },
  sql: 'insert into "asset_exif" ("assetId", "fileSizeInByte") values ($1::uuid, $2) on conflict ("assetId") do update set "fileSizeInByte" = "excluded"."fileSizeInByte"',
  params: [ 'f4aeba33-f52b-43f2-a543-070787b85c1f', 974938 ]
}
�[31m[Nest] 8  - �[39m12/02/2025, 11:03:56 PM �[31m  ERROR�[39m �[33m[Microservices:{"id":"f4aeba33-f52b-43f2-a543-070787b85c1f"}]�[39m �[31mUnable to run job handler (AssetExtractMetadata): Error: ENOENT: no such file or directory, stat '/data/upload/c016b5b2-5509-4657-8652-76a5838b59e4/3a/0c/3a0c7feb-342e-4b86-9b5e-ce8e46ca35a0.JPG'�[39m
Error: ENOENT: no such file or directory, stat '/data/upload/c016b5b2-5509-4657-8652-76a5838b59e4/3a/0c/3a0c7feb-342e-4b86-9b5e-ce8e46ca35a0.JPG'
    at async Object.stat (node:internal/fs/promises:1037:18)
    at async Promise.all (index 1)
    at async MetadataService.handleMetadataExtraction (/usr/src/app/server/dist/services/metadata.service.js:166:35)
    at async JobService.onJobRun (/usr/src/app/server/dist/services/job.service.js:51:30)
    at async EventRepository.onEvent (/usr/src/app/server/dist/repositories/event.repository.js:91:13)
    at async /usr/src/app/server/node_modules/.pnpm/[email protected]/node_modules/bullmq/dist/cjs/classes/worker.js:512:32

Additional information

Would there be an easy way for me to check what assets are in immich database but not on my nas?

[skatsubo]

For a starter you may have a look at

• Images inexplicably displayed on the disk #24266 (comment)