Not loading pictures after migrating to the recommended new file structure on TrueNas

[PhonicSword]

I have searched the existing issues, both open and closed, to make sure this is not a duplicate report.

• Yes

The bug

Immich recommended that i migrate my file structure from Immich/[dataset] (uploads,thumbs,library,profile,backups,encoded-video) to Immich/data/
and then create a directory using truenas shell command
mkdir -p /mnt/tank/immich/data/{uploads,thumbs,library,profile,backups,encoded-video}

The postgres was not touched. Afterwards, we were told to migrate all of the folders.

After doing this, the immich app was not able to boot because the /.immich file in each of these directories was not able to be read. Initially, there was no /.immich file in the folders, so i added them to each folder and changed the permissions to root so that immich could read them. This resolved some of the folders, but not all, particularly the /upload directory.

Due to not making headway, I made a new instance of immich with the new file structure, and did the inital set up with new data and postgres folders. Afterwards, I turned off the server and migrated all of the folder contents from the old data folder to the new data folder, excluding contents that were already there like the /.immich files using this command

sudo rsync -ah --info=progress2 --ignore-existing /mnt/DataStore/App_Data/Immich/datas/ /mnt/DataStore/App_Data/Immich/data/

Afterwards, i redirected the immich database file to the old database that was used prior to migrating the file structure.

This allowed all of my settings and users to come back, and it allowed all of the pictures to show up in immich. However, almost all of them you cannot view the preview, and when clicking, you cannot view the pictures of any of them. The metadata for the pictures is still there.

I have tried rebuilding the thumbnails and smart search but it is not working. When i go to download a photo it says the file may have been moved so i suspect it might have something to do with the database.

The OS that Immich Server is running on

TrueNas

Version of Immich Server

v1.134.0

Version of Immich Mobile App

v1.9.0

Platform with the issue

• Server
• Web
• Mobile

Your docker-compose.yml content

cannot access through truenas

Your .env content

cannot access through truenas

Reproduction steps

Detailed above

Relevant log output

Additional information

No response

[ComputerGeek347]

I am having the same problem. I migrated the folder structure and it was working on 1.135.3. I updated to 1.137.3 and now none of my photos or thumbnails load. When I check the server container logs, I can see that it is trying to load photos from upload/library/. I think it should be data/library/. I don't know why immich is trying to access the wrong path or how to fix my database. Did you ever figure this out?

[codecrafting-io]

Same issue (1.135.3 - 1.137.3). I migrate everything to the data dataset (except database) and now everything is broken. Not sure if is database related, but no photos pr profile photos are loading, but the server can access those and everything is in /data. I had to rollback to 1.135.3 and restore the older database. Since nothing was working, I had to quickly revert, but I couldn't spot any errors in the logs.

[julian-alarcon]

This seems to be related to recent changes
truenas/apps#893
A detailed procedure to do the migration is mentioned here: https://www.reddit.com/r/truenas/comments/1lelkxj/immich_migration/

[ComputerGeek347]

I already migrated by data to the new dataset structure discussed in those posts. It is working fine on 1.135.3. There is another storage related change in 1.136. The internal directory that the data dataset is bound to has changed. I think it's supposed to automatically fix all the paths in the database to use the new /data directory instead of /upload, but it didn't work for me. None of my images would load on version 1.137 because it was trying to access /upload which no longer exists.

I just realized the op was having this issue on 1.134, so it is not the same issue. I will make my own issue post if I can't figure this out.

[Engelhan]

I had the same issue. You can change the location via the immich cli. This fixed it for me. First see in the server logs where immich thinks, that the images are and then change it via the cli to the path, where the images really are.
https://immich.app/docs/administration/server-commands/

[froydtech]

I had the same issue, and the immich cli migrate database didn't help.

I couldn't see thumbnails, and I couldn't download my photos, the link was broken. I had to spelunk into the postgres database itself, and rewrite the entries there. It had duplicated the storage for files prior to August (when I updated Immich). It used to be stored at upload/, that change moved all the links in the database to upload/upload, which borked the linking. After that, images were stored at /upload/, which worked fine for all my new post-August 3rd photos. Day before yesterday, I changed the storage based on the deprecation issue,.

When I spelunked in the database, I looked at the originalPath and the images uploaded after August 3rd suddenly all had /data/upload now, but the old photos pre-August were still pointing at upload/upload/.

FIX: I used sql through docker on truenas scale to replace upload/upload/ with /data/upload/. MAKE SURE YOU HAVE THE FIRST FORWARD SLASH! Now I have the ability to download all my photos, I am currently running the generate thumbnails job in the UI and that seems to be fixing the thumbnails. I've only got 1.3gb of images, so it may take a while, but results look promising.

Let me know if you need the commands to seplunk, I'll get them to you.

[froydtech]

That may point to the problem here. Not sure though. When you look at the datasets in truenas, and hover over the square thingy, does it say if an app is using the dataset? Like so:

[avniavdulla]

I believe it did, but I'm re-copying the data again to a new dataset to retry. So the app is not running right now. I'll update you once its done. Appreciate all the help tho man 👏

[froydtech]

No probs, it's a bit like the blind leading the blind here, I remember all the setup and frustration at getting this stuff working.

[avniavdulla]

ok yeah, the instructions on that immich doc do not give an example cmd for moving the postgres data, so I just totally forgot about it. Once I re-did it, it works fine.
Thanks for trying anyuway Froyd :)

[froydtech]

Hooray and Huzzah! I'm glad it was a fix that didn't require too much other rigamarole!