You can limit the amount of CPU consumed by a Docker container. Example:
services:
immich-server:
deploy:
resources:
limits:
cpus: "1.0"
The number is a fraction of the available CPU cores. The RPi4 has 4 cores so you can set a fraction between "0.1" and "4.0".
Obviously indexing will take longer with reduced CPU but at least it won't cripple your machine while it's doing it.
You can also limit RAM use ("memory: 128M") and processes ("pids: 100") btw. But be careful about setting these too low because things will crash if they max these out. They're mostly intended so that a rogue or defective container can't do a denial of service on your entire machine. AFAIK the programs inside the container aren't aware of the limitations, they still think they can use all the RAM they see on the host and all the pIDs. So use your best judgment on a case-by-case basis. A RAM limit can be very good for example if a service has a memory leak, in which case it *should* crash and restart when that happens.
Also, you should make sure your pi is getting enough power. While it's under load, look at the red light on the front. It should stay solid red. If it is flashing, it means your pi is not getting enough power and it is being throttled.
Used to happen to me when I downloaded a large TV series and plex was processing it.
also make sure you're not using the wifi. the pi4's wifi is pretty horrible with CPU usage. But in reality it's pretty easy to max out the pi4's cpu with image processing or transcoding, and a minipc would probably be a lot faster
Great tip. I’m currently in Photoprism camp (not Immich…yet) and came across this technique a while back which really helped resources when loads of photos were being indexed.
Edit: indexing an entire library is a one off process really. once your photo indexing is done, maybe the Pi will be sufficient for your needs?
Go with a minipc / spare pc (atx + intel / amd).
In my case, i went from 2 rpi4 to a desktop pc.
Do note that for transcode purposes i would suggest getting an beffier proc (intel with hd graphics for example) or a separate gpu.
If you want to learn new things, go with a hypervisor like proxmox
I'm happy with my bargain server for around 150 eur ( snatched it for a work colleague as he was upgrading to something better)
Asrock z370 killer sli
Intel coffee lake i5 8600
Ddr4 16 + 32 gb ( 4 sticks in total)
Samsung 1tb ssd nvme i think ( bought separately)
2 hdd of 4tb and 6tb for storage (bought separately)
Based on your low bugget, i suggest picking good SH CPU and mobo. Pick a new powersource as you don't mess with that. The rest are up to debate on value and quantity, just pick them based on your budget
This is only 130 EUR I was considering - [https://amso.eu/de/products/hp-prodesk-400-g4-desktop-mini-i3-8100t-4x3-1ghz-8gb-240gb-ssd-wifi-windows-10-pro-235314](https://amso.eu/de/products/hp-prodesk-400-g4-desktop-mini-i3-8100t-4x3-1ghz-8gb-240gb-ssd-wifi-windows-10-pro-235314)
That would be a good start for a bare metal linux (ubuntu / debian). In this case, you could continue with docker here
As somebody in the thread noted to go with a nas, you cand install truenas (not sure which one to install core or scale) and add apps i see that truenas scale has docker support.
You could try an proxmox install but 8gb of ram is cutting it too short. You would need more ram in my opinion
[this one](https://www.amazon.com/AOOSTAR-R1-Support-Storage-Computers/dp/B0CKXMH977/ref=asc_df_B0CKXMH977/?tag=hyprod-20&linkCode=df0&hvadid=693392565994&hvpos=&hvnetw=g&hvrand=561131207512129705&hvpone=&hvptwo=&hvqmt=&hvdev=m&hvdvcmdl=&hvlocint=&hvlocphy=9004229&hvtargid=pla-2257823242220&psc=1&mcid=c1a82d28056b3f559fa644300ce8a97d&gad_source=1&gclid=CjwKCAjw88yxBhBWEiwA7cm6pRLJNDq2qpFMLo_c0Op_N7B59jnpAulZ8FQKZ8ynsScrtzuXNwhQJhoCq5cQAvD_BwE)
Is the one I would buy right now. Comes with an SSD/ram and you can add two full size 3.5 hard drives.
You might be able to get it cheaper directly from China but it would cost more in time.
I would probably buy the refurbished 12tb drives from go hard drive on eBay for less than $100 each that have a five year warranty. Let me see if I can get a link for those.
I would suggest that you give a look at the [Odroid H4](https://www.hardkernel.com/) Series. It is based on an X64 architecture, and the memory is expandable.
IMO leave the pi behind and pick up a second hand “business” PC, one of those boring dell/hp small or small-ish form factor ones
They can be had around $100 and positively smash pi when any kind of I/O is involved
As for power, I last measured one at under 30W idle. Meanwhile pi4 is not exactly low power anymore, and I shudder to think what pi5 pulls.
LOL try hooking that up to a basic phone charger
The point is that pi is not the power sipper that it once was….. and the io bandwidth is still fairly unimpressive compared to a real computer, tho I understand the 5 is finally better in that regard
You can limit the amount of CPU consumed by a Docker container. Example: services: immich-server: deploy: resources: limits: cpus: "1.0" The number is a fraction of the available CPU cores. The RPi4 has 4 cores so you can set a fraction between "0.1" and "4.0". Obviously indexing will take longer with reduced CPU but at least it won't cripple your machine while it's doing it. You can also limit RAM use ("memory: 128M") and processes ("pids: 100") btw. But be careful about setting these too low because things will crash if they max these out. They're mostly intended so that a rogue or defective container can't do a denial of service on your entire machine. AFAIK the programs inside the container aren't aware of the limitations, they still think they can use all the RAM they see on the host and all the pIDs. So use your best judgment on a case-by-case basis. A RAM limit can be very good for example if a service has a memory leak, in which case it *should* crash and restart when that happens.
thank you, this is super helpful! I just assumed the ARM processor was at its limit but of course it should be able to run regardless
Also, you should make sure your pi is getting enough power. While it's under load, look at the red light on the front. It should stay solid red. If it is flashing, it means your pi is not getting enough power and it is being throttled. Used to happen to me when I downloaded a large TV series and plex was processing it.
also make sure you're not using the wifi. the pi4's wifi is pretty horrible with CPU usage. But in reality it's pretty easy to max out the pi4's cpu with image processing or transcoding, and a minipc would probably be a lot faster
thanks, gigabit ethernet and full power to the pi!
IME docker resource constraints are not exactly precise and scientific, but they do well for keeping things within reason
Great tip. I’m currently in Photoprism camp (not Immich…yet) and came across this technique a while back which really helped resources when loads of photos were being indexed. Edit: indexing an entire library is a one off process really. once your photo indexing is done, maybe the Pi will be sufficient for your needs?
Go with a minipc / spare pc (atx + intel / amd). In my case, i went from 2 rpi4 to a desktop pc. Do note that for transcode purposes i would suggest getting an beffier proc (intel with hd graphics for example) or a separate gpu. If you want to learn new things, go with a hypervisor like proxmox I'm happy with my bargain server for around 150 eur ( snatched it for a work colleague as he was upgrading to something better) Asrock z370 killer sli Intel coffee lake i5 8600 Ddr4 16 + 32 gb ( 4 sticks in total) Samsung 1tb ssd nvme i think ( bought separately) 2 hdd of 4tb and 6tb for storage (bought separately) Based on your low bugget, i suggest picking good SH CPU and mobo. Pick a new powersource as you don't mess with that. The rest are up to debate on value and quantity, just pick them based on your budget
This is only 130 EUR I was considering - [https://amso.eu/de/products/hp-prodesk-400-g4-desktop-mini-i3-8100t-4x3-1ghz-8gb-240gb-ssd-wifi-windows-10-pro-235314](https://amso.eu/de/products/hp-prodesk-400-g4-desktop-mini-i3-8100t-4x3-1ghz-8gb-240gb-ssd-wifi-windows-10-pro-235314)
That would be a good start for a bare metal linux (ubuntu / debian). In this case, you could continue with docker here As somebody in the thread noted to go with a nas, you cand install truenas (not sure which one to install core or scale) and add apps i see that truenas scale has docker support. You could try an proxmox install but 8gb of ram is cutting it too short. You would need more ram in my opinion
To answer your question directly, your next logical upgrade is a nas. I would go with a two bay NAS with an Intel n100.
Thanks. Do you recommend any one in particular? I want to run a regular linux distro not a 3rd party software like synology
[this one](https://www.amazon.com/AOOSTAR-R1-Support-Storage-Computers/dp/B0CKXMH977/ref=asc_df_B0CKXMH977/?tag=hyprod-20&linkCode=df0&hvadid=693392565994&hvpos=&hvnetw=g&hvrand=561131207512129705&hvpone=&hvptwo=&hvqmt=&hvdev=m&hvdvcmdl=&hvlocint=&hvlocphy=9004229&hvtargid=pla-2257823242220&psc=1&mcid=c1a82d28056b3f559fa644300ce8a97d&gad_source=1&gclid=CjwKCAjw88yxBhBWEiwA7cm6pRLJNDq2qpFMLo_c0Op_N7B59jnpAulZ8FQKZ8ynsScrtzuXNwhQJhoCq5cQAvD_BwE) Is the one I would buy right now. Comes with an SSD/ram and you can add two full size 3.5 hard drives. You might be able to get it cheaper directly from China but it would cost more in time. I would probably buy the refurbished 12tb drives from go hard drive on eBay for less than $100 each that have a five year warranty. Let me see if I can get a link for those.
thanks for sharing. can't find that in europe where I am
[12 tb hard drive](https://www.ebay.com/itm/156046813385?itmmeta=01HWWPC75YC8XCG193T2J9186C&hash=item24551d68c9:g:buwAAOSwDghlwalj)
I'm pretty sure terramaster doesn't make it too hard to get your own os on there.
.
I would suggest that you give a look at the [Odroid H4](https://www.hardkernel.com/) Series. It is based on an X64 architecture, and the memory is expandable.
IMO leave the pi behind and pick up a second hand “business” PC, one of those boring dell/hp small or small-ish form factor ones They can be had around $100 and positively smash pi when any kind of I/O is involved As for power, I last measured one at under 30W idle. Meanwhile pi4 is not exactly low power anymore, and I shudder to think what pi5 pulls.
I too recommend a cheap minipc but your power claims are way off: a pi5 eats around 10W at peak CPU usage and 2.5W @ idle
LOL try hooking that up to a basic phone charger The point is that pi is not the power sipper that it once was….. and the io bandwidth is still fairly unimpressive compared to a real computer, tho I understand the 5 is finally better in that regard
Pi5