Ah nice, I was aware of the remote ML instance option but I didn’t know it was optional, i.e. if it’s there rely on it, if not still work. I thought it was either do ML locally ALL the time or do ML remotely all the time.
Is it just an optional ML endpoint on the NAS instance pointing to the ML only container on the more powerful machine on the same LAN?
Pretty much that - the NAS instance is running all the time, and there’s a setting in Immich for the network address for the ML container(s) that accepts a comma (or semi colon) separated list, which is tried in order.
The docs mention that you can balance requests, but you’d have to use an external method for that at the moment.
Ah nice, I was aware of the remote ML instance option but I didn’t know it was optional, i.e. if it’s there rely on it, if not still work. I thought it was either do ML locally ALL the time or do ML remotely all the time.
Is it just an optional ML endpoint on the NAS instance pointing to the ML only container on the more powerful machine on the same LAN?
Pretty much that - the NAS instance is running all the time, and there’s a setting in Immich for the network address for the ML container(s) that accepts a comma (or semi colon) separated list, which is tried in order.
The docs mention that you can balance requests, but you’d have to use an external method for that at the moment.