Templates
On-device assistant
Reference entryOn-device assistant
An on-device assistant runs some or all inference locally to reduce latency, limit data transfer and work with device context.
Where it sits
An on-device assistant runs some or all inference locally to reduce latency, limit data transfer and work with device context.