Example: Chat

Synopsis

This tutorial describes how the Chat Processor uses the phymes-ml and phymes-core crates to run a text generation inference using embedded Candle assets. The chat executable is provided in the examples.

Tutorial

In progress...

Next steps

The Chat Processor comes with a number of default configurations including the model, number of tokens to sample, temperature of sampling, etc. that can be modified by the user.