Adding ollama running service
I think it could be very useful to have an environment to run the ollama framework in order to integrate custom llm functionality into applications. It could be a separate service like Elastic Email that you subscribe to by paying or prepaying the additional computational cost. A configuration panel or command line could let you choose which model to run or configure a custom model. There are several packages in PHP that already allow integration like llphant.
1
vote