Télécharger l'open source Bot Libre Community Edition et installer Bot Libre sur votre propre serveur
Self, AIML, and scripting

implementation of local LLM on local install of Bot Libre Community Edition.

par invzame posté May 29 2023, 14:50

I have a local install of CE installed on docker. Its running great with no issues. My question is, in SELF, is there any way I can integrate a locally running LLM running on PyTorch to my bot? Another idea I had was to also try and make an inference API call on one of the pretrained models on huggingface and I haven't been able to get that to work either. I'm new to self and I'm kind of scratching my head with this problem. 

by admin posted May 30 2023, 8:18
You will need to create a web API to expose your Python API such as using the Flask Python web server.
You can then call the web API from Self.

Thumbs up: 0, thumbs down: 0, stars: 0.0
Views: 418, today: 2, week: 44, month: 51

Id: 47685232
Posté: May 29 2023, 14:50
Réponses: 1
Vues: 449, aujourd'hui: 2, semaine: 41, mois: 45
0 0 0.0/5