Upgrade to our Diamond service and we will build you your own app for Android or iOS
Self, AIML, and scripting

implementation of local LLM on local install of Bot Libre Community Edition.

by invzame posted May 29 2023, 14:50

I have a local install of CE installed on docker. Its running great with no issues. My question is, in SELF, is there any way I can integrate a locally running LLM running on PyTorch to my bot? Another idea I had was to also try and make an inference API call on one of the pretrained models on huggingface and I haven't been able to get that to work either. I'm new to self and I'm kind of scratching my head with this problem. 


by admin posted May 30 2023, 8:18
You will need to create a web API to expose your Python API such as using the Flask Python web server.
You can then call the web API from Self.

Thumbs up: 0, thumbs down: 0, stars: 0.0
Views: 560, today: 0, week: 2, month: 21

Id: 47685232
Posted: May 29 2023, 14:50
Replies: 1
Views: 597, today: 1, week: 3, month: 23
0 0 0.0/5