LLM blocklet ？
Is it possible to run up some open source big model as a blocklet, and then aigne can choose to use this big model blocklet inside, because nowadays the cost of using aigne is not low for the average user
有没有可能跑起一些开源的大模型作为blocklet，然后aigne里面可以选择用这个大模型blocklet，因为现在普通用户使用aigne成本不低
2 replies
Interesting idea
The team said they’ll implement a cheaper alternative from running aigne with AI kit soon. So importing a new open source LLM might not be necessary👌
Hey there! Just wanted to let you know that it's totally possible to run LLM using blocklet, although it does require a pretty powerful GPU 😄. But don't worry, you can also deploy LLM yourself and create your own interface. AIGNE even supports custom LLM Adapter to access custom LLM interfaces (we're currently working on this feature and will be releasing it officially soon)! How cool is that? 😊