With the unveiling of FSR4 alongside the 9070 XT in May, AMD has made significant strides in the discrete GPU market, closing ...
This is a chrome extension and flask server that allows you to query the llama-cpp-python models while in the browser. It uses a local server to handle the queries and display the results in a popup.
For Vue 2.x, please check the v1 branch.