请问HN:在Google TPU上运行模型的最佳后端是什么?
我买了 Pixel 10 Pro,想在上面运行鹦鹉(parakeet)或耳语(whisper)模型进行语音转文本。我正在开发一个人工智能听写应用(aidictation.com)。我在寻找在设备上运行这个模型的方法时遇到了困难。不得不使用 groq API,这并不是最理想的选择。<p>有什么建议吗?
查看原文
So, I got Pixel 10 Pro, and I'd like to run parakeet (or whisper) model on it for voice to text. I'm building an ai dictation app (aidictation.com). I'm struggling to find a way to run this model on device. I have to reserve to use groq API, which is suboptimal.<p>Any recommendations?