• 0 Posts
  • 54 Comments
Joined 2 years ago
cake
Cake day: June 16th, 2023

help-circle



  • I run tech for a midsize business, and consult for several small businesses. Aside from one 4-person company, all of the businesses I oversee found it less expensive to host their own LLM in Azure than to pay for OpenAI’s subscriptions. I’m talking 10% of the cost of subscriptions for the same functionality.

    The midsize business in particular has only seen measurable benefit from more specialized/global applications of “AI” tools, such as integrating machine learning into data analytics. There are a ton of people who use the LLM chat, but I think the mishaps caused by the LLM may have undone any efficiency gains. Either way, I’m sure glad they’re not paying hundreds of thousands of dollars annually for it.

















  • This sounds like a security nightmare though. A central repository of all code and keys is a gold mine for exploitation. Don’t get me wrong, I would really want this to work, but if it was compromised it could he catastrophic.

    I do think there should be regulations in place that are clearly and easily enforceable by the FTC though. I’d love to see companies be hit with fines and/or compulsory refunds if they stop supporting devices and don’t provide some path forward for customers to keep using the device. That doesn’t solve for startups that go out of business, but it would at least cover the tech giants who are doing this garbage.