• 0 Posts
  • 244 Comments
Joined 1 year ago
cake
Cake day: December 2nd, 2023

help-circle





  • Hmmm weird. I have a 4090 / Ryzen 5800X3D and 64GB and it runs really well. Admittedly it’s the 8B model because the intermediate sizes aren’t out yet and 70B simply won’t fly on a single GPU.

    But it really screams. Much faster than I can read. PS: Ollama is just llama.cpp under the hood.

    Edit: Ah, wait, I know what’s going wrong here. The 22B parameter model is probably too big for your VRAM. Then it gets extremely slow yes.



  • And the longer the time between episodes, the smaller the chance it would generate new sales because existing users lost interest.

    True, but with that particular game what didn’t help either was that there were many years between episodes, it was pretty awful. It’s one thing I really hate about episodic gaming. But Valve already proved it to be a failure, only Telltale And Dontnod still do it (and they do it consistently right, to be fair).

    The rest of the gaming industry has gone on to “Early access” which is even more awful. Rather than buying the first part of the story for a lower fee, you now pay top dollar for a game which isn’t even finished and never might be because once you pay them there is no real incentive to actually finish it :)

    But really, most categories of mobile games don’t interest me. Arcade and other simple crap like angry birds never interested me even in the 80s. Adventures yes but they’re few and far between on mobile and if they are they’re almost always desktop ports anyway. FPS really really sucks on mobile for me, the input is just too crappy and the screens too small.





  • The LLMs for text are also based on “theft”. They’re just much better at hiding it because they have a multitude more source material. Still, it does sometimes happen that they quote a source article verbatim.

    But yeah basically they’re just really good copy/paste engines that work with statistical analysis to determine the most likely answer based on what’s written in basically the whole internet :P It’s a bit hard to explain sometimes to people who think that the AI really “thinks”. I always say: If that were the case, why is the response to a really complicated question just as fast as a simple one? The wait is just based on the length of the output.

    In terms of the “theft” I think it’s similar ethically to google cache though.


  • A lot of translation and summarisation. ChatGPT is extremely good in absorbing a whole mix of comments in different languages and summarising them in English (or whatever other language).

    For programming I don’t use it so much anymore because it hallucinates too much, calling APIs that don’t even exist. And when I lower the temperature the output is too sparse.

    I’m also trying to build an assistant that can also communicate proactively (I intend to auto-prompt it when things happen and then evaluate if it should cause a message to me). But I need to get a local LLM going for that because running that through the ChatGPT API will be too costly.

    Also, a replacement for some of my web searches. Sometimes I just want to know something and it’s refreshing that it can give me an answer (even though it does need to be validated, it’s much easier to do that when you know what you’re looking for!)




  • That’s true. They actually stopped supporting Nginx recently which really bothered me too because I want to keep using self-signed certs (my server is only reachable internally and I do not want to expose it to the internet). And the new server they use (I forgot which) didn’t really have that option. So right now I’m locked out from updating until I fix that.

    And yes it is totally feasible to use upstream! Not a problem at all.

    I would recommend to use the dockers though, as the whole debian thing becomes a bit of a mess with different python requirements for some of the bridges. I tried that in a long forgotten past and there is a reason I’m trying to forget that 🤭

    Like you I know the ansible playbook has its limits (for example one other thing I run into is that I want to run several instances of the same bridge to bridge eg. 2 whatsapp accounts!) but I do think docker is the way to go. I’m interested to hear how you’re faring though as it’s a long time ago since I tried that.



  • most personal trips can be done safely and easily using an E-bike (much smaller batteries that can be produced en mass with existing supply chains) and cars should be reduced in usage outside of particularly rural areas where they truly are a necessity (which is a tiny portion of the overall population).

    E-bikes are often not an option for many reasons. Needing to bring cargo, bad weather, danger from other traffic. If they were actually such an amazing option everyone would be using them because they are hella cheaper than cars. Even in the netherlands where bike infrastructure is great, people are extremely car-centric.

    Personally I think subsidised public transport is a much better option.

    And nuclear is not cheaper and it doesn’t even factor in waste storage and decommissioning otherwise it would not have been viable. Right now when a nuclear plant is closed the operator walks off scot free and the cleanup costs are borne by the public. The mining of the uranium is also pretty polluting. There’s a lot of this externalisation to make it viable.

    The only reason it worked in the past was that the governments were building nuclear arsenals and invested in nuclear industry (note that this industry was not necessarily capable of producing weapons-grade plutonium but still, it was about building up an industry). It’s no coincidence that most countries relying heavily on nuclear power are also nuclear armed.

    Also, environmental pollution is also a safety issue. Don’t just look at human deaths. Even Fukushima was a major disaster despite not leading to many deaths. The regulation is there for a reason and that still didn’t manage to prevent Fukushima (not talking about Chernobyl there because that was just human idiocy fucking up at its worst). And other first-world countries have also had meltdowns.

    Personally I also feel bad about dumping our waste problem on future generations. That kind of thinking is exactly what led to the climate crisis. But admittedly this is a lesser issue for nuclear in particular because we do this with pretty much everything (as this article also mentions)