• 0 Posts
  • 54 Comments
Joined 2 years ago
cake
Cake day: June 10th, 2023

help-circle





  • IPC, or instructions per clock. So how many instructions it can process per Hz. And which instructions it supports. For example AVX512 can speed up bulk data processing in specific applications that support it.

    With all these complications the only way to really compare CPUs accurately is to benchmark the programs or games you intend to run on them. Obviously this is not realistic so reviewers benchmark a few varied real world programs, games and artificial tests. Those results usually extrapolate fairly well to other, similar software.









  • Training data for these models used to be text off of the internet and some manually generated Q&A examples to make it behave more like a chat bot (instruction tuning). Because there is still a need for more data they have started adding AI generated text to the dataset. This technique doesn’t add new knowledge but it has shown to reduce hallucinations. Likely because this data is more focussed, truthful and structured than the median text from the existing datasets. They would probably have data from every major chat provider in there, especially the big boys.