numeri

You seem to be responding to what you think I'm saying, not what I'm saying. As far as I know, "killing children" is not a dog-whistle. No one uses the words "killing children…

No, avoiding anything potentially negative is not what I'm saying. Your argument (that context always matters) leaves discourse and society highly susceptible to dog-whistles[1], by forcing all g…

It was the term invented by the architects of the Holocaust, and I disagree that "eh, context matters". Setting all moral arguments aside, it's important to know that similar phrases ca…

No, the person you're responding to is absolutely right. The easy test (which has been done in papers again and again) is the ability to train linear probes (or non-linear classifier heads) on th…

Do you have a good reference I can read up on? I'd love to learn a bit more and update my mental "citation"

I've been slightly annoyed by how the Speculative Decoding paper has gotten all the credit for the technique – I first learned about the technique from a paper more than a year older[1], Shallow …

This behavior started happening for me in the last few months. If I click on a result, then go back, I have different search results. I've found a workaround, though – click back into the DDG sea…

The First Amendement limits what the US Congress/government can do, not what a private person can do. > Congress shall make no law respecting an establishment of religion, or prohibiting the f…

But gpt-4o can already answer your question for a fraction of the price and time: To determine which of the items could be used to make an actual fire, we need to analyze the definitions provided: 1. …

There was at least one case of someone trying this against Nigel in French, and he got them.

Nigel Richards usually outperforms (and is orders of magnitude faster than, at least for the complicated endgames, if I understand correctly) the best computer Scrabble programs.

Yes, from what I understand – and they also make mistakes.

The big issue here is that they didn't issue a DMCA request, they reported them for fraud.

GPU inference is always a balancing act, trying to avoid bottlenecks on memory bandwidth (loading data from the GPU's global memory/VRAM to the much smaller internal shared memory, where it …

The point of this program isn't that it makes things substantially quicker at the checkpoint – it is a minor speed-up at best. The goal is to normalize the collection of biometric data, to shift …

I've declined several times now, and have gotten harassed about it about 3/4 times. Whoever designed the program really did a good job getting buy-in from the lower-level employees.

My take on this: You're absolutely allowed to speak on your experience, but you should also take the feedback at face value and try to figure out whether it's useful or not. Plenty of feedba…

I think their "proof" would also prove that no child could ever learn to behave like an adult.

I've got bad news for you – that term was used in deep learning research well before LLMs came on the scene. It has nothing to do with pundits trying to popularize anything or trying to justify L…

Sort of like this? It does help: Source-Aware Training Enables Knowledge Attribution in Language Models ( https://arxiv.org/abs/2404.01019 ) From the abstract: > ... To give LLM…

OpenAI stated [1] that one of the breakthroughs needed for o1's train of thought to work was reinforcement learning to teach it to recover from faulty reasoning. > Through reinforcement learni…

SentencePiece is a tool and library for training and using tokenizers, and supports two algorithms: Byte-Pair Encoding (BPE) and Unigram. You could almost say it is the library for tokenizers, as it…

I'm also confused about some of the figures' captions, which don't seem to match the results: - "Only Sonnet-3.5 can count the squares in a majority of the images", but Sonnet…

Any career in fundamental research is more or less like that. From what I've seen personally, academics and government labs are the two biggest places you can find the most open ended roles. Each…

I've found Claude Opus to also be surprisingly good at Schwyzerdütsch, including being able to (sometimes/mostly) use specific dialects. I haven't tested this one much, but it's fu…

Is "meringues me" a typo, or a really fun new vocab word for me?

Yeah, this is correct and I'm not sure what paper GP was thinking of – Chinchilla is only about finding the point at which it would be more useful to scale the model rather than training longer. …

I believe this was one of Machiavelli's big arguments in The Prince – that sometimes a country in crisis needs a single strong leader/monarch/dictator, using cruelty if necessary to kee…

I didn't imply that they know anything about where atoms are, I was just pointing out the sheer absurdity of that volume of data. I should make it clear that my comparison there is unfair and mos…

Your suggested scheme (assuming a mapping from 10 tokens to 10 tokens, with each token taking 2 bytes to store) would take (32000 * 20) * 2 bytes = 2.3e78 TiB of storage, or about 250 MiB per atom in …