E.g. On biases in LLM responses and lack of explainability:
> Believe it or not, there is a historical precedent in old industrial technologies for making progress in commercial products and services before experts understood the underlying determinants. At the start of the Bessemer process being used by the US steel industry, for example, steel mills produced high-grade steel at a large scale even though nobody knew the chemistry to explain why ore from some North American locations worked so well. The science of chemistry had not caught up with the industrial processes. As a result, workers needed to learn how to fine-tune performance by recognizing the errors without knowing the underlying causes. The early US steel industry did live for decades with such uncertainty – and furnaces blew up occasionally – but there was too much money to be made.
That's a really good analogy. The question is: in this modern era of higher regulation, will capitalistic drive and risk-appetite (for things blowing up) be able to outpace lawmakers?