原推：Having a data advantage in AI could result in a massive performance/cost advantage.
Relative to 800 billion tokens, 1.2 trillion tokens allows you to reduce training cost by 1/3rd and reduce inference costs by half for the same performance output. https://t.co/dTvGHzbQjE
Meta open sources a language model built on publicly available data that outperforms GPT-3 (at less than 1/10th the inference cost)