anhinga_drafts (![[personal profile]](https://www.dreamwidth.org/img/silk/identity/user.png)
anhinga_drafts) wrote2022-06-09 10:16 pm
anhinga_drafts) wrote2022-06-09 10:16 pm
Two years later/два года спустя
Two years since my last post in this journal, and two years since the revolutionary events of the first half of 2020.
* The start of the major pandemic and the dynamics of the collective social response to that, the resulting impact was comparable to a soft version of the third World War (which is now gradually becoming less soft and more acute, especially this year).
* The GPT-3 revolution marking the transition from AI 2.0 (Deep Learning) to AI 3.0 (learning from a single or few examples, more and more competent program synthesis from linguistic clues, competent fast computational protein folding, "foundation models" based on Transformers or sometimes on hybrid models using artificial attention, etc).
The turbulence and the pace of change are only increasing. Very difficult and very interesting times are likely to be ahead of us this year and further down the road.
My main online platforms are still the dreamwidth and twitter accounts mentioned in the previous post.
* The start of the major pandemic and the dynamics of the collective social response to that, the resulting impact was comparable to a soft version of the third World War (which is now gradually becoming less soft and more acute, especially this year).
* The GPT-3 revolution marking the transition from AI 2.0 (Deep Learning) to AI 3.0 (learning from a single or few examples, more and more competent program synthesis from linguistic clues, competent fast computational protein folding, "foundation models" based on Transformers or sometimes on hybrid models using artificial attention, etc).
The turbulence and the pace of change are only increasing. Very difficult and very interesting times are likely to be ahead of us this year and further down the road.
My main online platforms are still the dreamwidth and twitter accounts mentioned in the previous post.
no subject
Also, the deployment of practically useful systems reached entirely new levels in the last few months. Rapid progress in text-to-image, breakthroughs associated with ChatGPT and related systems, etc.
We are approaching the third anniversary of the GPT-3 revolution, and it seems that a new rather unprecedented "phase transition" is starting to happen.
no subject
AlexNet; GPT-3; GPT-4