Anhinga anhinga playground

Two years later/два года спустя

Fri, 10 Jun 2022 02:34:58 GMT

Two years since my last post in this journal, and two years since the revolutionary events of the first half of 2020.

* The start of the major pandemic and the dynamics of the collective social response to that, the resulting impact was comparable to a soft version of the third World War (which is now gradually becoming less soft and more acute, especially this year).

* The GPT-3 revolution marking the transition from AI 2.0 (Deep Learning) to AI 3.0 (learning from a single or few examples, more and more competent program synthesis from linguistic clues, competent fast computational protein folding, "foundation models" based on Transformers or sometimes on hybrid models using artificial attention, etc).

The turbulence and the pace of change are only increasing. Very difficult and very interesting times are likely to be ahead of us this year and further down the road.

My main online platforms are still the dreamwidth and twitter accounts mentioned in the previous post.

comments

dmm.dreamwidth.org; twitter.com/ComputingByArts

Wed, 08 Jul 2020 21:26:11 GMT

The main place of my online activity for the last year:

https://dmm.dreamwidth.org/

The main place of my online activity for the last couple of months:

https://twitter.com/ComputingByArts

comments

Regularization in intrinsically sparse networks

Sun, 10 Mar 2019 17:08:28 GMT

My study (with a set of computational experiments) on the role of regularization in learning the network topology in a relatively novel neuroevolutionary scheme for intrinsically sparse networks:

https://github.com/anhinga/synapses/blob/master/regularization.md

( a shorter description here )

Crosspost: https://anhinga-drafts.livejournal.com/30356.html

comments