通过将学习系统建模为纤维丛来实现连续学习

人类大脑天生就有一种叫做连续学习(Continual Learning)的能力,然而目前的主流神经网络存在一种叫做灾难性遗忘(Catastrophic Forgetting)的问题。所谓灾难性遗忘,即突然和充分地学习一套新的模式,会导致完全遗忘已经学习过的模式。这篇文章提出一种将学习系统看作一个纤维丛(Fiber Bundle)的通用学习模型。通过在一系列的机器学习的实验中将文章提出的模型与传统模型的学习能力进行对比,作者发现文章提出的模型不仅仅有着极佳的连续学习能力,而且具有很大的信息容量。此外,作者发现,在某些学习情景下,假如我们让模型能够对时间产生意识(类似于人类大脑的情景记忆机制),模型的连续学习能力能够进一步得到增强。最后,作者发现文章提出的模型的遗忘性质和人类记忆的遗忘性质有着很好的对应。这个工作或许能够增进我们对人类大脑学习机制的认识。

Documentation for the project “The impact of asymmetric information-flow on the power-law exponent”

A power-law distribution for the connectivities of the nodes in a complex network has been widely reported in the studies of diverse networks. Though preferential attachment (PA) has been well accepted as an explanation for the power-law distributions observed in many systems, it is unclear how the asymmetry of information-flow in the networks will influence … Continue reading Documentation for the project “The impact of asymmetric information-flow on the power-law exponent”

Documentation for the project “Universality and correlations in individuals wandering through an online extremist space”

The `out of the blue' nature of recent terror attacks and the diversity of apparent motives, highlight the importance of understanding the online trajectories that individuals follow prior to developing high levels of extremist support. Here we show that the physics of stochastic walks, with and without temporal correlation, provides a unifying description of these … Continue reading Documentation for the project “Universality and correlations in individuals wandering through an online extremist space”

Documentation for the project “Group dynamics”

The dynamics of online human activity behind the evolution of online groups that individuals follow prior to developing high levels of extremist outbreak is a hot topic and crucial for improving the social security. Here is the documentation for the codes used for the analyses. Table of Contents Installation Preprocessing the datasets (optional) Observations Evolutionary … Continue reading Documentation for the project “Group dynamics”

Documentation for the project “Evolutionary Minority Game (EMG)”

Table of contents. Installation The core file Case studies 1. Installation Download the folder "projects/EMG", go to that folder, and then run in the terminal: pip install -r requirements.txt 2. The core file The core file is "EMG.py", in which the model is defined. The parameter "R" is the maximum step size (step range) for … Continue reading Documentation for the project “Evolutionary Minority Game (EMG)”

Documentation for the project “Grand canonical minority game”

The Grand Canonical Minority Game could be regarded as a simple extension of the basic version of Minority Game, by allowing the users to not play the game when they feel it is too risky. Here is the documentation for the codes used in the project. The focus of this documentation will be on introducing … Continue reading Documentation for the project “Grand canonical minority game”

Documentation for the project “Predicting stock prices using I Ching”

This is the documentation for a python package for predicting the stock prices using I Ching. Table of contents: Installation and setup Drawing the 8x8-Gua rotating plane Drawing the 64 c-Guas Drawing the 64 c-Guas and their corresponding Xiangs Predicting the stock prices 5.1 Obtaining the basic mode of velocities 5.2 Generating the dataset for … Continue reading Documentation for the project “Predicting stock prices using I Ching”