LCI-ELM: Length-Changeable Incremental Extreme Learning Machine

 

Abstract: Extreme Learning Machine (ELM) is a learning algorithm for generalized Single-hidden-Layer Feed-forward Networks (SLFNs). In order to obtain a suitable network architecture, Incremental Extreme Learning Machine (I-ELM) is a sort of ELM constructing SLFNs by adding hidden nodes one by one. Although kinds of I-ELM-class algorithms were proposed to improve the convergence rate or to obtain minimal training error, they do not change the construction way of I-ELM or face the over-fitting risk. Making the testing error converge quickly and stably therefore becomes an important issue. In this paper, we proposed a new incremental ELM which is referred to as Length-Changeable Incremental Extreme Learning Machine (LCI-ELM). It allows more than one hidden node to be added to the network and the existing network will be regarded as a whole in output weights tuning. The output weights of newly added hidden nodes are determined using a partial error-minimizing method. We prove that an SLFN constructed using LCI-ELM has approximation capability on a universal compact input set as well as on a finite training set. Experimental results demonstrate that LCI-ELM achieves higher convergence rate as well as lower over-fitting risk than some competitive I-ELM-class algorithms.

 

Some ELM-class Source Codes

感谢朱怀忠老师为我们建立这一空间!

解释一下为什么要建立这个空间。

1、有了这个空间,有利于资料的积累和保存!

2、有很多问题是简单的、共性的问题,这些问题往往是大家的主要问题,并且这些问题很简单,希望大家通过阅读就可以更正。

3、以后介绍的论文以及对应的幻灯片,请大家提交到网站上来,之前大家做的幻灯片以及对应的论文,也请提交到网站上来。

4、后来的新同学可以方便地查阅我们积累下的经验。

5、大家可以将你认为有价值的经验或信息发布在此空间。

6、凡是发布在本空间的内容,属于组内内容,任何人不得私自将空间内的内容转发给他人。

本空间仅仅用于学习和经验交流,不得在此处传播任何未经证实的信息。谢谢大家共同遵守本空间准则!也再次感谢朱怀忠老师提供此空间!