Modified neural network activation function
Neural Network is said to emulate the brain, though, its processing is not quite how the biological brain really works. The Neural Network has witnessed significant improvement since 1943 to date. However, modifications on the Neural Network mainly focus on the structure itself, not the activat...
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Conference or Workshop Item |
| Language: | English English |
| Published: |
2014
|
| Subjects: | |
| Online Access: | http://irep.iium.edu.my/39658/ http://irep.iium.edu.my/39658/ http://irep.iium.edu.my/39658/1/39658.pdf http://irep.iium.edu.my/39658/4/39658_Modified%20Neural%20Network%20Activation%20Function.SCOPUS.pdf |
| id |
iium-39658 |
|---|---|
| recordtype |
eprints |
| spelling |
iium-396582018-05-23T06:35:40Z http://irep.iium.edu.my/39658/ Modified neural network activation function Ibrahim, Adamu Abubakar Chiroma, Haruna Abdulkareem, Sameem Ya’u Gital, Abdulsalam Abdullahi Muaz, Sanah Maitama, Jafaar Isah, Muhammad Lamir Herawan, Tutut Q350 Information theory Neural Network is said to emulate the brain, though, its processing is not quite how the biological brain really works. The Neural Network has witnessed significant improvement since 1943 to date. However, modifications on the Neural Network mainly focus on the structure itself, not the activation function despite the critical role of activation function in the performance of the Neural Network. In this paper, we present the modification of Neural Network activation function to improve the performance of the Neural Network. The theoretical background of the modification, including mathematical proof is fully described in the paper. The modified activation function is code name as SigHyper. The performance of SigHyper was evaluated against state of the art activation function on the crude oil price dataset. Results suggested that the proposed SigHyper was found to improved accuracy of the Neural Network. Analysis of variance showed that the accuracy of the SigHyper is significant. It was established that the SigHyper require further improvement. The activation function proposed in this research has added to the activation functions already discussed in the literature. The study may motivate researchers to further modify activation functions, hence, improve the performance of the Neural Network. 2014-12-03 Conference or Workshop Item PeerReviewed application/pdf en http://irep.iium.edu.my/39658/1/39658.pdf application/pdf en http://irep.iium.edu.my/39658/4/39658_Modified%20Neural%20Network%20Activation%20Function.SCOPUS.pdf Ibrahim, Adamu Abubakar and Chiroma, Haruna and Abdulkareem, Sameem and Ya’u Gital, Abdulsalam and Abdullahi Muaz, Sanah and Maitama, Jafaar and Isah, Muhammad Lamir and Herawan, Tutut (2014) Modified neural network activation function. In: 4th International Conference on Artificial Intelligence with Applications in Engineering and Technology (ICAIET 2014), 3 - 5th December, 2014, Kota Kinabalu, Sabah. http://uksim.info/icaiet2014/CD+ToC.pdf |
| repository_type |
Digital Repository |
| institution_category |
Local University |
| institution |
International Islamic University Malaysia |
| building |
IIUM Repository |
| collection |
Online Access |
| language |
English English |
| topic |
Q350 Information theory |
| spellingShingle |
Q350 Information theory Ibrahim, Adamu Abubakar Chiroma, Haruna Abdulkareem, Sameem Ya’u Gital, Abdulsalam Abdullahi Muaz, Sanah Maitama, Jafaar Isah, Muhammad Lamir Herawan, Tutut Modified neural network activation function |
| description |
Neural Network is said to emulate the brain,
though, its processing is not quite how the biological brain
really works. The Neural Network has witnessed significant
improvement since 1943 to date. However, modifications on the
Neural Network mainly focus on the structure itself, not the
activation function despite the critical role of activation
function in the performance of the Neural Network. In this
paper, we present the modification of Neural Network
activation function to improve the performance of the Neural
Network. The theoretical background of the modification,
including mathematical proof is fully described in the paper.
The modified activation function is code name as SigHyper.
The performance of SigHyper was evaluated against state of
the art activation function on the crude oil price dataset.
Results suggested that the proposed SigHyper was found to
improved accuracy of the Neural Network. Analysis of
variance showed that the accuracy of the SigHyper is
significant. It was established that the SigHyper require further
improvement. The activation function proposed in this
research has added to the activation functions already
discussed in the literature. The study may motivate researchers
to further modify activation functions, hence, improve the
performance of the Neural Network. |
| format |
Conference or Workshop Item |
| author |
Ibrahim, Adamu Abubakar Chiroma, Haruna Abdulkareem, Sameem Ya’u Gital, Abdulsalam Abdullahi Muaz, Sanah Maitama, Jafaar Isah, Muhammad Lamir Herawan, Tutut |
| author_facet |
Ibrahim, Adamu Abubakar Chiroma, Haruna Abdulkareem, Sameem Ya’u Gital, Abdulsalam Abdullahi Muaz, Sanah Maitama, Jafaar Isah, Muhammad Lamir Herawan, Tutut |
| author_sort |
Ibrahim, Adamu Abubakar |
| title |
Modified neural network activation function |
| title_short |
Modified neural network activation function |
| title_full |
Modified neural network activation function |
| title_fullStr |
Modified neural network activation function |
| title_full_unstemmed |
Modified neural network activation function |
| title_sort |
modified neural network activation function |
| publishDate |
2014 |
| url |
http://irep.iium.edu.my/39658/ http://irep.iium.edu.my/39658/ http://irep.iium.edu.my/39658/1/39658.pdf http://irep.iium.edu.my/39658/4/39658_Modified%20Neural%20Network%20Activation%20Function.SCOPUS.pdf |
| first_indexed |
2023-09-18T20:56:59Z |
| last_indexed |
2023-09-18T20:56:59Z |
| _version_ |
1777410370323873792 |