A Survey: Optimization Algorithms In Deep Learning

Autor: Uday Chourasia, Shivendra Dubey, Priyanka Dixit, Arundhati Arjaria, Anshul Tripathi
Rok vydání: 2020
Předmět:
Zdroj: SSRN Electronic Journal.
ISSN: 1556-5068
DOI: 10.2139/ssrn.3564978
Popis: Intelligent Systems or Smart Systems plays an important role in our day to day life. Deep learning (DL) is portray day by day a key role in our lives. It makes our work easier and efficient. It has already made a colossal impression in different areas, like cancer treatment diagnosis, in the quality of inventing new antibiotic, self-driving cars, foretelling of precognition and speech recognition. The meticulous domestic characteristics remover used in conventional knowledge, classification, and pattern recognition systems are not adaptable for massive-sized data sets. In many situations, confide in on the problem complication, DL can also beat the shortcomings of prior trivial networks that hindered productive training and thinking of hierarchical portrayal of multi-dimensional training data. A lot of parts of units comprised with enhanced algorithm and architecture used by DNN. The current survey retrospect’s a few optimization methods to boost the perfection of the training and to decrease time of training. We leave no stone unturn into the math back of training algorithms used in current deep networks. We define current shortcomings, enhancements, and implementations. The survey also canvas distant types of planning like intricacy networks, deep learning networks, frequent neural networks, increase learning areas & patterns variation auto encoders that aims to learn depiction for a set of data, typically for dimensionality contraction, by practicing the network to avoid signal “noise’’ and others.
Databáze: OpenAIRE