Learning Network Architectures of Deep CNNs Under Resource Constraints
| Autor: | Jason Thornton, Michael Chan, Ronald Duarte, Daniel Scarafoni, Luke Skelly |
|---|---|
| Rok vydání: | 2018 |
| Předmět: |
Network architecture
Linear programming Computer science Process (engineering) business.industry Deep learning Distributed computing 02 engineering and technology 010501 environmental sciences Object (computer science) 01 natural sciences Software deployment Iterative refinement Scalability 0202 electrical engineering electronic engineering information engineering 020201 artificial intelligence & image processing Artificial intelligence business 0105 earth and related environmental sciences |
| Zdroj: | CVPR Workshops |
| Popis: | Recent works in deep learning have been driven broadly by the desire to attain high accuracy on certain challenge problems. The network architecture and other hyperparameters of many published models are typically chosen by trial-and-error experiments with little considerations paid to resource constraints at deployment time. We propose a fully automated model learning approach that (1) treats architecture selection as part of the learning process, (2) uses a blend of broad-based random sampling and adaptive iterative refinement to explore the solution space, (3) performs optimization subject to given memory and computational constraints imposed by target deployment scenarios, and (4) is scalable and can use only a practically small number of GPUs for training. We present results that show graceful model degradation under strict resource constraints for object classification problems using CIFAR-10 in our experiments. We also discuss future work in further extending the approach. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|