© 2021 IEEE.This paper presents a Deep Neural network (DNN) system that uses a large set of geometric and categorical features for classification of secondary structure elements (SSEs) in the protein's trace that consists of Calpha atoms on the backbone. A systematical approach is implemented for classification of protein SSE problem. This approach consists of two network architecture search (NAS) algorithms for selecting (1) network architecture and layer connectivity, and (2) regularization parameters. Each algorithm uses a different search space and they are used in succession to develop a DNN. The DNN system generates over 93% classification rate on average for multiple test sets without any post processing for amino acid configurations.