In clinical practice, electrocardiography is used to diagnose cardiac abnormalities. Because of the extended time required to monitor electrocardiographic signals, the necessity of interpretation by physicians, and the vulnerability of electrocardiographic signals to noise interference, electrocardiography is laborious and places a heavy burden on healthcare providers. Therefore, in this paper, a convolutional Takagi–Sugeno–Kang (TSK)-type fuzzy neural network (CTFNN) is proposed to address the challenges of arrhythmia signal classification. The proposed CTFNN is divided into three parts, namely, a convolutional layer, a feature fusion layer, and a TSK fuzzy neural network. The TSK fuzzy neural network is used to replace the fully connected neural network, thereby reducing the number of parameters and enabling the model to mimic the human brain when classifying signals. In addition, because the parameters of the CTFNN are difficult to determine, the uniform experimental design method, which requires only a small number of experiments, is used to determine the optimal parameter combination. The proposed model was tested using the Massachusetts Institute of Technology-Beth Israel Hospital (MIT-BIH) arrhythmia database, which contains 1000 records belonging to 17 categories. Each record has a duration of 10 s and contains 3600 sampling points. According to our experimental results, the accuracy, recall, precision, and F1-score of the CTFNN for long-term signals were 97.33, 97.96, 96.00, and 96.97%, respectively. In addition, the number of parameters for the proposed model was only 558,728, which was less than that for LeNet (i.e., 1734501).