We report on the optical spectroscopic follow-up observations of the candidate counterparts to four INTEGRAL sources: IGR J04069+5042, IGR J06552-1146, IGR J21188+4901, and IGR J22014+6034. The candidate counterparts were determined with Chandra, and the optical observations were performed with 1.5 m RTT-150 telescope (TUBITAK National Observatory, Antalya, Turkey) and 2.4 m Hiltner Telescope (MDM Observatory, Kitt Peak, Arizona). Our spectroscopic results show that one of the two candidates of IGR J04069+5042 and the one observed for IGR J06552-1146 could be active late-type stars in RS CVn systems. However, according to the likelihood analysis based on Chandra and INTEGRAL, two optically weaker sources in the INTEGRAL error circle of IGR J06552-1146 have higher probabilities to be the actual counterpart. The candidate counterparts of IGR J21188+4901 are classified as an active M-type star and a late-type star. Among the optical spectra of four candidates of IGR J22014+6034, two show H alpha emission lines, one is a late-type star, and the other is an M type. The likelihood analysis favors a candidate with no distinguishing features in the optical spectrum. Two of the candidates classified as M-type dwarfs, are similar to some IGR candidates claimed to be symbiotic stars. However, some of the prominent features of symbiotic systems are missing in our spectra, and their NIR colors are not consistent with those expected for giants. We consider the IR colors of all IGR candidates claimed to be symbiotic systems and find that low-resolution optical spectrum may not be enough for conclusive identification.