Kaviyoor is an ancient rock cut temple, carved on a huge rock and well preserved the carved rooms and sculptures. The Kaviyoor Thrikkakkudi Cave Temple, also known as the Rock Cut Cave Temple, is historically significant and is preserved by the Archeological Department as a monument. On 20 December 1967 the Temple was taken over by the Board of Travancore Devaswom.
The temple has a verandah with a Lord Ganapathi sculpture carved into the wall and an inner sanctum that contains a tall shivalinga, all carved out one huge rock. It carries close resemblance to the architectural style of Pallava. The engravings here are amongst the earliest stone sculpture specimens in Kerala. The shrine's main deity, Lord Shiva, is enclosed in a square cave, depicted in the 'Shivalinga' which is about three feet high and carved out of granite. There are also idols of Ganapathy, Maharshi and Dwarapalakas in the shrine. It was built from 608 to 850 AD during the rule of the Pallava dynasty which reigned over South India.In fact, the rock cave, is called Thri-kal-kudi Paara. It means practically cave settlement. Also named 'Kal-kudi' was the land surrounding the rock. Still, there's a nearby piece of land called 'Kakkudiyil,' a corrupt 'Kalkudiyil' form.