It was first mentioned in the Halych-Volhynian Chronicle in 1276, when a castle with a keep, the tower of Kamyenyets, was being constructed on this spot, to protect the northern boundary of Volhynia from the raids of invaders. This site on the stony steep bank of the Liasnaja (Lysna or Leśna) River had attracted Oleksa, the prominent builder and architect of Volhynia. He showed the site to Vladimir Vasilkovich, the Prince of Volhynia, who appreciated the place and ordered Oleksa to build a castle with a keep on the spot. Later a town appeared around the fortification. The tower is often called Bielaja Vieža (alternative transliteration: Belaya Vezha), which means White Tower or White Fortress in Belarusian, because after its foundation it was tiled in white. The neighboring primeval forest of Belavezhskaya Pushcha received its name, which also means White Tower, through association with the tower. However, today the color of the castle is brick-red, having weathered through the ages, not white.
The original name of the town comes from the Slavic word kamennyj which means stony in English, as it was founded atop a stony rise.
In 1366, it was incorporated into the Grand Duchy of Lithuania and in 1376 it was burnt by Teutonic Crusaders but rapidly rebuilt. In 1503, local townsfolk received a limited self-administration right (probably the Magdeburg Rights) that was used by 1795, when it was annexed by Russia. In 1588 and 1659, the town was devastated with plague.
In the 19th century and the first four decades of the 20th century, local Jewish community was the most active part of the townsfolk. Memories of the town are included in
Yechezkel Kotik's memoir, published in English as Journey To a Nineteenth Century Shtetl: The Memoirs of Yekhezkel Kotik.
In 1919, Kamyenets was occupied by Poland. In 1939, it was occupied by Soviet Union and appended to Soviet Belarus. During the Nazi occupation of 1941 - 1944, most local Jews were killed.
After the World War II, the town developed as a minor center of the food processing industry (cheese and butter making, baking of bread, etc.).