Roman Theater at the Caesarea's National Park with Mediterranean sea in the background, Israel. Caesarea was built by Herod the Great about 25ââ¬â13 BCE as the port city Caesarea Maritima. It served as an administrative center of Judaea Province of the Roman Empire, and later the capital of the Byzantine Palaestina Prima province during the classic period.