St. Anne's church started as a small chapel built atop a hillock by visiting French priest Fr. Adolphe Couellan in 1846. At the time, the congregation comprised about 190 people, mainly Chinese Catholics who settled down at the foothill of Bukit Mertajam. They were originally from Province Wellesley.