The first wooden temple was pulled down in 1902. On 7 July of the same year the erection of the new brick church dedicated to St Andrew the Apostle was started under the direction of priest Wincenty Wojtekunas,the parish-priest of Wyszki.
The official consecration of the new temple built in Neo-Gothic style, was conducted on 28 August 1905 by priest prelate (1854-1914), canon of the Vilnius Cathedral Chapter. In the same year the temple was consecrated by priest Edward Libera baron von Ropp (1851-1939), the bishop of Vilnius (1904-1907). During the Second World War the soviet army confiscated the bells and the temple itself was damaged. After the ending of the military action, the necessary redecorations were done by priest Bolesław Wincenty Jarocki (1868-1922), the parish-priest of Wyszki of that time (1910-1922). At the end of the Second World War, the withdrawing SS troops on 30 July 1944 blown up the church towers and pulled down the pediment. From 26 August 1945 on, masses were held in provisionally redecorated temple. Rebuilding of the church, initiated by priest Izydor Niedroszlański (1887-1950), the parish-priest of Wyszki (1930-1948), continued for many years and was completed in 1961. However, it resulted with the reduction of the Gothic towers. Construction works were conducted under the direction of priest Tomasz Miłkowski (1906-1963). Alongside the church is situated a brick presbytery, built in the years 1978-1979, due to an effort of priest Edmunda Tararuja (parish-priest 1977-1985).