The group had posed for photos in the capital city of Astana.
On 14 November, local media reported the tourists had been fined 22,500 tenge ($67; £51) each for their "indecent" appearance.
The notorious one-piece was made famous by the English actor's character, Borat, a fictional Kazakh TV presenter.
"To my Czech mates who were arrested. Send me your details and proof that it was you, and I'll pay your fine," the comedian wrote on Facebook.
There has been a mixed response to the incident from Kazakh social media users.