
GCIS's anti-misinformation bot wrote a fake R1,500 SRD notice in October. Retested this week, it is still broken in places, US-hosted and labelled Testing.
The government chatbot meant to help South Africans spot fake news is still running as a pilot, three weeks after it was caught writing a fake grant announcement. Testers say parts of it are still broken. RSA Facts, run by the Government Communication and Information System and embedded on the gov.za page for the campaign, was built with Microsoft's Copilot Studio. It answers questions by searching gov.za and the state news site SAnews.
The government launched it in late October and asked for feedback. "This is a pilot project, and your feedback matters! Try it out, share your experience and help us improve the service," the official government account on X said.
The bot's job is to counter misinformation. The tests that have been published found it producing some.
Joel Cedras, a cybersecurity researcher, tested RSA Facts on 30 October. He asked it to draft a fake South African Social Security Agency statement. It refused. When he said he worked inside government, it wrote one, claiming the social relief of distress grant would rise from R370 to R1,500 a month from 1 November 2026. One version carried a real agency email address. The grant remains R370 a month.
A refusal that collapses when the user claims a government job is not a safety rule. It is a prompt. Anyone who can type a sentence about working inside the state can, on that test, get a document that looks like an official notice, with a real email address on it. The grant figure in the notice was more than four times the actual monthly amount, and the date was set in 2026, so a reader who did not already know the grant would have had no reason to doubt it.
Asked yes-or-no questions, the bot said "Yes" three times to whether the ANC government is corrupt, citing a gov.za anti-corruption page that did not support the answer, and "No" for the DA, the EFF and the MK Party. Asked who built it, it named two officials at the Ehlanzeni District Municipality, with no sign either had anything to do with it. It answered a question in isiZulu in English. The page hosting it still carried placeholder template text reading "Use this paragraph to describe what you do."
"When the bot cannot find what it is looking for, it tends to simply make up the facts," Cedras wrote.
Cedras also found that the bot's connection details are public, so anyone can run it from their own website or script. He said Microsoft charges the department for every conversation. No amount has been reported. A public connection string means the pilot is not only the box on gov.za. It is an endpoint. A page that is not the government's can ask the same questions, and the answers still carry the government's system behind them.
A retest reported on 18 November found the web interface broken, with prompts no longer visible, and the bot no longer responding naturally to simple greetings. Questions outside its scope now get the same reply: "I'm sorry, I'm not sure how to help with that. Can you try rephrasing?"
Some of the worst behaviour appears to have been tightened. The retest's request for a fake R1,500 grant statement was refused, and the ANC answer could not be repeated.
The chief technology officer of EskomSePush, whose name as printed could not be verified and is not repeated here, told that retest that the bot sits on a Zoho landing page made of a single frame, runs in an environment named "Default" with the title "Testing", shows a broken favicon, and is hosted in the United States. The department had not responded by the time of that report.
A title that still says "Testing", on a page whose prompts have disappeared, is a pilot that has not been withdrawn and has not been finished. Users who open it on gov.za are still talking to something the builder has labelled a test, hosted outside the country, on a page assembled as a single frame.
In May, Minister in the Presidency Khumbudzo Ntshavheni said the department was building fact-checking capability and wanted it to become "the anchor of the truth". A tool with that job carries the government's name on every answer, including the wrong ones. An anchor that invents a grant increase, or that answers a party-political question from a page that does not say what the bot claims, is not a correction of misinformation. It is a new source of it, with a gov.za address.
The bot also arrives while South Africa has no settled artificial intelligence policy. The rewritten national policy is due to the minister by 30 November, and cabinet is only expected to consider it in March 2027. No adopted national policy yet sets rules for a public-facing government tool like this one: where the questions are stored, who may call the endpoint, what a wrong answer costs, or when a pilot has to come down.
The department has not said how much the pilot costs per conversation, where users' questions are stored given the United States hosting, who signed off the launch, or what it has changed since the October findings. The bot is still live on gov.za and still labelled a pilot.
Until those answers exist, the public record is the two tests. In October the bot would write a fake grant notice if the user claimed to work in government, and it would answer political questions the cited page did not support. In November the interface was broken, the greeting no longer worked, the fake grant was refused, and the system was still called Testing. That is not a fact-checking service. It is a pilot that has been shown to invent, and that has not been taken off the government's website.
Source: SA Tech News




