As part of a test run for Australia's corporate regulator, AI was used to summarise submissions made by the public.
The trial found that AI performed worse in every metric compared with humans. Assessors suggested AI would make more work for people, not less. https://www.crikey.com.au/2024/09/03/ai-worse-summarising-information-humans-government-trial/