Transparency, CODIL, and the Horizon "black box" Software

 

One of the biggest difficulties faced by chatbots and other AI packages based on large language models is that they are black box systems which lack transparency. The same difficulty can also apply to large conventionally programmed commercial applications where the lack of transparency can have serious consequences. This problem has been spectacularly demonstrated by the problems caused by the General Post Office's Horizon software where innocent postmasters ended in prison because of errors in the "black box" software. Part of the problem was that the courts were prepared to accept as reliable "evidence" from a complex "black box" system which was unable to answer questions about the origins or reliability of the evidence it was being provided.