Hi ,
Back in February, GitHub "banned" their own co-founder because "something went wrong" with their automation.
The fact that he posted about it on social media shows he could see the humour in the situation - and it was undoubtedly fixed right away. Yet, it also highlights the perils of delegating decision-making to machines.
Here's the thing...
No model will ever achieve 100% accuracy - so when automated decision-making is used, we are all just one edge case away from having our lives turned upside down.
The only way to avoid such a situation is to keep a human in the loop.
Errors in automated decision-making can seem like something that only ever happen to "other people".
But if it can happen to the co-founder of GitHub while using his own product, it can easily happen to you.
Talk again soon,
Dr Genevieve Hayes.
