Artifical Intelligence and research – it’s not the tech that’s the problem, but rather why it is used!

Artifical Intelligence (AI) has undoubted positive potential to be used to enable completely new kinds of research, especially in areas that require the “analysis” of very large amounts of data. This is particularly so in fields as diverse as modelling environmental change, and medical diagnostics. However, I am shocked almost every day by the scale at which it is now used overtly to cheat (and seek to get an advantage over others) and to support downright laziness in academic research.

Cartoon in exhibition along the shore of Lake Geneva, May 2024

Many univeristies have introduced AI policies for students (both undergraduates and postgraduates) that focus largely on identifying permitted and illegal aspects of the use of AI, focusing especially on penalising perceived abuse thereof. All too often these policies fail sufficiently to recognise how it can indeed be used positively and constructively. What such policies also fail to recognise is the scale at which deceit was already widely practised in universities prior to the advent of AI (see my posts in 2010 on Univeristy Students Cheating and on plagiarism and the production of knowledges, and in 2021 On PhDs). As with so many digital technologies, they serve to accentuate existing aspects of human behaviour. With the massification and grade inflation that has occurred in higher education over the last quarter of a century, it is scarcely surprising that some (perhaps most) people will use any means at their disposal to gain the highest level of certification with the least amount of effort.

What is deeply worrying is the speed at which the use of AI is transforming – and possible destroying – traditional values of academic integrity and labour. Two recent examples highlight the scale of the challenge:

  • Prize nominations. I have recently been on several boards reviewing nominations/applications for prizes. Increasing numbers of these appeared suspicious to me, and a quick check with a variety of AI detectors indicated high probabilities that they were indeed produced through the use of AI. Examining some of the entries for international awards ceremonies over the last couple of years, also suggests that several of the winning entries were produced through the use of AI, and that some of the evidence adduced therein was not based on physical reality. The reasons are obvious, with potential winners believing that they can gain an advantage through the use of such technologies.
  • Research proposals. In the last couple of years, an increasing number of proposals I receive from prospective postgraduate or post-doc applicants are clearly produced using AI. This is deeply concerning, not least because it provides no evidence that an applicant is indeed able to undertake independent research, and were such applicants to be accepted there would probably be very real problems during the research process. However what has provoked me to write this short post is that one such applicant seemed to express surprise that I should actually want to receive an application written only by a human!

Some members of review panels clearly do not mind if AI has been used to enhance a proposal, but I remain very concerned for four main reasons:

  • Above all, extensive reliance on AI to design research (and presumably therefore also to undertake and produce it) will take away the ability of human researchers to think for themselves and create new ideas. This is already happening, but any loss of this ability is deeply problematic, not least since it increasingly limits our individual and collective ability to be resilient and solve new challenges in the future. I fundamentally disagree with arguments that suggest this does not matter because it will enable our brains to concentrate on other, higher level, functionalities.
  • Second, though, AI is only as good as the data drawn upon by its algorithms. Such data, by definition, always comes from the past, and is biased. Hence, it cannot be truly innovative. All it does (at present) is reconfigure existing knowledge in new ways. To be sure, this can be interesting, but randomness (not least in our genetic makeup – although genetic drift is now seen as being less random that was previosuly thought) and serendipity are key elements of true innovation and creativity. These are what has enabled us to survive as a race, and if we lose them we will lose not only our souls but also our physical ability to function.
  • Third, all too oftenpeople using AI do so because they find thinking too difficult and/or they are lazy. They want a quick solution without the effort. Yet if we do not use our brains they will atrophy; if we do not draw on our memories, we will forget how to use them. Digital dementia is already a significant problem, but it will become very much more so in the future if we do not continue to exercise our minds. We must cherish real creative and innovative research by humans. This has always been tough; excellence does not come easy. However, it is rewarding. We must do all we can to encourage and reward real and high quality human research. If not, the mediocre and trivial will increasingly come to dominate our enquiry.
  • Fourth, it raises real problems for institutions and the management of research. Focusing on penalising cheating is a sign of failure. What we need to do is to encourage as many people as possible to think new thoughts for themselves. The mundane can indeed be left to those who enjoy trawling through the slop created by “AI pigs”. This will require much tighter processes for the selection of academic researchers (and this also surely applies to industry), along with absolute certainty and rigour over processes designed to penalise those who seek to dissemble. Put simply, all uses of AI should be declared (and on many occasions may be acceptable), and failure to do so should be accompanied by elimination.

Much more could be written (and indeed has already been writter by others) on these issues, but when people start assuming that universities and researchers welcome AI generated proposals or nominations then it is clear that the rot has already set in, and we need to quarterise it as soon as possible. We don’t have the antibiotics yet that can treat this infection!

Latest six podcasts on Digital Inclusion in an Unequal World (Episodes 11-16)

The ICT4D Collective has recently launched a podcast channel on Apple Podcasts which contains audio versions of the vignettes in my upcoming book Digital Inclusion in an Unequal World: An Emancipatory Manifesto. The fourth tranche of episodes (11-16) is now available as follows:

Episode 16. Benita Rowe on “The Tech Will Save Her’ – False Promises in Digital Gender-Based Violence (GBV) Solutions”

This is the sixteenth episode of our podcast based on the vignettes contributed by friends and colleagues to Tim Unwin’s new book Digital Technologies in an Unequal World: An Empancipatory Manfesto. In it, Benita Rowe illustrates how “Digital interventions aimed at preventing or responding to gender-based violence (GBV) have re-emerged in recent years in cyclical form, each positioned as a world-first innovation”. Yet, she argues that “Despite differences in format, these interventions often replicate a flawed set of design assumptions that consistently fail to
account for lived realities”.

The full vignette can be read here.

All audio files relating to the book are also available on our podcast with a new episode every week.

Episode 15. Nimmi Rangaswamy on “Social, Shared and Sustainable: Whatever Happened to the Community Internet?”

This is the fifteenth episode of our podcast based on the vignettes contributed by friends and colleagues to Tim Unwin’s new book Digital Technologies in an Unequal World: An Empancipatory Manfesto. In it, Nimmi Rangaswamy concludes that “What was once imagined as a shared, empowering infrastructure has become a personalised, pay-per-use playground — curated for binge and scroll rather than community or collective good. The Internet in India today is more a screen in the palm than a shared window. It entertains more than it empowers, and connects more to content than to community”.

The full vignette can be read here.

All audio files relating to the book are also available on our podcast with a new episode every week.

Episode 14. Nnenna Nwakanma on “Working WITH, not FOR”

This is the fourteenth episode of our podcast based on the vignettes contributed by friends and colleagues to Tim Unwin’s new book Digital Technologies in an Unequal World: An Empancipatory Manfesto. In it, Nnenna Nwakanma tells the story of her experiences having asked to visit a “school that the media has touted as the ‘model’” of good use of digital tech in education in a West African country. As she notes, “I needed to see things for myself, where the rubber hits the road. I also refused any ‘official’ or ‘media-related’ accompaniment”. The vignette reports on the schocks she encountered when she visited. As she concludes “When are we going to stop working FOR stakeholders and start working WITH them?”

The full vignette can be read here.

All audio files relating to the book are also available on our podcast with a new episode every week.

Épisode 13 en français. Yuliya Morenets sur « Au-delà du rôle symbolique: repenser l’inclusion des jeunes dans les forums mondiaux »

Voici le treizième épisode de notre podcast, inspiré des témoignages d’amis et de collègues qui ont contribué au nouveau livre de Tim Unwin, «Digital Technologies in an Unequal World: An Empancipatory Manfesto». Yuliya Morenets y raconte sa rencontre dans le hall d’inscription d’un événement IGF, illustrant comment l’inclusion des jeunes privilégie souvent la familiarité à l’innovation. Elle conclut : « Si nous voulons une véritable participation, nous devons dépasser le symbolisme. Nous devons investir dans les jeunes, non seulement comme des acteurs, mais aussi comme des bâtisseurs : imparfaits, passionnés et toujours en apprentissage. L’important n’est pas de polir chaque voix, mais d’écouter celles qui n’ont pas encore été entendues ». 

Le texte intégral est disponible ici.

Audio en français

Tous les fichiers audio relatifs au livre sont également disponibles sur notre podcast, avec un nouvel épisode chaque semaine.

Episode 13 in English. Yuliya Morenets on “Beyond the Token Seat: Rethinking Youth Inclusion in Global Forums”

This is the thirteenth episode of our podcast based on the vignettes contributed by friends and colleagues to Tim Unwin’s new book Digital Technologies in an Unequal World: An Empancipatory Manfesto. In it, Yuliya Morenets tells the story of an encounter in the registration lobby of an IGF event to show how youth inclusion often rewards familiarity over innovation. She concludes that “If we want real participation, we must move beyond tokenism. We need to invest in youth not just as performers, but as builders—messy, passionate, and still learning. The point is not to polish every voice but to hear the ones that haven’t been heard”.

The full vignette can be read here.

Audio in English

All audio files relating to the book are also available on our podcast with a new episode every week.

Episode 12. David Hollow on “Evidence-driven decision-making in the use of digital technologies in education”

This is the twelfth episode of our podcast based on the vignettes contributed by friends and colleagues to Tim Unwin’s new book Digital Technologies in an Unequal World: An Empancipatory Manfesto. In it, David Hollow argues that building a cuture of evidence-driven decision making can help ensure that EdTech is used wisely to mitigate the global learning crisis. He argues that everyone can contribute to building such a culture of evidence-based decision-making in EdTech by asking the following question: will this use of technology lead to an impact on learning outcomes that is cost-effective and works at scale?

The full vignette can be read here.

All audio files relating to the book are also available on our podcast with a new episode every week.

Episode 11. Janet Longmore on “The Youth-led Imperative”

This is the eleventh episode of our podcast based on the vignettes contributed by friends and colleagues to Tim Unwin’s new book Digital Technologies in an Unequal World: An Empancipatory Manfesto. In it, Janet Longmore provides a summary of the six main learnings from the work of Digital Opportunity Trust with young people drawing especially on their recent experiences in Rwanda and Uganda. Implementation of these learnings can provide a fundamental ‘mindset shift’ that reflects new skills and an entrepreneurial socially responsible spirit, resiliency and adaptability among young people that are critical for navigating employment and self-employment opportunities in a digital economy.

The full vignette can be read here.

All audio files relating to the book are also available on our podcast with a new episode every week.

Digital Inclusion in an Unequal World: An Emancipatory Manifesto – a quick summary

For those wanting a quick summary of the arguments made in my upcoming book Digital Inclusion in an Unequal World: An Emancipatory Manifesto, the video and graphic below provide an outline of its concluding reflections (click on the slide to see the animated video).

Full details of the book are also available through the following links: