Hosted by Thoughtworks · EN
Generative AI's popularity has led to a renewed interest in quality assurance — perhaps unsurprising given the inherent unpredictability of the technology. This is why, over the last year, the field has seen a number of techniques and approaches emerge, including evals, benchmarking and guardrails. While these terms all refer to different things, grouped together they all aim to improve the reliability and accuracy of generative AI. To discuss these techniques and the renewed enthusiasm for testing across the industry, host Lilly Ryan is joined by Shayan Mohanty, Head of AI Research at Thoughtworks, and John Singleton, Program Manager for Thoughtworks' AI Lab. They discuss the differences between evals, benchmarking and testing and explore both what they mean for businesses venturing into generative AI and how they can be implemented effectively. Learn more about evals, benchmarks and testing in this blog post by Shayan and John (written with Parag Mahajani): https://www.thoughtworks.com/insights/blog/generative-ai/LLM-benchmarks,-evals,-and-tests
Covid-19 unleashed a wave of medical and pharmaceutical research and innovation across the world. In India, the government launched the Drug Discovery Hackathon, an initiative designed to bring together expertise in fields ranging from biotechnology, pharmaceuticals, machine learning and virology to discover new drugs that could help thwart the pandemic. One team that took part was from Thoughtworks India. In this episode of the Technology Podcast, two of the members — Pooja Arora and Justin Jose — talk to Rebecca Parsons and Ashok Subramanian about a number of projects they worked on during the hackathon. Among other things, they explain how they used reinforcement learning to improve the efficacy of potential drugs in tackling what was, at the time, a virus that was only partially understood.
Thoughtworks CTO Rebecca Parsons has had a long and varied career in technology. Even before joining Thoughtworks in 1999, she completed a PhD, worked as a postdoc researcher at Los Alamos National Laboratory and taught at the University of Central Florida. Becoming CTO in 2007, she has seen Thoughtworks — and the wider tech industry — evolve through a period in which the business mainstream has become increasingly comfortable with cutting-edge innovation. In this episode of the Technology Podcast, Neal Ford and Birgitta Böckeler talk to Rebecca about her career, starting from Caterpillar warehouses in Peoria, Illinois, to being awarded the Technical Leadership Abie Award by AnitaB.org. It's the latest episode in our ongoing mini-series of Thoughtworker Journeys, offering an insight into the diverse and sometimes surprising experiences of technologists at Thoughtworks. Learn more about AnitaB.org: https://anitab.org/ Read the new edition of Rebecca's book, Building Evolutionary Architectures: https://www.thoughtworks.com/insights/books/building-evolutionaryarchitectures-second-edition