Scrum Master Toolbox Podcast: Agile Storytelling from the Trenches

Episode: BONUS Implementing Agile Practices for Data and Analytics Teams
Host: Vasco Duarte, Agile Coach, Certified Scrum Master, Certified Product Owner
Guest: Henrik Reich, Principal Architect and Developer at Today Data and AI Denmark
Release Date: March 14, 2025

Introduction

In this bonus episode of the Scrum Master Toolbox Podcast, host Vasco Duarte engages with Henrik Reich, a Principal Architect and Developer at Today Data and AI Denmark. Henrik brings his extensive expertise in data, Agile development, and continuous learning to discuss the intricacies of implementing Agile practices within data and analytics teams.

The Importance of Agile in Data Teams

Henrik underscores the growing convergence of data practices with software development principles. He explains, “Data is moving towards the principle of software development” (02:23). This shift is propelled by the increasing use of programming languages like Python in data roles, which traditionally have been less engineering-focused. Henrik emphasizes the necessity for Agile methodologies to adapt to these changes to ensure quality and efficiency in data projects.

Unique Challenges for Agile Data Teams

Dynamic Team Composition

One of the primary challenges Henrik identifies is the dynamic nature of data teams, especially within consultancy environments. He states, “In a perfect world we would have static teams, but I have never seen that work in real life” (04:13). The reality of fluctuating team members and resource availability requires Agile frameworks to be more flexible and adaptable.

Inadequate Tools and Practices

Henrik points out that many data tools are not inherently supportive of Agile practices. He mentions, “The data industry and the tools have been lagging attention to agile development for so many years” (07:25). This lag has resulted in a lack of best practices for utilizing programming tools effectively within data projects.

Diverse Skill Sets and Backgrounds

Data teams often comprise individuals from non-engineering backgrounds, lacking familiarity with software development best practices. Henrik notes, “People who work within data doesn't have an engineering background as many software developers” (02:23). This diversity necessitates tailored Agile training and methodologies to bridge the knowledge gap.

Approaches to Implementing Agile Practices in Data Teams

Emphasizing Continuous Integration and Delivery (CI/CD)

Henrik highlights the importance of enabling CI/CD within data teams to enhance delivery speed and value. He explains, “Our first approach is actually how can we make CI CD available?” (10:09). By adopting specific programming patterns and development practices, the team can better integrate and deliver data solutions efficiently.

Developing Accelerators and Workarounds

When faced with tools that do not support Agile practices like CI/CD, Henrik’s team develops accelerators to maintain productivity. He shares, “We have built accelerators and are building ways of working together with these accelerators” (12:46). These solutions often involve creating alternative workflows that mimic Agile processes despite tool limitations.

Version Control and Manual Workarounds

In situations where tools restrict Agile practices, Henrik advocates for creative workarounds. He states, “Sometimes we are facing technologies where it's not possible and then we have to figure out what can we do instead” (15:16). This approach ensures that teams can still adhere to Agile principles even when direct implementation is challenging.

Team Composition and Roles

Balancing Specialists and Generalists

Henrik discusses the diversity within teams, categorizing members into those who “code for a living” and those who “live for coding” (24:28). Understanding these dynamics helps in assigning roles that align with individual strengths, fostering a more cohesive and productive team environment.

Utilizing Sprint Goals to Foster Collaboration

A key strategy Henrik employs is the use of sprint goals to encourage team-wide participation. He explains, “If we can decide, okay, we need to do this within a sprint, then everybody can contribute” (28:20). This method allows team members to leverage their unique skills towards common objectives, enhancing collaboration and unity.

Recommendations and Best Practices

Start Small and Iterate

Henrik advises teams to begin with small, manageable tasks and gradually integrate Agile practices. He recommends, “Start small and figure out how and what jobs you have to do” (16:36). This incremental approach prevents overwhelming the team and allows for continuous improvement based on real-world feedback.

Define Clear Stakeholders and Product Owners

To avoid misalignment and undue pressure, Henrik emphasizes the importance of identifying clear stakeholders and product owners from the project’s outset. He notes, “It should be decided at the beginning of a project who owns it and who is the stakeholders” (19:46). Clear ownership facilitates better requirement gathering and project guidance.

Encourage Open Communication and Feedback

Implementing regular open office hours for consultants to interact with the team fosters a culture of transparency and continuous feedback. Henrik shares, “We have two hours per week where we have something called open office hours” (20:56). This practice helps in promptly addressing issues and refining processes.

Resources and Further Learning

Henrik acknowledges the scarcity of comprehensive resources tailored specifically for Agile data teams. He mentions, “We haven't found a source which saying, okay, this is the whole grail for this” (30:52). However, he encourages leveraging personal and team experiences to develop effective Agile practices within data environments. Interested listeners are encouraged to reach out to him via LinkedIn for more insights and guidance.

Conclusion

Henrik Reich provides valuable insights into the unique challenges and solutions associated with implementing Agile practices in data and analytics teams. His emphasis on flexibility, tailored methodologies, and leveraging team strengths offers a practical roadmap for Scrum Masters and Agile Coaches navigating the complexities of data-driven projects.

Notable Quotes

• Henrik Reich [02:23]: “Data is moving towards the principle of software development.”
• Henrik Reich [04:13]: “In a perfect world we would have static teams, but I have never seen that work in real life.”
• Henrik Reich [07:25]: “The data industry and the tools have been lagging attention to agile development for so many years.”
• Henrik Reich [10:09]: “Our first approach is actually how can we make CI CD available?”
• Henrik Reich [12:46]: “We have built accelerators and are building ways of working together with these accelerators.”
• Henrik Reich [15:16]: “Sometimes we are facing technologies where it's not possible and then we have to figure out what can we do instead.”
• Henrik Reich [24:28]: “Most of them are living for code, it's a hobby for these people.”
• Henrik Reich [28:20]: “If we can decide, okay, we need to do this within a sprint, then everybody can contribute.”
• Henrik Reich [30:52]: “We haven't found a source which saying, okay, this is the whole grail for this.”

Timestamp References

• 02:23 - Importance of Agile in Data Teams
• 04:13 - Dynamic Team Composition
• 07:25 - Inadequate Tools and Practices
• 10:09 - Emphasizing CI/CD
• 12:46 - Developing Accelerators and Workarounds
• 15:16 - Version Control and Manual Workarounds
• 16:36 - Start Small and Iterate
• 19:46 - Define Clear Stakeholders and Product Owners
• 20:56 - Encourage Open Communication and Feedback
• 24:28 - Balancing Specialists and Generalists
• 28:20 - Utilizing Sprint Goals to Foster Collaboration
• 30:52 - Resources and Further Learning

Note: For more insights and to connect with Henrik Reich, listeners are encouraged to reach out to him on LinkedIn and follow his technical blog.