What does a good data strategy look like when we consider testing of AI systems?

,

:rabbit_face: I’m falling down a rabbit hole of AI data and what it means for quality engineering and software testing practices.

First, to warm things up, a poll:

When building with AI, data strategy is a core part of our quality engineering strategy

  • Agree
  • Somewhat agree
  • Somewhat disagree
  • Disagree
0 voters

And now some questions to help you see my thoughts:

  • How does data play into testing strategies?
  • What are some traps to avoid?
  • What are some mistakes that could easily be avoided?
  • How can quality engineers help contribute to having better data for AI purposes?
  • At what points are humans best at reviewing?
  • What has been done to tidy up data for quality purposes?
  • What does good data governance look like?

This post was inspired by:

Trying to wrap my head around this topic and needed to have a look of what a data strategy comprises. I hope this is part of the context of your questions.
"A data strategy is a comprehensive blueprint guiding the processes, policies, and technologies for data collection, storage, management, and analysis across every area of the business.

  • Data creation, access, storage, and updates: Manage the data lifecycle across multiple cloud and on-premise environments.
  • High availability and disaster recovery: Help ensure data is consistently accessible and protected against cyber threats, breaches, and unauthorized access.
  • Data use: Use data more effectively among a growing variety of AI algorithms, analytics, applications, and mobile apps.
  • Data privacy and security compliance: Implement measures to protect data and comply with government and industry regulations.
  • Data archiving and deletion: Follow retention schedules and compliance standards for data management.
  • Data administration: Guide business users and administrators on the capabilities of existing data management technologies, regulatory requirements, and organizational needs for optimizing data value."
    What Is a Data Strategy? | SAP