Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Open Data] Add tests to verify data #1432

Open
4 tasks
flanakin opened this issue Mar 22, 2025 · 0 comments
Open
4 tasks

[Open Data] Add tests to verify data #1432

flanakin opened this issue Mar 22, 2025 · 0 comments
Labels
Skill: DevOps GitHub setup and automation Tool: Open data Datasets to normalize and enhance FinOps reports

Comments

@flanakin
Copy link
Collaborator

⚠️ Problem

We need tests to validate that the data in open datasets is good and free of bugs.

🛠️ Solution

Create tests to validate scenarios for each dataset:

  • Regions: Each row with the same RegionId should have the same RegionName
    • Example hubs query:
      Regions 
      | summarize make_set(RegionName) by RegionId 
      | where array_length(set_RegionName) != 1
  • Services: Each row with the same ServiceName should have the same ServiceCategory/Subcategory/etc
  • Resource types: Do not include default portal links
  • Resource types: Do not include "en-us" in any URLs

🙋‍♀️ Ask for the community

We could use your help:

  1. Please vote this issue up (👍) to prioritize it.
  2. Leave comments to help us solidify the vision.
@flanakin flanakin added Skill: DevOps GitHub setup and automation Tool: Open data Datasets to normalize and enhance FinOps reports labels Mar 22, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Skill: DevOps GitHub setup and automation Tool: Open data Datasets to normalize and enhance FinOps reports
Projects
None yet
Development

No branches or pull requests

1 participant