DataOps的一些心得

[aiden-liu]

啥是DataOps？

怎么一步步搭建DataOps框架

1. Project workspace （JIRA， Teams Channel， Confluence， Repository， Roles， Environments）
2. Developer workspace （Local develop environment， debug tools，commit convention， code scan，vulnerability check，pr review，compliance check，deploy，test，document（versioning，badging））
3. Engineering workspace （data landing, data pipeline, data models, data apis, data monitor）
4. Batch / Streaming

为什么要搞DataOps？

1. For leaders: Data governance - standardisation, federation, meshing
2. For developers & engineers: collaboration, automation, maintenance

caveats:

1. Team working culture
2. Leader's aspiration
3. Have someone to sell up
4. Rome isn't build in one day, be patient
5. Getting early feedback is the key, form your alpha group of people and start a pilot project, test and iterate.
6. Agile - stakeholder (Product Owner, Project Manager, SME) continuous engagement.
7. DevOps practise