with ng platform
total effort
1 Day
Resources
1 Business User
without ng platform
total effort
60+ Days minimum
Resources
4 resources: Business User, Data Scientist, Data Engineer, Cloud Engineer
Data
- Select input data
- Use Pre-built ELT frameworks
- Use current Notebooks or Python code
Data (data engineer)
- Setup framework to download data
- Setup frameworks to translate data
- Create QA and retry logic
- Create a monoting
- Add a scheduler
DataBase
- Use out of the box data lake and structured storage
DataBase (cloud engineer)
- Create a data lake
- Create a database
machine learning
- Use pre-built Features, ML, and Backtesting Task
machine learning (Data Scientist)
- Build ML process
- Test ML process
Move to production
- Save the data flow pipeline to production
- Schedule or trigger to run
Move to production (ML/Dev ops or Cloud Engineer)
- Setup cloud framework
- Move data flow pipeline to production
quality monitoring
- Use pre-built data, model, and pipeline quality monitoring
quality monitoring (ML/Dev ops)
- Create:
- Data quality monitoring
- Model quality monitoring
- Pipeline quality monitoring
Governance
- Configure access rights
- Review user logs and version
Governance (Cloud Engineer)
- Create:
- Access rights
- Process to record user logs
- Process to record version