Core Modeling & Analysis
- Leverage strong exploratory data analysis skills to analyze and integrate a wide range of data. Apply standard methods, models, algorithms, and/or simulations to solve simple to moderately complex business problems, performing ad-hoc analysis as necessary.
- Demonstrate an understanding of statistics and ML methodologies, working under the direction of more senior data scientists when asked to take on more complex work.
- Deliver systems that automate, expedite, simulate, predict, validate, audit, diagnose, reconcile, and/or explain.
Data Preparation & Feature Development
- Work closely with Data Engineers to define data requirements, evaluate source data quality, determine needed data transformations, and execute candidate feature engineering.
- Develop and manage ETL pipes in support of specific analytic project work, including understanding and advocating for mixed-use ML/GenAI systems’ data requirements.
Deployment, Monitoring & Maintenance
- Work closely with Deployment Engineers to refactor model and feature code for deployment via the Model Ops toolchain, test the model workflow pre-deployment, and deploy and evaluate the model workflow into production.
- Manage maintenance, retraining, or quality control on models actively in production. This includes evaluating the accuracy of predictive ML models and LLM responses—recognizing the non-deterministic nature of GenAI output—and suggesting tuning or feature engineering to address inaccuracies.
- Measure and monitor automated pipeline performance using standard metrics (e.g., accuracy, AUC, bias, calibration, pinball loss, stability, etc.).
Quality, Standards & Tools
- Act as an individual contributor responsible for implementing data science best practices. Own and be accountable for model and code quality and documentation for executed project work.
- Leverage pre-defined cloud compute resources and technology (Databricks, AWS, GitHub)
Collaboration & Stakeholder Management
- Interact with business partners in a hybrid work environment to understand their needs and influence others towards an effective solution.
- Partner closely with Engineering on GenAI component implementation and to utilize data science tools.
- Communicate with, coordinate with, and train users and stakeholders about the advanced analytics products being built and maintained.