Senior Data Manager

Summary

New Visions for Public Schools develops and implements scalable approaches to achieving equitable outcomes for students in public schools across New York City and beyond. Our data and systems work supports this mission by providing staff with actionable, timely, and accessible information.  We currently support over 900,000 students in nearly 1,600 schools, working with teachers and administrators to help students progress towards graduation and beyond into post-secondary success.

The School Systems and Data Analytics department is at the core of supporting New Visions staff and schools in translating data into action. Multiple times per day, we manage the processing of data from multiple internal and external source systems into New Visions databases and into live tools, providing staff with actionable, timely, and accessible information to make data-informed decisions. 

We are looking for a thoughtful Senior Data Manager to join our growing Data Architecture team and to help fundamentally shape our product. Your work will help massive numbers of students, teachers, and parents across New York and beyond.

Who You Are…

• You are excited about public service and the prospect of solving problems that are challenging and affect urban schools everywhere
• You are a strong technical mentor with a demonstrated ability to motivate and guide high-performing teams
• You enjoy working with analysts, designers and product managers to determine the best way to grow our data model to accommodate new features and tools
• You are detail oriented and enjoy organizing data in a way that will facilitate the work of team members
• You take pride in engineering resilient, high-uptime infrastructure that can scale to meet the demands of real-time data requests and mission-critical reporting
• You care about creating a data model that is optimized for performance and quality
• You love working in teams to solve complex challenges.  You thrive in a fast-paced, highly collaborative environment. 

Essential Job Functions

• Partner with Product Managers and Software Engineers to architect data solutions that align with feature development and releases
• Design, implement, and maintain high-performance PostgreSQL and Amazon Redshift clusters for responsive transactional and analytical workloads and  large-scale data warehousing
• Conduct deep-dive query optimization, vacuuming, and indexing strategies in PostgreSQL and Redshift to ensure sub-second query latency where required
• Manage and enhance code pattern libraries and development and release best practices to enhance code quality, reduce technical debt, and accelerate development cycles
• Monitor system health, respond to production incidents, and implement corrective actions to prevent future occurrences
• Optimize, streamline and standardize data processes to decrease execution time and simplify our data model
• Establish robust validation processes to ensure that the processed data reflected in our tools is an accurate reflection of the raw data sources
• Maintain the New Visions Data Model with effective data ingestion (ETL), transformation, integration, business logic processing, and documentation

Required Education and Experience

• Bachelor’s Degree or equivalent experience 
• 3+ years experience leading a team in data management, data analytics, or a related field
• Proficiency in R, SQL databases (Redshift, PostgreSQL, etc.) and ETL/ELT development
• Expertise managing and enhancing data pipelines to support continuing increases in data volume and complexity
• Demonstrated ability in SQL with expertise in schema design, data modeling, and database performance tuning

Required Knowledge and Skills

• Experience using AI models, MCP and/or agents to support code creation, optimize databases, and protect PII
• Champion technical standards and patterns to accelerate team productivity
• Knowledge of R and SQL required
• Experience developing for and optimizing performance of AWS Redshift and PostgreSQL database systems
• Knowledge of Git and Github - including branching, merging, diffs, and hotfixes
• Strong analytical, critical thinking and organizational skills
• Close attention to detail
• Demonstrated ability to prioritize, multi-task, work under pressure and meet deadlines
• Demonstrated persistence and independence in learning technical subject matter, and in solving technical problems

Desired Knowledge and Skills

• Experience processing large datasets with libraries like R data.table and Python pandas
• Experience with MongoDB data ingestion, query optimization, and aggregation pipelines
• Experience consuming REST APIs
• Experience scheduling tasks with Airflow
• Knowledge of public education data in New York State

Our Technology Stack

• Data/Databases
  • AWS (Redshift, S3, RDS), MongoDB, PostgreSQL 
• Languages 
  • R, Python, SQL, Linux/BASH
• Tools
  • Airflow, Docker, Kubernetes, AWS ECS, dbt

Disclaimer:

The statements herein are intended to describe the general nature and level of work being performed by the employee in this position.  These statements are not intended to be construed as an exhaustive list of all responsibilities, duties, and skills required of a person in this position.

Additional Information:

NYC-based headquarters. Remote options available, ideally working from locations in Eastern Standard Time. Additional details will be shared if selected for an interview

Our offices are currently operating in a hybrid model, with staff expected to work in person several days per week.  Additional details will be shared if selected for an interview.