Blackbaud
Senior Data Engineer
Edtech.com's Summary
- Design and operate large volume data structures for data products and data science.
- Implement scalable, distributed data pipelines integrating multiple data sources.
- Develop design patterns to support data ingestion, movement, transformation, and aggregation.
- Collaborate with Product Managers, Software Engineers, and Data Scientists to achieve key results.
- Build, test, and deploy high-quality production-level data pipelines.
- Lead complex, critical projects and develop breakthrough technologies to expand business.
- Provide mentorship and enforce coding standards for data engineering teams.
- Experience with big data technologies such as Spark, Databricks, Delta Lake, Hive.
- Proficiency in core languages including Python (preferred), Scala, or Java with 4+ years.
- Hands-on experience with PaaS offerings in a public cloud environment, preferably Azure.
- Knowledge of Big Data design patterns, distributed computing frameworks, TDD, CI/CD, and Azure DevOps.
- Advanced skills in unit and integration testing, QA, and validation.
- Understanding of data security, authentication protocols, governance, privacy, and regulatory compliance.
- Experience integrating multiple data sources into common data assets.
Senior Data Engineer Full Description
Data Engineering at Blackbaud is responsible for ingestion, transformation and processing of data that powers Blackbaud Data Intelligence and Advanced analytics products. The data managed by the team supports data science, data enrichment, research and data analysis as well as making data operationally able to be consumed by Blackbaud's products and services.
As a Senior Data Engineer, you will take responsibility for technical design, implement complex features and provide mentorship in the Data Engineering discipline of Infrastructure Engineering & Cloud Operations (IECO). You build data intensive solutions that are highly available, scalable, reliable, secure, and cost-effective. You contribute to our common code repositories; help establish and enforce coding standards for data engineering teams.
What will You be doing:
Design, develop and operate high performance, large volume data structures for data-powered products and data science.
Implement efficient, distributed and scalable pipelines and integrate data from multiple sources to create data products
Implement design patterns that support data ingestion, data movement, transformation, aggregation, and much more.
Collaborate with Product managers, Software engineers, and Data Scientists, and work towards achieving key results.
Build high quality production level code, test and deploy data pipelines
Undertake complex tasks that are large and diverse in scope and/or critical in nature
Design and develop breakthrough products, services or technological advancements that expand our business
Participate in code reviews, brainstorm design approaches with peers and mentor junior engineers
Work in fast paced agile environment, participate in scrum ceremonies and help ensure that the team meets sprint commitments
What you'll bring:
have 6+ years of software and/or data engineering experience
Experience with big data technologies such as Spark, Databricks, Delta lakes, Hive, etc.
4+ years of experience in core languages such as Python, Scala or Java (Preferably Python)
Hands-on experience leveraging PaaS offerings in a public cloud environment (Azure preferred)
Experience with Big Data design patterns and distributed computing tools/frameworks
Proven expertise building big data pipelines (batch processing, real-time streaming)
Working knowledge of TDD, CI/CD concepts and tools (Preferably Azure DevOps)
Advanced understanding of unit testing/integration testing/QA/Validation
Knowledge of data security and authentication protocols
Experience in areas of data governance, privacy and regulation and professional experience with architectural approaches to data security
Have experience integrating multiple data sources into a common set of data assets
Stay up to date on everything Blackbaud, follow us on Linkedin, X, Instagram, Facebook and YouTube â
Blackbaud is a digital-first company which embraces a flexible remote or hybrid work culture. Blackbaud supports hiring and career development for all roles from the location you are in today!
Blackbaud is proud to be an equal opportunity employer and is committed to maintaining an inclusive work environment. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, physical or mental disability, age, or veteran status or any other basis protected by federal, state, or local law.
Similar Jobs
Data Analyst - Power BI Specialist
Wiley
🇺🇸 Hybrid - Hoboken, NJ
Staff Data Engineer - Craft Education
Western Governors University
🇺🇸 Nashville, TN
Business Intelligence Analyst
Southern New Hampshire University
🇺🇸 Remote - US
Director, Revenue Insights & Analytics
Vector Solutions
🇺🇸 Remote - US
Senior Manager of Data Engineering
ReUp Education
🇺🇸 Hybrid - Austin, TX
