Blackbaud
Senior Data Engineer
Edtech.com's Summary
- Design, develop, and operate high performance, large volume data structures for data-powered products and data science.
- Implement efficient, distributed, and scalable data pipelines integrating multiple data sources.
- Utilize big data technologies such as Spark, Databricks, Delta Lakes, and Hive.
- Proficient in core programming languages including Python, Scala, or Java; Python preferred.
- Hands-on experience with public cloud platforms, preferably Azure PaaS offerings.
- Expertise in big data design patterns, distributed computing frameworks, and building batch and real-time streaming pipelines.
- Knowledge of test-driven development (TDD), continuous integration/continuous delivery (CI/CD), and Azure DevOps.
- Strong understanding of unit testing, integration testing, quality assurance, and validation.
- Experience with data security, authentication protocols, data governance, privacy legislation, and architectural security approaches.
- Collaborate with product managers, software engineers, and data scientists in an agile environment and participate in scrum ceremonies.
Senior Data Engineer Full Description
Data Engineering at Blackbaud is responsible for ingestion, transformation and processing of data that powers Blackbaud Data Intelligence and Advanced analytics products. The data managed by the team supports data science, data enrichment, research and data analysis as well as making data operationally able to be consumed by Blackbaud's products and services.
As a Senior Data Engineer, you will take responsibility for technical design, implement complex features and provide mentorship in the Data Engineering discipline of Infrastructure Engineering & Cloud Operations (IECO). You build data intensive solutions that are highly available, scalable, reliable, secure, and cost-effective. You contribute to our common code repositories; help establish and enforce coding standards for data engineering teams.
What will You be doing:
Design, develop and operate high performance, large volume data structures for data-powered products and data science.
Implement efficient, distributed and scalable pipelines and integrate data from multiple sources to create data products
Implement design patterns that support data ingestion, data movement, transformation, aggregation, and much more.
Collaborate with Product managers, Software engineers, and Data Scientists, and work towards achieving key results.
Build high quality production level code, test and deploy data pipelines
Undertake complex tasks that are large and diverse in scope and/or critical in nature
Design and develop breakthrough products, services or technological advancements that expand our business
Participate in code reviews, brainstorm design approaches with peers and mentor junior engineers
Work in fast paced agile environment, participate in scrum ceremonies and help ensure that the team meets sprint commitments
What you'll bring:
have 6+ years of software and/or data engineering experience
Experience with big data technologies such as Spark, Databricks, Delta lakes, Hive, etc.
4+ years of experience in core languages such as Python, Scala or Java (Preferably Python)
Hands-on experience leveraging PaaS offerings in a public cloud environment (Azure preferred)
Experience with Big Data design patterns and distributed computing tools/frameworks
Proven expertise building big data pipelines (batch processing, real-time streaming)
Working knowledge of TDD, CI/CD concepts and tools (Preferably Azure DevOps)
Advanced understanding of unit testing/integration testing/QA/Validation
Knowledge of data security and authentication protocols
Experience in areas of data governance, privacy and regulation and professional experience with architectural approaches to data security
Have experience integrating multiple data sources into a common set of data assets
Stay up to date on everything Blackbaud, follow us on Linkedin, X, Instagram, Facebook and YouTube â
Blackbaud powers social impact through purposeâdriven technology and responsible AI. Guided by our Intelligence for Good® vision, we're building a culture where innovation, trust, and human expertise come together to help organizations make a greater difference in the world.
Blackbaud is proud to be an equal opportunity employer and is committed to maintaining an inclusive work environment. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, physical or mental disability, age, or veteran status or any other basis protected by federal, state, or local law.
Similar Jobs
Senior Data Analyst
Stride
🇺🇸 Remote - VA
Staff Data Scientist
Chegg
🇮🇳 Remote - IN
Enterprise Business Intelligence and Data Governance Analyst
George Washington University
🇺🇸 Hybrid - Ashburn, VA
Director, Business Intelligence & Analytics (BIA) - USA Remote
TurnItIn
🇺🇸 Remote - TX
Director, Business Intelligence & Analytics (BIA) - USA Remote
TurnItIn
🇺🇸 Remote - IL
