JOB OVERVIEW
Plan A Technologies is looking for an experienced Data Engineer to join our team and help design, build, and maintain scalable data pipelines and infrastructure. The ideal candidate will have strong hands-on experience with Kafka, Google Cloud Bigtable, and modern Data Warehouse (DWH) solutions. You’ll play a key role in enabling real-time and batch data processing, optimizing data flows, and ensuring high data quality and availability across the organization. This is a fast-paced job with room for significant career growth.
Please note: you must have at least 5+ years of experience as a Data Engineer working with Kafka, Bigtable, and Data Warehouse platforms to be considered for this role.
JOB RESPONSIBILITY
Design and implement scalable data pipelines for both real-time and batch processing.
Build and manage integrations using Apache Kafka for streaming and event-driven architectures.
Develop and maintain data models and storage strategies using Google Cloud Bigtable.
Create, manage, and optimize data warehouses to support reporting, analytics, and BI.
Collaborate with data analysts, data scientists, and software engineers to ensure accessible, high-quality data.
Implement data quality monitoring, validation, and governance processes.
Optimize performance and cost-efficiency of data infrastructure.
Document architecture, processes, and workflows for future scalability.
EXPERIENCE
5+ years of proven experience as a Data Engineer working with Kafka, Bigtable, and Data Warehouse platforms.
Strong programming skills in Python, Java, or Scala.
Solid understanding of ETL/ELT processes, data partitioning, schema design, and data modeling.
Experience with cloud platforms (preferably Google Cloud Platform, AWS, or Azure).
Proficiency with SQL and working knowledge of distributed systems and data processing frameworks (e.g., Apache Beam, Spark).
Experience with Airflow, DBT, or other orchestration tools.
Familiarity with other storage solutions (e.g., Big Query, Snowflake, Redshift).
Background in data governance, data security, and compliance.
Exposure to containerization (Docker, Kubernetes) and CI/CD for data pipelines.
Ability to prioritize and work autonomously
Excellent verbal and written English communication skills.
Initiative and drive to do great things.
ABOUT THE COMPANY/BENEFITS
Plan A Technologies is an American software development and technology advisory firm that brings top-tier engineering talent to clients around the world. Our software engineers tackle custom product development projects, staff augmentation, major integrations and upgrades, and much more. The team is far more hands-on than the giant outsourcing shops, but still big enough to handle major enterprise clients.
Read more about us here: www.PlanAtechnologies.com .
Location: Work From Home 100% of the time, or come in to one of our global offices. Up to you.
Great colleagues and an upbeat work environment: You'll join an excellent team of supportive engineers and project managers who work hard but don't ever compete with each other.
Benefits: You’ll get a generous vacation schedule, Brand New Laptop, and other goodies.
If this sounds like you, we'd love to hear from you!
Get notifed when new similar jobs are uploaded