Data Engineer

2 Months ago • 5 Years +
Data Analysis

Job Description

Plan A Technologies is seeking an experienced Data Engineer to design, build, and maintain scalable data pipelines and infrastructure. The role requires strong hands-on experience with Kafka, Google Cloud Bigtable, and modern Data Warehouse (DWH) solutions. You will be instrumental in enabling real-time and batch data processing, optimizing data flows, and ensuring high data quality and availability. This is a fast-paced position with opportunities for significant career growth.
Good To Have:
  • Working knowledge of distributed systems
  • Experience with data processing frameworks (Spark, Beam)
  • Experience with Airflow, DBT
  • Familiarity with Big Query, Snowflake, Redshift
  • Background in data governance
  • Exposure to Docker, Kubernetes
  • Exposure to CI/CD for data pipelines
Must Have:
  • 5+ years as Data Engineer
  • Experience with Kafka
  • Experience with Google Cloud Bigtable
  • Experience with Data Warehouse platforms
  • Strong Python, Java, or Scala skills
  • Solid ETL/ELT understanding
  • Proficiency with SQL
  • Experience with cloud platforms (GCP, AWS, Azure)
Perks:
  • Generous vacation schedule
  • Brand New Laptop

Add these skills to join the top 1% applicants for this job

communication
apache-beam
aws
azure
apache-kafka
spark
google-cloud-platform
ci-cd
docker
kubernetes
python
sql
scala
java

JOB OVERVIEW

Plan A Technologies is  looking for an experienced Data Engineer to join our team and help design, build, and maintain scalable data pipelines and infrastructure. The ideal candidate will have strong hands-on experience with Kafka, Google Cloud Bigtable, and modern Data Warehouse (DWH) solutions. You’ll play a key role in enabling real-time and batch data processing, optimizing data flows, and ensuring high data quality and availability across the organization. This is a fast-paced job with room for significant career growth. 


Please note: you must have at least 5+ years of experience as a Data Engineer working with Kafka, Bigtable, and Data Warehouse platforms to be considered for this role.

 


JOB RESPONSIBILITY

  • Design and implement scalable data pipelines for both real-time and batch processing.

  • Build and manage integrations using Apache Kafka for streaming and event-driven architectures.

  • Develop and maintain data models and storage strategies using Google Cloud Bigtable.

  • Create, manage, and optimize data warehouses to support reporting, analytics, and BI.

  • Collaborate with data analysts, data scientists, and software engineers to ensure accessible, high-quality data.

  • Implement data quality monitoring, validation, and governance processes.

  • Optimize performance and cost-efficiency of data infrastructure.

  • Document architecture, processes, and workflows for future scalability.



EXPERIENCE

  • 5+ years of proven experience as a Data Engineer working with Kafka, Bigtable, and Data Warehouse platforms.

  • Strong programming skills in Python, Java, or Scala.

  • Solid understanding of ETL/ELT processes, data partitioning, schema design, and data modeling.

  • Experience with cloud platforms (preferably Google Cloud Platform, AWS, or Azure).

  • Proficiency with SQL and working knowledge of distributed systems and data processing frameworks (e.g., Apache Beam, Spark).

  • Experience with Airflow, DBT, or other orchestration tools.

  • Familiarity with other storage solutions (e.g., Big Query, Snowflake, Redshift).

  • Background in data governance, data security, and compliance.

  • Exposure to containerization (Docker, Kubernetes) and CI/CD for data pipelines.

  • Ability to prioritize and work autonomously

  • Excellent verbal and written English communication skills.

  • Initiative and drive to do great things.



ABOUT THE COMPANY/BENEFITS

Plan A Technologies is an American software development and technology advisory firm that brings top-tier engineering talent to clients around the world. Our software engineers tackle custom product development projects, staff augmentation, major integrations and upgrades, and much more. The team is far more hands-on than the giant outsourcing shops, but still big enough to handle major enterprise clients.

Read more about us here: www.PlanAtechnologies.com .

Location: Work From Home 100% of the time, or come in to one of our global offices. Up to you.

Great colleagues and an upbeat work environment: You'll join an excellent team of supportive engineers and project managers who work hard but don't ever compete with each other.

Benefits: You’ll get a generous vacation schedule, Brand New Laptop, and other goodies.


If this sounds like you, we'd love to hear from you!

Set alerts for more jobs like Data Engineer
Set alerts for new jobs by plana technologies
Set alerts for new Data Analysis jobs in Costa Rica
Set alerts for new jobs in Costa Rica
Set alerts for Data Analysis (Remote) jobs

Contact Us
hello@outscal.com
Made in INDIA 💛💙