Senior Data Engineer

Job Description: Data Engineer

Location: Bangalore, India

Experience: 5 +Years

About Quation Solution:

In today’s data-driven world, information is power. But raw data alone can’t fuel success. At Quation, we bridge the gap. We’re a data analytics consultancy with a purpose to empower brands like yours to unlock the true potential of their data.

We translate complex data landscapes into clear, actionable insights that inform strategic decision-making across your entire organization. We leverage cutting-edge technology and a deep understanding of your industry to ensure our solutions are tailored to your unique challenges and opportunities.

If you are a passionate and skilled Data Scientist looking for an exciting opportunity, we would love to hear from you. Apply now to join our team in Bangalore!

Feel free to customize any part of this description to better fit your needs.

In today’s data-driven world, information is power. But raw data alone can’t fuel success. At Quation, we bridge the gap. We’re a data analytics consultancy with a purpose to empower brands like yours to unlock the true potential of their data.

We translate complex data landscapes into clear, actionable insights that inform strategic decision-making across your entire organization. We leverage cutting-edge technology and a deep understanding of your industry to ensure our solutions are tailored to your unique challenges.

Job Overview

Job Role: Senior Data Engineer

Educational Background: Bachelor’s or master’s degree in computer science, Engineering, or a related field.

Experience: 5 years of experience in Data Engineering preferably in manufacturing industry and logistics, transportation process areas, with proven expertise in delivering analytics solutions. Prior consulting experience is a plus.

Technical Expertise:

• Proficient understanding of distributed computing principles.
• Data engineering implementation experience with Big Data technologies in cloud and on- prem environments.
• Proficiency with big data technologies managing large data sets, databases, data lakes and cloud-based storage.
• Expertise in managing and optimizing Spark clusters, along with other implementations of Spark.
• Strong programming skills in Python, Py-spark
• Strong proficiency in SQL and experience with relational databases (PostgreSQL, MySQL, Oracle, etc.) and NoSQL databases (MongoDB, Cassandra, DynamoDB).
• Experienced on the software development using services such as AWS Glue, S3, Lambda, Spark in hyperscaler AWS.
• Knowledge of data modeling techniques such as star/snowflake, data vault etc.,
• Knowledge of semantic modeling
• Familiarity with BI Tools such as Power BI, Oracle Analytics Cloud, etc.,
• Strong problem-solving skills - Be able to hone business acumen with a capacity for straddling between macro business strategy to micro tangible data and AI products.
• Database: AWS S3 (Landing, Bronze, Silver, Gold)
• Data Transformation: Python script
• Data Read/Write to Medallion Architecture: PySpark script
• Application DB: Postgres
• Scope: No Data Science work; primarily data cuts and variance analysis
• Skills: Strong understanding of the AWS ecosystem
• Proficiency in Python/PySpark with a good grasp of object-based structures