Quation Solution - Consultant – Data engineer

7 Minutes ago • 2-3 Years • Data Analysis

Job Summary

Job Description

We are seeking a skilled and passionate Data Engineer to join our team. This role involves designing, developing, and maintaining data infrastructure, ensuring smooth data flow, and enabling data-driven decision-making. Responsibilities include building and optimizing data pipelines using SQL and Python with Apache Airflow, developing ETL processes, implementing data quality checks, and collaborating with data analysts and scientists. The ideal candidate will have 2-3 years of experience and strong proficiency in relevant technologies.
Must have:
  • Design, build, and maintain data pipelines using SQL and Python.
  • Utilize Apache Airflow for data orchestration, scheduling, and monitoring.
  • Develop and implement ETL processes and data quality checks.
  • Collaborate with data analysts and scientists on data solutions.
  • Optimize data pipelines for performance and scalability.
  • Document data pipelines and contribute to data governance.
  • Bachelor's degree in Computer Science or related field.
  • 2-3 years of experience as a Data Engineer.
  • Proficiency in SQL and Python (Pandas, NumPy, Dask, Airflow).
  • Familiarity with cloud platforms (AWS, Azure, GCP) and data warehousing (Snowflake, Redshift).
  • Strong analytical, problem-solving, communication, and documentation skills.
Good to have:
  • Experience with data visualization tools (Tableau, Power BI)

Job Details

JOB DESCRIPTION

We are looking for a skilled and passionate Data Engineer to join our growing team. As a Data Engineer, you will play a critical role in designing, developing, and maintaining our data infrastructure, ensuring the smooth flow of data and enabling data-driven decision-making across the organization.

Responsibilities:

  • Design, build, and maintain efficient and reliable data pipelines using SQL and Python, leveraging tools like Apache Airflow for orchestration.
  • Develop ETL (Extract, Transform, Load) processes to move data between various sources and destinations.
  • Implement data quality checks and validation routines to ensure data accuracy and integrity.
  • Collaborate with data analysts and scientists to understand their data needs and translate them into actionable data solutions.
  • Optimize existing data pipelines for performance and scalability using Airflow's features for monitoring and optimization.
  • Develop and maintain documentation for data pipelines and processes, including Airflow workflows.
  • Contribute to the development and maintenance of data governance policies.
  • Stay up-to-date with the latest trends and technologies in the data engineering field, including advancements in orchestration tools like Airflow.

Qualifications:

  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • 2-3 years of experience as a Data Engineer or in a similar role.
  • Strong proficiency in SQL for data querying, manipulation, and analysis.
  • Excellent programming skills in Python, including experience with data manipulation libraries (Pandas, NumPy) and data engineering libraries (Dask, Airflow).
  • Proficiency in using Apache Airflow for data pipeline orchestration, scheduling, and monitoring.
  • Familiarity with cloud platforms (AWS, Azure, GCP) and data warehousing solutions (Snowflake, Redshift).
  • Experience with data visualization tools (Tableau, Power BI) is a plus.
  • Ability to work independently and as part of a team.
  • Strong analytical and problem-solving skills.
  • Excellent communication and documentation skills

About Quation

We specialize in delivering synergistic solutions that enable businesses to make informed decisions. With 200+ years of cumulative experience, our leaders strive to create customized solutions that empower Fortune companies to make better decisions. We deliver tangible and measurable benefits through advanced analytics solutions.

Quation is a forward-thinking organization that is committed to delivering high-quality services to its clients. We are known for our expertise in specialized fields viz. Technology, Supply Chain Analytics, Data Engineering, Data Warehousing, and Marketing Analytics.

Our goal is to help businesses achieve their objective by providing them with the tools, information, and resources that they need to succeed. Quation provides exceptional customer service and builds long-term relationships.

Data is an asset! When harnessed, it effectively enhances performance, fosters efficiency, and accelerates growth in real-time.

At Quation, we believe that the field of analytics is constantly evolving. To stay abreast with the latest trends and technologies, we make significant investments in learning and development.

With deep domain expertise and core technical knowledge, our products and services provide our customers with a vital competitive edge. We create a world where understanding the complex intricacies of businesses becomes easier.

Our USP is our ability to leverage artificial intelligence to help businesses solve complex problems and make data-driven decisions. We analyze vast amounts of data quickly and accurately, providing insights that would be difficult or impossible to obtain through traditional methods.

We help businesses automate processes, improve efficiency, reduce costs, and gain a competitive advantage in the marketplace.

Similar Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Similar Skill Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Jobs in Bengaluru, Karnataka, India

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Data Analysis Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

About The Company

Web3 and AI based next generation hiring platform

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (Remote)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

View All Jobs

Get notified when new jobs are added by NextHire

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug