Data Engineer

Key Responsibilities:

• Design, develop, and maintain robust data pipelines using Python, SQL, and Apache Spark.
• Build and manage data workflows and ETL/ELT processes in Azure Data Factory or similar tools.
• Optimize data storage and performance using Azure Data Lake, Blob Storage, and SQL-based data warehouses (e.g., Azure Synapse).
• Collaborate with cross-functional teams to understand data needs and translate requirements into scalable solutions.
• Ensure data integrity, governance, and security across platforms.
• Monitor and troubleshoot data pipelines for failures and performance issues.
• Participate in code reviews and adhere to best practices in data engineering and software development.

Required Skills:

• Strong proficiency in Python for scripting and data processing.
• Advanced SQL skills for data manipulation, transformation, and performance tuning.
• Hands-on experience with Apache Spark (PySpark preferred).
• Deep understanding of Azure services like Data Factory, Databricks, Data Lake, Blob Storage, Synapse, etc.
• Experience with CI/CD and version control tools (e.g., Git, Azure DevOps).
• Knowledge of data modeling and data warehousing concepts.

About Statusneo :

We accelerate your business transformation by leveraging best fit CLOUD NATIVE technologies wherever feasible. We are DIGITAL consultants who partner with you to solve & deliver. We are experts in CLOUD NATIVE TECHNOLOGY CONSULTING & SOLUTIONS. We build, maintain & monitor highly scalable, modular applications that leverage elastic compute, storage and network of leading cloud platforms. We CODE your NEO transformations. #StatusNeo

Business domain experience is vital to the success of neo transformations empowered by digital technology. Experts in domain ask the right business questions to diagnose and address. Our consultants leverage your domain expertise & augment our digital excellence to build cutting edge cloud solutions.