Engineer & Data Analyst

Description

Why Ness

We know that people are our greatest asset. Our staff’s professionalism, innovation, teamwork, and dedication to excellence have helped us become one of the world’s leading technology companies. It is these qualities that are vital to our continued success. As a Ness employee, you will be working on products and platforms for some of the most innovative software companies in the world.

You’ll gain knowledge working alongside other highly skilled professionals that will help accelerate your career progression.

You’ll also benefit from an array of advantages like access to trainings and certifications, bonuses, and aids, socializing activities, and attractive compensation.

Requirements and responsibilities

We are looking for a Mid-Level Data Engineer to join our team and contribute to the development of FlowObjects Auditing & Monitoring 2.0. You will work on building robust data pipelines, integrating Snowflake and Databricks environments, and developing features that deliver performance insights and governance enhancements. This role involves developing data solutions and generating actionable insights through metadata analysis.

What you'll do

• Data Pipeline Development: Build and maintain efficient data pipelines for data ingestion, transformation, and loading, focusing on Snowflake and Databricks.
• Integration: Work on integrating Snowflake with other systems, ensuring seamless data flow and optimized performance.
• Performance Monitoring: Leverage Snowflake metadata to identify performance bottlenecks, cost-saving opportunities, and potential optimizations.
• Access Control & Security: Assist in the analysis of access control mechanisms, such as RBAC and DAC, and implement solutions for streamlining role management and enhancing security.
• Storage Optimization: Analyze and track storage usage, identifying opportunities for cost and performance optimization.
• Collaboration: Collaborate closely with architects and frontend developers to ensure the technical feasibility of new features.
• AI Integration: Work on incorporating AI-driven insights into the project for anomaly detection and trend analysis.

What you'll bring

• Experience: 3-5 years of experience in data engineering, with at least 2 years working with Snowflake and Databricks.
• Technical Skills: Strong understanding of Snowflake’s architecture, RBAC/DAC systems, Databricks, and data governance principles.
• Programming Languages: Proficiency in Python, SQL, and other relevant languages for data pipeline development.
• Metadata Handling: Experience working with metadata management and analyzing performance data.
• Cloud Experience: Hands-on experience with cloud services, preferably within Snowflake environments.
• Problem-Solving: Strong analytical and troubleshooting skills with the ability to work in a fast-paced environment.

Other preferred Skills

• Experience with AI/ML tools to generate insights from usage patterns.
• Familiarity with Snowflake’s Native App Framework.
• Knowledge of data governance tools and frameworks.
• Experience working in Agile project environments (e.g., Jira).

Not checking every single requirement?

If this role sounds good to you, even if you don’t meet every single bullet point in the job description, we encourage you to apply anyway. For most of the candidates that applied, we found a role that was a very good fit with their skills.

Let’s meet and you may just be the right candidate for one of our roles.

At Ness Digital Engineering we are willing to build a work culture that is based on diversification, inclusion, and authenticity.