Senior Data Engineer
Job Summary
Job Description
As a Senior Data Engineer, you will be responsible for delivering end-to-end data and analytics capabilities. This includes data ingest, transformation, data science, and data visualization. You will design and deploy databases and data pipelines. Furthermore, you will develop scalable workflows. The role involves documenting issues, solutions, findings, and recommendations. You'll need to apply tools and technologies like Python, Spark, and AWS. Performance optimization for queries and dashboards, and delivering briefings to stakeholders are also key responsibilities. Analyze client data and systems. Test data pipelines, datasets, and reports. Develop and communicate solutions and present solutions to both business and technical stakeholders. You will also provide end-user support.
Must have:
- Expert experience in SQL, Python, and PySpark.
- Experience in data and analytics technologies.
- Knowledge of CI/CD and related tools such as Gitlab.
- Experience in AWS services.
- Solid scripting skills (e.g., bash/shell scripts, Python).
Good to have:
- Other programming languages (R, Scala, SAS, Java).
- Exposure to Snowflake and Airflow.
- Experience with agile delivery methodologies.
- AWS Solutions Architect/Developer/Data Analytics certifications.
15 skills required
Job Details
Data Engineer Responsibilities :
- Deliver end-to-end data and analytics capabilities, including data ingest, data transformation, data science, and data visualization in collaboration with Data and Analytics stakeholder groups
- Design and deploy databases and data pipelines to support analytics projects
- Develop scalable and fault-tolerant workflows
- Clearly document issues, solutions, findings and recommendations to be shared internally & externally
- Learn and apply tools and technologies proficiently, including:
- Languages: Python, PySpark, ANSI SQL, Python ML libraries
- Frameworks/Platform: Spark, Snowflake, Airflow, Hadoop , Kafka
- Cloud Computing: AWS
- Tools/Products: PyCharm, Jupyter, Tableau, PowerBI
- Performance optimization for queries and dashboards
- Develop and deliver clear, compelling briefings to internal and external stakeholders on findings, recommendations, and solutions
- Analyze client data & systems to determine whether requirements can be met
- Test and validate data pipelines, transformations, datasets, reports, and dashboards built by team
- Develop and communicate solutions architectures and present solutions to both business and technical stakeholders
- Provide end user support to other data engineers and analysts
Candidate Requirements :
- Expert experience in the following[Should have/Good to have]:
- SQL, Python, PySpark, Python ML libraries. Other programming languages (R, Scala, SAS, Java, etc.) are a plus
- Data and analytics technologies including SQL/NoSQL/Graph databases, ETL, and BI
- Knowledge of CI/CD and related tools such as Gitlab, AWS CodeCommit etc.
- AWS services including EMR, Glue, Athena, Batch, Lambda CloudWatch, DynamoDB, EC2, CloudFormation, IAM and EDS
- Exposure to Snowflake and Airflow.
- Solid scripting skills (e.g., bash/shell scripts, Python)
- Proven work experience in the following:
- Data streaming technologies
- Big Data technologies including, Hadoop, Spark, Hive, Teradata, etc.
- Linux command-line operations
- Networking knowledge (OSI network layers, TCP/IP, virtualization)
- Candidate should be able to lead the team, communicate with business, gather and interpret business requirements
- Experience with agile delivery methodologies using Jira or similar tools
- Experience working with remote teams
- AWS Solutions Architect / Developer / Data Analytics Specialty certifications, Professional certification is a plus
- Bachelor Degree in Computer Science relevant field, Masters Degree is a plus
Similar Jobs
Looks like we're out of matches
Set up an alert and we'll send you similar jobs the moment they appear!
Similar Skill Jobs
Looks like we're out of matches
Set up an alert and we'll send you similar jobs the moment they appear!
Jobs in Thiruvananthapuram, Kerala, India
Looks like we're out of matches
Set up an alert and we'll send you similar jobs the moment they appear!
Similar Category Jobs
Looks like we're out of matches
Set up an alert and we'll send you similar jobs the moment they appear!
About The Company
Forescout delivers automated cybersecurity across the digital terrain. We empower our customers to achieve continuous alignment of their security frameworks with their digital realities, across all asset types – IT, IoT, OT, and IoMT. It is a non-stop journey, managing cyber risk through automation and data-powered insights. For more information, please visit www.forescout.com.
Get notified when new jobs are added by forescout
