Python Developer with AWS, Glue and PySpark
luxsoft
Job Summary
Support one of the top Australian banks in modernizing their data and analytics platform. This role involves working directly with IT and business stakeholders in the Data and Platform team to implement the bank's data strategy to become the best AI bank in the world. We are looking for a Software Engineer with strong experience in designing, building, and maintaining production-grade software systems, focusing on automation, quality, and resilience across the software development lifecycle.
Must Have
- Design and implement robust, scalable software solutions.
- Develop automation frameworks for performance, integration, security, and testing.
- Embed unit, integration, and contract tests into CI/CD pipelines (shift-left approach).
- Collaborate with teams to ensure testability, observability, and resilience.
- Drive quality strategy and establish engineering dashboards for delivery and production health.
- 4 to 7 years of hands-on experience.
- Programming: Python (priority), Java, Ab Initio, SAS, scripting.
- Data & Processing: AWS Glue, PySpark, Spark.
- Workflow Orchestration: Airflow.
- Database & Querying: SQL, RDBMS (Teradata, Oracle).
- Cloud: AWS (cloud-native architectures).
- Automation & AI: Test automation frameworks, AI-assisted development.
- Additional: CI/CD tools (TeamCity, GitHub, Jenkins, Octopus), Linux environments, DevSecOps practices.
- Proven ability to design and build automation frameworks.
- Familiarity with observability tools and microservices architecture.
Good to Have
- Markets domain knowledge.
- Experience dealing with complex hierarchical datasets such as those used to represent financial products in the likes of Murex/MRE/Wallstreet.
Job Description
##### Project description
Support one of the top Australian banks as they seek to modernise their data and analytics platform. You will be working directly with IT and business stakeholders in Data and Platform team to implement banks data strategy to become the best AI bank of the world.
##### Responsibilities
- We are looking for a Software Engineer with strong experience in designing, building, and maintaining production-grade software systems. The role focuses on automation, quality, and resilience across the software development lifecycle, with end-to-end ownership of features from design through deployment and monitoring.
- Key Responsibilities:
- Design and implement robust, scalable software solutions.
- Develop automation frameworks for performance, integration, security, and testing.
- Embed unit, integration, and contract tests into CI/CD pipelines (shift-left approach).
- Collaborate with teams to ensure testability, observability, and resilience.
- Drive quality strategy and establish engineering dashboards for delivery and production health.
##### Skills
Must have
- 4 to 7 years of hands-on experience.
- Skills Required:
- Programming: Python (priority), Java, Ab Initio, SAS, scripting.
- Data & Processing: AWS Glue, PySpark, Spark.
- Workflow Orchestration: Airflow.
- Database & Querying: SQL, RDBMS (Teradata, Oracle).
- Cloud: AWS (cloud-native architectures).
- Automation & AI: Test automation frameworks, AI-assisted development.
- Additional: CI/CD tools (TeamCity, GitHub, Jenkins, Octopus), Linux environments, DevSecOps practices.
- 4-7 years of hands-on programming and software development.
- Proven ability to design and build automation frameworks.
- Familiarity with observability tools and microservices architecture.
Nice to have
- Markets domain knowledge.
- Experience dealing with complex hierarchical datasets such as those used to represent financial products in the likes of Murex/MRE/Wallstreet.
##### Other
Languages
English: C2 Proficient
Seniority
Regular