Data Engineer

Data Engineer
Location:
Southbank 3006, Melbourne, Victoria
Address
Southbank 3006, Melbourne, VictoriaDescription
Posted 29 June 2022
SalaryNegotiable
LocationSouthbank
Job type Contract
DisciplineCloud + Infrastructure, IT General
ReferenceBBBH257117_1656478094
Job description
As a Data Engineer your role will be
Utilising Scala and Apache Spark on AWS EMR to process large transaction volumes.
Leveraging Apache Spark to run Business Rules on past transactions.
Designing and implementing Kafka streaming services using Scala to enrich and transform data for business use cases.
Experience
About 5 years' experience in data practices (2 to 3 years in cloud-based technologies) - ETL
Experience in conceptual, logical, and physical data models
Experience with Cloud Technologies (AWS ecosystem - S3, ECS, EC2, Lambda, Step Functions).
Experience in Cloud based Databases - SQL, NoSql (DynamoDB, Redshift, Neo4J, RDS).
Experience with Data Streaming technologies - Kafka.
Demonstrated experience in successful delivery of a complex development of work.
Experience in Agile/Scrum methodologies
To be considered for the role or for more information about this and other opportunities please contact Yash Jain on 03 8680 4238 or email and quote the above job reference number.
Paxus values diversity and welcomes applications from Indigenous Australians, people from diverse cultural and linguistic backgrounds and people living with a disability. If you require an adjustment to the recruitment process please contact me on the above contact details.
no -- Principals only. Recruiters, please don’t contact this job advertiser.
no -- Please, no phone calls about this job!
no -- Reposting this message elsewhere is NOT OK.
Placed or Updated:
- Category: Other vacancies
- ID: 13403
0views
⚠ Never send money to anyone you have only communicated with online or by phone!