Data Engineer

Data Engineer

Location:
Southbank 3006, Melbourne, Victoria
Address
Southbank 3006, Melbourne, Victoria

Description



Posted 29 June 2022
SalaryNegotiable
LocationSouthbank
Job type Contract
DisciplineCloud + Infrastructure, IT General
ReferenceBBBH257117_1656478094


Job description

As a Data Engineer your role will be
Utilising Scala and Apache Spark on AWS EMR to process large transaction volumes.
Leveraging Apache Spark to run Business Rules on past transactions.
Designing and implementing Kafka streaming services using Scala to enrich and transform data for business use cases.
Experience
About 5 years' experience in data practices (2 to 3 years in cloud-based technologies) - ETL
Experience in conceptual, logical, and physical data models
Experience with Cloud Technologies (AWS ecosystem - S3, ECS, EC2, Lambda, Step Functions).
Experience in Cloud based Databases - SQL, NoSql (DynamoDB, Redshift, Neo4J, RDS).
Experience with Data Streaming technologies - Kafka.
Demonstrated experience in successful delivery of a complex development of work.
Experience in Agile/Scrum methodologies



To be considered for the role or for more information about this and other opportunities please contact Yash Jain on 03 8680 4238 or email and quote the above job reference number.

Paxus values diversity and welcomes applications from Indigenous Australians, people from diverse cultural and linguistic backgrounds and people living with a disability. If you require an adjustment to the recruitment process please contact me on the above contact details.


no -- Principals only. Recruiters, please don’t contact this job advertiser.
no -- Please, no phone calls about this job!
no -- Reposting this message elsewhere is NOT OK.


Reports of intellectual property infringement or improper use of images or data (for example telephone, e-mail, names and addresses) can be notified to the e-mail address info@fastiko.au

To report cases of content deemed illegal or abusive, you can send an email to info@fastiko.au