Data Engineer (M4)

Posted 13 February 2025
SalaryNegotiable
LocationMelbourne
Job type Contract
DisciplineCloud & Infrastructure
Reference90M0660958_1739427006

Job description

FinXL by Randstad Digital is an innovative provider of technology-enabled business solutions and consulting services across industries such as Government, Telecommunications, Commercial, and Finance. With over 1,200 consultants across Australia, we help clients achieve competitive advantage and growth by delivering new systems, processes, and technology solutions.

We're partnering with a key client on an exciting data migration project, and we're seeking a Data Engineer to join the team. This role focuses on migrating data from on-prem applications to a new system, ensuring a smooth transition, and optimizing processes. As IT is a smaller part of the business, we're looking for someone who can handle data integration, mapping, scripting, and analysis while contributing to a collaborative, fast-paced environment.

The role requires full-time in-office attendance (Inner Melbourne CBD location) and is an initial 4-5 month contract.

Key Responsibilities:

  • Data Integration: Migrate data from on-prem applications to the new system, ensuring seamless integration.
  • Data Mapping: Analyze and map data structures to ensure compatibility between systems.
  • Python Scripting: Develop scripts to automate ETL processes, including data cleaning, validation, and aggregation.
  • Automation: Use PowerShell or Bash to automate migration tasks and manage the migration of non-structured databases, including files.
  • Data Analysis: Validate and analyze data for accuracy.
  • Collaboration: Collaborate with various teams to understand business requirements and translate them into actionable data insights.
  • Database Management: Work with MS SQL and Oracle DBA databases to ensure smooth data migration and analysis.
  • Integration: Manage data integrations, working with APIs, JSON, XML, and other integration technologies as required.

Skills & Experience required:

  • SQL Expertise: Experience with querying, transforming, and optimizing data in SQL Server, MySQL, or PostgreSQL.
  • Scripting: Proficient in Python, PowerShell, or Bash for automating migration tasks.
  • ETL Pipelines: Experience in building and maintaining ETL pipelines for data migrations.
  • SSIS: Proficient in SQL Server Integration Services.
  • Legacy Databases: Familiar with older technologies (e.g., flat files, proprietary DBs, Firebird, PSQL).
  • Batch Processing: Knowledge of data transfer and batch processing methods.
  • Cloud Platforms: Experience with Azure, AWS, or Google Cloud for data storage and migration.
  • Data Analysis: Strong skills in data cleaning and validation.
  • Storage Solutions: Familiar with Blob Storage, S3, or Data Lakes (nice to have)
  • Integrations: Experience with APIs, JSON, and XML for data integrations (nice to have)
  • On-Site Work: Comfortable with office-based work (no remote options).

If this opportunity sounds like the challenge you have been looking for please apply online today!

Please note that due to the volume of expected applications, only shortlisted individuals will be contacted.