SimpleCareer

Data Engineer - Databricks

Celebal Technologies
Brisbane, AustraliaData Engineer$125k–$235kPosted Jul 27, 2026
ApplyView on SimpleCareer

Data Engineer - Databricks

Celebal Technologies Brisbane, Queensland, Australia

Data Engineer - Databricks

Celebal Technologies Brisbane, Queensland, Australia 1 day ago Be among the first 25 applicants

See who Celebal Technologies has hired for this role

No longer accepting applications

Direct message the job poster from Celebal Technologies

Abhilesh Mangal

Abhilesh Mangal

Talent Acquisition Leader | Architect of High-Performing Global Teams | Software Development & Tech Hiring Strategist

Description:

We are seeking a highly skilled and experienced Senior Data Engineer to join our team. The

ideal candidate will have a strong background in data engineering, with a focus on working with

Databricks, PySpark, Scala-Spark, and advanced SQL. This role requires hands-on experience in

implementing or migrating projects to Unity Catalog, optimizing performance on Databricks

Spark, and orchestrating workflows using various tools.


Key Responsibilities:

• Data engineering and analytics project delivery experience – Min. 2+ years

• Minimum one project done in past of Databricks Migration (Ex. Hadoop to Databricks, Teradata to Databricks, Oracle to Databricks, Talend to Databricks etc)

• Hands on with Advanced SQL and Pyspark and/or Scala Spark

• Design, develop, and optimize data pipelines and ETL processes using Databricks and Apache

Spark.

• Implement and optimize performance on Databricks Spark, ensuring efficient data processing

and management.

• Develop and validate data formulation and data delivery for Big Data projects.

• Collaborate with cross-functional teams to define, design, and implement data solutions that

meet business requirements.

• Conduct performance tuning and optimization of complex queries and data models.

• Manage and orchestrate data workflows using tools such as Databricks Workflow, Azure Data

Factory (ADF), Apache Airflow, and/or AWS Glue.

• Maintain and ensure data security, quality, and governance throughout the data lifecycle


Technical Skills:

• Extensive experience with PySpark and Scala-Spark.

• Advanced SQL skills for complex data manipulation and querying.

• Proven experience in performance optimization on Databricks Spark across at least three

projects.

• Hands-on experience with data formulation and data delivery validation in Big Data projects.

• Experience in data orchestration using at least two of the following: Databricks Workflow,

Azure Data Factory (ADF), Apache Airflow, AWS Glue.


Preferred Qualifications:

• Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform.

• Familiarity with data governance and data security best practices.

• Experience with other Big Data technologies and frameworks is a plus

  • Seniority level

    Mid-Senior level

  • Employment type

    Full-time

  • Job function

    Information Technology

  • Industries

    IT Services and IT Consulting

Referrals increase your chances of interviewing at Celebal Technologies by 2x

See who you know

Get notified about new Data Engineer jobs in Brisbane, Queensland, Australia.

Sign in to create job alert

Similar jobs

People also viewed

Similar Searches

Only part of this posting is shown here. Read the full description

Want jobs like this matched to you?

SimpleCareer scores fresh postings against your résumé so you only see the matches that matter.

Get started free