DysrupIT is actively seeking an experienced Databricks Developer specializing in Unity Catalog Migration for a high-paying, fully remote position based in Australia. As companies migrate to decentralized data meshes, the demand for specialized engineers who can migrate legacy metastores to Databricks Unity Catalog has skyrocketed. If you are a remote tech professional looking to leverage your cloud data warehousing expertise, this role offers the perfect blend of technical ownership and work-from-home flexibility.
Role Overview & Key Responsibilities / Stellenübersicht / نظرة عامة على الوظيفة
In this role, you will lead the strategic migration of data assets, schemas, and permissions to Databricks Unity Catalog. You will work closely with security and data governance teams to ensure seamless transition without interrupting live business intelligence pipelines.
- Data Governance: Design and configure metastores, catalogs, schemas, and tables using Unity Catalog.
- Migration Execution: Migrate legacy workspaces, external tables, and mounts to the new governance framework.
- Optimization: Refactor PySpark, Scala, and SQL scripts to align with Unity Catalog best practices.
- Collaboration: Act as the primary technical point of contact for remote stakeholders across Australia.
Requirements / Anforderungen / المتطلبات
To succeed in this role, you should have a solid background in data engineering and direct experience with modern cloud infrastructure.
- Strong experience with Databricks platform administration and workspace setup.
- Proven hands-on experience executing at least one full-scale Unity Catalog migration.
- Advanced knowledge of SQL, Python, PySpark, and cloud platforms (AWS, Azure, or GCP).
- Familiarity with data security standards, row-level filtering, and column-level masking.
How to Apply / Bewerbungsverfahren / كيف تتقدم للطلب
If you are ready to take on this challenge, please submit your updated resume and a brief cover letter outlining your migration experience to careers@dysrupit.com with the subject line "Databricks Developer - Unity Catalog".
Related: For professionals looking to streamline their remote lifestyle and optimize enterprise deals, read more here: The Global Professional’s Suite: Secure Enterprise SaaS Deals & Premium Travel Perks | Die Suite für Global Professionals: Sichere Enterprise-SaaS-Deals & Premium-Reisevorteile.