Databricks Engineer (Perm)

Job Title
Databricks Engineer (Perm)
Location
Remote
Overview / Role Summary
We are a fast-growing technology company dedicated to building a cloud-based platform that facilitates complex, data-intensive business processes on a global scale. Our systems manage large volumes of structured financial and operational data across various regions and regulatory environments. We are currently seeking a Databricks Engineer to join our dynamic team. This full-time role offers an exciting opportunity to design, build, and maintain a cutting-edge data lakehouse platform, with a focus on enhancing performance and reliability in current production workloads.
Benefits / Value Proposition

• Competitive compensation and benefits package
• Opportunities for professional growth and development
• Collaborative and innovative work environment
• Flexibility to work remotely

Key Responsibilities

• Data Architecture & Design:
  
  • Analyze existing data models and database workloads to identify performance and scalability issues.
  • Design and implement a modern lakehouse architecture using Databricks.
  • Architect scalable data storage and processing solutions leveraging the Azure ecosystem.
  • Define long-term data architecture standards and best practices.
• Technical Implementation:
  
  • Build data ingestion pipelines from PostgreSQL systems and external sources.
  • Optimize .NET-based data access layers for existing databases.
  • Develop high-performance analytical and reporting query APIs.
  • Design and optimize ETL/ELT workflows to ensure effective data transformation and processing.
• System Integration:
  
  • Integrate the lakehouse with existing applications and enterprise systems.
  • Ensure data consistency, correctness, and quality across all systems.
• Testing, Documentation & Compliance:
  
  • Conduct load, performance, and consistency testing under increasing data volumes.
  • Document data architecture, pipelines, and operational procedures.
  • Support audits, certifications, and internal compliance processes.

Required Experience & Skills

• Professional Experience:
  
  • Minimum of 6+ years in data engineering or related roles.
  • At least 4+ years of hands-on experience with Microsoft Azure data services.
  • Proven track record in delivering high-performance data platforms on Azure, especially with Databricks.
  • Strong experience with PostgreSQL, Azure Data Factory, and data processing solutions.
• Technical Skill Set:
  
  • Extensive knowledge of the Azure data platform including Azure Synapse, Azure Data Factory, and Azure Storage.
  • Advanced .NET Core development capabilities.
  • Strong SQL skills with demonstrated experience in database performance optimization.
  • Solid understanding of data modeling concepts tailored for analytical and operational use cases.

Dealbreakers (Non-Negotiable Requirements)

• Legal work eligibility.
• Mandatory experience in data engineering roles.
• Required 4+ years of hands-on experience with Microsoft Azure data services and Databricks.
• Essential technical capability in PostgreSQL and Azure Data Factory.

Desirable / Nice-to-Have Skills

• Experience with Spark-based analytics and large-scale data processing.
• Familiarity with regulated or sovereign data environments.
• Background in finance, analytics, or other data-driven fields.
• Experience in high-growth or scaling product teams.

Application Call to Action
Are you ready to leverage your expertise in a fast-paced, innovative environment? If you meet the qualifications and are passionate about data engineering, we invite you to apply today! Join us as we shape the future of data-driven solutions!