Databricks - Data Engineer (IC)

• Design, develop, and maintain scalable and efficient data pipelines using Databricks and cloud-native technologies. • Build and optimize ETL/ELT processes for structured, semi-structured, and unstructured datasets. • Develop robust data models, data quality frameworks, and monitoring solutions to ensure platform reliability. • Support advanced analytics, machine learning, AI initiatives, and enterprise reporting through high-quality data products. • Collaborate with business stakeholders and technical teams to translate requirements into scalable technical solutions. • Troubleshoot data platform issues, identify performance bottlenecks, and implement effective resolutions. • Contribute to CI/CD processes, automation initiatives, and infrastructure-as-code practices. • Ensure adherence to data governance, security, compliance, and operational best practices. • Participate in architectural discussions and drive continuous improvement across the data platform.

• Experience with Azure Databricks and the Microsoft data ecosystem. • Knowledge of Delta Lake, Unity Catalog, and Lakehouse architecture principles. • Experience with orchestration tools such as Azure Data Factory, Apache Airflow, or similar platforms. • Understanding of DevOps practices, CI/CD pipelines, and automation frameworks. • Experience developing APIs or backend services using .NET/C#. • Familiarity with Power BI or similar business intelligence tools. • Experience supporting AI, machine learning, or advanced analytics workloads. • Knowledge of containerization technologies such as Docker and Kubernetes.

You will have the opportunity to work with modern cloud technologies, large-scale datasets, and cutting-edge analytics solutions in a collaborative and innovative environment. Your contributions will directly support data-driven decision making and help shape the future of our enterprise data platform.

Job Title: Databricks - Data Engineer (IC) Job Description We're Concentrix. The intelligent transformation partner. Solution-focused. Tech-powered. Intelligence-fueled. The global technology and services leader that powers the world’s best brands, today and into the future. We’re solution-focused, tech-powered, intelligence-fueled. With unique data and insights, deep industry expertise, and advanced technology solutions, we’re the intelligent transformation partner that powers a world that works, helping companies become refreshingly simple to work, interact, and transact with. We shape new game-changing careers in over 70 countries, attracting the best talent. In our Information Technology and Global Security team, you will deliver the latest technology infrastructure, transformative software solutions and industry-leading global security for our staff and clients. You will work with the best in the world to design, implement and strategize IT, security, application development, innovation, and solutions in today’s hyperconnected world. You will be part of the technology team that is core to our vision of develop, build and run the future of Integrated Services. Our game-changers around the world have devoted their careers to ensuring every relationship is exceptional. And we’re proud to be recognized with awards such as "World's Best Workplaces," “Best Companies for Career Growth,” and “Best Company Culture,” year after year. We embrace our game-changers with open arms, people from diverse backgrounds, who are curious and willing to learn. Your natural talent to help others and go beyond WOW for our customers will fit right in with what we do and who we are. Join us and be part of this journey towards greater opportunities and brighter futures. We are seeking a talented and motivated Databricks Engineer to join our Analytics Technology team. In this role, you will design, develop, and optimize scalable data solutions that power business intelligence, advanced analytics, reporting, and AI-driven initiatives across the organization. You will work closely with data engineers, analysts, architects, software developers, and business stakeholders to deliver reliable, high-quality data products that enable data-driven decision making. The ideal candidate combines strong expertise in the Databricks Lakehouse Platform, modern cloud-based data architectures, and data engineering best practices. Experience with .NET/C# development is highly desirable and will support seamless integration between enterprise applications and modern data platforms. This is an excellent opportunity for a data professional who enjoys solving complex business challenges, building scalable solutions, and contributing to the evolution of a modern analytics ecosystem. Key Responsibilities: • Design, develop, and maintain scalable and efficient data pipelines using Databricks and cloud-native technologies. • Build and optimize ETL/ELT processes for structured, semi-structured, and unstructured datasets. • Develop robust data models, data quality frameworks, and monitoring solutions to ensure platform reliability. • Support advanced analytics, machine learning, AI initiatives, and enterprise reporting through high-quality data products. • Collaborate with business stakeholders and technical teams to translate requirements into scalable technical solutions. • Troubleshoot data platform issues, identify performance bottlenecks, and implement effective resolutions. • Contribute to CI/CD processes, automation initiatives, and infrastructure-as-code practices. • Ensure adherence to data governance, security, compliance, and operational best practices. • Participate in architectural discussions and drive continuous improvement across the data platform. Required Qualifications: • Bachelor's degree in Computer Science, Information Systems, Engineering, or a related discipline, or equivalent practical experience. • Hands-on experience with Databricks and modern data engineering methodologies. • Strong experience developing data pipelines using Python, Spark, and PySpark. • Experience working with cloud platforms, preferably Microsoft Azure. • Strong SQL skills and understanding of data warehousing concepts. • Experience with source control and collaboration tools such as Git. • Knowledge of data modeling, performance optimization, and data quality management. • Strong analytical, troubleshooting, and problem-solving skills. • Excellent communication skills and the ability to work effectively within global teams. • Ability to work independently with minimal supervision and translate business requirements into technical solutions. Preferred Qualifications: • Experience with Azure Databricks and the Microsoft data ecosystem. • Knowledge of Delta Lake, Unity Catalog, and Lakehouse architecture principles. • Experience with orchestration tools such as Azure Data Factory, Apache Airflow, or similar platforms. • Understanding of DevOps practices, CI/CD pipelines, and automation frameworks. • Experience developing APIs or backend services using .NET/C#. • Familiarity with Power BI or similar business intelligence tools. • Experience supporting AI, machine learning, or advanced analytics workloads. • Knowledge of containerization technologies such as Docker and Kubernetes. Technical Environment Data & Analytics • Databricks • Azure Databricks • PySpark • Spark SQL • Delta Lake • Unity Catalog • SQL • Python Cloud & Data Integration • Microsoft Azure • Azure Data Factory • Azure Storage Development & DevOps • Git • Azure DevOps • CI/CD • .NET • C# • REST APIs Modern Platform Technologies • Docker • Kubernetes • Power BI What Success Looks Like: • Delivering scalable, reliable, and high-performing data solutions that drive business insights. • Improving data pipeline performance, quality, and operational efficiency. • Promoting engineering best practices, automation, and govern