AI Engineering

AI/ML Development: Design, develop, and deploy machine learning models, LLMs, and AI workflows within the Databricks environment. Data Pipeline Engineering: Build scalable, efficient Delta Lake pipelines using PySpark and Python to ingest, clean, and preprocess large-scale datasets for AI applications. MLOps Implementation: Set up and manage the ML lifecycle using MLflow for model tracking, versioning, deployment, and monitoring. Optimization & Performance: Optimize PySpark jobs, Databricks clu…