Job Descriptions :
We are seeking a highly skilled Senior Python Developer with expertise in Data Engineering, Databricks, Machine Learning (ML), and Large Language Models (LLMs). The ideal candidate will have strong hands-on experience in building data pipelines, optimizing data workflows, and deploying ML models in production environments. You will work closely with data scientists, ML engineers, and software developers to build scalable and high-performance AI-driven solutions.
Qualifications :
- Design, develop, and maintain scalable ETL/ELT pipelines for processing structured and unstructured data.
- Optimize Apache Spark workflows on Databricks for high-performance data transformations.
- Work with Delta Lake, Data Lakes, and Warehouses for efficient data storage and processing.
- Integrate Databricks with cloud services (AWS, Azure, GCP) for end-to-end data pipelines.
- Automate data ingestion, transformation, and validation processes.
- Design and develop end-to-end ML pipelines, including data preprocessing, feature engineering, model training, and evaluation.
- Implement and fine-tune Large Language Models (LLMs) using frameworks like Hugging Face, OpenAI, LangChain.
- Deploy, monitor, and optimize ML models in production, ensuring scalability and efficiency.
- Implement MLOps practices for model versioning, retraining, and performance tracking.
- Utilize NLP techniques, including text embeddings, summarization, text generation, and vector search for AI-driven applications.
Job Location : Jaipur
Job Type : Full Time