Primary Skills

--------------------

Language: Python, PySpark, SQL (advanced), Scala (nice to have)

Database: Relational (Oracle, Postgres,e tc. ), NoSQL (MongoDB, Cassandra. Etc)

Tools: Spark, Databricks, Hadoop, Kafka, Airflow, Apache NiFi (any 2 – 3)

Cloud Platforms: AWS, or Azure or GCP

Reporting Tools: PowerBI, Tableau, Etc.

Others: CICD, Git, Data Pipelines, Performance Optimization, etc.

AI / ML: Must be trained in AI Augmented development using Copilot & Other LLMs. Should be comfortable adopting GenAI in all phase of SDLC.

Advanced troubleshooting skills & Experience with logging and monitoring tools like Kibana to trace logs of microservices/APIs for interactions between external systems.

Developer lead

AWS Airflow, Apache Airflow,Azure Databricks,BPM,Microsoft Azure Databricks,Python,SQL,Spark,business administration,business organization,data analysis,data processing,data querying,data science,data science solutions,information technology,management,programming,software development,technology,web application,web application frameworks,web applications

development, workflow management system