Databricks Developer

Mandatory skills:  Databricks, ADF, Pyspark and SQL

Working with multiple stakeholders, tools and workflows

Analysing and providing most reliable data on time for various review process

Demystify the process complexity and identify simplification opportunities

Experience with Azure: ADLS, Databricks, Stream Analytics, SQL DW, COSMOS DB, Analysis Services, Azure Functions, Serverless Architecture,?ARM Templates

Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.

Experience with object-oriented/object function scripting languages: Python, SQL, Scala, Spark-SQL  etc.

Nice to have experience with big data tools: Hadoop, Spark, Kafka, etc.

Nice to have experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.

Nice to have experience with stream-processing systems: Storm

Database: SQL DB

Programming languages: PL/SQL, Spark SQL

Data Warehousing experience with strong domain knowledge & experience working as a Technical lead

Azure: Azure data factory,  ADLS- Azure data lake store, Azure data bricks.