Siva Krishna  ·  Senior Azure Databricks Data Engineer  ·  7+ yrs

Senior
7+ years experienceremote
Available within 48 hrs

Proof of scale

3.9 million residents served
3.9 million residents served
Built for
ShellRexHubRBL BankEnbridge GasClassic Foods

About Siva

Sivakrishna is a Data Engineer with 8+ years of experience in designing and implementing data pipelines using Azure technologies. He has a strong background in optimizing Spark applications and developing solutions with PySpark.

7+ years of commercial experience in

BankingEnergy & UtilitiesFinTechManufacturing & Industrial

Skills(15)

Azure DatabricksAzure Data FactoryPySparkSQLPythonInformatica PowerCenterAzure DevOpsAzure Data Lake StorageAzure SQL DBSSMSSQL ServerShell ScriptingDataStageOracleUNIX

Why hire Siva?

Production deploy authority

Designed and implemented robust data pipelines using Azure Data Factory and Azure Databricks.

Optimized Spark applications and developed solutions using PySpark for large datasets.

Involved in Agile project delivery frameworks, requirement gathering, and design documentation.

Achieved business transformation using Data Flow, Stored Procedures, and PySpark.

Implemented CDC and SCD Type 2 for data warehousing solutions.

Regular participation in testing and data validation to ensure data integrity.

Project highlights(5)

Energy Data Pipeline – Data Engineer

Overview: Shell is an international energy company focused on exploration, production, refining, and marketing of oil, natural gas, and chemicals, leveraging advanced technologies for sustainable energy solutions. Responsibilities: Gathered requirements and created Design documents for data solutions. Developed data pipelines using Azure Databricks to read data from Azure Data Lake Storage into target Synapse for fact tables. Utilized Python and PySpark to create data frames, implement incremental date functions, and define views. Scheduled and monitored pipelines using Azure Data Factory's scheduling and tumbling triggers, resolving pipeline issues.

Azure Data FactoryAzure DatabricksPythonPySpark

Key outcomes:

  • Achieved business transformation using Data Flow, Stored Procedures, and PySpark.

  • Involved in testing and data validation.

Real Estate Data Solutions – Data Engineer

Overview: RexHub provides an online platform offering real estate appraisal management software for appraisal management companies and lenders. Responsibilities: Developed data solutions using Azure Data Factory and Azure Databricks.

Azure Data FactoryAzure Databricks

Finance Data Solutions – Data Engineer

Overview: RBL Bank is a leading private sector bank in India, offering specialized services across Corporate & Institutional Banking, Commercial Banking, Branch & Business Banking, Retail Assets, and Treasury and Financial Markets Operations. Responsibilities: Developed data solutions using Azure Data Factory and Azure Databricks.

Azure Data FactoryAzure Databricks

Project 4 – Development

  • RBL Bank is a leading private sector bank in India, offering specialized services across Corporate & Institutional Banking, Commercial Banking, Branch & Business Banking, Retail Assets, and Treasury and Financial Markets Operations.
  • Developed data solutions using Azure Data Factory, Informatica, and Azure Databricks.
Azure Data FactoryInformatica PowerCenterAzure DatabricksAzure DevOpsAzure Data Lake StorageAzure SQL DBSSMSSQL ServerPythonPySparkShell Scripting

Project 5 – Development and support

  • Classic Foods, Inc. is a family-owned manufacturer of branded snack foods, distributed throughout the United States and Canada, including Kettle Classics® Potato Chips and Stoned Classics® Tortilla Chips.
  • Designed parallel jobs using DataStage tool.
  • Applied various stages (Sequential file, Data Set, Aggregator, Remove Duplicates, Lookup, Join, Filter, Sort, Surrogate Key Generator) according to business requirements.
  • Involved in unit testing, test execution, and deployment.
  • Developed ETL processes using DataStage Tools.
DataStageSQL ServerOracleUNIXAzure Data FactoryPythonPySparkShell Scripting

Key outcomes:

  • Understood business requirements and design documents.

Industry experience

Banking

2 projects
  • •Finance Data Solutions— Data EngineerAzure Data Factory · Azure Databricks
  • •Project— DevelopmentAzure Data Factory · Informatica PowerCenter · Azure Databricks · Azure DevOps +7

Energy & Utilities

1 project
  • •Energy Data Pipeline— Data EngineerAzure Data Factory · Azure Databricks · Python · PySpark

FinTech

2 projects
  • •Finance Data Solutions— Data EngineerAzure Data Factory · Azure Databricks
  • •Project— DevelopmentAzure Data Factory · Informatica PowerCenter · Azure Databricks · Azure DevOps +7

Manufacturing & Industrial

5 projects
  • •Energy Data Pipeline— Data EngineerAzure Data Factory · Azure Databricks · Python · PySpark
  • •Real Estate Data Solutions— Data EngineerAzure Data Factory · Azure Databricks
  • •Finance Data Solutions— Data EngineerAzure Data Factory · Azure Databricks
  • •Project— DevelopmentAzure Data Factory · Informatica PowerCenter · Azure Databricks · Azure DevOps +7
  • •Project— Development and supportDataStage · SQL Server · Oracle · UNIX +4

Ready to work with Siva?

Schedule an interview and onboard within 48 hours. No long hiring cycles.

At a Glance

Experience7+ years
Work moderemote
Starting from₹1.6 L/mo
Direct hirePossible
Start within48 hours
From₹1.6 L/ month

Single contract. No agency markup confusion.

Typically responds within 4 business hours.

5-day replacement guarantee
48-hour onboarding, single invoice
Direct chat — no recruiter middleman
Seniority signals
Owns production deploysGreenfield architectSystem owner
VerifiedVetted by Witarist
Technical skills assessed & verified
Background & identity checked
English communication verified
Ready to onboard in 48 hours

Not sure if this is the right fit?

Tell us your requirements and we'll match you with the best candidates.

Siva Krishna

Azure Data Bricks