A Azure/Pyspark Developer with a good understanding of the entire ETL/Azure lifecycle with a background of data projects.
Work you'll do
As an ETL ADF Pyspark Analyst on the Solutions Delivery-Canada team, you will be responsible for:
- Design and develop ETL systems and data integration solutions, ensuring coding standards, procedures, and techniques are followed.
- Act as a subject matter expert on development techniques and design and develop migration of data and ETL processes to Azure-based services including Logic Apps and Synapse.
- Design and develop PySpark code, implement code changes in .NET, and create technical code documentation while contributing to solution design and estimation.
- Perform unit testing, analyze and report results to pertinent teams, and troubleshoot issues reported by QA, product owners, and end users.
- Provide third-level production support and contribute to product, project, and software development life cycle practices for ETL and data-oriented projects.
The team
Solutions Delivery-Canada is an integral part of the Information Technology Services group. The principle focus of this organization is the development and maintenance of technology solutions that e-enable the delivery of Function and Marketplace Services and Management Information Systems.
Solutions Delivery Canada develops and maintains solutions built on varied technologies like Siebel, PeopleSoft Microsoft technologies and Lotus Notes. Solutions Delivery Canada has various groups which provide the best of the breed solutions to the clients by following a streamlined system development methodology. Solutions Delivery Canada comprises of groups like Usability, Application Architecture, Development and Quality Assurance and Performance.
Location: Hyderabad
Shift Timings: 2 PM to 11 PM
Qualifications
Required:
- Bachelor’s degree in Computer Science or equivalent work experience.
- 1.5-2.5 years of experience with PySpark, Azure Data Factory, and Azure services such as Logic Apps and Synapse.
- Experience designing and developing extract, transform, and load solutions and data integration workflows.
- Experience with Databricks.
- Experience with relational databases, including Microsoft SQL Server.
- Experience with cloud-based ETL services.
- Experience creating technical documentation, performing unit testing, and resolving application issues.
Preferred:
- Experience with IBM DataStage or other data integration tools.
- Knowledge of Python programming.
- Knowledge of .NET.
- Experience with web service design and development, including SOAP and XML.
- Experience with message queue design and development.
- Experience with Microsoft System Center Orchestrator.