Sr. Consultant/Sr. Data Engineer/Data Scientist

Description

SKILLS

Data Science/Data Analytics - 3 Years
R/Python - 3 Years
Data warehousing - 10 Years
ETL (IBM Datastage) - 7.5 Years
Oracle/DB2/SQL Server SQL - 10 Years
Big Data (Hadoop, Hive, Spark, Scala, Sqoop) - 3 Years
Data Modelling - 1 Year
Tableau - 3 Years

Main Skills

Other Skills

Data warehousing

Tableau

code migration

Oracle

Hadoop

Datastage

SQL queries

Oracle SQL

MS SQL Server

Sqoop

Data Architect

Python

Spark

SQL

ETL

Star schema

Azure SQL

Toad Data Modeler

db2

UNIX

data warehouse architecture

Analytics

Scala

XGBoost

Hive

Data Engineer

Naïve Bayes

performance tuning

OBIEE

Data Analytics

Databases

Azure

SQL Server

AWS

Salesforce

UAT

Big Data

Cloud

user documentation

Netezza

Work & Experience

01.12.2015 — Now

PROJEKTHISTORIE; Deloitte Consulting USI

Sr. Consultant/Data Engineer/Data Scientist

Deloitte Consulting USI * Hyderabad * Leading a team of 20+ individuals. * Architecting & designing of integrating 9 Source Systems with 300 tables having different data transformations using 1 Generic Spark & Scala Code in Hadoop. * Implemented the creation of feature sets on the ingested data using Datasets in Spark & Scala. * Architecting the Azure environment & Created Standards for Project. * Predicted Telecom Customer Churn for a Telecom Company for 70000+ customer's data. Identified best model out of KNN, Naïve Bayes, Logistic, and SVM. Final prediction accuracy was 82.2%. * Predicted Engagement Analytics for a Telecom Company for 70000+ customer's data. Identified best model out of Naïve Bayes, Logistic and Random Forest. Final prediction accuracy was 81.1%. Used Lift and Gain Chart to showcase the cost difference due to analytics to Business. * ML on Fraud Detection Model: Created model to reduce fraud by 50% by using Random forest on credit history data of customers. * Involved in Acquisition Analytics project for a banking firm. The project was to predict the response and find the optimal customers and increase the conversion rate and reduce the overall conversion cost. Used Logistic Regression, Random Forest and XGBoost with Gain and Lift chart for optimal cost. * Created Data Models for Azure SQL DB Databases using Toad Data Modeler. * Creating different reports using Tableau for client presentation.

01.07.2011 — 31.12.2015

Cognizant Technology Solutions India PVT Ltd

Technical Specialist

Cognizant Technology Solutions India PVT Ltd * Hyderabad * Lead a team of 10 to complete project development on Hadoop & its ecosystem tools like Hive, Sqoop, and Spark. * ML on Rail-Wagon project for Canadian National Railways to predict the possibility of rail engine failure based on available sensor data & secondly to predict the faulty component with an accuracy of 75%. Identified best model out of KNN, Naïve Bayes, Logistic, and SVM. * Implemented BI Solutions using IBM Datastage on Hadoop. Creation of reusable generic Datastage Jobs & UNIX Scripts. * Implemented complex business requirements, Hierarchy architecture & performance tuning. * Involved in creating Tableau Reports on Salesforce Data using filters, actions, labels etc. * Have done POC (Proof of Concept) on connectivity to Cloud based solutions (Salesforce, Azure & AWS) from IBM Datastage.

01.12.2009 — 31.07.2011

HSBC GLT India

Software Engineer

HSBC GLT India * Hyderabad * Participated in the requirement gathering and feasibility analysis process of the project, understanding the source data and integration of the source data * Designed & testing of complex Datastage requirement for Account Opening project of HSBC. * Conversion of complex DB stored procedure to Datastage Jobs. * Responsible for END to END of the Project Development & support. * Responsible from interacting with Client, evaluating the data in different source system & integrating them & creating Technical requirement document. * Responsible of Design & Development of Datastage Jobs, Scheduling, Performing Check Standard & Deployment of Jobs to Production. * Involved in design of dimensional data model - Star schema and Snow Flake Schema * Worked SCDs to populate Type I and Type II slowly changing dimension tables from several operational source files * Implemented multi-node declaration using configuration files APT_Config_file for performance enhancement. * Repartitioned job flow by determining DataStage PX best available resource consumption. * Involved in the creation of a Number of Generic Jobs to increase re-usability. * Created a number of UNIX & Batch scripts for Automation like CheckStandard Script, Load Netezza Script, Performance Tuning Script etc. * Alone Responsible for Integration Testing using Generic Compare Jobs. * Applied Optimization Techniques for the better performance of the reports.

01.10.2007 — 31.12.2009

HCL Technologies

Software engineer

HCL Technologies * Chennai * Skilled with Datastage & worked alongside with Business team, bridging the gap between business and ETL team for successful deliverables. * Interacted with the BAs in order to prepare and finalize the Functional Specs for different sources system and countries & timely closure of SIT/UAT. * Created Datastage Jobs for B&CPR reconciliation. * As Software Engineer, he was responsible to understand the project detailed data warehouse architecture. * He was responsible to write SQL Stored Procedures for Medium to complex requirements * Interact with the business team for clarity on the requirement. * Planning & Strategy building of the requirement implementation in IBM Datastage * He was responsible for the design & development of Medium complexity ETL requirements using IBM Datastage. * He was responsible for detailed testing of designed ETL Jobs in IBM Datastage to ensure minimal defects. * Involve in deployment of ETL projects in different environments like UAT/PROD. * He follows the quality standard set and delivers the ETL jobs with the best quality possible. * Involved in POC on preparation of reports using OBIEE. * Creation of technical specification documents for the source systems to be used for future modification and maintenance. * Writing, updating and maintaining end user documentation and operational procedures * Performing code migration and tracking code version change using SCM. * Writing SQL queries to fetch and validate the converted data.