Lead Data Engineer
Teradata is the connected multi-cloud data platform for enterprise analytics company. Our enterprise analytics solve business challenges from start to scale. Only Teradata gives you the flexibility to handle the massive and mixed data workloads of the future, today.
The Teradata Vantage architecture is cloud native, delivered as-a-service, and built on an open ecosystem. These design features make Vantage the ideal platform to optimize price performance in a multi-cloud environment.
Position: Lead Data Engineer
Experience: 8+ Years
What You'll Do
Translate the business requirements into technical requirements
ETL development using native and 3rd party tools and utilities
Lead the semantic modelling and development activities
Write and optimize complex SQL and shell scripts
Design and develop code, scripts, and data pipelines that leverage structured and unstructured data
Data ingestion pipelines and ETL processing, including low-latency data acquisition and stream processing
Design and develop processes/procedures for integration of data warehouse solutions in an operative IT environment.
Monitoring performance and advising any necessary configurations & infrastructure changes.
Create and maintain technical documentation that is required in supporting solutions.
Coordinate with customers to understand their requirements
Who You'll Work With
Work with Teradata project managers to scope projects and develop a work break down structures and do risk analysis.
Provide direct support to the solution architect and the solution delivery team.
Lead a dynamic and collaborative team, demonstrating excellent interpersonal skills and management capabilities.
Readiness to travel to customer sites for short, medium or long-term engagements.
B.S. / M.S. in Computer Sciences or related field
Hands on experience with one or more ETL tools like Informatica, DataStage, Talend etc.
Hands on experience with Teradata Industry standard data models and mapping between source systems, core and semantic data structures.
Working knowledge of financial services domain
Good understanding of different dimensional modeling techniques such as Star vs SnowFlake Schemas.
Working experience on creating semantic and reporting mapping documents.
Strong concepts/experience of designing and developing ETL architectures.
Strong RDBMS concepts and SQL development skills
Strong knowledge of data modeling and mapping
Experience with Data Integration from multiple data sources
Working experience in one or more business areas and industries: Telecom, Retail, Financial etc.
Working experience with one or more Cloud environments like AWS, Azure or GCP along with hands on experience with different cloud services.
Hands on development experience on Python along with a good knowledge of programming languages such as Java, AngularJS, C++, Groovy etc.
Good understanding of reporting tools such as PowerBI, MicroStrategy or Business Objects
Good knowledge of Big Data technologies such as Pig, Hive, Spark, Kafka, Nifi
Experience with NoSQL databases, such as HBase, Cassandra, MongoDB
Experience with any of the Hadoop distributions such as Cloudera/Hortonworks
Experience with Teradata tools and technologies will be a plus.
Training/Certification on Teradata will be a plus.
What You'll Bring
Excellent communication and presentation skills, both verbal and written
Proven experience in customer facing roles for large engagements and managing solution delivery teams.
Ability to solve problems using a creative and logical mind set
Demonstrated skills in team leadership, coaching, and competency building
Must be self-motivated, analytical, detail oriented, organized and pursue excellence on all tasks