Experience – 6+ years
Job Description for Senior Data Engineer:
Senior Data Engineer is self-starter to work in a diverse and fast-paced environment that can
join our Enterprise Data team. The role is responsible for designing and developing of data
solutions that are strategic for the business and built on the latest technologies and
patterns.
As a Senior Data Engineer, you will:
● Contributes to the design of information infrastructure, and data management
processes to move the organization to a more sophisticated, agile and robust target
state data architecture
● Develop systems that ingest, cleanse and normalize diverse datasets, develop data
pipelines from various internal and external sources and build structure for
previously unstructured data
● Develop and operate modern data architecture approaches to meet key business
objectives and provide end-to-end data solutions
● Develop good understanding of how data will flow & stored through an organization
across multiple applications such as CRM, Broker & Sales tools, Finance, HR etc
● Design & develop data management and data persistence solutions for application
use cases leveraging relational, non-relational databases and enhancing our data
processing capabilities
● Develop POCs to influence platform architects, product managers and software
engineers to validate solution proposals and migrate
● Functionally lead team of data engineers to deliver data solutions in Agile manner
while mentoring junior-level data engineers
What we are looking for:
● 6+ years’ overall work experience and Bachelor’s degree in Information Science,
Computer Science or a quantitative discipline.
● Minimum of 6 years of experience as a data developer using Python, Kafka, Spark
Streaming, Azure SQL Server, Cosmos DB/Mongo DB, Azure Event Hubs, Azure Data
Lake Storage, Azure Search etc.
● Excellent technical, analytical and organizational skills.
● Hands-on engineering lead who is curious about technology, should be able to
quickly adopt to change and one who understands the technologies supporting areas
such as Cloud Computing (AWS, Azure(preferred), etc.), Micro Services, Streaming
Technologies, Network, Security Etc
● Hands-on Experience for building Data Pipelines in Cloud.
● Design & develop data management and data persistence solutions for application
use cases leveraging relational, non-relational databases and enhancing our data
processing capabilities.
● Experience handling un-structured data, working in a data lake environment,
leveraging data streaming and developing data pipelines driven by events/queues
● Experience in developing integration testing framework
● Team player, Reliable, self-motivated, and self-disciplined individual capable of
executing on multiple projects simultaneously within a fast-paced environment
working with cross functional teams
● Someone who is genuinely excited about data infrastructure and operations with a
familiarity working in cloud environments and Working with data excites you: you
have created data architecture, you can build and operate data pipelines, and
maintain data storage, all within distributed systems