Python developerPosted: May 18, 2021, 5:39 a.m. - Full Time - Pune
The Energy Exemplar (EE) data team is looking for an experienced Python Developer (Data Engineer) to join our Pune office. As a dedicated Data Engineer on our Research team, you will apply data engineering expertise, work very closely with the core data team to identify different data sources for specific energy markets and create an automated data pipeline. The pipeline will then incrementally pull the data from its sources and maintain a dataset, which in turn provides tremendous value to hundreds of EE customers.
At EE, you’ll have access to vast amounts of energy-related data from our sources. Our data pipelines are curated and supported by engineering teams. We also offer many company-sponsored classes and conferences that focus on data engineering, data platform. There’s great growth opportunity for data engineering at EE.
Develop, test and maintain architectures, such as databases and large-scale processing systems using high-performance data pipeline.
Recommend and implement ways to improve data reliability, efficiency, and quality.
Identify performant features and make them universally accessible to our teams across EE.
Work together with data analysts and data scientists to wrangle the data and provide quality datasets and insights to business critical decisions.
Take end-to-end responsibility for the development, quality, testing, and production readiness of the services you build.
Define and evangelize Data Engineering best standards and practices to ensure engineering excellence at every stage of development cycle.
Act as a resident expert for data engineering, feature engineering, exploratory data analysis.
3+ years of Experience in developing data-pipelines for large-scale, complex datasets from varieties of data sources.
Data Engineering expertise with strong experience working with Python, Beautiful Soup, Web Scraping.
Experience working with Cloud based data technologies such as Azure Data lake, Azure Data factory, Azure Data Bricks optionally desirable.
Moderate coding skills. SQL or similar required. C# or other languages strongly preferred.
Outstanding communication and collaboration skills. You can learn from and teach others.
Strong drive for results. You have a proven record of shepherding experiments to create successful shipping products/services.
Immediate Joiners will be preferred
A Bachelor or Masters degree in Computer Science or Engineering with coursework in Python, BigData, Data Engineering highly desirable.