The AWS Energy Team is hiring a Data Engineer to lead the design, development and maintenance of a new tool to track energy consumption and other sustainability metrics. In this role, you will work with data sets from across AWS infrastructure, finance and services. The successful candidate will be a motivated self-starter that can work independently in a fast paced, ambiguous environment. As the Data Engineer on this project, you will be responsible for managing large data sets provided by multiple teams. The successful candidate will work with energy experts, data center SDE’s, and customer metering teams to gain a deep understanding of available data. In this role, you will own solving a critical customer problem through deep data review, data manipulation, and creation of new tools. You will design and implement data validations to ensure results continuously meets the highest bar for accuracy and integrity. Responsibilities: · Engineer data sets to determine resource utilization by
· Bachelor’s degree in computer science, information systems, or a related technical discipline · 5+ years of experience performing data analysis · 5+ years of experience with a scripting language (python, perl etc…) · 3+ years working with relational databases and SQL · 3+ years of experience automating data pipelines· Master’s degree in Computer Science, Engineering, Math, Finance, Statistics or a related discipline. · Familiarity with AWS solutions such as EC2, DynamoDB, S3, and Redshift. · Experience with map-reduce frameworks (spark, Hadoop, flink, etc) · Experience using unstructured data