Southern California Edison Data Engineer, Advisor - Project Regular [REMOTE] in Rosemead, California
Join the Clean Energy Revolution
Become a Data Engineer, Advisor and build a better tomorrow. This position specializes in data engineering and design function specifically leveraging technologies such as Palantir, Python, PySpark, and Cloud Data Warehouse such as Snowflake. The responsibilities include performing extensive data mining, analysis, engineering, and design. The position is responsible for working with advanced analytics groups to facilitate data engineering activities covering data acquisition, extraction, normalization, transformation, management, and manipulation of large and complex data sets primarily using Python, PySpark, SQL, and Palantir.
The job function includes understanding of business requirements, defining data requirements, identifying enterprise data sources, planning, designing, and building data acquisition from sources, defining data model, taxonomy, designing data ingestion pipelines, data normalization, data transformation, and consumption using platforms such as Palantir and Snowflake. The position is responsible for developing and maintaining data ingestion and consumption pipelines for Palantir, deriving data insights using platform capabilities towards the realization of analytics and data science use cases. The job function includes developing data insights, data mining, and support for AI/ML use cases training and deployment within SCE analytics landscape, specifically within Palantir platform. Specifically, the job involves:
Development of data transformation scripts using PySpark
Development of documentation for data transformation scripts
Development of design artifacts to describe technical components of scripts for long term maintenance and support
Participation in daily scrum style meetings for update progress on tasks.
Participation in sprint planning to provide estimates for time to complete tasks
Support of End-to-End testing with SCE System
You will also work closely with data engineers and data scientists across enterprise towards realization of high-valued analytical use cases using AI/ML. You are expected to have a good understanding of utilities use cases and data and is required to proactively derive data insights to facilitate data-driven decision making. A good understanding and experience with CRISP-DM methodology for training and deploying analytical (AI/ML) models will be an advantage.
The position is part of the enterprise IT function supporting all organizational units for data engineering, analytics, and data science use cases. The candidate is therefore expected to design and implement the data architecture, data engineering solutions and best practices for analyzing very large data sets; perform data mining activities to derive data insights; Keep abreast of new and current data science, data engineering, and big data techniques. You will lead/participate in rapid prototyping, evaluating, performing impact assessment, and recommending data engineering technologies and solutions for the enterprise.
Following knowledge and skills are important to be effective in this role:
Expertise in building data engineering solutions using Python, PySpark
Expertise in building use cases / solutions using technologies such as Palantir Foundry
Design, build, execute and deploy data engineering and analytics solutions.
Ability to perform complex analysis, consulting, and perform technical activities as assigned.
Strong understanding & experience with ETL design and implementation in the context of large datasets
Experience working with data warehouses, writing SQL queries of varying complexity
Experience working with distributed systems and concepts such as Apache Spark, Parquet, MapReduce, and Hadoop (experience not necessary)
Knowledge of API’s based integration, workflow applications
Knowledge in deploying, scaling, and optimizing applications in cloud platform
Experience in Agile methodologies and development best practices
Understanding of electric utility use cases and underlying datasets (specifically Assets Management and Work management)
Experience delivering IT solutions in an environment utilizing industry standard methodologies such as TOGAF, CRISP-DM
Ability to make effective decisions that meet business needs while minimizing risk and operating within company policies and all levels of regulations
Communicate effectively with analytics/data experts, business leaders, and management to develop data driven solutions and deliver data insights.
Translate business objectives into data and analytics solutions using appropriate data engineering, analytics, visualization & dashboard applications
Excellent oral and written communication skills a must
Eager to Learn: Development in Foundry can be complex, will work together with Palantir engineers to ramp up and build expertise
As a Data Engineer, Advisor your work will help power our planet, reduce carbon emissions, and create cleaner air for everyone. Are you ready to take on the challenge to help us build the future?
A day in the life - Get ready to think big, work smart and shine bright!
A multi-faceted role that involves diverse responsibilities such as:
Conceptualize, plan, design, and implement various business use cases using technologies such as Palantir, Python, Pyspark, SQL
Defining data requirements, identifying enterprise data sources, planning, designing, and building data acquisition from sources
Developing/implementing data model and taxonomy within Palantir
Designing and developing data ingestion pipelines, data normalization/harmonization, data transformation, and consumption using platforms such as Palantir, Python, Pyspark, SQL
Deriving data insights using platform capabilities towards the realization of analytics and data science use cases
Seven (7) or more years of experience in architecting and designing information, integration, and analytics solutions
Three (3) or more years ofexperience in data engineering, data mining, large scale data acquisition, transformation, and cleaning both structured and unstructured data
Experience developing solutions using Palantir technology, Python, Pyspark, SQL
Bachelor’s degree in computer science, Information Systems, Engineering, Statistics/Mathematics, or related field of study
Experience with EDW and Analytics platforms such as Snowflake, BW/Hana, Hadoop, PowerBI
Experience delivering business intelligence and data engineering solutions preferably in a regulated utility environment
You should know …
Work Mode : The position’s work mode is remote .Employee is able to work primarily at home or remote however, the employee may be expected to come to an SCE facility on occasion. Unless otherwise noted, employees are required to reside in the state of California. Hiring organizations can add further requirements related to specific jobs. Further details of this work mode will be discussed at the interview stage.
Visit our Candidate Resources page (https://www.edisoncareers.com/page/show/Candidate-Resources) to get meaningful information related to benefits, perks, resources, testing information, and hiring process, and more!
This is a full-time, project regular position for an estimated duration of up to 24 months. This position is eligible for company benefits and incentives during the duration of the assignment.
The primary work location for this position is SCE Corporate offices in Rosemead (General Office Bldg 3), however, the successful candidate may also be asked to work for an extended amount of time at an alternate work location.
Position will require occasional traveling to other SCE offices in the SCE service territory.
Relocation may apply to this position.
- This position requires testing and applicants who are identified to continue through the selection process will be invited to test via email. We invite you to visit our Testing Information page for further information and to access information guides. For information guides (https://www.edisoncareers.com/page/show/SCE-Pre-Employment-Study-guides) , please reference test 8203. Candidates who have previously passed this assessment, in some cases, may not need to retest again for this position.
About Southern California Edison
The people at SCE don't just keep the lights on. Our mission is so much bigger. We’re fueling the kind of innovation that’s changing an entire industry, and quite possibly the planet. Join us and create a future with cleaner energy, while providing our customers with the safety and reliability they demand. At SCE, you’ll have a chance to grow personally and professionally, making a real impact in Southern California and around the world.
At SCE, we celebrate our differences. We are a proud Equal Opportunity Employer and will not discriminate based on race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, protected veteran status or any other protected status.
We are committed to ensuring that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodations at (833) 343-0727.
Southern California Edison
- Southern California Edison Jobs