📁
Information Technology Services
📅
102181 Requisition #

Job Purpose:

Responsible for performing difficult or complex analysis, design and programming involving multi-project leadership and broad responsibility in support of new and existing Data Engineering Projects and production support activities.

Core Duties:

  • Collaborate with cross-functional teams to understand business needs and identify opportunities for applying machine learning solutions.
  • Experience with Natural Language Processing (NLP) and deploying/using Large Language Models
  • Deep understanding and commitment to software engineering principles/processes (e.g. Lean, Agile, DevOps, CI/CD) and continuous improvement through measurement.
  • Thorough knowledge, expertise and practice Data Management Framework to design world class data stores. Best practices, Data Quality and security  are critical.
  • Understand data endpoints, consumers and develop strategy. 
  • Fluid end-to-end data vision, design pipelines for seamless data flow.
  • Lead and perform the design, development, implementation and maintenance of complex Data Store/ Data Lake/Lake house and Data warehousing  systems and data-intensive solutions that are scalable, optimized, and fault-tolerant.
  • Design and implement  Data Migration and Data Integration across cloud and hybrid environments.
  • Mastery and hands-on experience with Data Engineering technologies and scripting languages.  Identify new technologies and provide recommendations to Management.
  • Solid understanding and experience in Cloud technologies and applications. Data Migration, Integration, API’s development, Data Streaming ( Batch and continuous) and scheduling.
  • Data Modeling skills.  Able to come up with a Canonical Data Model and simplify data flow and interaction between different applications. Should be able to integrate new sources smoothly.
  • Ability to translate complex functional and technical requirements into detailed architecture, design and high performing software.
  • Design, build and optimize pipelines for data collection for storage, access and analytics.
  • Out of the box thinking to overcome engineering challenges with innovative design principles. 

Minimum Requirement  

Education and Experience:

  • Bachelor's degree and five years relevant experience or a combination of education and relevant experience.

Knowledge, Skills and Expertise:

  • Thorough understanding and experience in Data Lake, Lake House and Data Warehousing Architecture.  Should be able to suggest, architect and implement  Data Lake/Lake house/ DataWarehouse solution with a set of available cloud tools and programming.
  • Knowledge and ability to use AWS SageMaker Studio, BedRock and design strategy and implement ML Ops Architecture.  Should be well versed in AI/ML Programming, using various Large Language Models (LLMs) and build customized solutions.
  • Hands-on experience and expertise in Advanced SQL, Advanced Python programming, AWS Services ( such as S3, Redshift, Glue ETL, IAM, DMS, Appflow,VPC and others), SnowFlake, FiveTran, KAFKA, Airflow, Oracle Cloud and other open source tools. 
  • Experience in writing reusable complex Python/PySpark scripts for ELT, Business Logic OR APIs. Other Coding experience such as Scala and R Programming is a plus.
  • Hands-on development work on all aspects of data analysis, data provisioning, modeling, performance tuning and optimization.
  • Experience in working on AWS cloud environment, using the marketplace for the right tool, efficient utilization of them to meet business requirements.
  • Mastery of relational, NoSQL or NewSQL database systems. Expertise in working with unstructured, structured and semi-structured data.
  • Build scalable data pipelines for both real time and batch using best practices in data modeling, ETL/ELT processing using various technology stack .
  • Experience in designing and implementing tight data security at various levels.
  • Experience in streaming data from SaaS/PaaS applications .  Experience with DataOps and related set of practices, processes and technologies.
  • Experienced in Data Migration and Data Integration.  Know the pain points in Data integration across SaaS applications and implement the best solution that fits the organization.
  • Constantly monitor operations, tune for better performance and utilization. 


PHYSICAL REQUIREMENTS*:

  • Constantly perform desk-based computer tasks.
  • Frequently sit, grasp lightly/fine manipulation.
  • Occasionally stand/walk, use a telephone.
  • Rarely writing by hand, lift/carry/push/pull objects that weigh up to 10 pounds.
  • * Consistent with its obligations under the law, the University will provide reasonable accommodation to any employee with a disability who requires accommodation to perform the essential functions of the job.


WORKING CONDITIONS:

  • May work extended hours, evenings and weekends.

WORK STANDARDS:

  • Interpersonal Skills: Demonstrates the ability to work well with Stanford colleagues and clients and with external organizations.
  • Promote Culture of Safety: Demonstrates commitment to personal responsibility and value for safety; communicates safety concerns; uses and promotes safe behaviors based on training and lessons learned.
  • Subject to and expected to comply with all applicable University policies and procedures, including but not limited to the personnel policies and other policies found in the University's Administrative Guide, http://adminguide.stanford.edu.

The expected pay range for this position is $147,000 – 150,000 per annum.

Stanford University provides pay ranges representing its good faith estimate of what the university reasonably expects to pay for a position. The pay offered to a selected candidate will be determined based on factors such as (but not limited to) the scope and responsibilities of the position, the qualifications of the selected candidate, departmental budget availability, internal equity, geographic location and external market pay for comparable jobs.

At Stanford University, base pay represents only one aspect of the comprehensive rewards package. The Cardinal at Work website (https://cardinalatwork.stanford.edu/benefits-rewards) provides detailed information on Stanford’s extensive range of benefits and rewards offered to employees. Specifics about the rewards package for this position may be discussed during the hiring process.

Why Stanford is for You:
Stanford University has revolutionized the way we live and enrich the world.  Supporting this mission is our diverse and dedicated 17,000 staff.  We seek talent driven to impact the future of our legacy.  Our culture and unique perks empower you with:

  • Freedom to grow.  We offer career development programs, tuition reimbursement, or audit a course.  Join a TedTalk, film screening, or listen to a renowned author or global leader speak.
  • A caring culture.  We provide superb retirement plans, generous time-off, and family care resources.
  • A healthier you.  Climb our rock wall or choose from hundreds of health or fitness classes at our work-class exercise facilities.  We also provide excellent health care benefits.
  • Discovery and fun.  Stroll through historic sculptures, trails, and museums.
  • Enviable resources.  Enjoy free commuter programs, ridesharing incentives, discounts and more!
  • Redwood City.  Our new Stanford Redwood City campus, opened in 2019, will be the workplace for approximately 2,700 staff, including University IT, whose jobs are important to supporting the University’s mission.  The campus will offer amenities such as onsite cafes and a dining pavilion, a high-end fitness facility with an outdoor pool, and a childcare center for Stanford families.

The job duties listed are typical examples of work performed by positions in this job classification and are not designed to contain or be interpreted as a comprehensive inventory of all duties, tasks, and responsibilities. Specific duties and responsibilities may vary depending on department or program needs without changing the general nature and scope of the job or level of responsibility. Employees may also perform other duties as assigned.

Consistent with its obligations under the law, the University will provide reasonable accommodations to applicants and employees with disabilities. Applicants requiring a reasonable accommodation for any part of the application or hiring process should contact Stanford University Human Resources at stanfordelr@stanford.edu. For all other inquiries, please submit a contact form.

Stanford is an equal employment opportunity and affirmative action employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, protected veteran status, or any other characteristic protected by law.

My Submissions

Track your opportunities.

My Submissions

Similar Listings

Business Affairs: University IT (UIT), Redwood City, California, United States

📁 Information Technology Services

Business Affairs: University IT (UIT), Redwood City, California, United States

📁 Information Technology Services

Business Affairs: University IT (UIT), Redwood City, California, United States

📁 Information Technology Services

Global Impact
We believe in having a global impact

Climate and Sustainability

Stanford's deep commitment to sustainability practices has earned us a Platinum rating and inspired a new school aimed at tackling climate change.

Medical Innovations

Stanford's Innovative Medicines Accelerator is currently focused entirely on helping faculty generate and test new medicines that can slow the spread of COVID-19.

Technology

From Google and PayPal to Netflix and Snapchat, Stanford has housed some of the most celebrated innovations in Silicon Valley.

Advancing Education

Through rigorous research, model training programs and partnerships with educators worldwide, Stanford is pursuing equitable, accessible and effective learning for all.

Working Here
We believe you matter as much as the work

Group Dance Class In A Gym
Nora Cata Portrait

I love that Stanford is supportive of learning, and as an education institution, that pursuit of knowledge extends to staff members through professional development, wellness, financial planning and staff affinity groups.

Nora Cata

School of Engineering

Students Working With A Robot Arm
Philip Cheng Portrait

I get to apply my real-world experiences in a setting that welcomes diversity in thinking and offers support in applying new methods. In my short time at Stanford, I've been able to streamline processes that provide better and faster information to our students.

Phillip Cheng

Office of the Vice Provost for Student Affairs

Students Working With A Robot Arm
Denisha Clark Portrait

Besides its contributions to science, health, and medicine, Stanford is also the home of pioneers across disciplines. Joining Stanford has been a great way to contribute to our society by supporting emerging leaders.

Denisha Clark

School of Medicine

Students Working With A Robot Arm
Laura Lind Portrait

I like working in a place where ideas matter. Working at Stanford means being part of a vibrant, international culture in addition to getting to do meaningful work.

Laura Lind

Office of the President and Provost

Getting Started
We believe that you can love your job

Join Stanford in shaping a better tomorrow for your community, humanity and the planet we call home.

  • 4.2 Review Ratings
  • 81% Recommend to a Friend

View All Jobs