Job Details

Temporary Research Engineer
Go to our website »

Position Number: 5395634
Location: Boston, MA
Position Type: Science - Computer Science

Temporary Research Engineer

About the Opportunity

The National Deep Inference Fabric (NDIF) is awarding Summer Engineering Fellowships to participate in a high-priority summer project to develop and rapidly scale AI research infrastructure to keep pace with the precipitous increase in scale of state-of-the art AI.

NDIF is an NSF-funded project to create an innovative, highly-transparent large-scale AI inference infrastructure to enable scientific research on the largest open AI models. Read more about the NDIF project and team here, and read about the NNsight API architecture here. This twitter thread also provides some more context.

NDIF has recently received NSF support, including sufficient GPU resources to create a scalable service. This summer the project is embarking on a rapid summer initiative to implement:

High-throughput parallelism for a uniquely transparent large-scale LLM inference service.
Service autodeployment for public scientific use on NCSA HPC GPU clusters.
Robustness and monitoring for reliable serving for research users.

Before Fall 2024, open LLM models are anticipated that will be five to ten times larger than the current state-of-the art. Accordingly, scientific infrastructure to support research at that scale will be urgently needed. The NDIF Summer Engineering Fellowship is an intensive program for systems- and ML-focused students to contribute to an active state-of-the-art AI research engineering project in the public interest.

During your fellowship you will work under the supervision of a team of leading machine learning and software engineering systems professors. Your work in the fellowship will be essential for scaling up the innovative NDIF inference infrastructure to prepare the groundwork to enable interpretability, safety auditing, and transparent research at a scale that matches the pace of the ongoing increase in AI model complexity.

The program will be held in-person in Boston during Summer 2024.

Eligibility:

The NDIF engineering fellowship accepts applications from current and recent PhD, Masters, and Undergraduate students in computer science and related fields. The ideal applicant will have knowledge of machine learning systems, such as quantized and low-precision machine learning, ML compilers, and architectures for low-latency transformer inference.

Both systems-focused and machine-learning-focused applicants will be considered.

We are unable to accept applicants who will be under the age of 18 on June 1, 2024.

How to apply:

To apply, submit your contact information, CV, current transcript, and an explanation of your interest and potential contributions to the project using this form.

Position Type

Temporary

Additional Information

Northeastern University considers factors such as candidate work experience, education and skills when extending an offer.

Northeastern has a comprehensive benefits package for benefit eligible employees. This includes medical, vision, dental, paid time off, tuition assistance, wellness & life, retirement- as well as commuting & transportation. Visit https://hr.northeastern.edu/benefits/ for more information.

Northeastern University is an equal opportunity employer, seeking to recruit and support a broadly diverse community of faculty and staff. Northeastern values and celebrates diversity in all its forms and strives to foster an inclusive culture built on respect that affirms inter-group relations and builds cohesion.

All qualified applicants are encouraged to apply and will receive consideration for employment without regard to race, religion, color, national origin, age, sex, sexual orientation, disability status, or any other characteristic protected by applicable law.

To learn more about Northeastern University's commitment and support of diversity and inclusion, please see www.northeastern.edu/diversity.

To apply, visit https://northeastern.wd1.myworkdayjobs.com/en-US/careers/job/Boston-MA-Main-Campus/Temporary-Research-Engineer_R125315