Skip to content
Role Trackr

Intern, AI Systems Performance Engineer

Samsung Semiconductor · San Jose, CA

Found on Samsung Semiconductor's Greenhouse board. Last checked Nov 18.

Shep's read

I noticed it profiled agents across CPU, GPU, HBM, and CXL.

open 7 days

About the role

Please Note: To provide the best candidate experience amidst our high application volumes, each candidate is limited to 10 applications across all open jobs within a 6-month period. Advancing the World’s Technology Together Our technology solutions power the tools you use every day--including smartphones, electric vehicles, hyperscale data centers, IoT devices, and so much more. Here, you’ll have an opportunity to be part of a global leader whose innovative designs are pushing the boundaries of what’s possible and powering the future. We believe innovation and growth are driven by an inclusive culture and a diverse workforce. We’re dedicated to empowering people to be their true selves. Together, we’re building a better tomorrow for our employees, customers, partners, and communities. What You’ll Learn

Project Overview: Build AgentSysBench, a benchmark suite and profiling toolchain that measures how AI agent frameworks (Claude Code, Aider, LangGraph) use server resources: host CPU, DRAM, GPU HBM and CXL memory. The results will guide memory system design for future AI data centers. Skills You’ll Learn:

Profile system and microarchitecture performance with perf, eBPF, hardware PMUs and NVML/DCGM Characterize memory hierarchies (HBM, DDR5, CXL) and build performance models Benchmark LLM inference serving (vLLM/SGLang) on NVIDIA GPU servers

What You’ll Do Our team researches the next-generation memory solutions for AI workloads, including HBM, DRAM, and CXL memory expansion. This summer, you'll work on servers with Samsung CXL memory expanders and NVIDIA GPUs. You'll see how agentic AI workloads stress memory systems and how those findings feed into future memory product architecture design. Location: Daily onsite presence at our San Jose headquarters in alignment with our Flexible Work policy Reports to: Sr. Director

Build runtime adapters and a trace record/replay harness for AI agent frameworks Develop micro-kernel and end-to-end agent workload benchmarks that stress CPU, memory, storage and accelerator subsystems Profile agent workloads with perf, eBPF, PMUs and NVML/DCGM to break down per-turn latency and memory bandwidth usage Measure host DDR5, GPU HBM and CXL.mem bandwidth and latency across Intel Xeon and/or AMD EPYC servers Evaluate multi-agent KV-cache sharing and CXL memory expansion on Samsung CXL expanders Build an initial memory tiering cost model (HBM/DDR5/CXL) for long-running MoE agent workloads Present findings in weekly team meetings, then deliver a final report and presentation Complete other responsibilities as assigned.

What You Bring

Pursuing PhD in Computer Science, Computer Engineering, Electrical Engineering, or a related field Strong programming skills in Python and C/C++ in a Linux environment Solid understanding of computer architecture (CPU caches, the memory hierarchy, NUMA) Experience with performance profiling tools (perf, eBPF, VTune, or Nsight) Preferred: hands-on experience with LLM serving frameworks (vLLM, SGLang) or GPU programming Preferred: familiarity with HBM, CXL, or heterogeneous memory systems Preferred: experience with AI agent frameworks or benchmark development You’re inclusive, adapting your style to the situation and diverse global norms of our people. An avid learner, you approach challenges with curiosity and resilience, seeking data to help build understanding. You’re collaborative, building relationships, humbly offering support and openly welcoming approaches. Innovative and creative, you proactively explore new ideas and adapt quickly to change.

#LI-AD1 What We Offer The pay range below is for all roles at this level across all US locations and functions. Pay within this range varies by work location and may also depend on job-related knowledge, skills, and experience. This is in addition to our diverse package of benefits centered around the wellbeing of our employees and their loved ones. In addition to the usual Medical/Dental/Vision, our inclusive rewards plan empowers our people to care for their whole selves. An investment in your future is an investment in ours. Relocation Support Live 50+ miles away from your new office? No worries! We'll provide a stipend to help support your move. Housing Stipend Signing a lease on a new place for your summer internship? We'll help you pay your way with a monthly stipend. Give Back With a charitable giving match and frequent opportunities to get involved, we take an active role in supporting the community. Prioritize Emotional Wellness With on-demand apps and paid therapy sessions, you’ll have support no matter where you are. Stay Fit Eating well and being active are important parts of a healthy life. Our onsite Café and gym, plus virtual classes, make it easier. Embrace Flexibility Benefits are best when you have the space to use them. That’s why we facilitate a flexible environment so you can find the right balance for you. Hourly Base Pay Rate $28 — $68 USD Equal Opportunity Employment Policy Samsung Semiconductor takes pride in being an equal opportunity workplace dedicated to fostering an environment where all individuals feel valued and empowered to excel, regardless of race, religion, color, age, disability, sex, gender identity, sexual orientation, ancestry, genetic information, marital status, national origin, political affiliation, or veteran status. When selecting team members, we prioritize talent and qualities such as humility, kindness, and dedication. We extend comprehensive accommodations throughout our recruiting processes for candidates with disabilities, long-term conditions, neurodivergent individuals, or those requiring pregnancy-related support. All candidates scheduled for an interview will receive guidance on requesting accommodations. Our Commitment to Innovation and Fairness At Samsung Semiconductor, we use Artificial Intelligence (AI) tools in the recruitment process to enhance efficiency. However, AI is used as a support

Apply on Samsung Semiconductor's site, opens in a new tabYou apply on their site and press submit yourself.

Have an account? Track it in Role Trackr (opens in a new tab)

Similar roles from last night.

SPAN · San Francisco, CA · $137K to $250K
CreatorIQ · New York, NY · $121K to $155K
Temporal · Remote · $170K to $278K
I noticed this role focuses on optimizing agent token spend, latency, and quality.
Faire · San Francisco, CA · $211K to $291K

More roles like this →