[Remote] Software Engineer Intern (Applied Machine Learning - ML System) - 2026 Summer (BS/MS)
Note: The job is a remote job and is open to candidates in USA. ByteDance is a technology company founded in 2012 that aims to inspire creativity and enrich life. They are seeking a Software Engineer Intern to participate in the design and optimization of machine learning systems, providing students with hands-on experience and industry exposure. Responsibilities Participating in online architecture design and optimization centered around LLM inference tasks, achieving high concurrency and throughput in large-scale online systems Participating in the establishment of a comprehensive system covering stability, disaster recovery, R&D efficiency, and cost, enhancing overall system stability Participating in the design and implementation of end-to-end online pipeline systems with multiple models, plugins, and storage-computation components, enabling agile, flexible, and observable continuous delivery Collaborating closely with the MLE for optimization of algorithms and systems Being proactive, optimistic, highly responsible, and demonstrating meticulous work ethic, as well as possessing strong team communication and collaboration skills Skills Currently pursuing an Undergraduate/Master in Computer Science or a related technical discipline Excellent coding skills, strong understanding of data structures, and fundamental knowledge of algorithms. Proficiency in programming languages such as C/C++, Java, Go, Python, etc Rich experience in online architecture, with the ability to troubleshoot independently Strong sense of responsibility, good learning ability, communication skills, and self-motivation Must be able to commit to a 12-week full-time work period during Summer or Fall 2026 Understanding of GPU hardware architecture, familiarity with GPU software stack (CUDA, cuDNN), and experience in GPU performance analysis Knowledge of LLM models, experience in accelerating LLM model optimization is preferred Benefits Day one access to health insurance Life insurance Wellbeing benefits 10 paid holidays per year Paid sick time (56 hours if hired in first half of year, 40 if hired in second half of year) Housing allowance Company Overview ByteDance is a technology company that develops content creation platforms and services. It was founded in 2012, and is headquartered in Beijing, Beijing, CHN, with a workforce of 10001+ employees. Its website is Company H1B Sponsorship ByteDance has a track record of offering H1B sponsorships, with 1350 in 2025, 1123 in 2024, 775 in 2023, 487 in 2022, 417 in 2021, 245 in 2020. Please note that this does not guarantee sponsorship for this specific role.