Job Family: Research & Predevelopment
Req ID: 492619
Cybersecurity & AI Research Intern: Cyber Agents for Security Testing and Learning Environments
Job Description
We are seeking a Cybersecurity Research Intern to join our team in Princeton, New Jersey for a remote internship. This role is ideal for a PhD student passionate about the intersection of Large Language Models (LLMs), Reinforcement Learning (RL), and Autonomous Cyber Defense. As an intern, you will work on state-of-the-art research to address challenges posed by sophisticated cyber threats like Advanced Persistent Threats (APTs).
As an intern, you will move beyond theoretical research to build and test state-of-the-art agents capable of defending against sophisticated threats (APTs). You will work on hybrid systems that combine the reasoning capabilities of LLMs with the strategic optimization of causal inference and RL. We leverage these techniques to enhance computational efficiency and decision-making in real-world cybersecurity scenarios.
Transform the Everyday!
This position is remote working from a home office. Summer Internship, 3+ months.
The challenges and responsibilities
Engineer and refine LLM-based agents (pure vs. domain-enhanced) to act as autonomous cyber defenders. Work on prompt engineering strategies to format network observations for optimal model reasoning.
Design and implement Model Context Protocols (MCPs) that allow LLMs to interface securely and effectively with external security tools and environments.
Implement novel architectures where LLMs analyze and explain the decision paths of RL agents (operating in environments like CybORG CAGE-4).
Collaborate on research merging causal inference (e.g., C-POMCP) and optimization techniques with Generative AI to improve defender strategies.
Evaluate agent performance against benchmark scenarios (APTs), analyzing where "pure" network observation fails and where domain-knowledge injection succeeds.
Collaborate closely with researchers and engineers across Siemens Research to align research objectives with real-world applications.
Present findings in internal reviews and contribute to top-tier publications or patents.
Required Knowledge/Skills, Education, and Experience
Currently enrolled full-time in a PhD program in cybersecurity, artificial intelligence, computer science, or similar in an accredited university
Strong experience integrating LLMs into workflows (LangChain, LlamaIndex, or custom agents). Experience building Model Context Protocols (MCPs) is a plus.
Deep understanding of agent architectures (ReAct, Chain of Thought) and prompt engineering (formatting observations, injecting domain knowledge).
Strong theoretical foundation in RL, POMDPs, or Monte Carlo tree search (MCTS).
Proficiency in programming languages such as Python, with experience using frameworks like TensorFlow, PyTorch, or similar tools. Ability to navigate and refactor complex research codebases (wrappers, helper scripts).
Strong problem-solving skills with a demonstrated ability to work on complex projects involving mathematical modeling and experimentation.
Hands-on experience in Linux environments, including command-line usage and shell scripting.
Experience with professional software development tools and workflows, such as Git, Jira, or GitLab.
Proficiency in English both written and verbal.
Authorized to work in the United States without corporate sponsorship now or in the future.
Preferred Qualifications:
Advanced communication skills, with the ability to articulate complex technical ideas effectively.
Successful candidates must be able to work with controlled technology in accordance with US Export Control Law. US Export Control laws and applicable regulations govern the distribution of strategically important technology, services and information to foreign nationals and foreign countries. Siemens may require candidates under consideration for employment opportunities to submit information regarding citizenship status to allow the organization to comply with specific US Export Control laws and regulations. Additional information on the US Export Control laws & regulations can be found on https://www.bis.doc.gov/index.php/policy-guidance/deemed-exports/deemed-exports-faqs
What do we offer?
Our team is part of Siemens Technology (T), which is Siemens' central Research & Development department. The team is composed of consultants, innovators, engineers, and researchers that unite a passion about cybersecurity and securing our customers' assets and networks - in domains such as control systems used in energy utilities that are part of the nation's critical infrastructure, smart factories, building automation systems, intelligent transportation systems, healthcare, and innovative new products and solutions developed by Siemens. Our close contact to all our business units in Siemens provides the opportunity to contribute to and gain experience in real industrial applications.
Our research team is located in beautiful Princeton, NJ, a university town packed with exceptional international talent that provides a unique feel of this true cultural gem in the state. The town has plenty of activities to offer, but for those looking for more, at just about 1h drive we have NYC or Philadelphia. We have the best public schools in the country and all of the above glued together by a very active and welcoming community.
As Siemens' central Research & Development department, we embrace this community. Our core mission is to support our Siemens business units as a central knowledge hub for all cybersecurity capabilities globally. We research and develop new and innovative solutions, based on much-needed deep technical expertise, and our network with internal and external experts and academia. This allows us to invent new solutions and approaches, and verify their feasibility in the "real world" together with the product development teams of our business units - creating a stimulating setup for quick innovation cycles and rapid prototyping.
As an intern in our team, you have the opportunity to experience a professional industrial research team, and learn about the unique challenges and opportunities of a career in industrial cybersecurity. We support business units in testing and securing our customers' assets and networks - in domains such as control systems used in energy utilities that are part of the nation's critical infrastructure, smart factories, building automation systems, intelligent transportation systems, healthcare, and innovative new products and solutions developed by Siemens. Our close contact to all our business units in Siemens provides the opportunity to contribute to and gain experience in real industrial applications.
About Siemens:
We are a global technology company focused on industry, infrastructure, transport, and healthcare. From more resourceefficient factories, resilient supply chains, and smarter buildings and grids, to sustainable transportation as well as advanced healthcare, we create technology with purpose adding real value for customers. Learn more about Siemens here (https://www.siemens.com/global/en/company.html) .
Our Commitment to Equity and Inclusion in our Diverse Global Workforce:
We value your unique identity and perspective. We are fully committed to providing equitable opportunities and building a workplace that reflects the diversity of society, while ensuring that we attract the best talent based on qualifications, skills, and experiences. We welcome you to bring your authentic self and transform the everyday with us.
LI-JS
LI-Remote
$32-$47
Organization: Foundational Technologies
Job Type: Full-time
Category: Internal Services
