Senior Embedded Engineer/Architect with AI for Edge

R Systems is seeking a talented Edge AI Engineer with specialized expertise in GPU/TPU acceleration to join our team.

The ideal candidate will have extensive hands-on experience in local Large Language Models (LLM) inference with embedded GPU/TPU architectures. As a Principal Engineer specializing in Edge AI, you will play a crucial role in shaping the future Edge AI solution, leveraging the power of GPU/TPU acceleration and enterprise-grade, large-scale edge computing. They will aptly combine technical excellence with effective leadership, creating a positive impact on both projects and team dynamics.

If you are a skilled Edge AI Engineer with a passion for pushing the boundaries of edge computing and GPU/TPU acceleration, particularly in local LLM inference, we want to hear from you!

Apply now to be part of our dynamic and collaborative team and join us in shaping the future of AI at the edge and revolutionizing industries with innovative edge AI solutions!

Your contribution:

  • Influence the Edge AI strategy by providing expert advice on design and architecture.
  • Make critical decisions regarding technical directions, scalability, and system performance.
  • Develop and optimize AI inference models for deployment on edge devices with embedded GPU/TPU accelerators, focusing on local Low Latency Model (LLM) inference.
  • Implement and fine-tune low-latency model inference pipelines to meet real-time performance requirements.
  • Collaborate with cross-functional teams to integrate AI inference solutions into edge computing platforms and applications.
  • Collaborate with the GPU Hardware Design Team to design and optimize GPUs that power next-generation devices.
  • Conduct performance profiling and optimization to maximize the efficiency of GPU/TPU acceleration for local LLM inference.
  • Work on micro-architecture development, ensuring efficient execution of graphics, compute, and AI workloads within energy and area constraints.
  • Stay current with advancements in GPU/TPU technologies and edge AI frameworks, incorporating them into solution designs as appropriate.
  • Provide technical expertise and support to project teams, ensuring successful implementation and deployment of edge AI solutions.

Bring along:

    • Bachelor’s degree in computer science, Engineering, or a related field; Master’s degree preferred.
    • 5+ years of hands-on experience in AI model development and deployment, with a focus on edge computing and local LLM inference.
    • Strong programming skills in languages such as Python and C++
    • Proficiency in LLM frameworks (e.g., vLLM, Text generation inference, OpenLLM, Ray Serve, and HuggingFace Transformers) and deep learning libraries.
    • Extensive experience with GPU/TPU acceleration for AI inference, including optimization techniques (tensor, pipeline, data, sharded data parallelism) and performance tuning,
    • Hands on experience with one or more GPU frameworks: CUDA, Vulkan, OpenCL , familiarity with NVIDIA Jetson, ARM Mali, or relevant SoC configurations.
    • Knowledge of parallel computation, memory scheduling, and structural optimization
    • Excellent problem-solving and analytical skills, with a passion for innovation and continuous learning.

Additional Skills (Preferred):

  • Experience with edge device hardware and software integration.
  • Familiarity with edge computing architectures and IoT platforms.
  • Experience with edge AI applications in domains such as robotics, autonomous vehicles, or industrial automation

What's in it for you:

Hybrid work policy
A hybrid work policy, to promote and improve work-life balance! We’ll also provide the proper work equipment to ensure there is no digital barrier you can’t break.
Health coverage
Stay healthy and feel always in safe hands with full access to private medical subscription.
Professional development
Keep your knowledge fresh and achieve your professional goals, with free and unlimited access to Udemy online learning platform. We also provide 5 days off yearly to enjoy these courses plus, paid study holiday for bachelor students.
Building a community
If you know some awesome & talented innovators, recommend them to us and you’re in for a neat referral bonus. We also hope you’ll genuinely like us enough to stick around and enjoy our long-term contribution rewards.
Click Here
People-centered offices
Our offices are not only hip and cool, with private and co-working spaces, but also situated in central city locations, so that you can get there easily. Coming to the office is also a great opportunity to enjoy some fun activities in the company of your colleagues.
Click Here
Food for thought
To feed both your body and brain, we like to organize occasional Lunch & Learn sessions. If these leave you hungry for more, you can always enroll in our mentoring & coaching sessions.
Click Here
Healthy rivalry
Running shoes are not included in your welcome kit, but you may need to get a pair ASAP because we take our (inter)company sports competitions very seriously. And if you're competitive but sports are not your forte, you can always join our hackathons or reading marathons.
Click Here
A chance to give back
If you’re a charitable soul like us you’ll enjoy planting trees, baking cakes, playing chess, crafting, or donating to a cause in our social community events.
Click Here
Lots of fun
Our awesome people may be spread across many countries & cities, but we like to team up for some fun as often as we can. Be it team buildings, parties, or other team events, we take on every opportunity to meet and strengthen our sense of community.
Click Here
Previous slide
Next slide

Apply here

Who we are as a company:

R Systems is a global technology and analytics services company. We help our clients achieve speed-to-market, overcome digital barriers, and create business value with our specialized service offerings and consultative business approach.

We speak the language of business as fluently as we do the language of technology. In other words: We speak Digital. Our goal: accelerate our clients’ digital leadership.

At R Systems EU, we embrace diversity. Inclusion is a priority for us, and we are eager to foster an environment where everyone feels valued. We welcome applications regardless of ethnicity or cultural background, age, gender, nationality, religion, disability or sexual orientation.

Some quick aspects we take pride in:
Previous slide
Next slide

R Systems is Great Place to Work™ certified

Other roles you may be interested in

IT System Analyst

R Systems is seeking a skilled IT System Analyst, responsible for evaluating current business processes and recommending improvements based on

Read More »
Scroll to Top

Apply to this job

Contact us

Send your CV