Ilya Kelner

Engineering Leader and Systems Architect · Spacecraft, Robotics, and Autonomous Vehicles

Seattle, Washington · ilya@ilyakelner.com · ilyakelner.com · linkedin.com/in/ilyakelner

Education

Carnegie Mellon University Aug 2007 to May 2011
Electrical & Computer Engineering

About Me

Hi there! I'm a software engineer and engineering leader who works on machines that have to work - rockets, satellites, autonomous vehicles, and field robots. More than a decade in, the goal has stayed the same: build the hard parts properly, and make the whole system trustworthy enough to put in front of real people.

I've written flight software for launch vehicles at Relativity Space, the ground software that schedules and steers a satellite constellation at SpaceX, and the on-vehicle mapping stack behind NVIDIA's autonomous driving platform. Most recently, as a co-founder and CTO, I own every piece of software on an autonomous weeding robot - motor control and perception up through simulation, telemetry, and cloud. That range is deliberate. Safety-critical, real-time, and distributed systems are where I'm most useful.

These days I spend as much time building teams as building systems - setting technical direction, hiring, mentoring, and deciding what genuinely deserves to be engineered versus bought. I still write a great deal of code, and I still think a product isn't finished until the last detail has been seen to. The most interesting problems tend to be the ones nobody has tidied up yet.

Languages I speak

  • English, 100% proficiency
  • Russian, 90% proficiency
  • German, 60% proficiency

Work Experience

Red Barn Robotics June 2024 to Present
Autonomous Mechanical Weeding for Organic Row Crops
Co-Founder, CTO

Founding technical leader of an agricultural robotics company building an autonomous mechanical weeding robot for organic farms. Owner of every piece of software on and around the vehicle - embedded control, perception, navigation, simulation, telemetry, cloud, and developer tooling - along with the sensor and actuator packages and the technical direction of the engineering team. Started in a garage with the CEO, through YCombinator (W25), to $2.7M raised.

  • Lead the software engineering function: technical direction, hiring, on-boarding, and performance management, and delivery of the web operator interface and autonomous navigation controller.
  • Architect and principal author of the robot codebase - about three quarters of all commits - a Rust system spanning services, motion control, sensor and actuator drivers, telemetry, and simulation.
  • Own the sensor and actuator packages end to end: requirements, vendor sourcing, hardware selection, and integration, through to GMSL camera bring-up, optics, illumination, and shutter-synchronized strobing.
  • Built the perception post-processing stage that turns noisy per-frame detections into stable tracks, suppressing identity flicker and box-size variance for downstream control.
  • Wrote the controller for a high-inertia rotary weeding tool, solving motor timing and synchronization while both the target and the terrain underneath it keep changing.
  • Developed the tool-to-camera calibration and the four-bar linkage kinematics placing the implement in height and reach - error-prone given a tool deliberately kept invisible to perception.
  • Built the company's engineering infrastructure from nothing: CI/CD, release tooling, Terraform-managed cloud, WebRTC teleoperation relay, and TURN servers, and the corporate network.
  • Set a systems-integration-first hardware strategy, buying hardware wherever the market had an answer so engineering effort concentrated on the software that differentiates the product.
  • Regularly in the field with growers, turning what they actually do into technical requirements rather than our own assumptions about their needs.
  • Took the platform from garage prototype to the second-generation vehicle running today; now driving a redesign targeting 1 m/s with greater than 90% weed clearance between crop rows.
Relativity Space July 2022 to March 2024
Mission Assurance and Vehicle Simulation
Staff Software Engineer

Part of the Integrated Software group, responsible for all parts of the company's rocket software stack. Focused on the next generation of flight software, and specifically on making it testable, verifiable, and deployable at every stage - from a developer's laptop, through simulation and hardware-in-the-loop rigs, to an integrated vehicle. Treated a launch as the last instance of a procedure already run hundreds of times in test rather than as a singular event, and pulled practices, tooling, and languages in from outside aerospace so that critical software could change safely and often.

  • Evangelist for new processes, tools, languages from outside the aerospace sector to improve team velocity and reduce friction for cross-team collaboration. Advocated for standardizing across the software team to help team member fungibility, ease on-boarding of new members, and expand the hiring pool of new candidates.
  • Developer of the standard procedures and run-book for test and flight operations, making a launch a special case of procedures already run many times in test environments.
  • Identified and remediated performance bottlenecks in the flight computer runtime configuration across the software implementations and the platform configuration.
  • Contributed to building simulation proxy components to allow Vehicle-in-the-Loop testing, to help validate and ground the Hardware-in-the-loop tests on an integrated vehicle.
  • Built the state machine validation engine for the in-house domain-specific language used for automation.
NVIDIA Oct 2020 to July 2022
NVIDIA Drive AV Solution
Senior Software Engineer in Mapping

Responsible for all on-vehicle mapping contents for autonomous vehicles - from acquisition, to distribution, and back to telemetering discrepancies between perception and expectations.

  • Architect of the in-car map distribution topology and pipeline: a data syndication model for location updates around the Ego vehicle, and a request-response model for route queries, serving very different radii and data types.
  • Synchronized a real-time critical, highly scheduled piece of code with an asynchronous downloader and file manipulator process, including writing all libraries for downloading, decompressing, filesystem storage and retrieval, and content verification/validation.
  • Member of the small committee defining the NVIDIA mapping schema across all layers; author of the grammar engine (Bizarro) and its semantic validators, holding the schema consistent across terabytes of map data.
  • Built a continuous integration and deployment system on Gitlab's CI/CD to ensure code quality in Bizarro and across maps.
  • Mentored other members of the team with in-depth code reviews, 1-on-1 coaching, and broader philosophical discussions on how to develop and maintain highly critical, human-safety relevant software.
Maka ARS March 2020 to Sep 2020
Maka Weed Killing Robots
Senior Software Engineer

Brought on with deep experience in all parts of the mechatronic and electrical systems, and knowledge of how to build complicated hardware systems.

  • Introduced the concept of a GNC (Guidance, Navigation, and Control) system for managing high-level functions of the robot including how to perform autonomous driving subfunctions, and managing the interactions between the weed exterminator and the drive system.
  • Built a Madgwick-inspired pose estimator for calculating the orientation of the robot while driving, to prevent accidentally driving into orientations that would require manual human intervention to recover.
  • Championed a containerized software architecture composing the robot from microservices, giving a scalable and testable system with hardware components mocked out for development.
  • Built a telemetry gathering system that leveraged the same message bus used for inter-process communication, allowing testing and more importantly playback of recorded data that lead up to bugs being discovered. Also implemented a Grafana visualizer dashboard to automatically deploy with the robot from version controlled (in git repository) dashboard files.
SpaceX Corp Sep 2015 to March 2020
Starlink Satellite Internet
Flight Software Engineer 2

Responsible for all aspects of Telemetry, Tracking, and Control ground software systems and architecture. As member of the team, reviewed code and architecture direction from peers. Principally responsible for hardware/vendor abstraction antenna dish controlling software to integrate with company standard software stack, and the antenna time scheduler for allocating communications with satellites. Built constellation network simulation software from scratch using data collated from public sources for analysis to optimize business operations and deployment plans.

  • Built a Geo Information System database and analysis system for siting the gateways bridging the satellite network to the terrestrial internet, distributing traffic so no single ground connection saturated. Became a critical data source across satellite, network, and business operations.
  • Designed and deployed the satellite communication task scheduler prioritizing and dispatching traffic between satellites and ground data centers - health monitoring, telemetry and ephemeris updates, and software updates in flight.
  • Built a general-purpose antenna dish operating application extensible to any vendor's hardware over any interface, with proprietary algorithms for reliably acquiring satellites despite unpredictable sources of error.
  • Directly supported satellite operations with software by providing many mission critical tools to ensure the safe and reliable operation of vehicles in space.
  • Overhauled MVP architecture used for demonstration mission into a production ready global satellite internet service provider back-end capable of servicing billions of users.
  • Architected a complete software defined network interoperating with TCP/UDP alongside a proprietary space-optimized protocol built for variable-delay satellite links.
  • Lead investigator across control and data plane traffic, finding where and why radio throughput suffered, working with the Satellite Broadband Communication Integration team on ground-side and bidirectional aiming challenges.
  • Co-authored the self-alignment algorithm for in-house Ka radio dishes and drove it from inception to a product deployable worldwide on power and network alone - system design, firmware, hardware and data plane control, and deployment debugging.
Mark One Lifestyle Inc Oct 2014 to Aug 2015
Vessyl Smart Cup
Director of Firmware and Algorithms

Built and managed two inter-related software teams delivering the firmware and algorithms for the Vessyl smart cup; owned the technical specification, selected major hardware, and mentored the junior developers.

  • Designed and built from scratch a command-line IDE that combined Visual Studio, MSBuild, Keil µVision, MDK-ARM, and Git for cohesion between developers and workstation configurations.
  • Crafted a chip vendor independent, event driven, embedded operating system focusing on power efficiency, featuring a decentralized cross-library signalling mechanism and extensive debugging capabilities.
  • Developed core IP signal processing and machine learning algorithms for drink identification and nutrient detection.
  • Wrote a MatLab based visualization front-end for demonstrating the technology to investors and press, and for internal testing of sensor hardware iterations.
Microsoft Corp Dec 2011 to Oct 2014
Personal Devices
Software Development Engineer

Worked extensively on biometric algorithms alongside Microsoft Research focusing on world-first automatic human activity recognition and exercise agnostic repetition counting. Organized rigorous scientific validation studies of established medical science papers, identifying critical flaws, and incorporating the fixed implementations into the Microsoft Band product.

  • Invented an algorithm for repetitive exercise counting leveraging established techniques from audio beat and pitch detection.
  • Ported a Matlab based machine learning proof-of-concept algorithm to an embedded platform using custom built math libraries and processing pipeline optimization tricks.
  • Innovated testing methods for validation of algorithms running on device.
  • Developed an algorithm for estimating a user's heart rate based on their activity level to interpolate between actual measurements being taken, allowing for a 90% efficiency gain at no loss of fidelity.
Disney Research Pittsburgh Aug 2011 to Dec 2011
TeslaTouch
Product Development Engineer

Revised a research hardware prototype into a cost effective and mass producible design. Developed versatile and fault-tolerant embedded software to integrate with existing host driver and software. Designed, simulated, and prototyped electronics for driving high voltage, human contact safe signals.

  • Built a USB powered 400VDC constant current boost circuit and used it to modulate a software defined analog waveform.
Microsoft Corp May 2011 to Aug 2011
Xbox Accessories Incubation
Intern Incubation Engineer
  • Conducted research on the feasibility of technologies to be used in future Xbox accessories.
  • Developed alternative proprietary technologies, algorithms, and formulas for achieving desired end-user experiences.
  • Worked with vendors to identify problems and rapidly fix/mitigate their effects.
  • Constructed a test harness and demonstration application that allowed rapid testing and metrics gathering on hardware iterations.
Microsoft Corp May 2010 to Aug 2010
Windows Direct2D
Intern Software Development Engineer
  • Built an entire SVG Player implementation to SVG 1.1 specifications on the new Windows 8 Direct2D framework.
  • Deployed the SVG Player on a distributed testing platform to quickly analyze the performance of Direct2D library changes using a large battery of diverse tests.
  • Researched possible improvements to the Direct2D API, including ways to improve performance in special cases and ways to make typical use cases for developers easier to program.
  • Presented the research findings to the entire Direct2D team, led the discussion on implementing the changes, and defended the position under challenge from the team.
Carnegie Mellon University May 2007 to May 2010
Robotics Institute
Research Associate
  • Designed and deployed the controlling hardware and sensors for use inside a research boat, including writing drivers that incorporated custom inter-process communication.
  • Assembled by hand, tested, and debugged complicated circuit boards involving a variety of construction techniques, and loaded them with control software before deployment in the field.
  • Wrote simulation and data parsing/graphing scripts in MATLAB.
Astrobotic Technologies Aug 2008 to Dec 2008
RedRover
Power management team
  • Worked on the solar panel research and design team.
  • Responsible for mission critical calculations and simulations regarding power supply for a robot on the moon.

Projects

SWANDRIVE Aug 2010 to May 2011
Smart Wireless Analysis Network for Driver Information and Vehicle Efficiency
  • Developed a low-level fault-tolerant mesh network protocol based on IEEE 802.15.4 for use in and around automobiles.
  • Future technology tolerant architecture, based around a unified message passing protocol.
  • Designed and implemented many diverse sensors to capture valuable operating parameters of a vehicle.
  • Tested the system by mounting it to a go kart and used for telemetry and performance tuning.
JEULES Aug 2009 to May 2011
JEULES Energy Usage Learning Electrical Socket
  • Designed and developed a robust energy metering device for replacement of conventional electrical sockets.
  • Incorporated an ad-hoc mesh network of inexpensive, low power nodes to communicate information to a central server.
  • Custom PCB development, with focus on high signal integrity and ultra-low power usage.
  • Performed mechanical and electrical design.
  • First place winner of 2010 IBM Smarter Planet award, and Second place of 2010 Lockheed Martin Eta Kappa Nu award.
AAIT Aug 2007 to Aug 2009
Assistive Automotive Intelligence Technology
  • Lead a small team to design, build, and test a technology designed to improve safety of cars while simultaneously improve the efficiency of driving habits.
  • Designed a full sensing and processing package to be fitted onto a small 1/10th scale car design.
  • Presented project at the Carnegie Mellon Undergraduate Research Symposium.

Skills and Technology

Personal Skills
  • Algorithm Research & Development
  • Low-level Optimization
  • Full-stack Debugging
  • System Architecture
  • Data & Information Analysis
  • Product Life cycle Management
  • Technical Leadership
  • Machine Learning Application
  • Tech Specification Development
Platforms, Tools, and Technologies
  • Debian/Ubuntu
  • Docker
  • Kubernetes
  • Embedded Linux
  • PostgreSQL
  • MariaDB/MySQL
  • Bazel
  • InfluxDB
  • Grafana
  • ZeroMQ
  • MQTT
  • Windows
  • Visual Studio
  • Matlab
  • VMWare
  • Pro-FX
  • HyperV
  • Cadence
  • Altium Designer
Languages
  • .rs Rust , 100% proficiency
  • .cpp C++ , 100% proficiency
  • .c C , 100% proficiency
  • .py Python , 100% proficiency
  • .sh Bash , 100% proficiency
  • .sql SQL , 100% proficiency
  • .js JavaScript , 40% proficiency
  • .ts TypeScript , 40% proficiency
  • .cs C# , 10% proficiency
  • .java Java , 10% proficiency
  • .asm Assembly , 10% proficiency
  • .bat Batch , 10% proficiency
  • .ps1 Powershell , 10% proficiency
  • .pl Perl , 10% proficiency
  • .php PHP , 10% proficiency

Patents

  • Extending Gameplay With Physical Activity Monitoring Device - USPTO Grant # 8951164
  • Automatic Exercise Segmentation And Recognition - USPTO Grant # 9174084
  • Personal Training With Physical Activity Monitoring Device - USPTO Grant # 8951165
  • Motion Based Estimation Of Biometric Signals - USPTO Grant # 9717427
  • Intelligent Vessel - WIPO Publication # WO2015175969

Publications

RecoFit: Using a Wearable Sensor to Find, Recognize, and Count Repetitive Exercises
ACM CHI 2014DOI 10.1145/2556288.2557116