Projects

Data Fusion of GNSS with LEO Satellites as Alternate-PNT Systems Including Anomaly Detection

Principal Investigator(s): 
Ricardo Sanfelice (UCSC)
Executive Summary: 

The objective of this proposed project is a novel software-defined, resilient, network-based Position, Navigation, and Timing (PNT) system that has the potential to provide robust PNT for single-weapon and network-enabled weapon systems of interest to AFRL/RWWN. This proposed technology efficiently utilizes network signals from Low Earth Orbit (LEO) satellites (LEO PNT), Time Difference Of Arrival (TDOA), and Kalman filtering methods to provide accurate and precise PNT. Note that there is no need to collaborate with, or communicate via, the LEO satellites themselves. Rather, the proposed technology uses the LEO Satellites as RF Signals Of Opportunity (SOOP). Reference stations (stationary or mobile) at known locations measure TOA data of the LEO satellites that they can opportunistically receive. These TOA data are securely streamed to Command-and-Control (C&C) servers located in-theatre or secured in the cloud. The C&C servers compute position, velocity, altitude (PVA) for all of the LEO satellites that are in-theatre and stream the resulting LEO PVA and TOA to the in-theatre assets e.g., Aircraft, Drones, Munitions, and Mounted or Dismounted warfighters. Given the PVA and TOA, this technology enables assets to navigate to waypoints and targets to sub-meter accuracy using alt-PNT as a robust alternative to the easily spoofable and jammable Global Navigation Satellite Systems (GNSS). Proposed alt-PNT algorithms are modular to facilitate integration with existing RF network interfaces or use advanced low-probability of detection/interference (LPOD/I) Ultra-Wide-Band (UWB) network transceivers, and very importantly, their implementation is intended on COTS Software Defined Radios (SDR). All PVA and TOA data are recorded at the C&C servers for forensic analysis and algorithm testing and improvement.

MultiHyRL: Robust Hybrid RL for Obstacle Avoidance against Adversarial Attacks on the Observation Space

Principal Investigator(s): 
Ricardo Sanfelice (UCSC), Prashant Ganesh (EpiSci)
Executive Summary: 

The objective of this work is to generate new fundamental science for hybrid dynamical systems that enables systematic design of algorithms using reinforcement learning (RL) tech- niques that are hybrid. Hybrid systems are dynamical systems with intertwined continuous and discrete behavior. Hybrid controllers are algorithms that involve logic variables, timers, memory states, along with the associated decision-making logic. The combination of such mixed behavior, both in the system to control and in the algorithms, is embodied in key future engineering systems. The future autonomous systems will have variables that change continuously according to physics laws, exhibit jumps due to controlled switches, replanning of maneuvers, on-the-fly redesign, and failures, while the control algorithms require logic to adapt to such abrupt changes. Hybrid behavior also emerges in such engineering systems due to their complexity. In fact, communication events, abrupt changes in connectivity, and the cyber-physical interaction between vehicles, humans, robots, their environment, and com- munication networks lead to impulsive behavior that interacts with physics and computing. In this project, we propose to develop novel hybrid reinforcement learning control algorithms that can be validated in experimental data-driven testbeds. The proposed combination of hybrid control and learning informed by real-time data exploits – in a holistic manner – key robust stabilization capabilities of hybrid feedback control and learning capabilities of RL for autonomous systems of interest to AFRL that are part of the broad mission of the DoD.

Learning Algorithms for Hybrid Dynamical Systems using Experimental Data

Principal Investigator(s): 
Prof. Ricardo Sanfelice (UCSC)
Executive Summary: 

The objective of this work is to generate new fundamental science for hybrid dynamical systems that enables systematic design of algorithms for learning the parameters, dynamics, and constraints of such complex systems, using experimental data. Hybrid systems are dynamical systems with intertwined continuous and discrete behavior. Hybrid controllers are algorithms that involve logic variables, timers, memory states, along with the associated decision-making logic. The combination of such mixed behavior, both in the system to control and in the algorithms, is embodied in key future engineering systems. The future autonomous systems will have variables that change continuously according to physics laws, exhibit jumps due to controlled switches, replanning of maneuvers, on-the-fly redesign, and failures, while the control algorithms require logic to adapt to such abrupt changes. Hybrid behavior also emerges in such engineering systems due to their complexity. In fact, communication events, abrupt changes in connectivity, and the cyber-physical interaction between vehicles, humans, robots, their environment, and communication networks lead to impulsive behavior that interacts with physics and computing. The intellectual impact of the proposed research plan stems from a novel use of hybrid control theory, one that leads to experimental data-driven learning algorithms for hybrid systems that are not only robust but also optimal. The proposed combination of hybrid control and optimization in- formed by real-time data exploits–in a holistic manner–key robust stabilization capabilities of hybrid feedback control and optimality guarantees of receding horizon control for com- plex autonomous systems of interest to AFOSR that are part of the broad mission of the DoD.

AFOSR: Verification and Validation of Autonomous Systems with Hybrid Dynamics under Uncertainty

Principal Investigator(s): 
Ricardo Sanfelice (UCSC), Michael Wehner (U. Wisconsin), Daniele Venturi (UC Santa Cruz), Shai Revzen (U. Michigan)
Executive Summary: 

In conventional design processes, the design of the plant, the controller, the prototype as well as the certification of validity are products of consecutive phases of development utilizing distinct simulation, fabrication, and synthesis tools. Each phase produces an “optimal” solution, which is typically not jointly optimal for all phases. Phases need to be restarted from scratch if a new edge case or catastrophic failure is discovered at a later stage, and the interaction between failures, fabrication tolerances, and model inaccuracy is murky at best. Instead, we propose to combine rapid prototyping, hybrid systems techniques for modeling and control, formal verification, and quantified uncertainty and risk models for systematic autonomous system development. New advanced systems have raced ahead of our ability to analyze them, while advanced manufacturing technologies allow us to quickly and inexpensively build them. The paradigm we propose rapidly prototypes the design, validates its fabrication, and quantifies both its performance and its failure risk by conducting physical tests of the prototypes. This allows the new paradigm to rationally improve this combined representation without being subject to reality-gaps in simulation, and without requiring catastrophic restarts when new edge cases and failure modes are discovered.

NSF: Collaborative Research: CPS: Medium: Constraint Aware Planning and Control for Cyber-Physical Systems

Principal Investigator(s): 
Prof. Ricardo Sanfelice (UCSC), Prof. Shai Revzen (UMich)
Executive Summary: 

The objective of this work is to generate new fundamental science for computer controlled complex physical systems, a broad class of cyber-physical systems (CPS), and demonstrate this science in aerial vehicles and walking robots.  The new science enables autonomous planning and control in the presence of failures and abrupt changes in system variables.  A framework for the design of algorithms that exploit awareness of the physical and design constraints to autonomously self-adapt their motion plan and control actions will be generated.  The approach exploits elements from geometry, adaptive control, and hybrid control to advance the knowledge on modeling, planning, and design of CPS with constraints, nonsmooth, and intertwined continuous and discrete dynamics.  Unlike current approaches, which separate the task associated with planning the motion from the design of the algorithm used for control, the algorithms to emerge from this project self-learn and self-adapt in real time to cope with unexpected changes in motion and specification constraints so as to enable autonomous systems to perform robustly and safely, and degrade gracefully under failure conditions.  Specifically, the new algorithms will learn and monitor the physical and design constraints in real time, and adapt both planner and controller by selecting the appropriate constraints to enforce, with robustness and safety guarantees.  The capabilities of the new tools will be demonstrated on multi-legged robots in harsh environments that make them prone to failures, and on aerial vehicles in contested/adversarial environments.

The proposed plan contributes to Science of Cyber-Physical Systems by addressing modeling, motion planning, and design of CPS with constraints, nonsmooth, and intertwined continuous and discrete dynamics. The merits of the proposal fall into four broad categories: (i) a framework to mathematically formulate learning-based planning and control for CPS with awareness of its constraints, (ii) novel architectures that lead to robust adaptive constraint satisfaction,  (iii) deep understanding of roles and priorities of system constraints in CPS, and (iv) tools and design techniques that permit engineers to deploy constraint aware algorithms. The results of this work are broad in their application to all kinds of CPS that require planning and control, in particular, autonomous systems in transportation (air and ground). Synergistic collaborations with researchers at Samsung, the start-up Ghost Robotics, and at the University of Bologna are instrumental in disseminating the application of our results to industry and academia.  A synergistic outreach program at UCSC and the University of Michigan impacts high school students and teachers.

AFOSR SURI: Digital Twin Enabled Autonomous Control for On-Orbit Spacecraft Servicing

Principal Investigator(s): 
Prof. R. Sanfelice (UCSC), Prof. I. Kolmanovsky (U. Mich), Prof. K. Willcox (U. Texas at Austin), Prof. D. Venturi (UCSC)
Executive Summary: 

This multidisciplinary program of basic and applied research addresses the challenges of autonomous on-orbit space operations. A novel program of mathematical, computational and engineering research addresses foundational challenges in 1) digital twin technology, 2) feedback control algorithms and 3) human-machine-aware supervisory schemes, all in the context of space systems. A campaign of experimental validation and demonstration in multiple testbeds serves to integrate the research advances; validate, robustify and harden the algorithms; and enable transition of research products into DoD applications. Key novel research ideas include: 1) a probabilistic graphical model foundation for digital twins that automates model calibration and updating, makes data-model integration scalable across many assets and quantifies uncertainty; 2) new feedback control algorithms that leverage model predictive control to achieve control for on-orbit space operations under stringent constraints, and handle uncertainty by accounting for hybrid and set-valued dynamics; 3) new human-machine-aware supervisory schemes targeting uncertain and contested operating environments, synthesized as hybrid control schemes that coordinate control algorithms across different phases of the mission, address recovery from unexpected conditions, and incorporate the role of potential human intervention. Experimental demonstration in testbeds covers mission-specific features in three case studies: on-orbit assembly, decommissioning and towing, and on-orbit refueling. Experiments will be conducted at ERAU, UCSC, NPS, and AFRL/RV, specifically, in the multiple testbeds at the ROC lab, the BONSAI lab, the SPACER lab, and the LINCS lab. The experimental phase is a stepping stone for the development of a flight demonstration in collaboration with AFRL/RV and industry partners. The effort involves industry partners with unique expertise in space operations and the case studies driving the project.

STMicroelectronics: Incorporating STMicroelectronics Drone Kit in UC Santa Cruz’s Robotics Engineering Program

Principal Investigator(s): 
Prof. Ricardo Sanfelice (UCSC)
Executive Summary: 

Developing high-quality drone technology is essential for the emerging global market, as drones are able to perform increasingly complex tasks with limited human intervention. Businesses and defense organizations are increasing their investments in drone research to aid in military emergency response, disaster relief, and damage assessment during wildfires, hurricanes, and earthquakes. Utilizing innovative engineering technology to design high quality, autonomous drones is our goal.

As building drones helps students develop valuable skills in robotics and hardware design, we propose a project to incorporate STMicroelectronics drone kit STEVAL-DRONE01 in our educational program. The goal of the project is to design a curriculum to enrich our Robotics Engineering, specifically, our course ECE8: Robot Automation: Intelligence, through Feedback Control through the use of STMicroelectronics drone kits. To this end, we developed a series of six ECE8 labs, which are detailed below, that to fit teaching modality during the pandemic, can be carried out remotely. The labs developed incoroporating STMicroelectronics drone kit are available at the following website: https://hybrid.soe.ucsc.edu/incorporating-stdrone-in-robotics-education

AFOSR DURIP: A Test Bed for Verification and Validation of Autonomous Systems with Hybrid Dynamics under Uncertainty

Principal Investigator(s): 
Prof. R. Sanfelice (UCSC), Prof. D. Venturi (UCSC), Prof. M. Wehner (U. Wisconsin)
Executive Summary: 

In conventional design processes, the design of the plant, the con- troller, the prototype as well as the certification of validity are products of consecutive phases of development utilizing distinct simulation, fabrication, and synthesis tools. Each phase produces an “optimal” solution, which is typically not jointly optimal for all phases. Phases need to be restarted from scratch if a new edge case or catastrophic failure is discovered at a later stage, and the interaction between failures, fabrication tolerances, and model inaccuracy is murky at best. To overcome these issues, and building from our effort as part of a current AFOSR grant, we propose to build a test bed implementing a coherent and provably rational methodology for automated design optimization, modeling, test and evaluation, and validation of autonomous systems with guaranteed levels of risk and robustness to uncertainty. The test bed will permit prototyping, experimentation, and redesign of autonomous systems and their components in an unified system. No such test bed is known yet to exist.

Collaborative Research: CPS: Frontier: Computation-Aware Algorithmic Design for Cyber-Physical Systems

Principal Investigator(s): 
Prof. R. Sanfelice (UCSC), Prof. M. Arcak (UC Berkeley), Prof. L. Thi Xuan Phan (Penn), Prof. J. Sprinkle (Vanderbilt), Prof. M. Zamani (CU Boulder), Prof. A. Halder (UCSC), Prof. H. Litz (UCSC)
Executive Summary: 

This project explores a new vision of cyber-physical systems (CPSs) in which computing power and control methods are jointly considered. The approach is carried out through exploration of new theories for the modeling, analysis, and design of CPSs that operate under computational constraints. The tight coupling between computation, communication, and control pervades the design and application of CPSs. Due to the complexity of such systems, advanced design procedures that cope with the variability and uncertainty introduced by computing resources are mandatory, though the design choices are across many disciplines, which may result in over-design of a system. The project will have significant impact through the reduction in design and development time for complex cyber physical systems including ground, air, and maritime vehicles.

The proposed innovative research plan will advance the knowledge on modeling, analysis, and design of high-performance CPSs operating under computational constraints. By combining key expertise from hardware architecture, real-time systems, nonlinear control, hybrid systems, and optimization algorithms, the developed CPSs will execute algorithms that adapt to the platforms they operate in and to the environment they are deployed on. Additionally, the new platforms to emerge from this project may adapt to the algorithms, through reallocation of resources and self-adaptation/augmentation at runtime, by learning the main features of the platform (e.g., execution time, memory footprint, and power consumption) and of the physics (e.g., dynamics, actuation, sensing). This project will also generate tools to automatically design, synthesize, and implement feedback control algorithms that are compatible with both the physics and the computing platforms in the CPSs. Tools will be validated experimentally in intelligent transportation applications, including real-world ground, aerial, and marine autonomous vehicles, both in-house and in collaboration with our academic and industrial partners.

The broader impacts of this project stem from the potential to enable a new generation of transportation systems that improve the reliability and security of autonomous systems. The research in this project significantly addresses the growing carbon footprint challenge through efficiencies in computational CPS infrastructure, optimization of routes, and by increasing the utilization of autonomous systems. Industry partners may deploy enhanced safety and performance innovations on legacy vehicles, diversify hardware applications, and expand future technologies. Additional efforts in mentoring and undergraduate research are focused on Broadening Participation in Computing, with the goal to empower a new generation of researchers who are passionate to have impact on a societal scale.

Center of Excellence: Assured Autonomy in Contested Environments

Principal Investigator(s): 
Prof. R. Sanfelice (UCSC), Prof. R. Bevilacqua (UF), Prof. K. Butler (UF), Prof. W. Dixon (UF), Prof. N. Fitz-Coy (UF), Prof. M. Hale (UF), Prof. M. Pajic (Duke), Prof. J. Shea (UF), Prof. U. Topcu (UT), Prof. M. Zavlanos (Duke)
Executive Summary: 

The proposed Center of Excellence will pioneer the development of fundamental theories and methods to enable assured autonomous mission execution in complex, uncertain, and adversarial conditions. Our vision is that assured autonomous operations by a network of agents in contested environments require an integrated focus on the complex union of both physical and information dynamics within the analysis, design, and synthesis of logical decision making and control design. Efforts will focus on the availability, integrity, and effective use of information by leveraging our team’s diverse toolsets in dynamics, mathematics, control theory, information theory, communications, and computer science. Networks of autonomous systems will require information exchanges of many data types, including high-level mission specifications and sensor feedback for navigation and control. The goal of assuring autonomy is complicated by the interplay between dynamics of autonomous agents and the stochastic and intermittent dynamics of network traffic. This challenge is further amplified by delays and asynchrony in information flows. Information perturbations can also emanate from adversarial actors in unique and complex ways, requiring security-aware design and analysis methods. For example, we will develop techniques to protect mission-critical information and prevent information disruption/corruption. These challenges must be addressed considering resource limitations and quantitative tradeoffs.

Pages