GSAW 2020 Agenda, Presentations, & Tutorials
“Opportunities in Data Exploitation”
Select to view agenda:
Monday, March 2, 2020
Tuesday, March 3, 2020
Wednesday, March 4, 2020
Thursday, March 5, 2020
Monday, March 2, 2020
Tutorials
Chair: Anil Agrawal, The Aerospace Corporation
A: Model Based Systems Engineering for Ground Systems
Instructor: Mark McKelvin, The Aerospace Corporation
B: An Overview of Ground Systems for Satellite Operations
Instructors: James Anderson and Donald Town, The Aerospace Corporation
C: Alternative Software Development Approaches
Instructors: Supannika Mobasser, Curt Holmer, and Brook Cavell, The Aerospace Corporation
D: Demystifying Machine and Deep Learning
Instructors: Rohit Mital, KBR and Joseph Coughlin, The Aerospace Corporation
E: Reducing the Software Risk in Ground System Software
Instructor: Brandon Bailey, The Aerospace Corporation
F: Large Scale Mission Software Data Exploitation
Instructors: Barry Boehm and Pooyan Behnamghader, University of Southern California
G: Introduction to Satellite Communications
Instructors: Rob Andzik and Brian Willette, AMERGINT Technologies Inc.
H: DevOps/DevSecOps and Agile
Instructors: Supannika Mobasser, Curt Holmer, and Brook Cavell, The Aerospace Corporation
I: Ontologies for Space and Ground Systems
Instructor: Barry Smith, National Center for Ontological Research
J: Moving from Reactive to Pro-Active Cyber Resiliency
Instructor: Barry Lyons IV, KPMG LLP
K: Introduction to Open Systems Specifications for Space
Instructors: Rob Ritter, IMI—RT Logic; Brad Kizzort, Peraton, Inc.; Gerry Simon, Braxton Technologies; Luis Rodriguez, Amergint Technologies; Jay Bugenhagen, ASRC Federal Technical Services; and Justin Boss, Kratos
L: Practical Data Exploitation with Machine Learning for Cyber Defense
Instructors: Douglas Woodward and Nicholas Cohen, The Aerospace Corporation
Tuesday, March 3, 2020
Session 1: Keynote Session
Announcements and Introduction
Rick Johnson, GSAW 2020 Chair, The Aerospace Corporation
Welcome Address
Tammy Choy, Vice President, Chief Information Officer, The Aerospace Corporation
Keynote Address
Brig. Gen. Donna Shipton, Vice Commander, Space and Missile Systems Center
Session 2: Machine Learning
Chair: Chris Wallisch, The Aerospace Corporation
Operational Use of Machine Learning for Anomaly Detection
Paul Hudgins and Timothy Allard, General Dynamics Mission Systems
Evolving Neural Network Ensembles for Reliable Time Series Prediction
Philip Feldman, ASRC Federal
Exploiting Data at Mission Speed Through Artificial Intelligence
Virginia Cevasco and David Keppel, Booz Allen Hamilton
Session 3: Development Methodologies
Chair: Anil Agrawal, The Aerospace Corporation
Developing Ontologies and Their Role for Engineering Information Fusion Systems
David Limbaugh, University at Buffalo; Barry Smith, National Center for Ontological Research; and Ron Rudnicki, CUBRC
Minimum Viable Process: Iterative, Incremental Process Design with Minimal Data
Peter Capell, Suzanne Miller, Nanette Brown, and Crisanne Nolan, Software Engineering Institute, Carnegie Mellon University
Is Structured Agile an Oxymoron? Tales from Implementing and Executing Agile in a U.S. Government Environment
Theresa Beech, Sharon Orsborne, Jay Bugenhagen, Barbara Medina, and Jay Czarnecki, NASA Goddard Space Flight Center
Featured Lunchtime Speakers
Chair: Chris Wallisch, The Aerospace Corporation
Double Asteroid Redirection Test (DART): NASA’s First Planetary Defense Mission
Deane Sibol, Ground Data System (GDS) Lead, Johns Hopkins Applied Physics Laboratory
Satellite Data Analytics and Applications; Building Capacity for Data Exploitation and Utilization Through STEM
L. DeWayne Cecil, Destination SPACE; Eve Currens, Isabella Field, Hunter Miller, and Duncan Horvath, Nesbitt Discovery Academy
Session 4: Enterprise Components
Chair: Don Sather, The Aerospace Corporation
What Do You Think That Cloud Looks Like?
Rob Andzik, AMERGINT Technologies Inc. and Shayn Hawthorne, AWS Ground Station
Active Archival of Flight Engineering Data
James Michael “Myche” McAuley, NASA/Jet Propulsion Laboratory, California Institute of Technology
State and Evolution of Data Analytics Infrastructure at ESOC
Rui Santos and James Eggleston, European Space Operations Centre (ESOC)
Session 5: Data Exploitation
Chair: Anil Agrawal, The Aerospace Corporation
What Can We Learn from One Billion Ground System Log Messages?
Jay Bugenhagen, ASRC Federal Technical Services; Sharon Orsborne, Dan Smith, and Theresa Beech, NASA Goddard Space Flight Center
Preparing Spacecraft Mission Data for Machine Learning—Featurization of the Ground Data System
Jack Lightholder and James Michael “Myche” McAuley, NASA/Jet Propulsion Labora- tory, California Institute of Technology
Minimum Effort Telemetry Data Mining
Christopher O’Hare, Simon Gewirtz, and Jonathan Labin, The Johns Hopkins University Applied Physics Laboratory (JHU/APL)
A Scalable and Open Data Platform for Data Exploitation
Loic Coulet, Training and Cyber, Kratos Space
Session 6: Flexible Approaches
Chair: Dan Smith, NASA Goddard Space Flight Center
An Open Architecture for an Infinitely Scalable C2 System Using Docker, Kubernetes, and Istio
Ryan Melton, Ball Aerospace
Microservices Architecture for a Resilient, Scalable, Distributed and Zero-downtime Ground Segment
Enrique Fraga, Gregorio Juliana Quirós, Elena Godino Llani, and Cristina Morán Capa, GMV
Flexible Operations on ASTERIA with Cloud-based Ground Station Services
Peter Di Pasquale, Kyle Hughes, Alessandra Babuscia, Lorraine Fesq, NASA/Jet Propulsion Laboratory, California Institute of Technology
Session 7: Working Group Previews
Chair: Michelle Carter, The Aerospace Corporation
Session 11A: Agile Retrospective: Opportunities to Perform Agile Acquisition Differently
Leads: Supannika Mobasser and Jodene Sasine, The Aerospace Corporation
Session 11B: Automation in Contested and Congested Space
Leads: Donald Sather and Carlos Rexach, The Aerospace Corporation
Session 11C: Cloud Computing and Big Data Technologies for Ground Systems
Leads: Ramesh Rangachar and Craig Lee, The Aerospace Corporation
Session 11D: Semantic Consistency—a Critical Enabler for Big Data Analytics
Leads: Victor Rohr, The Aerospace Corporation and Ron Rudnicki, CUBRC, Inc.
Session 11E: Intelligent Systems / Machine Learning for Space Ground Systems
Leads: Jon Neff and Dan Balderston, The Aerospace Corporation
Session 11F: Improving Data Exploitation for Engineers and Operators Through Model-Based Engineering
Leads: Ryan Noguchi and Fredda Lerner, The Aerospace Corporation
Session 11G: Using Data for Novel Approaches in Cybersecurity: Detecting Threats, Reducing Risk and Ensuring Data Integrity
Leads: Scott Niebuhr and Michelle Yohannes, The Aerospace Corporation
Wednesday, March 4, 2020
Session 8: Keynote Session
Announcements
Rick Johnson, GSAW 2020 Chair, The Aerospace Corporation
Introduction
Jerome Bennett, Chief of the Software Engineering Division, NASA Goddard Space Flight Center
Keynote Address
Dr. Prasun Desai, Deputy Associate Administrator, NASA Space Technology Mission Directorate
Session 9: Mission Operations
Chair: Costin Radulescu, NASA/Jet Propulsion Laboratory, California Institute of Technology
Integrated Mission Operation Concepts for the Dream Chaser Spacecraft
Gilles Kbidy, L3Harris; David Kortenkamp and Scott Bell, TRACLabs; Jason Gabbert and Jeremy Owen, Sierra Nevada Corporation
LEO Doppler Curves Satellite Tracking and Characterization
Capt. Jean-Francois Guimond, Defence R&D Canada and Simon Henault, Ottawa Research Centre
Anomaly Detection for Spacecraft/Rover Telemetry Using Long Short-Term Memory Network
Valentino Constantinou and Ian Colwell, NASA/Jet Propulsion Laboratory, California Institute of Technology
Complex Event Processing for Mission Operation Systems
Marcus Wallum, European Space Agency
Session 10: Addressing Resilience
Chair: Antonio Sanders, NASA/Jet Propulsion Laboratory, California Institute of Technology
Resilient Space Services Through Hybrid Military/Commercial Architectures
Clay Bosler, Lan Nguyen, and Rich Gobbi, LinQuest Corporation
A Methodology for Developing Effective and Efficient Cybersecurity Architectures for Data Centers
William Belei, Peter Katsumata, Wai “Sky” Troyer, and Matthew Thomas, The Aerospace Corporation; Nathan Pritchard, Booz Allen Hamilton Inc.; and Ryan Greenleaf, ENSCO Inc.
Using Distributed Ledger for Managing Trust Among Data Exchanges
Rohit Mital, KBR Inc.
Session 11: Working Groups
Session 11A: Agile Retrospective: Opportunities to Perform Agile Acquisition Differently
Leads: Supannika Mobasser and Jodene Sasine, The Aerospace Corporation
Agile software and system development is no longer a new topic for the government sector. Current software development standards and guidance do not enable successful Agile adoption for government programs. Ground software systems are usually large in scale and high in complexity so there is a need to balance between agility and discipline. The challenge for these systems is to smartly apply Agile concepts, not only to software system development, but throughout the whole ground system acquisition life-cycle. What can we do differently to enable smarter, Agile- informed acquisition strategies?
This working group provides an opportunity for agile practitioners to share their experiences and learn from others on several topics regarding challenges in agile acquisition, such as:
- Agile-compatible milestones and battle rhythm
- Deliverables: what, when, and how?
- Continuous integration, verification, and testing
- Just-in-time certification and accreditation
- Collective ownership between government and contractor
- Smarter and faster data-driven metrics
The format of the working group will be a combination of presentations, case studies, and interactive discussion focusing on different aspects of agile adoption for ground system acquisition and software system development.
Presentations:
Agile Retrospective: Opportunities to Perform Agile Acquisition Differently
Supannika Mobasser and Jodene Sasine, The Aerospace Corporation
Agile Readiness at SMC: Applying agile principles and practices in a high stakes acquisition environment
Capt. Honghao Patrick Wu, U.S. Air Force
Using Organizational Baselining to Inform Adoption Planning of New Practices
Suzanne Miller and Bart Hackemack, Software Engineering Institute, Carnegie Mellon University
Session 11B: Automation in Contested and Congested Space
Leads: Donald Sather and Carlos Rexach, The Aerospace Corporation
If we are to operate within the tactical timelines required in a contested and congested space, satellites and ground systems will need to become increasingly automated.
Likewise, today’s limited view of automation as a means to liberate operators from repetitive and error-prone actions will need to evolve. Systems will need to become aware of their environments and then respond appropriately without operator input. This will require new architectures able to extract all relevant information from larger data sets, embedded tactical procedures to identify correct solutions, and new human/machine interfaces and methods to integrate operators into the decision loop when needed.
To address this, the Working Group will hear from operators, headquarters, laboratories, FFRDCs and commercial entities that will share their organizations perspectives and activities in developing systems that enable our warfighters to fight and win a war that extends into space.
Presentations:
Key Issues in Human Systems Integration: Addressing Automation in the Development and Operation of Large-Scale
Susan Dawes, The Aerospace Corporation
Automation in Contested and Congested Space
John Heskett, KSAT
Session 11C: Cloud Computing and Big Data Technologies for Ground Systems
Leads: Ramesh Rangachar and Craig Lee, The Aerospace Corporation
This is the tenth year of this working group. The main objective of the working group is to continue discussion on the adoption of cloud computing and Big Data in satellite ground systems. The Cloud Reference Model and Roadmap produced by Aerospace will be used to frame the discussion. The working group will focus on:
State of the art in cloud computing and ground systems technologies;
- Cloud reference models and roadmaps;
- Cloud-based ground systems;
- Cloud and Big Data technologies;
- Cloud security, standards, and compliance;
- Acquisition strategies for cloud-based systems;
- Cloud computing economics; and
- Cloud performance management.
This working group will consist of two parts. Part 1 will include presentations, case studies, and demonstrations related to cloud computing and Big Data for ground systems. Part 2 will be a town hall meeting on cloud computing and Big Data for ground systems. This will include a moderated discussion on the focus issues mentioned above, with expert opinions from panelists.
Presenters, panelists, and participants will include ground systems providers, integrators, and operators, cloud solutions providers, and others interested in ground systems and cloud computing.
Presentations:
The Trajectory of the GSAW Cloud Computing Working Group: 10 Years and Counting
Ramesh Rangachar and Craig Lee, The Aerospace Corporation
Migration to Cloud and Path to Modernization for JPSS Data Production System
Scott Kern and Josh Olson, Raytheon IIS
The Data Exploitation (DEX) Platform
Ann L. Chervenak, Eltefaat Shokri, Carlos Rexach, Carl Yu, Richard Yee, Karen Richardson, Joshua Stoermer, Caroline Jones, Samuel Konowitch, Mandy Ngo, Tyler Nguyen, Ryan Waer, and Chang Zhang, The Aerospace Corporation
Session 11D: Semantic Consistency—A Critical Enabler for Big Data Analytics
Leads: Steve Houchin, The Aerospace Corporation and David Limbaugh, SUNY Buffalo
The goal of this working group topic is to stimulate a discussion and explore pathways toward resolving the extremely tough challenges associated with integrating information held in widely disparate databases and systems. Core among these challenges, is the critical need for semantic and syntactic consistency. Building algorithms to extract knowledge from multiple sources of data today, frequently requires a data cleansing process to normalize the data before it can be fully exploited. Without semantic and syntactic standards, this normalization must be performed against all data sources used by the exploitation algorithm, requiring software modifications each time a new data source comes online.
From the perspective of semantics, an ontology provides a means through which “term and relations can be expressed using natural language” while at the same, being “captured in a formal language that is machine readable. … An ontology can help to achieve sharing of meaning because its terms are associated with formal definitions specifying their meanings in a way that can be processed computationally. If an ontology can be shared across participating organizations, then data can be exchanged in such a way that meaning is preserved if the data can be associated with corresponding shared ontology terms.” With semantic consistency based on formally defined terms, machine level understanding of information and the potential for powerful data exploitation is enabled. Without this consistency across disparate systems of information, higher order machine reasoning that is capable of continually leveraging the full corpus of both historic and current domain knowledge, remains impossible.
Presentations:
Building Blocks – A paradigm for product format design
Scott Houchin, The Aerospace Corporation
Semantic & Syntactic Consistency – A Critical Enabler for Big Data Analytics
Victor Rohr, The Aerospace Corporation and Ron Rudnicki, CUBRC
Session 11E: Intelligent Systems/Machine Learning for Space Ground Systems
Leads: Jon Neff and Dan Balderston, The Aerospace Corporation
Adaptive, reliable automation and intelligent decision making are essential for the success of our space ground systems. The challenge is finding the proper balance between human control and autonomy. Applied intelligent systems and machine learning technologies have begun to address these challenges through self-evolving, efficient, and value-focused capabilities. These approaches are often misunderstood, misapplied, too complex or costly to sustain, or insufficient for mission needs. In addition, unrealized opportunities exist for applying established, or rapidly emerging technologies, solutions and architectures to the area of ground system space control and mission processing.
The working group will explore deeper the questions of:
- Where do intelligent systems and machine learning currently exist in space ground systems?
- What underlying parts of the space ground systems, enterprise and operations are suited to intelligent systems and machine learning?
- What emerging capabilities and technologies are being developed in the community?
- What are real-world impediments for adoption?
- What capability and technology gaps exist and might seed further research and investment?
Presentations:
Detection and Reporting Preparation to Support JPSS-2
Jon Neff, The Aerospace Corporation
Lightning Round Panel
John Donohue and Dr. Zhenping, ASRC Federal
BrainBlocks – Leveraging Distributed Binary Representations
Jacob Everist, The Aerospace Corporation
Smart Systems for Space Operations
Garrett Brown, Karen Casey, Jabari Loving, and Tyler Reesey, Raytheon
Automated Data Accountability for Mars Science Lab
Brian Kahovec, Dr. S. Ryan Alimo, and Dr. Dariush Divsalar, Jet Propulsion Laboratory, California Institute of Technology
Session 11F: Improving Data Exploitation for Engineers and Operators Through Model-Based Engineering
Leads: Ryan Noguchi and Fredda Lerner, The Aerospace Corporation
In this Working Group, we hope to foster a mutually beneficial discussion of the community’s lessons learned and best practices in Model-Based Engineering (MBE). As in previous years, we plan to facilitate an open discussion of the issues and concerns of MBE to encourage broad participation from the assembled participants. We plan to open the session with a very brief presentation that sets the stage, but we have found that the discussion evolves on its own accord, leads the group in directions we can’t predict in advance, and results in the beneficial emergence of insightful conclusions and the identification of key challenges and opportunities that face the community.
In keeping with this year’s GSAW theme, we would like to focus the working group’s discussions on the ways in which MBE processes, methods, and tools can be used to integrate information and data from multiple sources and provide developers and operators with better insight about their systems and enterprises to inform programmatic, architecture, design, test, and operational decisions. We would like to share lessons learned from model-based engineering efforts, to understand how these modern methods and tools are able to improve organizations’ ability to achieve agility, enable greater proactivity, and capitalize on advances being made in machine learning, intelligent systems, automation, and innovative accelerated development processes.
No presentations
Session 11G: Using Data for Novel Approaches in Cybersecurity: Detecting Threats, Reducing Risk and Ensuring Data Integrity Leads: Scott Niebuhr and Michelle Yohannes, The Aerospace Corporation
Purpose of this Working Group is to present an array of topics to enhance Space Mission Resiliency. Additionally, this working group will focus on efforts to reduce cyber risks and ensure confidentiality and integrity of data in increasingly connected systems.
Some topics will include:
- Using vulnerability assessments to inform decision makers and reduce mission system cyber risk.
- Identifying cybersecurity threats hidden within partner and commercial streaming data.
- Using watermarks and blockchain technology to manage the supply chain of imagery data.
This working group will include participants from the civil, commercial, defense and intelligence communities.
Presentations
Re-defining Success of Ground Cyber Assessments
Brandon Bailey, The Aerospace Corporation
Using Blockchain for Imagery Supply Chain Management
Leon Davidson, Oracle National Security Group
Protecting the Satellite Data Fidelity by Monitoring the RF Spectrum at the Ground Station
Dr. Pouyan Amirshahi, The Aerospace Corporation and Steven Grippando, RFIMS Project Manager, NOAA
Secure Data Ingest
Gilles Kbidy, L3Harris Technologies
Session 12: Evening Session
Session 12A: Advancing Space Exploration at NASA’s Jet Propulsion Laboratory (JPL)
Leads: Antonio Sanders and Costin Radulescu, NASA/Jet Propulsion Laboratory, California Institute of Technology
Introduction: Dan Crichton
Keynote: Larry James, Deputy Director of JPL
“Building a Data-Centric Strategy for Space Observing Systems”
(Presentation currently not available)
This special session will highlight the exciting accomplishments and progress of several efforts currently being undertaken at the Jet Propulsion Laboratory. A virtual reality demonstration will also be available.
© 2020 by NASA/Jet Propulsion Laboratory, California Institute of Technology. Published by The Aerospace Corporation with permission
Big Data, Data Science and AI: Architectural Considerations
Daniel Crichton, NASA/Jet Propulsion Laboratory, California Institute of Technology
Large-scale Science Data Systems for SAR Missions, with On-Demand Machine Learning and Analysis-Ready Services
Hook Hua, NASA/Jet Propulsion Laboratory, California Institute of Technology
Mars 2020: Ground Data System – Utilizing the Cloud, Collaboration, and Automation to Enable Faster Operations
Hallie Abarca, Guy Pyrzak, Parker Abercrombie, Usha Guduri, and Justin Huang, NASA/Jet Propulsion Laboratory, California Institute of Technology
Navigation – Getting Where You Want to Go
David Berry, NASA/Jet Propulsion Laboratory, California Institute of Technology
Artificial Intelligence and Analytics in JPL’s Innovation Experience Center
Chris Mattmann, NASA/Jet Propulsion Laboratory, California Institute of Technology
Complex Data EXplorer (CODEX) – Know Thy Data
Jack Lightholder, Lukas Mandrake, Joshua Rodriguez, and Rob Tapella, NASA/Jet Propulsion Laboratory, California Institute of Technology
Session 12B: Government and Industry Dialog— Turning the Tables for GSAW 2020
Lead: Dan Smith, NASA Goddard Space Flight Center Moderator: Donald Sather, The Aerospace Corporation
In past years, GSAW has held evening sessions with government representatives on the panel talking about trends and taking questions from the commercial products and services providers. For 2020, we are turning the tables! Industry members will be on the panel explaining their views on trends, similarities and differences across the government agencies, and the business case for supporting small and large government programs. The audience members, including those from government space agencies and those from industry, may agree or disagree with panel members as we expand the conversation in new directions. With major commonality initiatives of the Space Force and NASA, and the amazing growth of commercial space, it should be an interesting evening with a mix of both common and contradictory ideas.
Presentation
Turning the Tables – GSAW 2020
Gerry Simon, Braxton
Thursday, March 5, 2020
Session 13: Keynote Session
Announcements
Rick Johnson, GSAW 2020 Chair, The Aerospace Corporation
Best Presentation Award Introduction
David Eccles, General Manager, Defense Systems Operations, The Aerospace Corporation
Keynote Address
Col. Ryan Colburn, Chief, Ground C3, Launch & User Equipment Support Cell, United States Space Development Agency
Session 14: Panel Discussion: Opportunities in Data Exploitation
Chair: Kalyani Rengarajan, The Aerospace Corporation
Moderator
Tammy Choy
Vice President, Chief Information Officer The Aerospace Corporation
Panelists
Rob Andzik
AMERGINT Technologies
Azad Madni, Ph.D.
Professor, Astronautical Engineering
Executive Director, System Architecting and Engineering Program Director, Distributed Autonomy and Intelligent Systems Laboratory University of Southern California
Costin Radulescu
Program Chief Engineer
Multi-mission Ground Systems and Services Program Office NASA/Jet Propulsion Laboratory, California Institute of Technology
Chris Stevens
Principal Engineer/Scientist Space Program Operations The Aerospace Corporation
Col. Wallace “Rhet” Turnbull III
Director, Cross Mission Ground and Communications Enterprise Space and Missile Systems Center
Session 15: Summary Session
Session 11A: Agile Retrospective: Opportunities to Perform Agile Acquisition Differently
Leads: Supannika Mobasser and Jodene Sasine, The Aerospace Corporation
Session 11B: Automation in Contested and Congested Space
Leads: Donald Sather and Carlos Rexach, The Aerospace Corporation
Session 11C: Cloud Computing and Big Data Technologies for Ground Systems
Leads: Ramesh Rangachar and Craig Lee, The Aerospace Corporation
Session 11D: Semantic Consistency—a Critical Enabler for Big Data Analytics
Leads: Victor Rohr, The Aerospace Corporation and Ron Rudnicki, CUBRC, Inc.
Session 11E: Intelligent Systems / Machine Learning for Space Ground Systems
Leads: Jon Neff and Dan Balderston, The Aerospace Corporation
Session 11F: Improving Data Exploitation for Engineers and Operators Through Model-Based Engineering
Leads: Ryan Noguchi and Fredda Lerner, The Aerospace Corporation
Session 11G: Using Data for Novel Approaches in Cybersecurity: Detecting Threats, Reducing Risk and Ensuring Data Integrity
Leads: Scott Niebuhr and Michelle Yohannes, The Aerospace Corporation
Workshop Summary
Chris Wallisch, The Aerospace Corporation
Closing Remarks
Rick Johnson, GSAW 2020 Chair, The Aerospace Corporation
End of General Workshop
End of GSAW 2020