Introduction to Intelligent Networked System

(Press ? for help, n and p for next and previous slide; usage hints)

Mo, Yilin
Sept 2020

Intelligent Networked System

What is Intelligent Networked System

Figure

Search Results for Intelligent Networked System

What is Intelligent Networked System

Figure

Search Results for 智能网联系统

Wireless Sensor Networks

Wireless sensor network (WSN) refers to a group of spatially dispersed and dedicated sensors for monitoring and recording the physical conditions of the environment and organizing the collected data at a central location.

Figure

Pros and Cons of Going Wireless

Figure

Figure

Pros and Cons of Going Wireless

Pros:

  • Increased Mobility
  • Scalability
  • Lower Cost
  • Ease of Installation
  • Wider Reach

Cons:

  • Communication Issues:
    • Packet drop
    • Low throughput
    • High latency
  • Energy Constraints

Vision of Wireless Sensor Networks

  • Building Monitoring

Figure

  • Mine Monitoring

Figure

Figure

  • Typical Sensor Nodes:

Figure

Figure

Figure

Figure

Figure

Figure

History of Wireless Sensor Networks

  Gen 1 (80s-90s) Gen 2 (1999-2006) Gen 3 (2010 and beyond)
Size Large shoe-box Pack of cards Dust particle
Weight Kilograms Grams Negligible
Node Separate sensing/comm Semi-integrated Fully integrated
Topology Point-to-point, star Client-server, peer-to-peer P2P
Energy Large batteries AA batteries Energy Harvesting
Life Time hours/days/weeks days to months years
Deployment Vehicle-placed, air drop Hand placed Embedded, “scattered” leave behind

Internet of Things

The Internet of things (IoT) describes the network of physical objects, i.e., things, such as vehicles, buildings, and other items, that are embedded with sensors, software, and other technologies for the purpose of connecting and exchanging data with other devices and systems over the Internet.

In the real world, things matter more than ideas.

[Ashton], “That ‘internet of things’ thing”, 2009

Internet of Things Paradigm

Figure

Internet of Things Paradigm, [IoT2018]

Early History of Internet of Things

  • 1973: Mario W. Cardullo receives the patent for first RFID tag
  • 1982: Carnegie Mellon internet-connected soda machine
  • 1991: HP introduces HP LaserJet IIISi: First Ethernet-connected network printer

    Figure

  • 1993: Internet-connected coffee pot at University of Cambridge (First Networked Camera)

    Figure

  • 1999: The term Internet of Things was coined
  • 2005: United Nation’s International Telecommunications Union report predicting the rise of IoT for the first time

Trends

  • Google Search Trends
Month,Jan-04,Feb-04,Mar-04,Apr-04,May-04,Jun-04,Jul-04,Aug-04,Sep-04,Oct-04,Nov-04,Dec-04,Jan-05,Feb-05,Mar-05,Apr-05,May-05,Jun-05,Jul-05,Aug-05,Sep-05,Oct-05,Nov-05,Dec-05,Jan-06,Feb-06,Mar-06,Apr-06,May-06,Jun-06,Jul-06,Aug-06,Sep-06,Oct-06,Nov-06,Dec-06,Jan-07,Feb-07,Mar-07,Apr-07,May-07,Jun-07,Jul-07,Aug-07,Sep-07,Oct-07,Nov-07,Dec-07,Jan-08,Feb-08,Mar-08,Apr-08,May-08,Jun-08,Jul-08,Aug-08,Sep-08,Oct-08,Nov-08,Dec-08,Jan-09,Feb-09,Mar-09,Apr-09,May-09,Jun-09,Jul-09,Aug-09,Sep-09,Oct-09,Nov-09,Dec-09,Jan-10,Feb-10,Mar-10,Apr-10,May-10,Jun-10,Jul-10,Aug-10,Sep-10,Oct-10,Nov-10,Dec-10,Jan-11,Feb-11,Mar-11,Apr-11,May-11,Jun-11,Jul-11,Aug-11,Sep-11,Oct-11,Nov-11,Dec-11,Jan-12,Feb-12,Mar-12,Apr-12,May-12,Jun-12,Jul-12,Aug-12,Sep-12,Oct-12,Nov-12,Dec-12,Jan-13,Feb-13,Mar-13,Apr-13,May-13,Jun-13,Jul-13,Aug-13,Sep-13,Oct-13,Nov-13,Dec-13,Jan-14,Feb-14,Mar-14,Apr-14,May-14,Jun-14,Jul-14,Aug-14,Sep-14,Oct-14,Nov-14,Dec-14,Jan-15,Feb-15,Mar-15,Apr-15,May-15,Jun-15,Jul-15,Aug-15,Sep-15,Oct-15,Nov-15,Dec-15,Jan-16,Feb-16,Mar-16,Apr-16,May-16,Jun-16,Jul-16,Aug-16,Sep-16,Oct-16,Nov-16,Dec-16,Jan-17,Feb-17,Mar-17,Apr-17,May-17,Jun-17,Jul-17,Aug-17,Sep-17,Oct-17,Nov-17,Dec-17,Jan-18,Feb-18,Mar-18,Apr-18,May-18,Jun-18,Jul-18,Aug-18,Sep-18,Oct-18,Nov-18,Dec-18,Jan-19,Feb-19,Mar-19,Apr-19,May-19,Jun-19,Jul-19,Aug-19,Sep-19,Oct-19,Nov-19,Dec-19,Jan-20,Feb-20,Mar-20,Apr-20,May-20,Jun-20,Jul-20,Aug-20,Sep-20 Internet of Things,1,1,1,1,1,2,1,1,3,1,1,2,2,1,1,1,2,2,1,0,1,2,2,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,2,1,1,1,1,1,1,1,1,1,1,1,1,1,1,2,2,1,2,1,1,1,2,2,2,2,2,2,3,3,2,3,2,2,2,2,3,2,2,2,2,2,3,2,2,2,2,2,3,3,3,3,3,3,3,3,3,3,3,3,3,3,4,4,4,4,4,4,4,4,5,7,7,6,10,10,11,12,11,11,13,13,15,16,15,13,18,19,20,19,19,19,18,18,20,20,20,18,18,20,19,19,18,16,16,16,18,23,23,17,19,19,19,18,17,16,14,14,17,18,19,16,18,16,16,15,15,13,13,14,15,16,14,12,12,14,14,13,13,13,13,12,15,14,14,12,12,14,12,12,11,11,10,11,13 IoT,4,4,4,5,4,4,4,5,4,4,4,5,4,4,5,5,5,6,5,3,4,4,5,4,4,6,6,4,5,6,5,4,6,4,3,4,4,4,4,5,4,4,6,4,4,4,5,3,5,5,5,5,5,5,5,5,4,5,5,5,6,5,5,4,5,5,5,5,6,5,6,5,5,6,6,6,6,6,7,6,6,6,7,5,6,6,7,6,6,6,6,6,6,6,7,6,6,7,6,6,6,7,6,6,6,7,6,6,7,6,7,7,7,7,7,6,7,8,8,8,9,10,11,13,12,15,15,15,18,21,20,19,27,29,30,35,40,41,42,45,49,53,53,51,56,63,67,69,70,69,68,68,77,83,86,73,85,88,92,86,90,87,83,83,91,94,100,91,94,95,97,95,97,90,92,95,95,99,94,82,93,99,96,98,92,91,91,91,99,94,97,85,90,98,82,77,80,86,80,77,88
  • The Hype Cycle

Figure

Gartner Hype Cycle

Metcalfe’s law

The value of a network goes up as the square of the number of users.

Year,2016,2017,2018,2019,2020,2021,2022,2023,2024,2025,2026,2027,2028,2029,2030 Population (billion),7.33,7.41,7.49,7.57,7.64,7.72,7.79,7.86,7.94,8.01,8.08,8.14,8.21,8.28,8.34 Connected devices (billion),17.68,20.35,23.14,26.66,30.73,35.82,42.62,51.11,62.12,75.44,91.58,111.18,134.97,163.86,198.92

Cyber-Physical Systems

CPSs refer to the next generation of engineered systems that require tight integration of computing, communication, and control technologies to achieve stability, performance, reliability, robustness, and efficiency in dealing with physical systems of many application domains.

[Kumar], Proceedings of the IEEE, 2012

Figure

Cyber-Physical System

Convergence of Computation and Control

  • 1948: The term “Cybernetics” was coined by Norbert Wiener.

    Figure

  • 1970s: Real time system
  • 1990s: Hybrid system
  • 2006: The term “Cyber-Physical System” was coined by NSF.

Boeing 787 ZA002 Incident

The P100 panel is one of several power panels in the aft electronics bay. It receives power from the left engine and distributes it to an array of systems. In the event of a failure of the P100 panel, backup power sources – including power from the right engine, the Ram Air Turbine, the auxiliary power unit or the battery – are designed to automatically engage to ensure that those systems needed for continued safe operation of the airplane are powered.

Figure

Convergence of Communication and Control

  • 1971: ALOHAnet, first public wireless packet data network
  • 1997: IEEE 802.11 (Wifi) was introduced
  • 2000: Panel on Future Directions in Control, Dynamics, and Systems, Control in an Information Rich World:

Networks of sensory or actuator nodes with computational capabilities, connected wirelessly or by wires, can form an orchestra which controls our physical environment.

Convergence of Communication and Control

Intelligent Networked System

30 Internet of Things 30 Informatization 20 Data Analytics 15 Cyber-Physical System 15 Wireless Sensor Network 15 Smart Algorithms 12 Cloud Computing 12 Embedded Devices 12 5G 10 RFID 10 LPWAN 10 802.15 10 TLS 10 Linux 8 RTOS 8 Python 8 C/C++ 8 Java 5 MQTT 5 CoAP 5 Bluetooth 5 Zigbee 5 Wifi 5 OFDMA 4 Mesh

Applications

Manufacturing

  • Use cases:
    • Preventative maintenance on new and pre-existing factory machinery
    • Throughput increase through real-time demand
    • Energy savings
    • Safety systems such as thermal sensing, pressure sensing, and gas leaks
    • Factory floor expert systems
  • Goal: Improving yield, uptime, real-time response, and systems safety.
  • Challenges: Real-time decision, Legacy system, Security

Consumer

  • Use cases:
    • Smart home gadgetry: Smart irrigation, smart garage doors, smart locks, smart lights, smart thermostats, and smart security.
    • Wearables: Health and movement trackers, smart clothing/wearables.
    • Pets: Pet location systems, smart dog doors.
  • Goal: Improving quality of life
  • Constraints: bifurcation of standards

Retailing

  • Use cases:
    • Beaconing, such as proximity sensing customers, traffic patterns, and inter-arrival times as marketing analytics.
    • Beaconing systems within entertainment venues, conferences, concerts, amusement parks, and museums.
    • Targeted advertising, such as locating known or potential customers by proximity and providing sales information.
    • Asset tracking, such as inventory control, loss control, and supply chain optimizations.
    • Apply predictive analytics to food supply.
    • Digital signage within retail, hospitality, or citywide.
  • Goal: Lowering sales costs and Improving customer experience
  • Constraints: Cost/benefit ratio

Healthcare

  • Use cases:
    • In-home patient care
    • Learning models of predictive and preventative healthcare
    • Dementia and elderly care and tracking
    • Hospital equipment and supply asset tracking
    • Pharmaceutical tracking and security
    • Remote field medicine
    • Drug research
    • Patient fall indicators
  • Goal: Improving the quality of life and reduce health costs
  • Constraints: Government Regulation, Reliability, Zero downtime, Privacy

Energy

  • Use cases:
    • Oil rig analysis of thousands of sensors and data points for efficiency gains
    • Remote solar panel monitoring and maintenance
    • Hazardous analysis of nuclear facilities
    • Smart electric meters in a citywide deployment to monitor energy usage and demand
    • Real-time blade adjustments as a function of weather on remote wind turbines
  • Constraints: Real-time responsiveness, extreme environment

Transportation

  • Use cases:
    • Fleet tracking and location awareness
    • Railcar identification and tracking
    • Asset and package tracking within fleets
    • Preventative maintenance of vehicles on the road
  • Goal: Safety, Minimize downtime
  • Challenges: Mobility, Spatial data

Smart City

  • Use cases:
    • Pollution control and regulatory analysis through environmental sensing
    • Microclimate weather predictions using citywide sensor networks
    • Efficiency gains and improved costs through waste management service on demand
    • Improved traffic flow and fuel economy through smart traffic light control and patterning
    • Energy efficiency of city lighting on demand
    • Smart snow plowing based on real-time road demand, weather conditions, and nearby plows
    • Smart irrigation of parks and public spaces, depending on weather and current usage
    • Smart cameras to watch for crime and real-time automated AMBER Alerts
    • Smart parking lots to automatically find best space parking on demand
    • Bridge, street, and infrastructure wear and usage monitors to improve longevity and service
  • Challenges: Scale (More is different)

Technology Stack

Enabling Technology

Figure

Enabling Technology

Four Layer Model

Figure

Four-Layer Model of Internet of Things

Enabling Technology

  • Node Level:
    • Embedded systems: Sensors, RFIDs
    • Embedded operating systems: Linux, Windows IoT, Real-time OS
    • Energy-harvesting
    • Micro-Electro-Mechanical Systems (MEMs).
  • Network Level:
    • Wireless communication: Cellular, LPWAN, IEEE 802.15
    • Ad-Hoc network
    • MQTT, CoAP
    • Internet Security
  • Service Level:
    • Clouding computing
    • Big data, Data analytics, Machine learning
    • Clock Synchronization
    • Localization
  • Applications

The Many-Sidedness of Internet of Things & CPS

iot.png
blindmenandelephant.jpg

Takeaway from the course

  • We CANNOT cover everything in details in this course.
  • Look at the big picture:
    • What are we trying to solve?
    • What are the key considerations?
    • What is the fundamental limit?
    • How to effectively trade off between X and Y based on specific application?

Example: Physical Layer

  • What are we trying to solve?
    • Transmitting raw bits via a physical medium
  • What are the key considerations?
    • Throughput, Range, Energy consumption
    • Other considerations: Latency, Mobility, Cost
  • What is the fundamental limit?
    • The Shannon Limit
    • Free space path loss formula
  • How to effectively trade off between X and Y based on specific application?
    • Surveillance camera: Wifi, 4G/5G, Wired
    • Environmental monitoring: LoRa, NBIoT
    • Smart home: Zigbee, Bluetooth

Course Information

Course Information

  • Pre-requisites:
    • 计算机语言与程序设计
    • 计算机网络与应用
  • Things that you will need for the lab/project:
    • Raspberry Pi: Most popular single board computer
    • GNU/Linux: Most popular OS for IoT
    • Using SSH to connect to RPi
    • Writing short Python code (<100 lines)
    • Version control and collaborating with your teammate using Git

Course Instructors

  • Mo, Yilin
    • Office: FIT Building 3-613
    • Office Hour: Wednesday 14:00-17:00
    • Phone: 62792438
    • Email: ylmo@tsinghua.edu.cn
  • Pei, Xin
    • Office: Central Main Building 809
    • Office Hour: Wednesday 14:00-17:00
    • Phone: 62795043
    • Email: peixin@tsinghua.edu.cn

Teaching Assistant

  • Lu, Yiwen
    • Office: FIT Building 3-623
    • Office Hour: Friday 14:00-17:00
    • Phone: 62772430
    • Email: luyw20n@mails.tsinghua.edu.cn

Tentative Lecture Schedule

  • Lecturer: Mo, Yilin
Lecture # Date Topics
1 9/18 Introduction, Sensor OS
2 9/25 Sensors, Actuators, Energy Harvesting
3 9/27 Lab 1: Raspberry Pi platform
4 10/9 Physical Layer
5 10/16 MAC Layer
6 10/23 Routing
7 10/30 Lab 2: Networking
8 11/6 Lab 3: Wireless Mesh Network
9 11/13 Security

Tentative Lecture Schedule

  • Lecturer: Pei, Xin
Lecture # Date Topics
10 11/20 Clock Synchronization
11 11/27 Localization
12 12/4 Big Data, Cloud Computing
13 12/11 Smart Transportation System
14 12/18 Smart Cities
15 12/25 Lab 4: Project
16 1/1 Project Demonstration

Grading Criteria

  • Quizzes (4 total): 20%
  • Lab Assignment: 20%
  • Final Project: 60%
    • Demo: 20%
    • Report: 40%
  • Pass/Fail

Quizzes

  • Four in-class, closed-book quizzes
  • Spread throughout the semester
  • Announcement will be one week ahead of time (with reading assignment)
  • The questions will be based on the reading assignment.

Lab Assignments

  • Three lab assignments at the first half of the semester
  • Location: Central Main Building 510
  • Goal: Get familiar with Raspberry Pi and networking protocols
    1. Installing Raspberry Pi OS, SSH, Light Sensor, LED
    2. Distributed “Whack-a-Mole”
    3. Wireless Mesh Network

Project

  • Carried out in teams of 3 students.
    • The code should be hosted on Tsinghua Gitlab Repo
    • We will review everyone’s contribution to the Repo
  • Each group will be given 3 Raspberry Pis, Sensors + LED, SD cards and other accessories
    • Take good care of the equipment
  • Buying additional hardware
    • Write a proposal with a budget (Typically < ¥1,000)
    • We will review the proposal and buy the HW

Project

  • A sample project list will be presented later
  • Example:
    • Developing an ad-hoc sensor network of 5+ nodes via Wifi and a front-end to show the sensor readings
    • Completing the tasks in Lab 2 while running RPI on bare metal
  • You are encourage to propose your own project and discuss with us
    • Combining it with your final year project!
  • Grading Criteria:
    • 2/3: Final Report
    • 1/3: Demonstration

Bibliography

  • [Ashton] Kevin Ashton, That ‘internet of things’ thing, RFID Journal 22, 97-114 (2009).
  • [IoT2018] Parry Lea, Internet of Things for Architects, Packt Publishing, 2018.
  • [Kumar] Kim & Kumar, Cyber-physical systems: A perspective at the centennial, in: Proc. IEEE, 2012.