This graduate course is a research-oriented seminar course with research presentations and discussions. The topics are drawn from the needs of two industry-oriented labs: Network Benchmarking Lab (NBL, www.nbl.org.tw) and Embedded Benchmarking Lab (EBL, www.ebl.org.tw). NBL, established in May 2002, focuses on evaluating network devices ranging from switch/router, WLAN, VoIP, network security, and to 4G/5G recently. EBL, just established in May 2011, extends into the evaluation of client handheld devices including smart phones and pads. The 1st and 2nd lines (a combined team of 25 full-time engineers and 20 students) of NBL/EBL test products and develop test tools, respectively, while the 3rd line (a team of 12-15 graduate students) devotes into test technology research. The research topics of the 3rd line, i.e., the main theme of this seminar course, are driven by the needs of the 1st/2nd lines. Students taking this course are expected to do two presentations (20 min each in the 1st and 2nd halves of the semester) on their chosen topics of research or study, and turn-in a term project report to summarize their works. Students currently not involved with NBL/EBL are welcome to take this course and encouraged to participate in the 1st/2nd lines, possibly with pay from NBL/EBL, to get the first-hand experiences. The topics of research or study could be drawn from the list below or through discussion with NBL/EBL 1st/2nd lines. It is very possible to find a thesis topic through this course. The presentations and discussions in the class will be mainly in Chinese and partially in English.
no textbook, mostly references from papers
presentations (x2, 20-min each, 60%), term project report (x1, 8 pages in Word or 20 pages in Powerpoint, 40%)
Topics of Interests: (but not limited to these)
- I. NBL-related
- Software Defined Networking
OpenFlow conformance, interoperability, performance studies
OpenFlow switch design
SDN data plane forwarding engines: software and hardware
SDN controller and application design
SDN distributed and hierarchical controller architectures
Extended SDN data plane: Network Function Virtualization (NFV)
Extended SDN control plane: Service Chaining (SC)
Service chaining and traffic steering
SDN App Store design
Security in and by SDN
Security and QoS as a Service by SDN
SDN-enabled Wi-Fi architectures and applications
SDN-enabled 5G architectures and applications
- Traffic Forensics
Beta Site: IPv6, on-the-fly capture-and-replay
In-Lab Live Testing (ILLT): generic replayer, replay accuracy
PCAP Lib: automatic production, packet trace downsizing
Traffic Diversity vs. Test Coverage
Testing products with real traffic has turned NBL into a world-wide unique “real traffic test lab”. We’ve constructed an on-campus beta site and continue to enhance it with IPv6, multicast, and on-the-fly capture-and-replay capabilities. In addition to the live traffic on the beta site, we also replay stored traffic, i.e., In-Lab Live Testing (ILLT), and build a classified repository of packet traces, i.e., PCAP Lib, in order to reproduce product defects. A more fundamental aspect of “traffic diversity vs. test coverage” is also being studied.
- Network Security
NCC Security Criteria
Sample collection and analysis: intrusion, malware, spam
Mobile Security: behavior vs. signature, AV behaviors on Android
Advanced Persistent Threat (APT)
NBL is defining national security criteria on IT products for NCC. Criteria for 8 categories of products have been released. There shall be more to come. Following the criteria, a massive scale of samples of intrusion, malware, and spam are being collected and analyzed in order to test products. With users extending their usage from PC to handheld, the security issues also migrate to Mobile Security.
- WLAN, 4G, and 5G
WLAN Replay: controlled mobility and environment
LTE Test Bed: conformance by emulators, interop by field test
Wi-Fi logo does not consider mobility and environment factors which do exist in the real world. Our WLAN Replay tries to reproduce the captured mobility and environment (noise/interference) factors. NBL recently extends into LTE where conformance and interoperability are two big issues for LTE handheld providers.
- II. EBL-related
Automatic GUI Testing: accuracy
Instead of testing GUI stability manually, EBL tries to automate the process by the techniques of remote control and image recognition. Now the accuracy becomes an issue to resolve.
- Power Profiling
Fine-Grain Power Measurement
EBL has solutions on measuring power consumption of hardware and software components in embedded devices. Next we need to profile in all granularity scales without source code.
- Time Profiling
Bytecode Interception at VM
Reduced Profiling Overhead by Multi-Core
Cross-Layer Profiling with FPGA
Flash File System on Android
Again, EBL has solutions on measuring time consumption of software components to identify the bottlenecks. But next we need to enhance these solutions to ones (1) without relying source code instrumentation and/or (2) with extra hardware support from multi-core and FPGA.